2023-07-09T21:28:40.780 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-09T21:28:40.781 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692 --verbose --owner scheduled_rishabh@teuthology --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} -- /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692/orig.config.yaml 2023-07-09T21:28:40.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T21:28:40.922 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692 branch: wip-rishabh-2023Jul9 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} email: null first_in_suite: false job_id: '7331692' kernel: client: branch: testing flavor: default kdb: true sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-2023Jul9 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 35b2d86cfd512f15ace2077050d20c8669933212 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 35b2d86cfd512f15ace2077050d20c8669933212 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jul9 sha1: 35b2d86cfd512f15ace2077050d20c8669933212 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 35b2d86cfd512f15ace2077050d20c8669933212 sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jul9 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 35b2d86cfd512f15ace2077050d20c8669933212 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi184.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots - tasks.cephfs.test_volumes.TestSubvolumeSnapshots teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-09_20:19:09 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-09T21:28:40.922 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa; will attempt to use it 2023-07-09T21:28:40.923 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks 2023-07-09T21:28:40.923 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-09T21:28:40.925 INFO:teuthology.task.internal:Checking packages... 2023-07-09T21:28:40.951 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '35b2d86cfd512f15ace2077050d20c8669933212' 2023-07-09T21:28:40.952 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-09T21:28:40.952 INFO:teuthology.packaging:ref: None 2023-07-09T21:28:40.952 INFO:teuthology.packaging:tag: None 2023-07-09T21:28:40.953 INFO:teuthology.packaging:branch: wip-rishabh-2023Jul9 2023-07-09T21:28:40.953 INFO:teuthology.packaging:sha1: 35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T21:28:40.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023Jul9 2023-07-09T21:28:41.166 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4759.g35b2d86c 2023-07-09T21:28:41.166 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-09T21:28:41.172 INFO:teuthology.task.internal:no buildpackages task found 2023-07-09T21:28:41.173 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-09T21:28:41.224 INFO:teuthology.task.internal:Saving configuration 2023-07-09T21:28:41.240 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-09T21:28:41.246 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T21:28:41.275 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 21:23:42.840811', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-09T21:28:41.302 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 21:23:42.838747', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-09T21:28:41.302 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-09T21:28:41.308 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-09T21:28:41.308 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-09T21:28:41.308 INFO:teuthology.run_tasks:Running task console_log... 2023-07-09T21:28:41.386 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8ba85c2280>, signals=[15]) 2023-07-09T21:28:41.387 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-09T21:28:41.393 INFO:teuthology.task.internal:Opening connections... 2023-07-09T21:28:41.393 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:28:41.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:28:41.462 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:28:41.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:28:41.529 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-09T21:28:41.536 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-07-09T21:28:41.557 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-07-09T21:28:41.557 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-07-09T21:28:41.616 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T21:28:41.617 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T21:28:41.617 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-07-09T21:28:41.617 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-07-09T21:28:41.617 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.6" 2023-07-09T21:28:41.617 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-07-09T21:28:41.617 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T21:28:41.617 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-07-09T21:28:41.617 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T21:28:41.618 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T21:28:41.618 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T21:28:41.618 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T21:28:41.618 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:28:41.618 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T21:28:41.618 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T21:28:41.618 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T21:28:41.619 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T21:28:41.619 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-07-09T21:28:41.644 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-07-09T21:28:41.664 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-07-09T21:28:41.664 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-07-09T21:28:41.727 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T21:28:41.727 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T21:28:41.727 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2023-07-09T21:28:41.727 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2023-07-09T21:28:41.727 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.6" 2023-07-09T21:28:41.728 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-07-09T21:28:41.728 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T21:28:41.728 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-07-09T21:28:41.728 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T21:28:41.728 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T21:28:41.728 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T21:28:41.728 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T21:28:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:28:41.729 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T21:28:41.729 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T21:28:41.729 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T21:28:41.729 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T21:28:41.729 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-07-09T21:28:41.752 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-09T21:28:41.761 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-09T21:28:41.767 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-09T21:28:41.767 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2023-07-09T21:28:41.769 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2023-07-09T21:28:41.790 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-09T21:28:41.795 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-09T21:28:41.795 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2023-07-09T21:28:41.829 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2023-07-09T21:28:41.859 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-09T21:28:41.919 INFO:teuthology.run_tasks:Running task kernel... 2023-07-09T21:28:41.934 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'} 2023-07-09T21:28:41.935 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-07-09T21:28:41.935 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-07-09T21:28:41.936 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-09T21:28:41.936 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-09T21:28:41.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:28:41.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-09T21:28:41.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:28:41.959 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-09T21:28:42.183 DEBUG:teuthology.task.kernel:sha1 for client.1 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:28:42.183 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-09T21:28:42.183 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-07-09T21:28:42.202 INFO:teuthology.orchestra.run.smithi184.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-09T21:28:42.203 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:28:42.203 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-09T21:28:42.204 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum upgrade -y linux-firmware 2023-07-09T21:28:42.251 DEBUG:teuthology.task.kernel:sha1 for client.0 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:28:42.251 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-09T21:28:42.252 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2023-07-09T21:28:42.271 INFO:teuthology.orchestra.run.smithi053.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-09T21:28:42.272 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:28:42.272 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-09T21:28:42.272 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum upgrade -y linux-firmware 2023-07-09T21:28:43.457 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-07-09T21:28:43.457 INFO:teuthology.orchestra.run.smithi184.stdout:Unable to read consumer identity 2023-07-09T21:28:43.482 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-07-09T21:28:43.482 INFO:teuthology.orchestra.run.smithi053.stdout:Unable to read consumer identity 2023-07-09T21:28:46.734 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 1.7 kB/s | 3.5 kB 00:01 2023-07-09T21:28:46.781 INFO:teuthology.orchestra.run.smithi053.stdout:Copr repo for python3-asyncssh owned by ceph 1.7 kB/s | 3.5 kB 00:01 2023-07-09T21:28:49.339 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 16 MB 00:02 2023-07-09T21:28:49.385 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 16 MB 00:02 2023-07-09T21:28:52.826 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 389 kB/s | 24 kB 00:00 2023-07-09T21:28:53.006 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 420 kB/s | 24 kB 00:00 2023-07-09T21:28:53.591 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-07-09T21:28:53.592 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-07-09T21:28:53.593 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-07-09T21:28:53.726 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.1... 2023-07-09T21:28:53.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:28:53.810 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2023-07-09T21:28:53.811 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2023-07-09T21:28:53.812 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2023-07-09T21:28:53.940 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-09T21:28:53.940 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:28:53.948 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ 2023-07-09T21:28:53.948 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_g84139c18d56f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-09T21:28:53.951 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi184.front.sepia.ceph.com to complete... 2023-07-09T21:28:54.157 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ 2023-07-09T21:28:54.157 DEBUG:teuthology.orchestra.run.smithi053:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_g84139c18d56f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-09T21:28:54.159 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi053.front.sepia.ceph.com to complete... 2023-07-09T21:29:37.634 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09 21:29:37 URL:https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/kernel-6.4.0_g84139c18d56f-1.x86_64.rpm [379858600/379858600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-09T21:29:37.634 INFO:teuthology.orchestra.run.smithi184.stderr:FINISHED --2023-07-09 21:29:37-- 2023-07-09T21:29:37.634 INFO:teuthology.orchestra.run.smithi184.stderr:Total wall clock time: 44s 2023-07-09T21:29:37.634 INFO:teuthology.orchestra.run.smithi184.stderr:Downloaded: 1 files, 362M in 43s (8.36 MB/s) 2023-07-09T21:29:37.635 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.1... 2023-07-09T21:29:37.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-09T21:29:39.224 INFO:teuthology.orchestra.run.smithi184.stdout:Verifying... ######################################## 2023-07-09T21:29:39.295 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing... ######################################## 2023-07-09T21:29:39.385 INFO:teuthology.orchestra.run.smithi184.stdout:Updating / installing... 2023-07-09T21:29:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09 21:29:44 URL:https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/kernel-6.4.0_g84139c18d56f-1.x86_64.rpm [379858600/379858600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-09T21:29:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:FINISHED --2023-07-09 21:29:44-- 2023-07-09T21:29:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:Total wall clock time: 50s 2023-07-09T21:29:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:Downloaded: 1 files, 362M in 50s (7.26 MB/s) 2023-07-09T21:29:44.277 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-09T21:29:44.278 DEBUG:teuthology.orchestra.run.smithi053:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-09T21:29:45.952 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying... ######################################## 2023-07-09T21:29:46.027 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing... ######################################## 2023-07-09T21:29:46.124 INFO:teuthology.orchestra.run.smithi053.stdout:Updating / installing... 2023-07-09T21:30:17.158 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-6.4.0_g84139c18d56f-1 ######################################## 2023-07-09T21:30:26.494 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-6.4.0_g84139c18d56f-1 ######################################## 2023-07-09T21:30:41.839 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-09T21:30:41.840 DEBUG:teuthology.orchestra.run.smithi184:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-09T21:30:41.893 INFO:teuthology.orchestra.run.smithi184.stdout:/boot/System.map-6.4.0-g84139c18d56f 2023-07-09T21:30:41.894 INFO:teuthology.orchestra.run.smithi184.stdout:/boot/config-6.4.0-g84139c18d56f 2023-07-09T21:30:41.894 INFO:teuthology.orchestra.run.smithi184.stdout:/boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T21:30:41.894 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f 2023-07-09T21:30:41.894 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel 2023-07-09T21:30:41.895 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch 2023-07-09T21:30:41.895 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86 2023-07-09T21:30:41.895 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto 2023-07-09T21:30:41.896 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-09T21:30:41.896 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-09T21:30:41.896 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-09T21:30:41.896 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-09T21:30:41.896 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-09T21:30:41.897 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-09T21:30:41.897 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-09T21:30:41.897 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-09T21:30:41.897 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-09T21:30:41.897 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-09T21:30:41.898 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-09T21:30:41.898 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-09T21:30:41.898 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-09T21:30:41.898 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-09T21:30:41.898 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-09T21:30:41.899 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-09T21:30:41.899 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-09T21:30:41.899 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-09T21:30:41.899 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-09T21:30:41.899 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-09T21:30:41.899 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel 2023-07-09T21:30:41.900 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu 2023-07-09T21:30:41.900 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce 2023-07-09T21:30:41.900 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-09T21:30:41.900 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm 2023-07-09T21:30:41.900 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-09T21:30:41.900 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-09T21:30:41.900 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-09T21:30:41.901 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto 2023-07-09T21:30:41.901 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-09T21:30:41.901 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-09T21:30:41.901 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-09T21:30:41.901 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx 2023-07-09T21:30:41.901 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-09T21:30:41.901 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-09T21:30:41.902 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-09T21:30:41.902 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-09T21:30:41.902 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-09T21:30:41.902 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-09T21:30:41.902 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-09T21:30:41.902 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-09T21:30:41.902 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-09T21:30:41.903 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-09T21:30:41.903 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-09T21:30:41.903 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-09T21:30:41.903 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-09T21:30:41.903 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-09T21:30:41.903 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-09T21:30:41.903 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-09T21:30:41.904 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-09T21:30:41.904 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-09T21:30:41.904 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-09T21:30:41.904 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-09T21:30:41.904 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-09T21:30:41.904 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-09T21:30:41.905 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-09T21:30:41.905 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-09T21:30:41.905 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-09T21:30:41.905 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-09T21:30:41.905 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-09T21:30:41.905 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-09T21:30:41.905 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-09T21:30:41.906 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-09T21:30:41.906 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-09T21:30:41.906 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-09T21:30:41.906 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-09T21:30:41.906 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-09T21:30:41.906 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-09T21:30:41.906 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-09T21:30:41.907 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-09T21:30:41.907 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-09T21:30:41.907 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-09T21:30:41.907 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-09T21:30:41.907 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-09T21:30:41.907 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-09T21:30:41.907 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-09T21:30:41.908 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-09T21:30:41.908 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-09T21:30:41.908 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers 2023-07-09T21:30:41.908 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi 2023-07-09T21:30:41.908 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-09T21:30:41.908 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-09T21:30:41.908 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/custom_method.ko 2023-07-09T21:30:41.909 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-09T21:30:41.909 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-09T21:30:41.909 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-09T21:30:41.909 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-09T21:30:41.909 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-09T21:30:41.909 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata 2023-07-09T21:30:41.910 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-09T21:30:41.910 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-09T21:30:41.910 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ata_generic.ko 2023-07-09T21:30:41.910 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-09T21:30:41.910 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-09T21:30:41.910 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-09T21:30:41.910 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-09T21:30:41.911 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-09T21:30:41.911 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-09T21:30:41.911 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-09T21:30:41.911 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-09T21:30:41.911 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-09T21:30:41.911 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-09T21:30:41.911 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-09T21:30:41.912 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-09T21:30:41.912 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-09T21:30:41.912 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-09T21:30:41.912 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-09T21:30:41.912 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-09T21:30:41.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-09T21:30:41.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-09T21:30:41.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-09T21:30:41.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-09T21:30:41.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-09T21:30:41.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-09T21:30:41.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-09T21:30:41.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-09T21:30:41.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-09T21:30:41.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-09T21:30:41.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-09T21:30:41.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-09T21:30:41.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-09T21:30:41.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-09T21:30:41.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-09T21:30:41.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-09T21:30:41.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-09T21:30:41.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-09T21:30:41.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-09T21:30:41.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sis.ko 2023-07-09T21:30:41.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-09T21:30:41.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-09T21:30:41.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-09T21:30:41.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-09T21:30:41.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-09T21:30:41.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-09T21:30:41.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-09T21:30:41.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-09T21:30:41.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-09T21:30:41.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-09T21:30:41.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-09T21:30:41.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-09T21:30:41.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-09T21:30:41.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-09T21:30:41.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-09T21:30:41.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-09T21:30:41.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-09T21:30:41.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay 2023-07-09T21:30:41.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-09T21:30:41.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base 2023-07-09T21:30:41.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap 2023-07-09T21:30:41.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-09T21:30:41.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma 2023-07-09T21:30:41.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-09T21:30:41.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block 2023-07-09T21:30:41.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe 2023-07-09T21:30:41.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-09T21:30:41.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/brd.ko 2023-07-09T21:30:41.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd 2023-07-09T21:30:41.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-09T21:30:41.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-09T21:30:41.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/loop.ko 2023-07-09T21:30:41.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx 2023-07-09T21:30:41.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-09T21:30:41.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-09T21:30:41.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk 2023-07-09T21:30:41.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-09T21:30:41.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-09T21:30:41.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-09T21:30:41.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/virtio_blk.ko 2023-07-09T21:30:41.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback 2023-07-09T21:30:41.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-09T21:30:41.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkfront.ko 2023-07-09T21:30:41.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram 2023-07-09T21:30:41.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-09T21:30:41.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char 2023-07-09T21:30:41.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-09T21:30:41.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random 2023-07-09T21:30:41.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-09T21:30:41.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-09T21:30:41.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-09T21:30:41.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-09T21:30:41.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-09T21:30:41.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi 2023-07-09T21:30:41.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-09T21:30:41.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-09T21:30:41.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-09T21:30:41.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-09T21:30:41.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-09T21:30:41.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-09T21:30:41.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-09T21:30:41.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave 2023-07-09T21:30:41.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-09T21:30:41.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-09T21:30:41.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-09T21:30:41.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm 2023-07-09T21:30:41.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm.ko 2023-07-09T21:30:41.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-09T21:30:41.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-09T21:30:41.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-09T21:30:41.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-09T21:30:41.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-09T21:30:41.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/uv_mmtimer.ko 2023-07-09T21:30:41.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/virtio_console.ko 2023-07-09T21:30:41.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq 2023-07-09T21:30:41.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-09T21:30:41.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-09T21:30:41.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-09T21:30:41.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-09T21:30:41.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-09T21:30:41.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-09T21:30:41.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto 2023-07-09T21:30:41.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp 2023-07-09T21:30:41.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-09T21:30:41.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-09T21:30:41.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel 2023-07-09T21:30:41.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat 2023-07-09T21:30:41.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common 2023-07-09T21:30:41.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-09T21:30:41.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-09T21:30:41.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-09T21:30:41.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-09T21:30:41.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-09T21:30:41.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio 2023-07-09T21:30:41.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-09T21:30:41.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca 2023-07-09T21:30:41.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-09T21:30:41.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq 2023-07-09T21:30:41.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-09T21:30:41.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma 2023-07-09T21:30:41.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw 2023-07-09T21:30:41.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-09T21:30:41.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat 2023-07-09T21:30:41.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-09T21:30:41.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac 2023-07-09T21:30:41.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-09T21:30:41.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-09T21:30:41.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-09T21:30:41.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-09T21:30:41.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-09T21:30:41.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-09T21:30:41.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-09T21:30:41.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-09T21:30:41.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-09T21:30:41.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-09T21:30:41.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-09T21:30:41.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-09T21:30:41.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-09T21:30:41.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware 2023-07-09T21:30:41.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/edd.ko 2023-07-09T21:30:41.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-09T21:30:41.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio 2023-07-09T21:30:41.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-09T21:30:41.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-09T21:30:41.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid 2023-07-09T21:30:41.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-09T21:30:41.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-09T21:30:41.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-09T21:30:41.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-09T21:30:41.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-09T21:30:41.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-09T21:30:41.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-09T21:30:41.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-09T21:30:41.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-09T21:30:41.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-09T21:30:41.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-09T21:30:41.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-09T21:30:41.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-09T21:30:41.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-09T21:30:41.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-09T21:30:41.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-09T21:30:41.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-09T21:30:41.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-09T21:30:41.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-09T21:30:41.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-09T21:30:41.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-09T21:30:41.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-09T21:30:41.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-09T21:30:41.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-09T21:30:41.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-09T21:30:41.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-09T21:30:41.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-09T21:30:41.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-09T21:30:41.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-09T21:30:41.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-09T21:30:41.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-09T21:30:41.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-09T21:30:41.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-09T21:30:41.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-09T21:30:41.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-09T21:30:41.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-09T21:30:41.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-09T21:30:41.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-09T21:30:41.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-09T21:30:41.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-09T21:30:41.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-09T21:30:41.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-09T21:30:41.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-09T21:30:41.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-09T21:30:41.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-09T21:30:41.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-09T21:30:41.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-09T21:30:41.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-09T21:30:41.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-09T21:30:41.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-09T21:30:41.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-09T21:30:41.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-09T21:30:41.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-09T21:30:41.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-09T21:30:41.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-09T21:30:41.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-09T21:30:41.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-09T21:30:41.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-09T21:30:41.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-09T21:30:41.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-09T21:30:41.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-09T21:30:41.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-09T21:30:41.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-09T21:30:41.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-09T21:30:41.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv 2023-07-09T21:30:41.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-09T21:30:41.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-09T21:30:41.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-09T21:30:41.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon 2023-07-09T21:30:41.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-09T21:30:41.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-09T21:30:41.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-09T21:30:41.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-09T21:30:41.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-09T21:30:41.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-09T21:30:41.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-09T21:30:41.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-09T21:30:41.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-09T21:30:41.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-09T21:30:41.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-09T21:30:41.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-09T21:30:41.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-09T21:30:41.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-09T21:30:41.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-09T21:30:41.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-09T21:30:41.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-09T21:30:41.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-09T21:30:41.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-09T21:30:41.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-09T21:30:41.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-09T21:30:41.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-09T21:30:41.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-09T21:30:41.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-09T21:30:41.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-09T21:30:41.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-09T21:30:41.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-09T21:30:41.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-09T21:30:41.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-09T21:30:41.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-09T21:30:41.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-09T21:30:41.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-09T21:30:41.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-09T21:30:41.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-09T21:30:41.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-09T21:30:41.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-09T21:30:41.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-09T21:30:41.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-09T21:30:41.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-09T21:30:41.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-09T21:30:41.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-09T21:30:41.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-09T21:30:41.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-09T21:30:41.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-09T21:30:41.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-09T21:30:41.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-09T21:30:41.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-09T21:30:41.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-09T21:30:41.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-09T21:30:41.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-09T21:30:41.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-09T21:30:41.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-09T21:30:41.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-09T21:30:41.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-09T21:30:41.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-09T21:30:41.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-09T21:30:41.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-09T21:30:41.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-09T21:30:41.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-09T21:30:41.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-09T21:30:41.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-09T21:30:41.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-09T21:30:41.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-09T21:30:41.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-09T21:30:41.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-09T21:30:41.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-09T21:30:41.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-09T21:30:41.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-09T21:30:41.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-09T21:30:41.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-09T21:30:41.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-09T21:30:41.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-09T21:30:41.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-09T21:30:41.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-09T21:30:41.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-09T21:30:41.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-09T21:30:41.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-09T21:30:41.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-09T21:30:41.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-09T21:30:41.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-09T21:30:41.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-09T21:30:41.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-09T21:30:41.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-09T21:30:41.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-09T21:30:41.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-09T21:30:41.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-09T21:30:41.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-09T21:30:41.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-09T21:30:41.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus 2023-07-09T21:30:41.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-09T21:30:41.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-09T21:30:41.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-09T21:30:41.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-09T21:30:41.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-09T21:30:41.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-09T21:30:41.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-09T21:30:41.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-09T21:30:41.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-09T21:30:41.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-09T21:30:41.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-09T21:30:41.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-09T21:30:41.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-09T21:30:41.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-09T21:30:41.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-09T21:30:41.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-09T21:30:41.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-09T21:30:41.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-09T21:30:41.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-09T21:30:41.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-09T21:30:41.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-09T21:30:41.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-09T21:30:41.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-09T21:30:41.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-09T21:30:41.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-09T21:30:41.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-09T21:30:41.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-09T21:30:41.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-09T21:30:41.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-09T21:30:41.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-09T21:30:41.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-09T21:30:41.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-09T21:30:41.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-09T21:30:41.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-09T21:30:41.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-09T21:30:41.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-09T21:30:41.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-09T21:30:41.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-09T21:30:41.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-09T21:30:41.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-09T21:30:41.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-09T21:30:41.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c 2023-07-09T21:30:41.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos 2023-07-09T21:30:41.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-09T21:30:41.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-09T21:30:41.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses 2023-07-09T21:30:41.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-09T21:30:41.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-09T21:30:41.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-09T21:30:41.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-09T21:30:41.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-09T21:30:41.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-09T21:30:41.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-09T21:30:41.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-09T21:30:41.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-09T21:30:41.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-09T21:30:41.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-09T21:30:41.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-09T21:30:41.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-09T21:30:41.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-09T21:30:41.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-09T21:30:41.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-09T21:30:41.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-09T21:30:41.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-09T21:30:41.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-09T21:30:41.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-09T21:30:41.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-09T21:30:41.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-09T21:30:41.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-09T21:30:41.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-dev.ko 2023-07-09T21:30:41.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-09T21:30:41.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-09T21:30:41.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-09T21:30:41.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-09T21:30:41.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband 2023-07-09T21:30:41.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core 2023-07-09T21:30:41.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-09T21:30:41.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-09T21:30:41.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-09T21:30:41.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-09T21:30:41.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-09T21:30:41.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-09T21:30:41.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-09T21:30:41.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw 2023-07-09T21:30:41.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4 2023-07-09T21:30:41.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-09T21:30:41.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4 2023-07-09T21:30:41.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-09T21:30:41.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5 2023-07-09T21:30:41.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-09T21:30:41.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca 2023-07-09T21:30:41.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-09T21:30:41.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp 2023-07-09T21:30:41.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib 2023-07-09T21:30:41.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-09T21:30:41.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser 2023-07-09T21:30:41.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-09T21:30:41.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert 2023-07-09T21:30:41.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-09T21:30:41.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp 2023-07-09T21:30:41.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-09T21:30:41.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt 2023-07-09T21:30:41.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-09T21:30:41.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input 2023-07-09T21:30:41.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport 2023-07-09T21:30:41.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-09T21:30:41.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-09T21:30:41.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-09T21:30:41.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-09T21:30:41.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-09T21:30:41.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-09T21:30:41.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard 2023-07-09T21:30:41.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-09T21:30:41.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse 2023-07-09T21:30:41.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-09T21:30:41.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-09T21:30:41.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-09T21:30:41.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-09T21:30:41.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-09T21:30:41.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-09T21:30:41.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-09T21:30:41.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-09T21:30:41.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4 2023-07-09T21:30:41.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-09T21:30:41.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio 2023-07-09T21:30:41.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-09T21:30:41.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-09T21:30:41.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-09T21:30:41.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-09T21:30:41.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-09T21:30:41.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu 2023-07-09T21:30:41.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd 2023-07-09T21:30:41.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-09T21:30:41.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds 2023-07-09T21:30:41.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-09T21:30:41.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-09T21:30:41.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-09T21:30:41.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-09T21:30:41.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger 2023-07-09T21:30:41.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-09T21:30:41.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-09T21:30:41.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-09T21:30:41.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-09T21:30:42.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-09T21:30:42.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-09T21:30:42.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-09T21:30:42.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-09T21:30:42.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md 2023-07-09T21:30:42.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache 2023-07-09T21:30:42.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-09T21:30:42.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-09T21:30:42.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-09T21:30:42.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-09T21:30:42.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-09T21:30:42.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-09T21:30:42.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-09T21:30:42.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-09T21:30:42.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-09T21:30:42.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-09T21:30:42.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-09T21:30:42.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-09T21:30:42.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-09T21:30:42.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-09T21:30:42.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-09T21:30:42.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-09T21:30:42.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-09T21:30:42.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-09T21:30:42.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-09T21:30:42.008 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data 2023-07-09T21:30:42.008 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-09T21:30:42.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-09T21:30:42.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-09T21:30:42.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-09T21:30:42.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-09T21:30:42.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message 2023-07-09T21:30:42.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion 2023-07-09T21:30:42.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-09T21:30:42.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-09T21:30:42.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-09T21:30:42.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-09T21:30:42.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-09T21:30:42.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-09T21:30:42.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-09T21:30:42.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd 2023-07-09T21:30:42.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-09T21:30:42.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-09T21:30:42.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mfd-core.ko 2023-07-09T21:30:42.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-09T21:30:42.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-09T21:30:42.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-09T21:30:42.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-09T21:30:42.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc 2023-07-09T21:30:42.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl 2023-07-09T21:30:42.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-09T21:30:42.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-09T21:30:42.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-09T21:30:42.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-09T21:30:42.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710 2023-07-09T21:30:42.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-09T21:30:42.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom 2023-07-09T21:30:42.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-09T21:30:42.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-09T21:30:42.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-09T21:30:42.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-09T21:30:42.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-09T21:30:42.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-09T21:30:42.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-09T21:30:42.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-09T21:30:42.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d 2023-07-09T21:30:42.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-09T21:30:42.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-09T21:30:42.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei 2023-07-09T21:30:42.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-09T21:30:42.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-09T21:30:42.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-09T21:30:42.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru 2023-07-09T21:30:42.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-09T21:30:42.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp 2023-07-09T21:30:42.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-09T21:30:42.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-09T21:30:42.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-09T21:30:42.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-09T21:30:42.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-09T21:30:42.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-09T21:30:42.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-09T21:30:42.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci 2023-07-09T21:30:42.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-09T21:30:42.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net 2023-07-09T21:30:42.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding 2023-07-09T21:30:42.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-09T21:30:42.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa 2023-07-09T21:30:42.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53 2023-07-09T21:30:42.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-09T21:30:42.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-09T21:30:42.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-09T21:30:42.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx 2023-07-09T21:30:42.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-09T21:30:42.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-09T21:30:42.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-09T21:30:42.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet 2023-07-09T21:30:42.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com 2023-07-09T21:30:42.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-09T21:30:42.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-09T21:30:42.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-09T21:30:42.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-09T21:30:42.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390 2023-07-09T21:30:42.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-09T21:30:42.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-09T21:30:42.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-09T21:30:42.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-09T21:30:42.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec 2023-07-09T21:30:42.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-09T21:30:42.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere 2023-07-09T21:30:42.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-09T21:30:42.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon 2023-07-09T21:30:42.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-09T21:30:42.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera 2023-07-09T21:30:42.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-09T21:30:42.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd 2023-07-09T21:30:42.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-09T21:30:42.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-09T21:30:42.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-09T21:30:42.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros 2023-07-09T21:30:42.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx 2023-07-09T21:30:42.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-09T21:30:42.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-09T21:30:42.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-09T21:30:42.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-09T21:30:42.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-09T21:30:42.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx 2023-07-09T21:30:42.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-09T21:30:42.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-09T21:30:42.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom 2023-07-09T21:30:42.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-09T21:30:42.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-09T21:30:42.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-09T21:30:42.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-09T21:30:42.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-09T21:30:42.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet 2023-07-09T21:30:42.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-09T21:30:42.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-09T21:30:42.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade 2023-07-09T21:30:42.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna 2023-07-09T21:30:42.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-09T21:30:42.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio 2023-07-09T21:30:42.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-09T21:30:42.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-09T21:30:42.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-09T21:30:42.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-09T21:30:42.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-09T21:30:42.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-09T21:30:42.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-09T21:30:42.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-09T21:30:42.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-09T21:30:42.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-09T21:30:42.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco 2023-07-09T21:30:42.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic 2023-07-09T21:30:42.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-09T21:30:42.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec 2023-07-09T21:30:42.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip 2023-07-09T21:30:42.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-09T21:30:42.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-09T21:30:42.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-09T21:30:42.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-09T21:30:42.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-09T21:30:42.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-09T21:30:42.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink 2023-07-09T21:30:42.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-09T21:30:42.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-09T21:30:42.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-09T21:30:42.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex 2023-07-09T21:30:42.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet 2023-07-09T21:30:42.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-09T21:30:42.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-09T21:30:42.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-09T21:30:42.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel 2023-07-09T21:30:42.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-09T21:30:42.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000 2023-07-09T21:30:42.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-09T21:30:42.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e 2023-07-09T21:30:42.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-09T21:30:42.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k 2023-07-09T21:30:42.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-09T21:30:42.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e 2023-07-09T21:30:42.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-09T21:30:42.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf 2023-07-09T21:30:42.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-09T21:30:42.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb 2023-07-09T21:30:42.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-09T21:30:42.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf 2023-07-09T21:30:42.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-09T21:30:42.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-09T21:30:42.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-09T21:30:42.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-09T21:30:42.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-09T21:30:42.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-09T21:30:42.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell 2023-07-09T21:30:42.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-09T21:30:42.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-09T21:30:42.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-09T21:30:42.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox 2023-07-09T21:30:42.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-09T21:30:42.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-09T21:30:42.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-09T21:30:42.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-09T21:30:42.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-09T21:30:42.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-09T21:30:42.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel 2023-07-09T21:30:42.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-09T21:30:42.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom 2023-07-09T21:30:42.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-09T21:30:42.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-09T21:30:42.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi 2023-07-09T21:30:42.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-09T21:30:42.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-09T21:30:42.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion 2023-07-09T21:30:42.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-09T21:30:42.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia 2023-07-09T21:30:42.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-09T21:30:42.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines 2023-07-09T21:30:42.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-09T21:30:42.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-09T21:30:42.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic 2023-07-09T21:30:42.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-09T21:30:42.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-09T21:30:42.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-09T21:30:42.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-09T21:30:42.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-09T21:30:42.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc 2023-07-09T21:30:42.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-09T21:30:42.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek 2023-07-09T21:30:42.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-09T21:30:42.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-09T21:30:42.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-09T21:30:42.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-09T21:30:42.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker 2023-07-09T21:30:42.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-09T21:30:42.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc 2023-07-09T21:30:42.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-09T21:30:42.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan 2023-07-09T21:30:42.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-09T21:30:42.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis 2023-07-09T21:30:42.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-09T21:30:42.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-09T21:30:42.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc 2023-07-09T21:30:42.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-09T21:30:42.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-09T21:30:42.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-09T21:30:42.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-09T21:30:42.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro 2023-07-09T21:30:42.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-09T21:30:42.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-09T21:30:42.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-09T21:30:42.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun 2023-07-09T21:30:42.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-09T21:30:42.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-09T21:30:42.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-09T21:30:42.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-09T21:30:42.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti 2023-07-09T21:30:42.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-09T21:30:42.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti 2023-07-09T21:30:42.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-09T21:30:42.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via 2023-07-09T21:30:42.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-09T21:30:42.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-09T21:30:42.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet 2023-07-09T21:30:42.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-09T21:30:42.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-09T21:30:42.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom 2023-07-09T21:30:42.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-09T21:30:42.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-09T21:30:42.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv 2023-07-09T21:30:42.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-09T21:30:42.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154 2023-07-09T21:30:42.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-09T21:30:42.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-09T21:30:42.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan 2023-07-09T21:30:42.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-09T21:30:42.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-09T21:30:42.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-09T21:30:42.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio 2023-07-09T21:30:42.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-09T21:30:42.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-09T21:30:42.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-09T21:30:42.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-09T21:30:42.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/net_failover.ko 2023-07-09T21:30:42.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-09T21:30:42.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-09T21:30:42.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs 2023-07-09T21:30:42.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-09T21:30:42.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-09T21:30:42.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy 2023-07-09T21:30:42.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-09T21:30:42.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-09T21:30:42.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-09T21:30:42.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-09T21:30:42.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-09T21:30:42.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-09T21:30:42.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-09T21:30:42.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-09T21:30:42.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/dp83640.ko 2023-07-09T21:30:42.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-09T21:30:42.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-09T21:30:42.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-09T21:30:42.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-09T21:30:42.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-09T21:30:42.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-09T21:30:42.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-09T21:30:42.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-09T21:30:42.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-09T21:30:42.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-09T21:30:42.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-09T21:30:42.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-09T21:30:42.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp 2023-07-09T21:30:42.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-09T21:30:42.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-09T21:30:42.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-09T21:30:42.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-09T21:30:42.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-09T21:30:42.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-09T21:30:42.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-09T21:30:42.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-09T21:30:42.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-09T21:30:42.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip 2023-07-09T21:30:42.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slhc.ko 2023-07-09T21:30:42.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-09T21:30:42.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-09T21:30:42.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-09T21:30:42.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team 2023-07-09T21:30:42.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-09T21:30:42.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-09T21:30:42.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-09T21:30:42.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-09T21:30:42.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-09T21:30:42.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-09T21:30:42.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tun.ko 2023-07-09T21:30:42.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-09T21:30:42.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/virtio_net.ko 2023-07-09T21:30:42.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3 2023-07-09T21:30:42.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-09T21:30:42.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan 2023-07-09T21:30:42.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-09T21:30:42.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback 2023-07-09T21:30:42.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-09T21:30:42.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netfront.ko 2023-07-09T21:30:42.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb 2023-07-09T21:30:42.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-09T21:30:42.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme 2023-07-09T21:30:42.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host 2023-07-09T21:30:42.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-09T21:30:42.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-09T21:30:42.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport 2023-07-09T21:30:42.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-09T21:30:42.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-09T21:30:42.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-09T21:30:42.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-09T21:30:42.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci 2023-07-09T21:30:42.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug 2023-07-09T21:30:42.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-09T21:30:42.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie 2023-07-09T21:30:42.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-09T21:30:42.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-09T21:30:42.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia 2023-07-09T21:30:42.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-09T21:30:42.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-09T21:30:42.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-09T21:30:42.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl 2023-07-09T21:30:42.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel 2023-07-09T21:30:42.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-09T21:30:42.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform 2023-07-09T21:30:42.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86 2023-07-09T21:30:42.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-09T21:30:42.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-09T21:30:42.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-09T21:30:42.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-09T21:30:42.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-09T21:30:42.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-09T21:30:42.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-09T21:30:42.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-09T21:30:42.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-09T21:30:42.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-09T21:30:42.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-09T21:30:42.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-09T21:30:42.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel 2023-07-09T21:30:42.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-09T21:30:42.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-09T21:30:42.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-09T21:30:42.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-09T21:30:42.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-09T21:30:42.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-09T21:30:42.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-09T21:30:42.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-09T21:30:42.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-09T21:30:42.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-09T21:30:42.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-09T21:30:42.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-09T21:30:42.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap 2023-07-09T21:30:42.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-09T21:30:42.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-09T21:30:42.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps 2023-07-09T21:30:42.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients 2023-07-09T21:30:42.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-09T21:30:42.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-09T21:30:42.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-09T21:30:42.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-09T21:30:42.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp 2023-07-09T21:30:42.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-09T21:30:42.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-09T21:30:42.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc 2023-07-09T21:30:42.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-09T21:30:42.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-09T21:30:42.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-09T21:30:42.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-09T21:30:42.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-09T21:30:42.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-09T21:30:42.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-09T21:30:42.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-09T21:30:42.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-09T21:30:42.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-09T21:30:42.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-09T21:30:42.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-09T21:30:42.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-09T21:30:42.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-09T21:30:42.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-09T21:30:42.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-09T21:30:42.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-09T21:30:42.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-09T21:30:42.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-09T21:30:42.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-09T21:30:42.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-09T21:30:42.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-09T21:30:42.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-09T21:30:42.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-09T21:30:42.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-09T21:30:42.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-09T21:30:42.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-09T21:30:42.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-09T21:30:42.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-09T21:30:42.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-09T21:30:42.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-09T21:30:42.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-09T21:30:42.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi 2023-07-09T21:30:42.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-09T21:30:42.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-09T21:30:42.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-09T21:30:42.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-09T21:30:42.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-09T21:30:42.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid 2023-07-09T21:30:42.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-09T21:30:42.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-09T21:30:42.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx 2023-07-09T21:30:42.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-09T21:30:42.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-09T21:30:42.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-09T21:30:42.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr 2023-07-09T21:30:42.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-09T21:30:42.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-09T21:30:42.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi 2023-07-09T21:30:42.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-09T21:30:42.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa 2023-07-09T21:30:42.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-09T21:30:42.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc 2023-07-09T21:30:42.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-09T21:30:42.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i 2023-07-09T21:30:42.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-09T21:30:42.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-09T21:30:42.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor 2023-07-09T21:30:42.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-09T21:30:42.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi 2023-07-09T21:30:42.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-09T21:30:42.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-09T21:30:42.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-09T21:30:42.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-09T21:30:42.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-09T21:30:42.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-09T21:30:42.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler 2023-07-09T21:30:42.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-09T21:30:42.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-09T21:30:42.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-09T21:30:42.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-09T21:30:42.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-09T21:30:42.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r 2023-07-09T21:30:42.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-09T21:30:42.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-09T21:30:42.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe 2023-07-09T21:30:42.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-09T21:30:42.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-09T21:30:42.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic 2023-07-09T21:30:42.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-09T21:30:42.085 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-09T21:30:42.085 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-09T21:30:42.085 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-09T21:30:42.085 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-09T21:30:42.085 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-09T21:30:42.085 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-09T21:30:42.085 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci 2023-07-09T21:30:42.086 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-09T21:30:42.086 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-09T21:30:42.086 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-09T21:30:42.086 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc 2023-07-09T21:30:42.086 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-09T21:30:42.086 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-09T21:30:42.086 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-09T21:30:42.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas 2023-07-09T21:30:42.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-09T21:30:42.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc 2023-07-09T21:30:42.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-09T21:30:42.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid 2023-07-09T21:30:42.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-09T21:30:42.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-09T21:30:42.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-09T21:30:42.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-09T21:30:42.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas 2023-07-09T21:30:42.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-09T21:30:42.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas 2023-07-09T21:30:42.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-09T21:30:42.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-09T21:30:42.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001 2023-07-09T21:30:42.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-09T21:30:42.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-09T21:30:42.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-09T21:30:42.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx 2023-07-09T21:30:42.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-09T21:30:42.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-09T21:30:42.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx 2023-07-09T21:30:42.090 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-09T21:30:42.090 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-09T21:30:42.090 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-09T21:30:42.090 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-09T21:30:42.090 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-09T21:30:42.090 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-09T21:30:42.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-09T21:30:42.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-09T21:30:42.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-09T21:30:42.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-09T21:30:42.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-09T21:30:42.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2 2023-07-09T21:30:42.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-09T21:30:42.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-09T21:30:42.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-09T21:30:42.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-09T21:30:42.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb 2023-07-09T21:30:42.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-09T21:30:42.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target 2023-07-09T21:30:42.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi 2023-07-09T21:30:42.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-09T21:30:42.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback 2023-07-09T21:30:42.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-09T21:30:42.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-09T21:30:42.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-09T21:30:42.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-09T21:30:42.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-09T21:30:42.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-09T21:30:42.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc 2023-07-09T21:30:42.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-09T21:30:42.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal 2023-07-09T21:30:42.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel 2023-07-09T21:30:42.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal 2023-07-09T21:30:42.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-09T21:30:42.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-09T21:30:42.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-09T21:30:42.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-09T21:30:42.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-09T21:30:42.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-09T21:30:42.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-09T21:30:42.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-09T21:30:42.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-09T21:30:42.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-09T21:30:42.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-09T21:30:42.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-09T21:30:42.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-09T21:30:42.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-09T21:30:42.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-09T21:30:42.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty 2023-07-09T21:30:42.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless 2023-07-09T21:30:42.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-09T21:30:42.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-09T21:30:42.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-09T21:30:42.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-09T21:30:42.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial 2023-07-09T21:30:42.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250 2023-07-09T21:30:42.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-09T21:30:42.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-09T21:30:42.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm 2023-07-09T21:30:42.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-09T21:30:42.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-09T21:30:42.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs 2023-07-09T21:30:42.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core 2023-07-09T21:30:42.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-09T21:30:42.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host 2023-07-09T21:30:42.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-09T21:30:42.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio 2023-07-09T21:30:42.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-09T21:30:42.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-09T21:30:42.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-09T21:30:42.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-09T21:30:42.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-09T21:30:42.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb 2023-07-09T21:30:42.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class 2023-07-09T21:30:42.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-09T21:30:42.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-09T21:30:42.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-09T21:30:42.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-09T21:30:42.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host 2023-07-09T21:30:42.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-09T21:30:42.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image 2023-07-09T21:30:42.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-09T21:30:42.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-09T21:30:42.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc 2023-07-09T21:30:42.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-09T21:30:42.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-09T21:30:42.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-09T21:30:42.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-09T21:30:42.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-09T21:30:42.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-09T21:30:42.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-09T21:30:42.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-09T21:30:42.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-09T21:30:42.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-09T21:30:42.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga 2023-07-09T21:30:42.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-09T21:30:42.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-09T21:30:42.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-09T21:30:42.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-09T21:30:42.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-09T21:30:42.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-09T21:30:42.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-09T21:30:42.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy 2023-07-09T21:30:42.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-09T21:30:42.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial 2023-07-09T21:30:42.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-09T21:30:42.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-09T21:30:42.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-09T21:30:42.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-09T21:30:42.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-09T21:30:42.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-09T21:30:42.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-09T21:30:42.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-09T21:30:42.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-09T21:30:42.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-09T21:30:42.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-09T21:30:42.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-09T21:30:42.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-09T21:30:42.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-09T21:30:42.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-09T21:30:42.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-09T21:30:42.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-09T21:30:42.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-09T21:30:42.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-09T21:30:42.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-09T21:30:42.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-09T21:30:42.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-09T21:30:42.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-09T21:30:42.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-09T21:30:42.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-09T21:30:42.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-09T21:30:42.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-09T21:30:42.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-09T21:30:42.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-09T21:30:42.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-09T21:30:42.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-09T21:30:42.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-09T21:30:42.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-09T21:30:42.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-09T21:30:42.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-09T21:30:42.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-09T21:30:42.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-09T21:30:42.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-09T21:30:42.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-09T21:30:42.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-09T21:30:42.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-09T21:30:42.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-09T21:30:42.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-09T21:30:42.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-09T21:30:42.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-09T21:30:42.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage 2023-07-09T21:30:42.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-09T21:30:42.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-09T21:30:42.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-09T21:30:42.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-09T21:30:42.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-09T21:30:42.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-09T21:30:42.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-09T21:30:42.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-09T21:30:42.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-09T21:30:42.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-09T21:30:42.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-09T21:30:42.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-09T21:30:42.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-09T21:30:42.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-09T21:30:42.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-09T21:30:42.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip 2023-07-09T21:30:42.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-09T21:30:42.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-09T21:30:42.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-09T21:30:42.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio 2023-07-09T21:30:42.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci 2023-07-09T21:30:42.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-09T21:30:42.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-09T21:30:42.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-09T21:30:42.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-09T21:30:42.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost 2023-07-09T21:30:42.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-09T21:30:42.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-09T21:30:42.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-09T21:30:42.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-09T21:30:42.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video 2023-07-09T21:30:42.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight 2023-07-09T21:30:42.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-09T21:30:42.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-09T21:30:42.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-09T21:30:42.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio 2023-07-09T21:30:42.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio.ko 2023-07-09T21:30:42.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_balloon.ko 2023-07-09T21:30:42.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_mmio.ko 2023-07-09T21:30:42.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci.ko 2023-07-09T21:30:42.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-09T21:30:42.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-09T21:30:42.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_ring.ko 2023-07-09T21:30:42.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1 2023-07-09T21:30:42.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters 2023-07-09T21:30:42.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-09T21:30:42.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-09T21:30:42.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves 2023-07-09T21:30:42.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-09T21:30:42.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-09T21:30:42.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-09T21:30:42.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-09T21:30:42.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-09T21:30:42.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-09T21:30:42.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-09T21:30:42.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-09T21:30:42.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-09T21:30:42.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-09T21:30:42.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-09T21:30:42.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-09T21:30:42.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog 2023-07-09T21:30:42.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-09T21:30:42.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-09T21:30:42.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-09T21:30:42.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-09T21:30:42.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-09T21:30:42.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-09T21:30:42.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-09T21:30:42.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-09T21:30:42.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-09T21:30:42.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-09T21:30:42.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-09T21:30:42.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-09T21:30:42.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-09T21:30:42.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-09T21:30:42.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-09T21:30:42.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-09T21:30:42.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-09T21:30:42.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-09T21:30:42.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-09T21:30:42.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-09T21:30:42.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-09T21:30:42.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-09T21:30:42.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-09T21:30:42.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-09T21:30:42.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-09T21:30:42.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-09T21:30:42.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen 2023-07-09T21:30:42.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-09T21:30:42.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-09T21:30:42.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-09T21:30:42.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-09T21:30:42.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback 2023-07-09T21:30:42.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-09T21:30:42.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-09T21:30:42.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs 2023-07-09T21:30:42.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-09T21:30:42.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs 2023-07-09T21:30:42.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p 2023-07-09T21:30:42.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-09T21:30:42.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs 2023-07-09T21:30:42.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-09T21:30:42.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs 2023-07-09T21:30:42.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-09T21:30:42.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-09T21:30:42.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs 2023-07-09T21:30:42.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-09T21:30:42.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles 2023-07-09T21:30:42.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-09T21:30:42.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph 2023-07-09T21:30:42.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-09T21:30:42.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda 2023-07-09T21:30:42.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-09T21:30:42.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs 2023-07-09T21:30:42.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-09T21:30:42.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm 2023-07-09T21:30:42.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-09T21:30:42.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs 2023-07-09T21:30:42.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-09T21:30:42.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs 2023-07-09T21:30:42.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-09T21:30:42.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat 2023-07-09T21:30:42.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/fat.ko 2023-07-09T21:30:42.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-09T21:30:42.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/vfat.ko 2023-07-09T21:30:42.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache 2023-07-09T21:30:42.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-09T21:30:42.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse 2023-07-09T21:30:42.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-09T21:30:42.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/fuse.ko 2023-07-09T21:30:42.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2 2023-07-09T21:30:42.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-09T21:30:42.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs 2023-07-09T21:30:42.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-09T21:30:42.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus 2023-07-09T21:30:42.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-09T21:30:42.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs 2023-07-09T21:30:42.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-09T21:30:42.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs 2023-07-09T21:30:42.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-09T21:30:42.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd 2023-07-09T21:30:42.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-09T21:30:42.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix 2023-07-09T21:30:42.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-09T21:30:42.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs 2023-07-09T21:30:42.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-09T21:30:42.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs 2023-07-09T21:30:42.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout 2023-07-09T21:30:42.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-09T21:30:42.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout 2023-07-09T21:30:42.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-09T21:30:42.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout 2023-07-09T21:30:42.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-09T21:30:42.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-09T21:30:42.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-09T21:30:42.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-09T21:30:42.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common 2023-07-09T21:30:42.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-09T21:30:42.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-09T21:30:42.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd 2023-07-09T21:30:42.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-09T21:30:42.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2 2023-07-09T21:30:42.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-09T21:30:42.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls 2023-07-09T21:30:42.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-09T21:30:42.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-09T21:30:42.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-09T21:30:42.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-09T21:30:42.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-09T21:30:42.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-09T21:30:42.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-09T21:30:42.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-09T21:30:42.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-09T21:30:42.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-09T21:30:42.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-09T21:30:42.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-09T21:30:42.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-09T21:30:42.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-09T21:30:42.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-09T21:30:42.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-09T21:30:42.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-09T21:30:42.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-09T21:30:42.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-09T21:30:42.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-09T21:30:42.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-09T21:30:42.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-09T21:30:42.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-09T21:30:42.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-09T21:30:42.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-09T21:30:42.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-09T21:30:42.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-09T21:30:42.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-09T21:30:42.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-09T21:30:42.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-09T21:30:42.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-09T21:30:42.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-09T21:30:42.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-09T21:30:42.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-09T21:30:42.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-09T21:30:42.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-09T21:30:42.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-09T21:30:42.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-09T21:30:42.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-09T21:30:42.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-09T21:30:42.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-09T21:30:42.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-09T21:30:42.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-09T21:30:42.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-09T21:30:42.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-09T21:30:42.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-09T21:30:42.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-09T21:30:42.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-09T21:30:42.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-09T21:30:42.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2 2023-07-09T21:30:42.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster 2023-07-09T21:30:42.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-09T21:30:42.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm 2023-07-09T21:30:42.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-09T21:30:42.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs 2023-07-09T21:30:42.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-09T21:30:42.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-09T21:30:42.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-09T21:30:42.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-09T21:30:42.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-09T21:30:42.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs 2023-07-09T21:30:42.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-09T21:30:42.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore 2023-07-09T21:30:42.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-09T21:30:42.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs 2023-07-09T21:30:42.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-09T21:30:42.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs 2023-07-09T21:30:42.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-09T21:30:42.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb 2023-07-09T21:30:42.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client 2023-07-09T21:30:42.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-09T21:30:42.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common 2023-07-09T21:30:42.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-09T21:30:42.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-09T21:30:42.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs 2023-07-09T21:30:42.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-09T21:30:42.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv 2023-07-09T21:30:42.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-09T21:30:42.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf 2023-07-09T21:30:42.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-09T21:30:42.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs 2023-07-09T21:30:42.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-09T21:30:42.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs 2023-07-09T21:30:42.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-09T21:30:42.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel 2023-07-09T21:30:42.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu 2023-07-09T21:30:42.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu/rcutorture.ko 2023-07-09T21:30:42.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-09T21:30:42.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace 2023-07-09T21:30:42.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-09T21:30:42.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib 2023-07-09T21:30:42.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/asn1_encoder.ko 2023-07-09T21:30:42.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-09T21:30:42.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-09T21:30:42.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto 2023-07-09T21:30:42.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-09T21:30:42.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-09T21:30:42.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-09T21:30:42.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-09T21:30:42.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4 2023-07-09T21:30:42.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-09T21:30:42.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-09T21:30:42.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math 2023-07-09T21:30:42.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-09T21:30:42.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6 2023-07-09T21:30:42.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-09T21:30:42.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon 2023-07-09T21:30:42.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-09T21:30:42.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-09T21:30:42.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-09T21:30:42.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-09T21:30:42.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd 2023-07-09T21:30:42.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd/zstd_compress.ko 2023-07-09T21:30:42.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm 2023-07-09T21:30:42.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-09T21:30:42.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net 2023-07-09T21:30:42.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan 2023-07-09T21:30:42.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-09T21:30:42.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-09T21:30:42.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-09T21:30:42.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-09T21:30:42.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-09T21:30:42.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-09T21:30:42.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-09T21:30:42.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-09T21:30:42.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802 2023-07-09T21:30:42.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-09T21:30:42.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-09T21:30:42.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-09T21:30:42.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-09T21:30:42.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-09T21:30:42.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q 2023-07-09T21:30:42.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-09T21:30:42.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p 2023-07-09T21:30:42.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-09T21:30:42.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-09T21:30:42.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-09T21:30:42.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-09T21:30:42.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv 2023-07-09T21:30:42.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-09T21:30:42.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge 2023-07-09T21:30:42.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-09T21:30:42.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-09T21:30:42.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter 2023-07-09T21:30:42.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-09T21:30:42.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-09T21:30:42.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-09T21:30:42.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-09T21:30:42.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-09T21:30:42.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-09T21:30:42.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-09T21:30:42.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-09T21:30:42.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-09T21:30:42.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-09T21:30:42.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-09T21:30:42.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-09T21:30:42.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-09T21:30:42.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-09T21:30:42.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-09T21:30:42.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-09T21:30:42.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-09T21:30:42.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-09T21:30:42.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-09T21:30:42.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-09T21:30:42.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-09T21:30:42.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-09T21:30:42.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-09T21:30:42.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-09T21:30:42.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph 2023-07-09T21:30:42.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-09T21:30:42.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core 2023-07-09T21:30:42.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/failover.ko 2023-07-09T21:30:42.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-09T21:30:42.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp 2023-07-09T21:30:42.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-09T21:30:42.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-09T21:30:42.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-09T21:30:42.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-09T21:30:42.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver 2023-07-09T21:30:42.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver/dns_resolver.ko 2023-07-09T21:30:42.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa 2023-07-09T21:30:42.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-09T21:30:42.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-09T21:30:42.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-09T21:30:42.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-09T21:30:42.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-09T21:30:42.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154 2023-07-09T21:30:42.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan 2023-07-09T21:30:42.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-09T21:30:42.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-09T21:30:42.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-09T21:30:42.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4 2023-07-09T21:30:42.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-09T21:30:42.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-09T21:30:42.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-09T21:30:42.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-09T21:30:42.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-09T21:30:42.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-09T21:30:42.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-09T21:30:42.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-09T21:30:42.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-09T21:30:42.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-09T21:30:42.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter 2023-07-09T21:30:42.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-09T21:30:42.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-09T21:30:42.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-09T21:30:42.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-09T21:30:42.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-09T21:30:42.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-09T21:30:42.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-09T21:30:42.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-09T21:30:42.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-09T21:30:42.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-09T21:30:42.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-09T21:30:42.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-09T21:30:42.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-09T21:30:42.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-09T21:30:42.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-09T21:30:42.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-09T21:30:42.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-09T21:30:42.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-09T21:30:42.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-09T21:30:42.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-09T21:30:42.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-09T21:30:42.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-09T21:30:42.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-09T21:30:42.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-09T21:30:42.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-09T21:30:42.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-09T21:30:42.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-09T21:30:42.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-09T21:30:42.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-09T21:30:42.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-09T21:30:42.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-09T21:30:42.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-09T21:30:42.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-09T21:30:42.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-09T21:30:42.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-09T21:30:42.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-09T21:30:42.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-09T21:30:42.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-09T21:30:42.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6 2023-07-09T21:30:42.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-09T21:30:42.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-09T21:30:42.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-09T21:30:42.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-09T21:30:42.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-09T21:30:42.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-09T21:30:42.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-09T21:30:42.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter 2023-07-09T21:30:42.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-09T21:30:42.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-09T21:30:42.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-09T21:30:42.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-09T21:30:42.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-09T21:30:42.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-09T21:30:42.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-09T21:30:42.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-09T21:30:42.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-09T21:30:42.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-09T21:30:42.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-09T21:30:42.171 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-09T21:30:42.171 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-09T21:30:42.171 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-09T21:30:42.171 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-09T21:30:42.171 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-09T21:30:42.171 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-09T21:30:42.171 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-09T21:30:42.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-09T21:30:42.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-09T21:30:42.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-09T21:30:42.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-09T21:30:42.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-09T21:30:42.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-09T21:30:42.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-09T21:30:42.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-09T21:30:42.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-09T21:30:42.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key 2023-07-09T21:30:42.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-09T21:30:42.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp 2023-07-09T21:30:42.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-09T21:30:42.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-09T21:30:42.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-09T21:30:42.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-09T21:30:42.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-09T21:30:42.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-09T21:30:42.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-09T21:30:42.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc 2023-07-09T21:30:42.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-09T21:30:42.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154 2023-07-09T21:30:42.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-09T21:30:42.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls 2023-07-09T21:30:42.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-09T21:30:42.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter 2023-07-09T21:30:42.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset 2023-07-09T21:30:42.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-09T21:30:42.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-09T21:30:42.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-09T21:30:42.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-09T21:30:42.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-09T21:30:42.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-09T21:30:42.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-09T21:30:42.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-09T21:30:42.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-09T21:30:42.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-09T21:30:42.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-09T21:30:42.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-09T21:30:42.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-09T21:30:42.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-09T21:30:42.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-09T21:30:42.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-09T21:30:42.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs 2023-07-09T21:30:42.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-09T21:30:42.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-09T21:30:42.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-09T21:30:42.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-09T21:30:42.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-09T21:30:42.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-09T21:30:42.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-09T21:30:42.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-09T21:30:42.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-09T21:30:42.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-09T21:30:42.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-09T21:30:42.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-09T21:30:42.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-09T21:30:42.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-09T21:30:42.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-09T21:30:42.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-09T21:30:42.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-09T21:30:42.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-09T21:30:42.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-09T21:30:42.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-09T21:30:42.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-09T21:30:42.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-09T21:30:42.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-09T21:30:42.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-09T21:30:42.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-09T21:30:42.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-09T21:30:42.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-09T21:30:42.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-09T21:30:42.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-09T21:30:42.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-09T21:30:42.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-09T21:30:42.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-09T21:30:42.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-09T21:30:42.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-09T21:30:42.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-09T21:30:42.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-09T21:30:42.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-09T21:30:42.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-09T21:30:42.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-09T21:30:42.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-09T21:30:42.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-09T21:30:42.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-09T21:30:42.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-09T21:30:42.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-09T21:30:42.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-09T21:30:42.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-09T21:30:42.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-09T21:30:42.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-09T21:30:42.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-09T21:30:42.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-09T21:30:42.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-09T21:30:42.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-09T21:30:42.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-09T21:30:42.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-09T21:30:42.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-09T21:30:42.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-09T21:30:42.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-09T21:30:42.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-09T21:30:42.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_quota.ko 2023-07-09T21:30:42.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-09T21:30:42.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-09T21:30:42.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-09T21:30:42.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-09T21:30:42.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tunnel.ko 2023-07-09T21:30:42.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-09T21:30:42.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-09T21:30:42.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-09T21:30:42.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-09T21:30:42.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-09T21:30:42.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-09T21:30:42.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-09T21:30:42.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-09T21:30:42.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-09T21:30:42.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-09T21:30:42.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-09T21:30:42.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-09T21:30:42.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-09T21:30:42.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-09T21:30:42.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-09T21:30:42.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-09T21:30:42.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-09T21:30:42.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-09T21:30:42.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-09T21:30:42.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-09T21:30:42.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-09T21:30:42.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-09T21:30:42.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-09T21:30:42.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-09T21:30:42.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-09T21:30:42.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-09T21:30:42.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-09T21:30:42.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-09T21:30:42.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-09T21:30:42.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-09T21:30:42.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-09T21:30:42.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-09T21:30:42.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-09T21:30:42.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-09T21:30:42.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-09T21:30:42.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-09T21:30:42.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-09T21:30:42.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-09T21:30:42.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-09T21:30:42.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-09T21:30:42.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-09T21:30:42.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-09T21:30:42.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-09T21:30:42.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-09T21:30:42.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-09T21:30:42.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-09T21:30:42.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-09T21:30:42.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-09T21:30:42.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-09T21:30:42.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-09T21:30:42.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-09T21:30:42.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-09T21:30:42.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-09T21:30:42.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-09T21:30:42.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-09T21:30:42.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-09T21:30:42.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-09T21:30:42.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-09T21:30:42.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-09T21:30:42.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-09T21:30:42.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-09T21:30:42.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-09T21:30:42.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-09T21:30:42.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-09T21:30:42.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-09T21:30:42.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-09T21:30:42.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-09T21:30:42.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-09T21:30:42.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-09T21:30:42.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-09T21:30:42.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-09T21:30:42.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink 2023-07-09T21:30:42.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-09T21:30:42.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh 2023-07-09T21:30:42.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-09T21:30:42.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch 2023-07-09T21:30:42.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-09T21:30:42.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-09T21:30:42.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-09T21:30:42.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-09T21:30:42.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet 2023-07-09T21:30:42.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-09T21:30:42.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds 2023-07-09T21:30:42.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-09T21:30:42.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-09T21:30:42.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-09T21:30:42.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched 2023-07-09T21:30:42.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-09T21:30:42.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-09T21:30:42.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-09T21:30:42.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-09T21:30:42.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-09T21:30:42.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-09T21:30:42.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-09T21:30:42.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-09T21:30:42.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-09T21:30:42.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-09T21:30:42.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-09T21:30:42.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-09T21:30:42.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-09T21:30:42.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-09T21:30:42.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-09T21:30:42.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-09T21:30:42.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-09T21:30:42.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-09T21:30:42.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-09T21:30:42.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-09T21:30:42.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-09T21:30:42.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-09T21:30:42.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-09T21:30:42.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-09T21:30:42.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-09T21:30:42.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-09T21:30:42.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-09T21:30:42.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-09T21:30:42.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-09T21:30:42.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-09T21:30:42.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-09T21:30:42.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-09T21:30:42.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-09T21:30:42.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-09T21:30:42.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-09T21:30:42.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-09T21:30:42.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-09T21:30:42.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-09T21:30:42.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-09T21:30:42.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-09T21:30:42.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-09T21:30:42.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-09T21:30:42.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-09T21:30:42.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-09T21:30:42.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp 2023-07-09T21:30:42.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-09T21:30:42.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-09T21:30:42.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc 2023-07-09T21:30:42.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss 2023-07-09T21:30:42.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-09T21:30:42.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-09T21:30:42.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-09T21:30:42.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma 2023-07-09T21:30:42.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-09T21:30:42.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc 2023-07-09T21:30:42.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-09T21:30:42.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-09T21:30:42.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix 2023-07-09T21:30:42.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-09T21:30:42.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock 2023-07-09T21:30:42.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-09T21:30:42.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-09T21:30:42.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-09T21:30:42.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-09T21:30:42.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-09T21:30:42.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm 2023-07-09T21:30:42.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-09T21:30:42.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security 2023-07-09T21:30:42.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys 2023-07-09T21:30:42.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys 2023-07-09T21:30:42.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-09T21:30:42.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys 2023-07-09T21:30:42.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys/trusted.ko 2023-07-09T21:30:42.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt 2023-07-09T21:30:42.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib 2023-07-09T21:30:42.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-09T21:30:42.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-09T21:30:42.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-09T21:30:42.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-09T21:30:42.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-09T21:30:42.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-09T21:30:42.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-09T21:30:42.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-09T21:30:42.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-09T21:30:42.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-09T21:30:42.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-09T21:30:42.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-09T21:30:42.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-09T21:30:42.212 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-09T21:30:42.212 DEBUG:teuthology.orchestra.run.smithi184:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-09T21:30:42.239 INFO:teuthology.orchestra.run.smithi184.stdout:postinstall scriptlet (using /bin/sh): 2023-07-09T21:30:42.240 INFO:teuthology.orchestra.run.smithi184.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-g84139c18d56f -a -r /boot/System.map-6.4.0-g84139c18d56f ]; then 2023-07-09T21:30:42.240 INFO:teuthology.orchestra.run.smithi184.stdout:cp /boot/vmlinuz-6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm 2023-07-09T21:30:42.240 INFO:teuthology.orchestra.run.smithi184.stdout:cp /boot/System.map-6.4.0-g84139c18d56f /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-09T21:30:42.240 INFO:teuthology.orchestra.run.smithi184.stdout:rm -f /boot/vmlinuz-6.4.0-g84139c18d56f /boot/System.map-6.4.0-g84139c18d56f 2023-07-09T21:30:42.240 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/installkernel 6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-09T21:30:42.241 INFO:teuthology.orchestra.run.smithi184.stdout:rm -f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-09T21:30:42.241 INFO:teuthology.orchestra.run.smithi184.stdout:fi 2023-07-09T21:30:42.241 INFO:teuthology.orchestra.run.smithi184.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-09T21:30:42.241 INFO:teuthology.orchestra.run.smithi184.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-09T21:30:42.241 INFO:teuthology.orchestra.run.smithi184.stdout:new-kernel-pkg --remove 6.4.0-g84139c18d56f --rminitrd --initrdfile=/boot/initramfs-6.4.0-g84139c18d56f.img 2023-07-09T21:30:42.241 INFO:teuthology.orchestra.run.smithi184.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-09T21:30:42.241 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-install remove 6.4.0-g84139c18d56f 2023-07-09T21:30:42.242 INFO:teuthology.orchestra.run.smithi184.stdout:fi 2023-07-09T21:30:42.242 INFO:teuthology.orchestra.run.smithi184.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-09T21:30:42.242 INFO:teuthology.orchestra.run.smithi184.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-09T21:30:42.242 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/update-bootloader --remove 6.4.0-g84139c18d56f 2023-07-09T21:30:42.242 INFO:teuthology.orchestra.run.smithi184.stdout:fi 2023-07-09T21:30:42.243 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -qi grub2-tools 2023-07-09T21:30:42.341 INFO:teuthology.orchestra.run.smithi184.stdout:Name : grub2-tools 2023-07-09T21:30:42.341 INFO:teuthology.orchestra.run.smithi184.stdout:Epoch : 1 2023-07-09T21:30:42.341 INFO:teuthology.orchestra.run.smithi184.stdout:Version : 2.02 2023-07-09T21:30:42.341 INFO:teuthology.orchestra.run.smithi184.stdout:Release : 123.el8 2023-07-09T21:30:42.342 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: x86_64 2023-07-09T21:30:42.342 INFO:teuthology.orchestra.run.smithi184.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-07-09T21:30:42.342 INFO:teuthology.orchestra.run.smithi184.stdout:Group : System Environment/Base 2023-07-09T21:30:42.342 INFO:teuthology.orchestra.run.smithi184.stdout:Size : 9265450 2023-07-09T21:30:42.342 INFO:teuthology.orchestra.run.smithi184.stdout:License : GPLv3+ 2023-07-09T21:30:42.342 INFO:teuthology.orchestra.run.smithi184.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-07-09T21:30:42.342 INFO:teuthology.orchestra.run.smithi184.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-07-09T21:30:42.343 INFO:teuthology.orchestra.run.smithi184.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-07-09T21:30:42.343 INFO:teuthology.orchestra.run.smithi184.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-07-09T21:30:42.343 INFO:teuthology.orchestra.run.smithi184.stdout:Relocations : (not relocatable) 2023-07-09T21:30:42.343 INFO:teuthology.orchestra.run.smithi184.stdout:Packager : Red Hat, Inc. 2023-07-09T21:30:42.343 INFO:teuthology.orchestra.run.smithi184.stdout:Vendor : Red Hat, Inc. 2023-07-09T21:30:42.343 INFO:teuthology.orchestra.run.smithi184.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-09T21:30:42.343 INFO:teuthology.orchestra.run.smithi184.stdout:Summary : Support tools for GRUB. 2023-07-09T21:30:42.344 INFO:teuthology.orchestra.run.smithi184.stdout:Description : 2023-07-09T21:30:42.344 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:30:42.344 INFO:teuthology.orchestra.run.smithi184.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-09T21:30:42.344 INFO:teuthology.orchestra.run.smithi184.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-09T21:30:42.344 INFO:teuthology.orchestra.run.smithi184.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-09T21:30:42.344 INFO:teuthology.orchestra.run.smithi184.stdout:hardware devices. 2023-07-09T21:30:42.344 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:30:42.345 INFO:teuthology.orchestra.run.smithi184.stdout:This subpackage provides tools for support of all platforms. 2023-07-09T21:30:42.346 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-09T21:30:42.346 INFO:teuthology.task.kernel:Updating grub on smithi184 to boot 6.4.0-g84139c18d56f 2023-07-09T21:30:42.346 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-09T21:30:46.710 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2023-07-09T21:30:48.753 INFO:teuthology.orchestra.run.smithi184.stderr:done 2023-07-09T21:30:48.755 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-07-09T21:30:48.778 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.laVapmIvme 2023-07-09T21:30:48.778 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.laVapmIvme 2023-07-09T21:30:48.853 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.laVapmIvme 2023-07-09T21:30:49.001 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.laVapmIvme is 6KB 2023-07-09T21:30:49.048 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.laVapmIvme 2023-07-09T21:30:49.065 DEBUG:teuthology.orchestra.run.smithi184:> sudo /bin/ls /boot/loader/entries || true 2023-07-09T21:30:49.135 INFO:teuthology.orchestra.run.smithi184.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-07-09T21:30:49.135 INFO:teuthology.orchestra.run.smithi184.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-07-09T21:30:49.135 INFO:teuthology.orchestra.run.smithi184.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.4.0-g84139c18d56f.conf 2023-07-09T21:30:49.136 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.4.0-g84139c18d56f 2023-07-09T21:30:49.284 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2023-07-09T21:30:56.374 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-09T21:30:56.375 DEBUG:teuthology.orchestra.run.smithi053:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-09T21:30:56.438 INFO:teuthology.orchestra.run.smithi053.stdout:/boot/System.map-6.4.0-g84139c18d56f 2023-07-09T21:30:56.438 INFO:teuthology.orchestra.run.smithi053.stdout:/boot/config-6.4.0-g84139c18d56f 2023-07-09T21:30:56.439 INFO:teuthology.orchestra.run.smithi053.stdout:/boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T21:30:56.439 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f 2023-07-09T21:30:56.439 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel 2023-07-09T21:30:56.439 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch 2023-07-09T21:30:56.439 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86 2023-07-09T21:30:56.439 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto 2023-07-09T21:30:56.439 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-09T21:30:56.440 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-09T21:30:56.440 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-09T21:30:56.440 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-09T21:30:56.440 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-09T21:30:56.440 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-09T21:30:56.440 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-09T21:30:56.441 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-09T21:30:56.441 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-09T21:30:56.441 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-09T21:30:56.441 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-09T21:30:56.441 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-09T21:30:56.441 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-09T21:30:56.441 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-09T21:30:56.441 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-09T21:30:56.442 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-09T21:30:56.442 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-09T21:30:56.442 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-09T21:30:56.442 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-09T21:30:56.442 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-09T21:30:56.442 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel 2023-07-09T21:30:56.442 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu 2023-07-09T21:30:56.442 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce 2023-07-09T21:30:56.443 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-09T21:30:56.443 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm 2023-07-09T21:30:56.443 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-09T21:30:56.443 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-09T21:30:56.443 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-09T21:30:56.443 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto 2023-07-09T21:30:56.443 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-09T21:30:56.444 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-09T21:30:56.444 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-09T21:30:56.444 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx 2023-07-09T21:30:56.444 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-09T21:30:56.444 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-09T21:30:56.444 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-09T21:30:56.445 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-09T21:30:56.445 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-09T21:30:56.445 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-09T21:30:56.445 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-09T21:30:56.445 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-09T21:30:56.445 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-09T21:30:56.445 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-09T21:30:56.446 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-09T21:30:56.446 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-09T21:30:56.446 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-09T21:30:56.446 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-09T21:30:56.446 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-09T21:30:56.446 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-09T21:30:56.446 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-09T21:30:56.446 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-09T21:30:56.447 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-09T21:30:56.447 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-09T21:30:56.447 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-09T21:30:56.447 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-09T21:30:56.447 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-09T21:30:56.447 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-09T21:30:56.447 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-09T21:30:56.447 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-09T21:30:56.448 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-09T21:30:56.448 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-09T21:30:56.448 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-09T21:30:56.448 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-09T21:30:56.448 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-09T21:30:56.448 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-09T21:30:56.448 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-09T21:30:56.449 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-09T21:30:56.449 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-09T21:30:56.449 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-09T21:30:56.449 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-09T21:30:56.449 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-09T21:30:56.449 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-09T21:30:56.449 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-09T21:30:56.449 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-09T21:30:56.450 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-09T21:30:56.450 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-09T21:30:56.450 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-09T21:30:56.450 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-09T21:30:56.450 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers 2023-07-09T21:30:56.450 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi 2023-07-09T21:30:56.450 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-09T21:30:56.451 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-09T21:30:56.451 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/custom_method.ko 2023-07-09T21:30:56.451 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-09T21:30:56.451 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-09T21:30:56.451 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-09T21:30:56.451 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-09T21:30:56.451 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-09T21:30:56.451 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata 2023-07-09T21:30:56.452 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-09T21:30:56.452 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-09T21:30:56.452 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ata_generic.ko 2023-07-09T21:30:56.452 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-09T21:30:56.452 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-09T21:30:56.452 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-09T21:30:56.452 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-09T21:30:56.453 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-09T21:30:56.453 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-09T21:30:56.453 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-09T21:30:56.453 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-09T21:30:56.453 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-09T21:30:56.453 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-09T21:30:56.453 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-09T21:30:56.454 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-09T21:30:56.454 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-09T21:30:56.454 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-09T21:30:56.454 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-09T21:30:56.454 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-09T21:30:56.454 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-09T21:30:56.454 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-09T21:30:56.454 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-09T21:30:56.455 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-09T21:30:56.455 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-09T21:30:56.455 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-09T21:30:56.455 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-09T21:30:56.455 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-09T21:30:56.455 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-09T21:30:56.455 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-09T21:30:56.455 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-09T21:30:56.456 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-09T21:30:56.456 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-09T21:30:56.456 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-09T21:30:56.456 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-09T21:30:56.456 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-09T21:30:56.456 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-09T21:30:56.456 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-09T21:30:56.457 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-09T21:30:56.457 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sis.ko 2023-07-09T21:30:56.457 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-09T21:30:56.457 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-09T21:30:56.457 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-09T21:30:56.457 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-09T21:30:56.457 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-09T21:30:56.458 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-09T21:30:56.458 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-09T21:30:56.458 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-09T21:30:56.458 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-09T21:30:56.458 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-09T21:30:56.458 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-09T21:30:56.458 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-09T21:30:56.458 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-09T21:30:56.459 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-09T21:30:56.459 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-09T21:30:56.459 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-09T21:30:56.459 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-09T21:30:56.459 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay 2023-07-09T21:30:56.459 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-09T21:30:56.459 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base 2023-07-09T21:30:56.459 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap 2023-07-09T21:30:56.460 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-09T21:30:56.460 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma 2023-07-09T21:30:56.460 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-09T21:30:56.460 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block 2023-07-09T21:30:56.460 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe 2023-07-09T21:30:56.460 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-09T21:30:56.460 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/brd.ko 2023-07-09T21:30:56.461 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd 2023-07-09T21:30:56.461 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-09T21:30:56.461 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-09T21:30:56.461 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/loop.ko 2023-07-09T21:30:56.461 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx 2023-07-09T21:30:56.461 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-09T21:30:56.461 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-09T21:30:56.461 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk 2023-07-09T21:30:56.462 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-09T21:30:56.462 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-09T21:30:56.462 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-09T21:30:56.462 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/virtio_blk.ko 2023-07-09T21:30:56.462 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback 2023-07-09T21:30:56.462 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-09T21:30:56.462 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkfront.ko 2023-07-09T21:30:56.462 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram 2023-07-09T21:30:56.463 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-09T21:30:56.463 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char 2023-07-09T21:30:56.463 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-09T21:30:56.463 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random 2023-07-09T21:30:56.463 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-09T21:30:56.463 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-09T21:30:56.463 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-09T21:30:56.463 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-09T21:30:56.464 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-09T21:30:56.464 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi 2023-07-09T21:30:56.464 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-09T21:30:56.464 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-09T21:30:56.464 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-09T21:30:56.464 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-09T21:30:56.464 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-09T21:30:56.465 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-09T21:30:56.465 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-09T21:30:56.465 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave 2023-07-09T21:30:56.465 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-09T21:30:56.465 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-09T21:30:56.465 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-09T21:30:56.465 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm 2023-07-09T21:30:56.466 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm.ko 2023-07-09T21:30:56.466 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-09T21:30:56.466 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-09T21:30:56.466 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-09T21:30:56.466 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-09T21:30:56.466 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-09T21:30:56.466 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/uv_mmtimer.ko 2023-07-09T21:30:56.466 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/virtio_console.ko 2023-07-09T21:30:56.467 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq 2023-07-09T21:30:56.467 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-09T21:30:56.467 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-09T21:30:56.467 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-09T21:30:56.467 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-09T21:30:56.467 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-09T21:30:56.467 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-09T21:30:56.468 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto 2023-07-09T21:30:56.468 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp 2023-07-09T21:30:56.468 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-09T21:30:56.468 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-09T21:30:56.468 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel 2023-07-09T21:30:56.468 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat 2023-07-09T21:30:56.468 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common 2023-07-09T21:30:56.469 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-09T21:30:56.469 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-09T21:30:56.469 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-09T21:30:56.469 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-09T21:30:56.469 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-09T21:30:56.469 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio 2023-07-09T21:30:56.469 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-09T21:30:56.470 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca 2023-07-09T21:30:56.470 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-09T21:30:56.470 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq 2023-07-09T21:30:56.470 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-09T21:30:56.470 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma 2023-07-09T21:30:56.470 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw 2023-07-09T21:30:56.470 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-09T21:30:56.471 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat 2023-07-09T21:30:56.471 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-09T21:30:56.471 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac 2023-07-09T21:30:56.471 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-09T21:30:56.471 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-09T21:30:56.471 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-09T21:30:56.471 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-09T21:30:56.471 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-09T21:30:56.472 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-09T21:30:56.472 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-09T21:30:56.472 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-09T21:30:56.472 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-09T21:30:56.472 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-09T21:30:56.472 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-09T21:30:56.473 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-09T21:30:56.473 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-09T21:30:56.473 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware 2023-07-09T21:30:56.473 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/edd.ko 2023-07-09T21:30:56.473 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-09T21:30:56.473 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio 2023-07-09T21:30:56.473 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-09T21:30:56.473 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-09T21:30:56.474 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid 2023-07-09T21:30:56.474 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-09T21:30:56.474 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-09T21:30:56.474 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-09T21:30:56.474 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-09T21:30:56.474 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-09T21:30:56.474 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-09T21:30:56.475 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-09T21:30:56.475 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-09T21:30:56.475 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-09T21:30:56.475 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-09T21:30:56.475 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-09T21:30:56.475 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-09T21:30:56.475 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-09T21:30:56.475 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-09T21:30:56.476 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-09T21:30:56.476 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-09T21:30:56.476 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-09T21:30:56.476 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-09T21:30:56.476 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-09T21:30:56.476 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-09T21:30:56.476 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-09T21:30:56.476 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-09T21:30:56.477 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-09T21:30:56.477 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-09T21:30:56.477 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-09T21:30:56.477 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-09T21:30:56.477 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-09T21:30:56.477 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-09T21:30:56.477 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-09T21:30:56.478 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-09T21:30:56.478 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-09T21:30:56.478 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-09T21:30:56.478 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-09T21:30:56.478 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-09T21:30:56.478 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-09T21:30:56.478 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-09T21:30:56.478 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-09T21:30:56.479 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-09T21:30:56.479 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-09T21:30:56.479 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-09T21:30:56.479 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-09T21:30:56.479 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-09T21:30:56.479 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-09T21:30:56.479 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-09T21:30:56.479 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-09T21:30:56.480 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-09T21:30:56.480 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-09T21:30:56.480 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-09T21:30:56.480 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-09T21:30:56.480 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-09T21:30:56.480 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-09T21:30:56.480 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-09T21:30:56.481 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-09T21:30:56.481 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-09T21:30:56.481 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-09T21:30:56.481 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-09T21:30:56.481 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-09T21:30:56.481 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-09T21:30:56.481 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-09T21:30:56.482 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-09T21:30:56.482 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-09T21:30:56.482 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-09T21:30:56.482 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-09T21:30:56.482 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-09T21:30:56.482 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv 2023-07-09T21:30:56.482 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-09T21:30:56.483 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-09T21:30:56.483 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-09T21:30:56.483 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon 2023-07-09T21:30:56.483 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-09T21:30:56.483 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-09T21:30:56.484 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-09T21:30:56.484 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-09T21:30:56.484 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-09T21:30:56.484 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-09T21:30:56.484 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-09T21:30:56.484 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-09T21:30:56.485 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-09T21:30:56.485 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-09T21:30:56.485 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-09T21:30:56.485 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-09T21:30:56.486 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-09T21:30:56.486 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-09T21:30:56.486 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-09T21:30:56.486 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-09T21:30:56.487 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-09T21:30:56.487 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-09T21:30:56.487 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-09T21:30:56.487 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-09T21:30:56.488 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-09T21:30:56.488 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-09T21:30:56.488 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-09T21:30:56.489 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-09T21:30:56.489 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-09T21:30:56.489 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-09T21:30:56.489 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-09T21:30:56.490 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-09T21:30:56.490 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-09T21:30:56.490 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-09T21:30:56.490 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-09T21:30:56.491 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-09T21:30:56.491 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-09T21:30:56.491 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-09T21:30:56.491 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-09T21:30:56.491 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-09T21:30:56.491 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-09T21:30:56.492 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-09T21:30:56.492 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-09T21:30:56.492 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-09T21:30:56.492 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-09T21:30:56.492 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-09T21:30:56.492 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-09T21:30:56.492 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-09T21:30:56.493 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-09T21:30:56.493 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-09T21:30:56.493 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-09T21:30:56.493 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-09T21:30:56.493 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-09T21:30:56.493 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-09T21:30:56.493 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-09T21:30:56.494 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-09T21:30:56.494 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-09T21:30:56.494 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-09T21:30:56.494 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-09T21:30:56.494 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-09T21:30:56.494 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-09T21:30:56.494 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-09T21:30:56.494 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-09T21:30:56.495 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-09T21:30:56.495 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-09T21:30:56.495 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-09T21:30:56.495 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-09T21:30:56.495 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-09T21:30:56.495 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-09T21:30:56.495 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-09T21:30:56.495 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-09T21:30:56.496 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-09T21:30:56.496 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-09T21:30:56.496 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-09T21:30:56.496 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-09T21:30:56.496 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-09T21:30:56.496 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-09T21:30:56.496 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-09T21:30:56.497 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-09T21:30:56.497 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-09T21:30:56.497 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-09T21:30:56.497 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-09T21:30:56.497 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-09T21:30:56.497 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-09T21:30:56.497 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-09T21:30:56.497 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-09T21:30:56.498 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-09T21:30:56.498 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-09T21:30:56.498 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-09T21:30:56.498 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-09T21:30:56.498 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-09T21:30:56.499 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-09T21:30:56.500 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus 2023-07-09T21:30:56.500 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-09T21:30:56.500 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-09T21:30:56.500 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-09T21:30:56.500 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-09T21:30:56.500 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-09T21:30:56.500 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-09T21:30:56.501 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-09T21:30:56.501 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-09T21:30:56.501 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-09T21:30:56.501 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-09T21:30:56.501 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-09T21:30:56.501 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-09T21:30:56.501 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-09T21:30:56.501 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-09T21:30:56.502 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-09T21:30:56.502 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-09T21:30:56.502 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-09T21:30:56.502 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-09T21:30:56.502 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-09T21:30:56.502 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-09T21:30:56.502 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-09T21:30:56.503 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-09T21:30:56.503 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-09T21:30:56.503 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-09T21:30:56.503 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-09T21:30:56.503 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-09T21:30:56.503 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-09T21:30:56.503 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-09T21:30:56.503 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-09T21:30:56.504 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-09T21:30:56.504 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-09T21:30:56.504 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-09T21:30:56.504 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-09T21:30:56.504 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-09T21:30:56.504 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-09T21:30:56.504 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-09T21:30:56.505 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-09T21:30:56.505 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-09T21:30:56.505 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-09T21:30:56.505 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-09T21:30:56.505 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-09T21:30:56.505 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c 2023-07-09T21:30:56.505 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos 2023-07-09T21:30:56.505 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-09T21:30:56.506 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-09T21:30:56.506 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses 2023-07-09T21:30:56.506 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-09T21:30:56.506 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-09T21:30:56.506 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-09T21:30:56.506 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-09T21:30:56.506 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-09T21:30:56.506 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-09T21:30:56.507 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-09T21:30:56.507 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-09T21:30:56.507 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-09T21:30:56.507 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-09T21:30:56.507 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-09T21:30:56.507 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-09T21:30:56.507 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-09T21:30:56.507 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-09T21:30:56.508 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-09T21:30:56.508 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-09T21:30:56.508 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-09T21:30:56.508 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-09T21:30:56.508 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-09T21:30:56.508 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-09T21:30:56.509 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-09T21:30:56.509 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-09T21:30:56.509 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-09T21:30:56.509 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-dev.ko 2023-07-09T21:30:56.509 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-09T21:30:56.509 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-09T21:30:56.509 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-09T21:30:56.509 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-09T21:30:56.510 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband 2023-07-09T21:30:56.510 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core 2023-07-09T21:30:56.510 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-09T21:30:56.510 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-09T21:30:56.510 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-09T21:30:56.510 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-09T21:30:56.510 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-09T21:30:56.510 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-09T21:30:56.511 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-09T21:30:56.511 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw 2023-07-09T21:30:56.511 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4 2023-07-09T21:30:56.511 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-09T21:30:56.511 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4 2023-07-09T21:30:56.511 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-09T21:30:56.511 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5 2023-07-09T21:30:56.512 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-09T21:30:56.512 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca 2023-07-09T21:30:56.512 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-09T21:30:56.512 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp 2023-07-09T21:30:56.512 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib 2023-07-09T21:30:56.512 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-09T21:30:56.512 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser 2023-07-09T21:30:56.512 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-09T21:30:56.513 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert 2023-07-09T21:30:56.513 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-09T21:30:56.513 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp 2023-07-09T21:30:56.513 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-09T21:30:56.513 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt 2023-07-09T21:30:56.513 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-09T21:30:56.513 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input 2023-07-09T21:30:56.513 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport 2023-07-09T21:30:56.514 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-09T21:30:56.514 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-09T21:30:56.514 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-09T21:30:56.514 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-09T21:30:56.514 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-09T21:30:56.514 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-09T21:30:56.514 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard 2023-07-09T21:30:56.515 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-09T21:30:56.515 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse 2023-07-09T21:30:56.515 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-09T21:30:56.515 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-09T21:30:56.515 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-09T21:30:56.515 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-09T21:30:56.515 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-09T21:30:56.515 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-09T21:30:56.516 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-09T21:30:56.516 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-09T21:30:56.516 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4 2023-07-09T21:30:56.516 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-09T21:30:56.516 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio 2023-07-09T21:30:56.516 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-09T21:30:56.516 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-09T21:30:56.516 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-09T21:30:56.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-09T21:30:56.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-09T21:30:56.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu 2023-07-09T21:30:56.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd 2023-07-09T21:30:56.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-09T21:30:56.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds 2023-07-09T21:30:56.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-09T21:30:56.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-09T21:30:56.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-09T21:30:56.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-09T21:30:56.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger 2023-07-09T21:30:56.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-09T21:30:56.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-09T21:30:56.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-09T21:30:56.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-09T21:30:56.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-09T21:30:56.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-09T21:30:56.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-09T21:30:56.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-09T21:30:56.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md 2023-07-09T21:30:56.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache 2023-07-09T21:30:56.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-09T21:30:56.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-09T21:30:56.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-09T21:30:56.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-09T21:30:56.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-09T21:30:56.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-09T21:30:56.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-09T21:30:56.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-09T21:30:56.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-09T21:30:56.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-09T21:30:56.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-09T21:30:56.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-09T21:30:56.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-09T21:30:56.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-09T21:30:56.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-09T21:30:56.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-09T21:30:56.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-09T21:30:56.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-09T21:30:56.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-09T21:30:56.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data 2023-07-09T21:30:56.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-09T21:30:56.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-09T21:30:56.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-09T21:30:56.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-09T21:30:56.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-09T21:30:56.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message 2023-07-09T21:30:56.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion 2023-07-09T21:30:56.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-09T21:30:56.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-09T21:30:56.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-09T21:30:56.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-09T21:30:56.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-09T21:30:56.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-09T21:30:56.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-09T21:30:56.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd 2023-07-09T21:30:56.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-09T21:30:56.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-09T21:30:56.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mfd-core.ko 2023-07-09T21:30:56.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-09T21:30:56.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-09T21:30:56.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-09T21:30:56.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-09T21:30:56.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc 2023-07-09T21:30:56.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl 2023-07-09T21:30:56.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-09T21:30:56.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-09T21:30:56.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-09T21:30:56.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-09T21:30:56.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710 2023-07-09T21:30:56.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-09T21:30:56.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom 2023-07-09T21:30:56.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-09T21:30:56.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-09T21:30:56.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-09T21:30:56.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-09T21:30:56.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-09T21:30:56.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-09T21:30:56.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-09T21:30:56.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-09T21:30:56.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d 2023-07-09T21:30:56.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-09T21:30:56.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-09T21:30:56.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei 2023-07-09T21:30:56.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-09T21:30:56.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-09T21:30:56.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-09T21:30:56.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru 2023-07-09T21:30:56.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-09T21:30:56.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp 2023-07-09T21:30:56.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-09T21:30:56.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-09T21:30:56.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-09T21:30:56.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-09T21:30:56.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-09T21:30:56.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-09T21:30:56.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-09T21:30:56.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci 2023-07-09T21:30:56.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-09T21:30:56.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net 2023-07-09T21:30:56.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding 2023-07-09T21:30:56.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-09T21:30:56.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa 2023-07-09T21:30:56.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53 2023-07-09T21:30:56.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-09T21:30:56.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-09T21:30:56.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-09T21:30:56.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx 2023-07-09T21:30:56.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-09T21:30:56.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-09T21:30:56.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-09T21:30:56.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet 2023-07-09T21:30:56.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com 2023-07-09T21:30:56.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-09T21:30:56.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-09T21:30:56.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-09T21:30:56.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-09T21:30:56.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390 2023-07-09T21:30:56.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-09T21:30:56.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-09T21:30:56.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-09T21:30:56.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-09T21:30:56.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec 2023-07-09T21:30:56.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-09T21:30:56.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere 2023-07-09T21:30:56.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-09T21:30:56.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon 2023-07-09T21:30:56.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-09T21:30:56.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera 2023-07-09T21:30:56.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-09T21:30:56.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd 2023-07-09T21:30:56.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-09T21:30:56.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-09T21:30:56.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-09T21:30:56.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros 2023-07-09T21:30:56.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx 2023-07-09T21:30:56.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-09T21:30:56.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-09T21:30:56.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-09T21:30:56.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-09T21:30:56.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-09T21:30:56.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx 2023-07-09T21:30:56.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-09T21:30:56.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-09T21:30:56.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom 2023-07-09T21:30:56.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-09T21:30:56.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-09T21:30:56.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-09T21:30:56.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-09T21:30:56.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-09T21:30:56.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet 2023-07-09T21:30:56.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-09T21:30:56.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-09T21:30:56.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade 2023-07-09T21:30:56.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna 2023-07-09T21:30:56.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-09T21:30:56.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio 2023-07-09T21:30:56.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-09T21:30:56.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-09T21:30:56.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-09T21:30:56.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-09T21:30:56.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-09T21:30:56.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-09T21:30:56.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-09T21:30:56.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-09T21:30:56.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-09T21:30:56.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-09T21:30:56.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco 2023-07-09T21:30:56.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic 2023-07-09T21:30:56.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-09T21:30:56.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec 2023-07-09T21:30:56.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip 2023-07-09T21:30:56.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-09T21:30:56.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-09T21:30:56.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-09T21:30:56.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-09T21:30:56.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-09T21:30:56.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-09T21:30:56.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink 2023-07-09T21:30:56.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-09T21:30:56.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-09T21:30:56.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-09T21:30:56.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex 2023-07-09T21:30:56.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet 2023-07-09T21:30:56.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-09T21:30:56.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-09T21:30:56.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-09T21:30:56.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel 2023-07-09T21:30:56.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-09T21:30:56.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000 2023-07-09T21:30:56.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-09T21:30:56.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e 2023-07-09T21:30:56.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-09T21:30:56.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k 2023-07-09T21:30:56.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-09T21:30:56.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e 2023-07-09T21:30:56.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-09T21:30:56.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf 2023-07-09T21:30:56.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-09T21:30:56.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb 2023-07-09T21:30:56.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-09T21:30:56.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf 2023-07-09T21:30:56.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-09T21:30:56.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-09T21:30:56.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-09T21:30:56.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-09T21:30:56.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-09T21:30:56.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-09T21:30:56.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell 2023-07-09T21:30:56.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-09T21:30:56.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-09T21:30:56.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-09T21:30:56.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox 2023-07-09T21:30:56.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-09T21:30:56.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-09T21:30:56.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-09T21:30:56.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-09T21:30:56.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-09T21:30:56.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-09T21:30:56.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel 2023-07-09T21:30:56.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-09T21:30:56.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom 2023-07-09T21:30:56.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-09T21:30:56.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-09T21:30:56.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi 2023-07-09T21:30:56.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-09T21:30:56.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-09T21:30:56.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion 2023-07-09T21:30:56.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-09T21:30:56.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia 2023-07-09T21:30:56.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-09T21:30:56.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines 2023-07-09T21:30:56.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-09T21:30:56.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-09T21:30:56.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic 2023-07-09T21:30:56.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-09T21:30:56.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-09T21:30:56.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-09T21:30:56.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-09T21:30:56.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-09T21:30:56.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc 2023-07-09T21:30:56.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-09T21:30:56.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek 2023-07-09T21:30:56.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-09T21:30:56.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-09T21:30:56.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-09T21:30:56.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-09T21:30:56.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker 2023-07-09T21:30:56.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-09T21:30:56.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc 2023-07-09T21:30:56.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-09T21:30:56.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan 2023-07-09T21:30:56.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-09T21:30:56.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis 2023-07-09T21:30:56.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-09T21:30:56.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-09T21:30:56.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc 2023-07-09T21:30:56.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-09T21:30:56.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-09T21:30:56.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-09T21:30:56.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-09T21:30:56.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro 2023-07-09T21:30:56.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-09T21:30:56.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-09T21:30:56.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-09T21:30:56.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun 2023-07-09T21:30:56.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-09T21:30:56.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-09T21:30:56.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-09T21:30:56.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-09T21:30:56.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti 2023-07-09T21:30:56.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-09T21:30:56.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti 2023-07-09T21:30:56.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-09T21:30:56.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via 2023-07-09T21:30:56.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-09T21:30:56.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-09T21:30:56.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet 2023-07-09T21:30:56.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-09T21:30:56.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-09T21:30:56.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom 2023-07-09T21:30:56.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-09T21:30:56.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-09T21:30:56.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv 2023-07-09T21:30:56.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-09T21:30:56.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154 2023-07-09T21:30:56.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-09T21:30:56.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-09T21:30:56.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan 2023-07-09T21:30:56.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-09T21:30:56.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-09T21:30:56.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-09T21:30:56.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio 2023-07-09T21:30:56.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-09T21:30:56.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-09T21:30:56.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-09T21:30:56.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-09T21:30:56.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/net_failover.ko 2023-07-09T21:30:56.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-09T21:30:56.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-09T21:30:56.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs 2023-07-09T21:30:56.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-09T21:30:56.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-09T21:30:56.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy 2023-07-09T21:30:56.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-09T21:30:56.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-09T21:30:56.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-09T21:30:56.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-09T21:30:56.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-09T21:30:56.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-09T21:30:56.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-09T21:30:56.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-09T21:30:56.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/dp83640.ko 2023-07-09T21:30:56.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-09T21:30:56.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-09T21:30:56.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-09T21:30:56.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-09T21:30:56.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-09T21:30:56.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-09T21:30:56.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-09T21:30:56.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-09T21:30:56.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-09T21:30:56.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-09T21:30:56.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-09T21:30:56.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-09T21:30:56.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp 2023-07-09T21:30:56.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-09T21:30:56.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-09T21:30:56.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-09T21:30:56.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-09T21:30:56.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-09T21:30:56.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-09T21:30:56.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-09T21:30:56.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-09T21:30:56.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-09T21:30:56.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip 2023-07-09T21:30:56.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slhc.ko 2023-07-09T21:30:56.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-09T21:30:56.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-09T21:30:56.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-09T21:30:56.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team 2023-07-09T21:30:56.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-09T21:30:56.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-09T21:30:56.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-09T21:30:56.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-09T21:30:56.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-09T21:30:56.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-09T21:30:56.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tun.ko 2023-07-09T21:30:56.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-09T21:30:56.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/virtio_net.ko 2023-07-09T21:30:56.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3 2023-07-09T21:30:56.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-09T21:30:56.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan 2023-07-09T21:30:56.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-09T21:30:56.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback 2023-07-09T21:30:56.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-09T21:30:56.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netfront.ko 2023-07-09T21:30:56.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb 2023-07-09T21:30:56.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-09T21:30:56.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme 2023-07-09T21:30:56.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host 2023-07-09T21:30:56.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-09T21:30:56.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-09T21:30:56.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport 2023-07-09T21:30:56.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-09T21:30:56.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-09T21:30:56.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-09T21:30:56.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-09T21:30:56.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci 2023-07-09T21:30:56.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug 2023-07-09T21:30:56.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-09T21:30:56.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie 2023-07-09T21:30:56.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-09T21:30:56.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-09T21:30:56.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia 2023-07-09T21:30:56.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-09T21:30:56.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-09T21:30:56.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-09T21:30:56.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl 2023-07-09T21:30:56.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel 2023-07-09T21:30:56.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-09T21:30:56.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform 2023-07-09T21:30:56.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86 2023-07-09T21:30:56.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-09T21:30:56.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-09T21:30:56.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-09T21:30:56.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-09T21:30:56.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-09T21:30:56.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-09T21:30:56.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-09T21:30:56.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-09T21:30:56.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-09T21:30:56.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-09T21:30:56.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-09T21:30:56.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-09T21:30:56.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel 2023-07-09T21:30:56.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-09T21:30:56.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-09T21:30:56.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-09T21:30:56.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-09T21:30:56.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-09T21:30:56.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-09T21:30:56.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-09T21:30:56.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-09T21:30:56.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-09T21:30:56.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-09T21:30:56.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-09T21:30:56.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-09T21:30:56.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap 2023-07-09T21:30:56.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-09T21:30:56.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-09T21:30:56.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps 2023-07-09T21:30:56.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients 2023-07-09T21:30:56.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-09T21:30:56.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-09T21:30:56.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-09T21:30:56.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-09T21:30:56.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp 2023-07-09T21:30:56.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-09T21:30:56.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-09T21:30:56.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc 2023-07-09T21:30:56.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-09T21:30:56.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-09T21:30:56.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-09T21:30:56.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-09T21:30:56.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-09T21:30:56.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-09T21:30:56.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-09T21:30:56.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-09T21:30:56.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-09T21:30:56.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-09T21:30:56.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-09T21:30:56.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-09T21:30:56.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-09T21:30:56.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-09T21:30:56.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-09T21:30:56.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-09T21:30:56.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-09T21:30:56.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-09T21:30:56.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-09T21:30:56.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-09T21:30:56.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-09T21:30:56.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-09T21:30:56.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-09T21:30:56.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-09T21:30:56.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-09T21:30:56.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-09T21:30:56.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-09T21:30:56.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-09T21:30:56.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-09T21:30:56.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-09T21:30:56.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-09T21:30:56.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-09T21:30:56.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi 2023-07-09T21:30:56.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-09T21:30:56.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-09T21:30:56.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-09T21:30:56.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-09T21:30:56.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-09T21:30:56.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid 2023-07-09T21:30:56.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-09T21:30:56.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-09T21:30:56.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx 2023-07-09T21:30:56.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-09T21:30:56.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-09T21:30:56.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-09T21:30:56.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr 2023-07-09T21:30:56.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-09T21:30:56.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-09T21:30:56.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi 2023-07-09T21:30:56.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-09T21:30:56.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa 2023-07-09T21:30:56.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-09T21:30:56.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc 2023-07-09T21:30:56.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-09T21:30:56.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i 2023-07-09T21:30:56.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-09T21:30:56.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-09T21:30:56.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor 2023-07-09T21:30:56.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-09T21:30:56.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi 2023-07-09T21:30:56.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-09T21:30:56.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-09T21:30:56.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-09T21:30:56.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-09T21:30:56.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-09T21:30:56.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-09T21:30:56.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler 2023-07-09T21:30:56.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-09T21:30:56.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-09T21:30:56.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-09T21:30:56.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-09T21:30:56.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-09T21:30:56.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r 2023-07-09T21:30:56.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-09T21:30:56.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-09T21:30:56.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe 2023-07-09T21:30:56.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-09T21:30:56.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-09T21:30:56.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic 2023-07-09T21:30:56.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-09T21:30:56.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-09T21:30:56.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-09T21:30:56.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-09T21:30:56.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-09T21:30:56.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-09T21:30:56.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-09T21:30:56.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci 2023-07-09T21:30:56.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-09T21:30:56.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-09T21:30:56.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-09T21:30:56.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc 2023-07-09T21:30:56.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-09T21:30:56.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-09T21:30:56.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-09T21:30:56.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas 2023-07-09T21:30:56.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-09T21:30:56.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc 2023-07-09T21:30:56.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-09T21:30:56.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid 2023-07-09T21:30:56.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-09T21:30:56.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-09T21:30:56.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-09T21:30:56.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-09T21:30:56.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas 2023-07-09T21:30:56.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-09T21:30:56.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas 2023-07-09T21:30:56.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-09T21:30:56.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-09T21:30:56.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001 2023-07-09T21:30:56.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-09T21:30:56.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-09T21:30:56.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-09T21:30:56.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx 2023-07-09T21:30:56.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-09T21:30:56.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-09T21:30:56.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx 2023-07-09T21:30:56.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-09T21:30:56.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-09T21:30:56.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-09T21:30:56.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-09T21:30:56.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-09T21:30:56.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-09T21:30:56.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-09T21:30:56.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-09T21:30:56.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-09T21:30:56.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-09T21:30:56.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-09T21:30:56.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2 2023-07-09T21:30:56.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-09T21:30:56.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-09T21:30:56.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-09T21:30:56.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-09T21:30:56.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb 2023-07-09T21:30:56.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-09T21:30:56.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target 2023-07-09T21:30:56.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi 2023-07-09T21:30:56.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-09T21:30:56.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback 2023-07-09T21:30:56.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-09T21:30:56.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-09T21:30:56.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-09T21:30:56.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-09T21:30:56.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-09T21:30:56.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-09T21:30:56.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc 2023-07-09T21:30:56.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-09T21:30:56.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal 2023-07-09T21:30:56.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel 2023-07-09T21:30:56.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal 2023-07-09T21:30:56.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-09T21:30:56.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-09T21:30:56.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-09T21:30:56.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-09T21:30:56.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-09T21:30:56.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-09T21:30:56.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-09T21:30:56.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-09T21:30:56.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-09T21:30:56.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-09T21:30:56.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-09T21:30:56.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-09T21:30:56.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-09T21:30:56.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-09T21:30:56.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-09T21:30:56.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty 2023-07-09T21:30:56.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless 2023-07-09T21:30:56.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-09T21:30:56.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-09T21:30:56.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-09T21:30:56.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-09T21:30:56.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial 2023-07-09T21:30:56.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250 2023-07-09T21:30:56.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-09T21:30:56.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-09T21:30:56.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm 2023-07-09T21:30:56.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-09T21:30:56.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-09T21:30:56.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs 2023-07-09T21:30:56.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core 2023-07-09T21:30:56.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-09T21:30:56.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host 2023-07-09T21:30:56.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-09T21:30:56.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio 2023-07-09T21:30:56.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-09T21:30:56.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-09T21:30:56.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-09T21:30:56.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-09T21:30:56.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-09T21:30:56.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb 2023-07-09T21:30:56.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class 2023-07-09T21:30:56.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-09T21:30:56.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-09T21:30:56.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-09T21:30:56.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-09T21:30:56.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host 2023-07-09T21:30:56.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-09T21:30:56.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image 2023-07-09T21:30:56.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-09T21:30:56.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-09T21:30:56.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc 2023-07-09T21:30:56.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-09T21:30:56.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-09T21:30:56.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-09T21:30:56.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-09T21:30:56.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-09T21:30:56.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-09T21:30:56.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-09T21:30:56.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-09T21:30:56.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-09T21:30:56.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-09T21:30:56.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga 2023-07-09T21:30:56.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-09T21:30:56.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-09T21:30:56.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-09T21:30:56.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-09T21:30:56.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-09T21:30:56.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-09T21:30:56.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-09T21:30:56.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy 2023-07-09T21:30:56.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-09T21:30:56.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial 2023-07-09T21:30:56.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-09T21:30:56.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-09T21:30:56.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-09T21:30:56.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-09T21:30:56.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-09T21:30:56.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-09T21:30:56.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-09T21:30:56.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-09T21:30:56.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-09T21:30:56.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-09T21:30:56.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-09T21:30:56.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-09T21:30:56.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-09T21:30:56.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-09T21:30:56.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-09T21:30:56.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-09T21:30:56.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-09T21:30:56.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-09T21:30:56.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-09T21:30:56.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-09T21:30:56.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-09T21:30:56.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-09T21:30:56.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-09T21:30:56.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-09T21:30:56.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-09T21:30:56.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-09T21:30:56.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-09T21:30:56.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-09T21:30:56.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-09T21:30:56.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-09T21:30:56.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-09T21:30:56.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-09T21:30:56.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-09T21:30:56.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-09T21:30:56.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-09T21:30:56.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-09T21:30:56.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-09T21:30:56.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-09T21:30:56.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-09T21:30:56.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-09T21:30:56.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-09T21:30:56.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-09T21:30:56.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-09T21:30:56.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-09T21:30:56.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-09T21:30:56.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage 2023-07-09T21:30:56.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-09T21:30:56.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-09T21:30:56.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-09T21:30:56.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-09T21:30:56.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-09T21:30:56.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-09T21:30:56.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-09T21:30:56.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-09T21:30:56.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-09T21:30:56.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-09T21:30:56.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-09T21:30:56.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-09T21:30:56.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-09T21:30:56.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-09T21:30:56.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-09T21:30:56.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip 2023-07-09T21:30:56.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-09T21:30:56.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-09T21:30:56.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-09T21:30:56.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio 2023-07-09T21:30:56.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci 2023-07-09T21:30:56.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-09T21:30:56.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-09T21:30:56.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-09T21:30:56.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-09T21:30:56.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost 2023-07-09T21:30:56.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-09T21:30:56.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-09T21:30:56.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-09T21:30:56.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-09T21:30:56.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video 2023-07-09T21:30:56.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight 2023-07-09T21:30:56.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-09T21:30:56.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-09T21:30:56.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-09T21:30:56.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio 2023-07-09T21:30:56.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio.ko 2023-07-09T21:30:56.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_balloon.ko 2023-07-09T21:30:56.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_mmio.ko 2023-07-09T21:30:56.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci.ko 2023-07-09T21:30:56.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-09T21:30:56.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-09T21:30:56.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_ring.ko 2023-07-09T21:30:56.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1 2023-07-09T21:30:56.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters 2023-07-09T21:30:56.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-09T21:30:56.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-09T21:30:56.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves 2023-07-09T21:30:56.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-09T21:30:56.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-09T21:30:56.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-09T21:30:56.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-09T21:30:56.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-09T21:30:56.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-09T21:30:56.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-09T21:30:56.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-09T21:30:56.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-09T21:30:56.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-09T21:30:56.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-09T21:30:56.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-09T21:30:56.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog 2023-07-09T21:30:56.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-09T21:30:56.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-09T21:30:56.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-09T21:30:56.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-09T21:30:56.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-09T21:30:56.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-09T21:30:56.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-09T21:30:56.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-09T21:30:56.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-09T21:30:56.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-09T21:30:56.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-09T21:30:56.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-09T21:30:56.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-09T21:30:56.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-09T21:30:56.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-09T21:30:56.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-09T21:30:56.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-09T21:30:56.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-09T21:30:56.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-09T21:30:56.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-09T21:30:56.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-09T21:30:56.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-09T21:30:56.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-09T21:30:56.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-09T21:30:56.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-09T21:30:56.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-09T21:30:56.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen 2023-07-09T21:30:56.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-09T21:30:56.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-09T21:30:56.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-09T21:30:56.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-09T21:30:56.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback 2023-07-09T21:30:56.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-09T21:30:56.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-09T21:30:56.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs 2023-07-09T21:30:56.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-09T21:30:56.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs 2023-07-09T21:30:56.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p 2023-07-09T21:30:56.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-09T21:30:56.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs 2023-07-09T21:30:56.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-09T21:30:56.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs 2023-07-09T21:30:56.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-09T21:30:56.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-09T21:30:56.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs 2023-07-09T21:30:56.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-09T21:30:56.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles 2023-07-09T21:30:56.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-09T21:30:56.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph 2023-07-09T21:30:56.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-09T21:30:56.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda 2023-07-09T21:30:56.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-09T21:30:56.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs 2023-07-09T21:30:56.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-09T21:30:56.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm 2023-07-09T21:30:56.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-09T21:30:56.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs 2023-07-09T21:30:56.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-09T21:30:56.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs 2023-07-09T21:30:56.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-09T21:30:56.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat 2023-07-09T21:30:56.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/fat.ko 2023-07-09T21:30:56.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-09T21:30:56.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/vfat.ko 2023-07-09T21:30:56.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache 2023-07-09T21:30:56.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-09T21:30:56.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse 2023-07-09T21:30:56.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-09T21:30:56.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/fuse.ko 2023-07-09T21:30:56.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2 2023-07-09T21:30:56.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-09T21:30:56.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs 2023-07-09T21:30:56.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-09T21:30:56.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus 2023-07-09T21:30:56.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-09T21:30:56.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs 2023-07-09T21:30:56.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-09T21:30:56.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs 2023-07-09T21:30:56.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-09T21:30:56.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd 2023-07-09T21:30:56.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-09T21:30:56.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix 2023-07-09T21:30:56.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-09T21:30:56.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs 2023-07-09T21:30:56.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-09T21:30:56.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs 2023-07-09T21:30:56.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout 2023-07-09T21:30:56.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-09T21:30:56.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout 2023-07-09T21:30:56.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-09T21:30:56.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout 2023-07-09T21:30:56.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-09T21:30:56.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-09T21:30:56.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-09T21:30:56.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-09T21:30:56.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common 2023-07-09T21:30:56.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-09T21:30:56.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-09T21:30:56.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd 2023-07-09T21:30:56.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-09T21:30:56.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2 2023-07-09T21:30:56.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-09T21:30:56.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls 2023-07-09T21:30:56.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-09T21:30:56.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-09T21:30:56.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-09T21:30:56.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-09T21:30:56.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-09T21:30:56.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-09T21:30:56.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-09T21:30:56.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-09T21:30:56.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-09T21:30:56.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-09T21:30:56.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-09T21:30:56.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-09T21:30:56.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-09T21:30:56.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-09T21:30:56.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-09T21:30:56.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-09T21:30:56.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-09T21:30:56.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-09T21:30:56.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-09T21:30:56.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-09T21:30:56.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-09T21:30:56.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-09T21:30:56.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-09T21:30:56.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-09T21:30:56.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-09T21:30:56.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-09T21:30:56.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-09T21:30:56.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-09T21:30:56.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-09T21:30:56.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-09T21:30:56.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-09T21:30:56.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-09T21:30:56.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-09T21:30:56.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-09T21:30:56.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-09T21:30:56.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-09T21:30:56.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-09T21:30:56.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-09T21:30:56.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-09T21:30:56.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-09T21:30:56.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-09T21:30:56.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-09T21:30:56.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-09T21:30:56.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-09T21:30:56.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-09T21:30:56.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-09T21:30:56.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-09T21:30:56.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-09T21:30:56.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-09T21:30:56.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2 2023-07-09T21:30:56.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster 2023-07-09T21:30:56.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-09T21:30:56.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm 2023-07-09T21:30:56.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-09T21:30:56.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs 2023-07-09T21:30:56.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-09T21:30:56.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-09T21:30:56.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-09T21:30:56.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-09T21:30:56.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-09T21:30:56.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs 2023-07-09T21:30:56.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-09T21:30:56.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore 2023-07-09T21:30:56.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-09T21:30:56.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs 2023-07-09T21:30:56.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-09T21:30:56.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs 2023-07-09T21:30:56.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-09T21:30:56.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb 2023-07-09T21:30:56.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client 2023-07-09T21:30:56.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-09T21:30:56.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common 2023-07-09T21:30:56.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-09T21:30:56.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-09T21:30:56.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs 2023-07-09T21:30:56.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-09T21:30:56.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv 2023-07-09T21:30:56.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-09T21:30:56.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf 2023-07-09T21:30:56.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-09T21:30:56.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs 2023-07-09T21:30:56.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-09T21:30:56.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs 2023-07-09T21:30:56.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-09T21:30:56.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel 2023-07-09T21:30:56.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu 2023-07-09T21:30:56.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu/rcutorture.ko 2023-07-09T21:30:56.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-09T21:30:56.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace 2023-07-09T21:30:56.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-09T21:30:56.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib 2023-07-09T21:30:56.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/asn1_encoder.ko 2023-07-09T21:30:56.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-09T21:30:56.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-09T21:30:56.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto 2023-07-09T21:30:56.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-09T21:30:56.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-09T21:30:56.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-09T21:30:56.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-09T21:30:56.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4 2023-07-09T21:30:56.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-09T21:30:56.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-09T21:30:56.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math 2023-07-09T21:30:56.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-09T21:30:56.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6 2023-07-09T21:30:56.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-09T21:30:56.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon 2023-07-09T21:30:56.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-09T21:30:56.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-09T21:30:56.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-09T21:30:56.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-09T21:30:56.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd 2023-07-09T21:30:56.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd/zstd_compress.ko 2023-07-09T21:30:56.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm 2023-07-09T21:30:56.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-09T21:30:56.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net 2023-07-09T21:30:56.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan 2023-07-09T21:30:56.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-09T21:30:56.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-09T21:30:56.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-09T21:30:56.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-09T21:30:56.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-09T21:30:56.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-09T21:30:56.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-09T21:30:56.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-09T21:30:56.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802 2023-07-09T21:30:56.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-09T21:30:56.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-09T21:30:56.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-09T21:30:56.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-09T21:30:56.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-09T21:30:56.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q 2023-07-09T21:30:56.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-09T21:30:56.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p 2023-07-09T21:30:56.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-09T21:30:56.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-09T21:30:56.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-09T21:30:56.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-09T21:30:56.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv 2023-07-09T21:30:56.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-09T21:30:56.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge 2023-07-09T21:30:56.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-09T21:30:56.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-09T21:30:56.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter 2023-07-09T21:30:56.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-09T21:30:56.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-09T21:30:56.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-09T21:30:56.666 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-09T21:30:56.666 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-09T21:30:56.666 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-09T21:30:56.666 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-09T21:30:56.666 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-09T21:30:56.666 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-09T21:30:56.666 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-09T21:30:56.666 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-09T21:30:56.667 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-09T21:30:56.667 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-09T21:30:56.667 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-09T21:30:56.667 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-09T21:30:56.667 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-09T21:30:56.667 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-09T21:30:56.667 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-09T21:30:56.667 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-09T21:30:56.668 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-09T21:30:56.668 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-09T21:30:56.668 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-09T21:30:56.668 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-09T21:30:56.668 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-09T21:30:56.668 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph 2023-07-09T21:30:56.668 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-09T21:30:56.668 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core 2023-07-09T21:30:56.669 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/failover.ko 2023-07-09T21:30:56.669 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-09T21:30:56.669 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp 2023-07-09T21:30:56.669 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-09T21:30:56.669 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-09T21:30:56.669 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-09T21:30:56.669 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-09T21:30:56.669 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver 2023-07-09T21:30:56.670 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver/dns_resolver.ko 2023-07-09T21:30:56.670 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa 2023-07-09T21:30:56.670 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-09T21:30:56.670 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-09T21:30:56.670 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-09T21:30:56.670 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-09T21:30:56.670 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-09T21:30:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154 2023-07-09T21:30:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan 2023-07-09T21:30:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-09T21:30:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-09T21:30:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-09T21:30:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4 2023-07-09T21:30:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-09T21:30:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-09T21:30:56.672 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-09T21:30:56.672 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-09T21:30:56.672 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-09T21:30:56.672 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-09T21:30:56.672 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-09T21:30:56.672 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-09T21:30:56.672 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-09T21:30:56.672 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-09T21:30:56.673 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter 2023-07-09T21:30:56.673 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-09T21:30:56.673 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-09T21:30:56.673 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-09T21:30:56.673 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-09T21:30:56.673 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-09T21:30:56.673 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-09T21:30:56.674 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-09T21:30:56.674 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-09T21:30:56.674 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-09T21:30:56.674 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-09T21:30:56.674 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-09T21:30:56.674 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-09T21:30:56.674 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-09T21:30:56.674 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-09T21:30:56.675 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-09T21:30:56.675 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-09T21:30:56.675 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-09T21:30:56.675 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-09T21:30:56.675 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-09T21:30:56.675 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-09T21:30:56.675 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-09T21:30:56.675 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-09T21:30:56.676 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-09T21:30:56.676 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-09T21:30:56.676 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-09T21:30:56.676 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-09T21:30:56.676 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-09T21:30:56.676 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-09T21:30:56.676 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-09T21:30:56.676 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-09T21:30:56.677 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-09T21:30:56.677 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-09T21:30:56.677 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-09T21:30:56.677 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-09T21:30:56.677 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-09T21:30:56.677 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-09T21:30:56.677 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-09T21:30:56.677 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-09T21:30:56.678 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6 2023-07-09T21:30:56.678 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-09T21:30:56.678 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-09T21:30:56.678 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-09T21:30:56.678 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-09T21:30:56.678 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-09T21:30:56.678 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-09T21:30:56.679 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-09T21:30:56.679 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter 2023-07-09T21:30:56.679 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-09T21:30:56.679 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-09T21:30:56.679 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-09T21:30:56.679 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-09T21:30:56.679 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-09T21:30:56.679 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-09T21:30:56.680 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-09T21:30:56.680 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-09T21:30:56.680 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-09T21:30:56.680 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-09T21:30:56.680 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-09T21:30:56.680 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-09T21:30:56.680 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-09T21:30:56.681 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-09T21:30:56.681 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-09T21:30:56.681 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-09T21:30:56.681 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-09T21:30:56.681 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-09T21:30:56.681 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-09T21:30:56.681 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-09T21:30:56.681 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-09T21:30:56.682 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-09T21:30:56.682 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-09T21:30:56.682 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-09T21:30:56.682 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-09T21:30:56.682 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-09T21:30:56.682 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-09T21:30:56.682 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key 2023-07-09T21:30:56.682 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-09T21:30:56.683 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp 2023-07-09T21:30:56.683 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-09T21:30:56.683 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-09T21:30:56.683 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-09T21:30:56.683 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-09T21:30:56.683 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-09T21:30:56.683 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-09T21:30:56.683 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-09T21:30:56.684 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc 2023-07-09T21:30:56.684 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-09T21:30:56.684 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154 2023-07-09T21:30:56.684 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-09T21:30:56.684 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls 2023-07-09T21:30:56.684 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-09T21:30:56.684 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter 2023-07-09T21:30:56.685 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset 2023-07-09T21:30:56.685 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-09T21:30:56.685 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-09T21:30:56.685 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-09T21:30:56.685 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-09T21:30:56.685 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-09T21:30:56.685 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-09T21:30:56.685 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-09T21:30:56.686 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-09T21:30:56.686 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-09T21:30:56.686 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-09T21:30:56.686 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-09T21:30:56.686 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-09T21:30:56.686 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-09T21:30:56.686 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-09T21:30:56.687 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-09T21:30:56.687 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-09T21:30:56.687 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs 2023-07-09T21:30:56.687 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-09T21:30:56.687 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-09T21:30:56.687 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-09T21:30:56.687 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-09T21:30:56.687 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-09T21:30:56.688 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-09T21:30:56.688 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-09T21:30:56.688 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-09T21:30:56.688 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-09T21:30:56.688 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-09T21:30:56.688 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-09T21:30:56.688 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-09T21:30:56.688 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-09T21:30:56.689 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-09T21:30:56.689 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-09T21:30:56.689 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-09T21:30:56.689 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-09T21:30:56.689 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-09T21:30:56.689 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-09T21:30:56.689 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-09T21:30:56.689 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-09T21:30:56.690 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-09T21:30:56.690 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-09T21:30:56.690 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-09T21:30:56.690 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-09T21:30:56.690 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-09T21:30:56.690 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-09T21:30:56.690 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-09T21:30:56.691 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-09T21:30:56.691 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-09T21:30:56.691 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-09T21:30:56.691 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-09T21:30:56.691 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-09T21:30:56.691 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-09T21:30:56.691 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-09T21:30:56.691 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-09T21:30:56.692 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-09T21:30:56.692 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-09T21:30:56.692 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-09T21:30:56.692 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-09T21:30:56.692 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-09T21:30:56.692 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-09T21:30:56.692 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-09T21:30:56.692 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-09T21:30:56.693 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-09T21:30:56.693 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-09T21:30:56.693 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-09T21:30:56.693 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-09T21:30:56.693 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-09T21:30:56.693 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-09T21:30:56.693 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-09T21:30:56.693 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-09T21:30:56.694 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-09T21:30:56.694 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-09T21:30:56.694 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-09T21:30:56.694 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-09T21:30:56.694 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-09T21:30:56.694 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-09T21:30:56.694 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_quota.ko 2023-07-09T21:30:56.694 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-09T21:30:56.695 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-09T21:30:56.695 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-09T21:30:56.695 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-09T21:30:56.695 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tunnel.ko 2023-07-09T21:30:56.695 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-09T21:30:56.695 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-09T21:30:56.695 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-09T21:30:56.695 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-09T21:30:56.696 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-09T21:30:56.696 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-09T21:30:56.696 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-09T21:30:56.696 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-09T21:30:56.696 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-09T21:30:56.696 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-09T21:30:56.696 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-09T21:30:56.696 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-09T21:30:56.697 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-09T21:30:56.697 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-09T21:30:56.697 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-09T21:30:56.697 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-09T21:30:56.697 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-09T21:30:56.697 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-09T21:30:56.697 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-09T21:30:56.698 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-09T21:30:56.698 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-09T21:30:56.698 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-09T21:30:56.698 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-09T21:30:56.698 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-09T21:30:56.698 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-09T21:30:56.698 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-09T21:30:56.698 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-09T21:30:56.699 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-09T21:30:56.699 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-09T21:30:56.699 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-09T21:30:56.699 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-09T21:30:56.699 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-09T21:30:56.699 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-09T21:30:56.699 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-09T21:30:56.699 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-09T21:30:56.700 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-09T21:30:56.700 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-09T21:30:56.700 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-09T21:30:56.700 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-09T21:30:56.700 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-09T21:30:56.700 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-09T21:30:56.700 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-09T21:30:56.700 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-09T21:30:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-09T21:30:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-09T21:30:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-09T21:30:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-09T21:30:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-09T21:30:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-09T21:30:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-09T21:30:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-09T21:30:56.702 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-09T21:30:56.702 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-09T21:30:56.702 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-09T21:30:56.702 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-09T21:30:56.702 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-09T21:30:56.702 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-09T21:30:56.702 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-09T21:30:56.702 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-09T21:30:56.703 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-09T21:30:56.703 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-09T21:30:56.703 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-09T21:30:56.703 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-09T21:30:56.703 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-09T21:30:56.703 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-09T21:30:56.703 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-09T21:30:56.703 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-09T21:30:56.704 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-09T21:30:56.704 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-09T21:30:56.704 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-09T21:30:56.704 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-09T21:30:56.704 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink 2023-07-09T21:30:56.704 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-09T21:30:56.704 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh 2023-07-09T21:30:56.705 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-09T21:30:56.705 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch 2023-07-09T21:30:56.705 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-09T21:30:56.705 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-09T21:30:56.705 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-09T21:30:56.705 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-09T21:30:56.705 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet 2023-07-09T21:30:56.705 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-09T21:30:56.706 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds 2023-07-09T21:30:56.706 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-09T21:30:56.706 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-09T21:30:56.706 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-09T21:30:56.706 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched 2023-07-09T21:30:56.706 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-09T21:30:56.706 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-09T21:30:56.706 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-09T21:30:56.707 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-09T21:30:56.707 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-09T21:30:56.707 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-09T21:30:56.707 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-09T21:30:56.707 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-09T21:30:56.707 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-09T21:30:56.707 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-09T21:30:56.707 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-09T21:30:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-09T21:30:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-09T21:30:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-09T21:30:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-09T21:30:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-09T21:30:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-09T21:30:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-09T21:30:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-09T21:30:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-09T21:30:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-09T21:30:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-09T21:30:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-09T21:30:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-09T21:30:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-09T21:30:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-09T21:30:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-09T21:30:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-09T21:30:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-09T21:30:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-09T21:30:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-09T21:30:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-09T21:30:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-09T21:30:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-09T21:30:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-09T21:30:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-09T21:30:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-09T21:30:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-09T21:30:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-09T21:30:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-09T21:30:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-09T21:30:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-09T21:30:56.712 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-09T21:30:56.712 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-09T21:30:56.712 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp 2023-07-09T21:30:56.712 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-09T21:30:56.712 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-09T21:30:56.712 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc 2023-07-09T21:30:56.712 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss 2023-07-09T21:30:56.712 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-09T21:30:56.713 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-09T21:30:56.713 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-09T21:30:56.713 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma 2023-07-09T21:30:56.713 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-09T21:30:56.713 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc 2023-07-09T21:30:56.713 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-09T21:30:56.713 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-09T21:30:56.713 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix 2023-07-09T21:30:56.714 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-09T21:30:56.714 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock 2023-07-09T21:30:56.714 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-09T21:30:56.714 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-09T21:30:56.714 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-09T21:30:56.714 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-09T21:30:56.714 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-09T21:30:56.714 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm 2023-07-09T21:30:56.715 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-09T21:30:56.715 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security 2023-07-09T21:30:56.715 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys 2023-07-09T21:30:56.715 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys 2023-07-09T21:30:56.715 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-09T21:30:56.715 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys 2023-07-09T21:30:56.715 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys/trusted.ko 2023-07-09T21:30:56.715 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt 2023-07-09T21:30:56.716 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib 2023-07-09T21:30:56.716 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-09T21:30:56.716 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-09T21:30:56.716 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-09T21:30:56.716 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-09T21:30:56.716 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-09T21:30:56.716 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-09T21:30:56.717 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-09T21:30:56.717 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-09T21:30:56.717 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-09T21:30:56.717 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-09T21:30:56.717 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-09T21:30:56.717 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-09T21:30:56.717 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-09T21:30:56.718 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-09T21:30:56.718 DEBUG:teuthology.orchestra.run.smithi053:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-09T21:30:56.746 INFO:teuthology.orchestra.run.smithi053.stdout:postinstall scriptlet (using /bin/sh): 2023-07-09T21:30:56.747 INFO:teuthology.orchestra.run.smithi053.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-g84139c18d56f -a -r /boot/System.map-6.4.0-g84139c18d56f ]; then 2023-07-09T21:30:56.747 INFO:teuthology.orchestra.run.smithi053.stdout:cp /boot/vmlinuz-6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm 2023-07-09T21:30:56.747 INFO:teuthology.orchestra.run.smithi053.stdout:cp /boot/System.map-6.4.0-g84139c18d56f /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-09T21:30:56.747 INFO:teuthology.orchestra.run.smithi053.stdout:rm -f /boot/vmlinuz-6.4.0-g84139c18d56f /boot/System.map-6.4.0-g84139c18d56f 2023-07-09T21:30:56.747 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/installkernel 6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-09T21:30:56.747 INFO:teuthology.orchestra.run.smithi053.stdout:rm -f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-09T21:30:56.748 INFO:teuthology.orchestra.run.smithi053.stdout:fi 2023-07-09T21:30:56.748 INFO:teuthology.orchestra.run.smithi053.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-09T21:30:56.748 INFO:teuthology.orchestra.run.smithi053.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-09T21:30:56.748 INFO:teuthology.orchestra.run.smithi053.stdout:new-kernel-pkg --remove 6.4.0-g84139c18d56f --rminitrd --initrdfile=/boot/initramfs-6.4.0-g84139c18d56f.img 2023-07-09T21:30:56.748 INFO:teuthology.orchestra.run.smithi053.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-09T21:30:56.748 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-install remove 6.4.0-g84139c18d56f 2023-07-09T21:30:56.748 INFO:teuthology.orchestra.run.smithi053.stdout:fi 2023-07-09T21:30:56.748 INFO:teuthology.orchestra.run.smithi053.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-09T21:30:56.749 INFO:teuthology.orchestra.run.smithi053.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-09T21:30:56.749 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/update-bootloader --remove 6.4.0-g84139c18d56f 2023-07-09T21:30:56.749 INFO:teuthology.orchestra.run.smithi053.stdout:fi 2023-07-09T21:30:56.750 DEBUG:teuthology.orchestra.run.smithi053:> sudo rpm -qi grub2-tools 2023-07-09T21:30:56.832 INFO:teuthology.orchestra.run.smithi053.stdout:Name : grub2-tools 2023-07-09T21:30:56.832 INFO:teuthology.orchestra.run.smithi053.stdout:Epoch : 1 2023-07-09T21:30:56.832 INFO:teuthology.orchestra.run.smithi053.stdout:Version : 2.02 2023-07-09T21:30:56.833 INFO:teuthology.orchestra.run.smithi053.stdout:Release : 123.el8 2023-07-09T21:30:56.833 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: x86_64 2023-07-09T21:30:56.833 INFO:teuthology.orchestra.run.smithi053.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-07-09T21:30:56.833 INFO:teuthology.orchestra.run.smithi053.stdout:Group : System Environment/Base 2023-07-09T21:30:56.833 INFO:teuthology.orchestra.run.smithi053.stdout:Size : 9265450 2023-07-09T21:30:56.833 INFO:teuthology.orchestra.run.smithi053.stdout:License : GPLv3+ 2023-07-09T21:30:56.833 INFO:teuthology.orchestra.run.smithi053.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-07-09T21:30:56.833 INFO:teuthology.orchestra.run.smithi053.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-07-09T21:30:56.834 INFO:teuthology.orchestra.run.smithi053.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-07-09T21:30:56.834 INFO:teuthology.orchestra.run.smithi053.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-07-09T21:30:56.834 INFO:teuthology.orchestra.run.smithi053.stdout:Relocations : (not relocatable) 2023-07-09T21:30:56.834 INFO:teuthology.orchestra.run.smithi053.stdout:Packager : Red Hat, Inc. 2023-07-09T21:30:56.834 INFO:teuthology.orchestra.run.smithi053.stdout:Vendor : Red Hat, Inc. 2023-07-09T21:30:56.834 INFO:teuthology.orchestra.run.smithi053.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-09T21:30:56.834 INFO:teuthology.orchestra.run.smithi053.stdout:Summary : Support tools for GRUB. 2023-07-09T21:30:56.834 INFO:teuthology.orchestra.run.smithi053.stdout:Description : 2023-07-09T21:30:56.835 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:30:56.835 INFO:teuthology.orchestra.run.smithi053.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-09T21:30:56.835 INFO:teuthology.orchestra.run.smithi053.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-09T21:30:56.835 INFO:teuthology.orchestra.run.smithi053.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-09T21:30:56.835 INFO:teuthology.orchestra.run.smithi053.stdout:hardware devices. 2023-07-09T21:30:56.835 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:30:56.835 INFO:teuthology.orchestra.run.smithi053.stdout:This subpackage provides tools for support of all platforms. 2023-07-09T21:30:56.836 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-09T21:30:56.836 INFO:teuthology.task.kernel:Updating grub on smithi053 to boot 6.4.0-g84139c18d56f 2023-07-09T21:30:56.837 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-09T21:30:58.010 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2023-07-09T21:30:59.802 INFO:teuthology.orchestra.run.smithi053.stderr:done 2023-07-09T21:30:59.804 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2023-07-09T21:30:59.824 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.XazppWUmLJ 2023-07-09T21:30:59.825 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XazppWUmLJ 2023-07-09T21:30:59.896 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.XazppWUmLJ 2023-07-09T21:31:00.039 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.XazppWUmLJ is 6KB 2023-07-09T21:31:00.086 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.XazppWUmLJ 2023-07-09T21:31:00.103 DEBUG:teuthology.orchestra.run.smithi053:> sudo /bin/ls /boot/loader/entries || true 2023-07-09T21:31:00.181 INFO:teuthology.orchestra.run.smithi053.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-07-09T21:31:00.182 INFO:teuthology.orchestra.run.smithi053.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-07-09T21:31:00.182 INFO:teuthology.orchestra.run.smithi053.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.4.0-g84139c18d56f.conf 2023-07-09T21:31:00.183 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.4.0-g84139c18d56f 2023-07-09T21:31:00.350 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2023-07-09T21:31:19.304 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-07-09T21:31:19.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-09T21:31:19.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:31:30.360 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-09T21:31:30.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-09T21:31:30.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:31:48.720 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-07-09T21:31:57.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-09T21:31:57.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:32:16.112 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-07-09T21:32:19.308 DEBUG:teuthology.orchestra.remote:timed out 2023-07-09T21:32:28.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-09T21:32:28.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:32:28.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-09T21:32:28.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:32:30.711 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-07-09T21:32:31.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-09T21:32:31.140 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-g84139c18d56f"... 2023-07-09T21:32:31.140 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2023-07-09T21:32:31.182 INFO:teuthology.orchestra.run.smithi053.stdout:6.4.0-g84139c18d56f 2023-07-09T21:32:31.183 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-09T21:32:31.183 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-09T21:32:31.183 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-07-09T21:32:31.693 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-07-09T21:32:32.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-09T21:32:32.155 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.4.0-g84139c18d56f"... 2023-07-09T21:32:32.155 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-07-09T21:32:32.184 DEBUG:teuthology.parallel:result is None 2023-07-09T21:32:32.196 INFO:teuthology.orchestra.run.smithi184.stdout:6.4.0-g84139c18d56f 2023-07-09T21:32:32.197 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-09T21:32:32.197 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-09T21:32:32.197 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-07-09T21:32:33.198 DEBUG:teuthology.parallel:result is None 2023-07-09T21:32:33.198 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-09T21:32:33.205 INFO:teuthology.task.internal:Creating test directory... 2023-07-09T21:32:33.205 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-09T21:32:33.213 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-09T21:32:33.259 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-09T21:32:33.265 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-09T21:32:33.276 INFO:teuthology.task.internal:Creating archive directory... 2023-07-09T21:32:33.277 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-09T21:32:33.283 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-09T21:32:33.359 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-09T21:32:33.366 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-09T21:32:33.366 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-09T21:32:33.371 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-09T21:32:33.553 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-09T21:32:33.558 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-09T21:32:33.587 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-09T21:32:33.607 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-09T21:32:33.610 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-09T21:32:33.617 INFO:teuthology.task.internal:Configuring sudo... 2023-07-09T21:32:33.618 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-09T21:32:33.622 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-09T21:32:33.690 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-09T21:32:33.700 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-09T21:32:33.701 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-09T21:32:33.705 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-09T21:32:33.747 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-09T21:32:33.858 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-09T21:32:33.960 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-09T21:32:34.034 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-09T21:32:34.114 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:32:34.115 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-09T21:32:34.183 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-09T21:32:34.258 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-09T21:32:34.341 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-09T21:32:34.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-09T21:32:34.492 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:32:34.492 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-09T21:32:34.562 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2023-07-09T21:32:34.566 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2023-07-09T21:32:34.687 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-09T21:32:34.707 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-09T21:32:35.077 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-09T21:32:35.085 INFO:teuthology.task.internal:Starting timer... 2023-07-09T21:32:35.086 INFO:teuthology.run_tasks:Running task pcp... 2023-07-09T21:32:35.097 INFO:teuthology.run_tasks:Running task selinux... 2023-07-09T21:32:35.105 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-09T21:32:35.106 DEBUG:teuthology.orchestra.run.smithi053:> sudo service auditd rotate 2023-07-09T21:32:35.229 INFO:teuthology.orchestra.run.smithi053.stdout:Rotating logs: 2023-07-09T21:32:35.233 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2023-07-09T21:32:35.365 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2023-07-09T21:32:35.369 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-09T21:32:35.370 DEBUG:teuthology.orchestra.run.smithi053:> /usr/sbin/getenforce 2023-07-09T21:32:35.429 INFO:teuthology.orchestra.run.smithi053.stdout:Permissive 2023-07-09T21:32:35.430 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2023-07-09T21:32:35.484 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2023-07-09T21:32:35.484 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi053.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2023-07-09T21:32:35.485 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-09T21:32:35.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:32:35.557 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-09T21:32:35.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:32:35.626 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-09T21:32:35.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo /usr/sbin/setenforce permissive 2023-07-09T21:32:35.696 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2023-07-09T21:32:35.772 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-09T21:32:35.783 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-09T21:32:35.790 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-09T21:32:35.962 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-09T21:32:35.983 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-09T21:32:35.986 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-09T21:46:30.589 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2023-07-09T21:46:30.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-09T21:46:30.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:46:30.683 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-07-09T21:46:30.798 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-09T21:46:30.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-09T21:46:30.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:46:30.884 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-07-09T21:46:30.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-09T21:46:30.992 INFO:teuthology.run_tasks:Running task clock... 2023-07-09T21:46:31.002 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-09T21:46:31.003 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-09T21:46:31.003 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-09T21:46:31.008 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-09T21:46:31.008 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-09T21:46:31.078 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-09T21:46:31.104 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-09T21:46:31.113 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-09T21:46:31.138 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-09T21:46:31.203 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: ntpd: command not found 2023-07-09T21:46:31.232 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2023-07-09T21:46:31.232 INFO:teuthology.orchestra.run.smithi053.stdout:506 Cannot talk to daemon 2023-07-09T21:46:31.260 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2023-07-09T21:46:31.267 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-09T21:46:31.293 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-09T21:46:31.302 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-09T21:46:31.327 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-09T21:46:31.390 INFO:teuthology.orchestra.run.smithi053.stderr:bash: ntpq: command not found 2023-07-09T21:46:31.397 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-09T21:46:31.398 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2023-07-09T21:46:31.398 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-09T21:46:31.398 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-09T21:46:31.399 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-09T21:46:31.399 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-09T21:46:31.415 INFO:teuthology.orchestra.run.smithi184.stderr:bash: ntpq: command not found 2023-07-09T21:46:31.422 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-09T21:46:31.423 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2023-07-09T21:46:31.423 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-09T21:46:31.423 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-09T21:46:31.423 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-09T21:46:31.423 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-09T21:46:31.424 INFO:teuthology.run_tasks:Running task install... 2023-07-09T21:46:31.434 DEBUG:teuthology.task.install:project ceph 2023-07-09T21:46:31.435 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}} 2023-07-09T21:46:31.435 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'} 2023-07-09T21:46:31.435 INFO:teuthology.task.install:Using flavor: default 2023-07-09T21:46:31.442 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-09T21:46:31.443 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-09T21:46:31.443 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212', 'tag': None, 'wait_for_package': False} 2023-07-09T21:46:31.444 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T21:46:31.446 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212', 'tag': None, 'wait_for_package': False} 2023-07-09T21:46:31.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T21:46:31.591 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/centos/8/flavors/default/ 2023-07-09T21:46:31.591 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4759.g35b2d86c 2023-07-09T21:46:31.661 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/centos/8/flavors/default/ 2023-07-09T21:46:31.661 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4759.g35b2d86c 2023-07-09T21:46:31.699 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-09T21:46:31.700 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:46:31.700 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-09T21:46:31.776 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-09T21:46:31.777 DEBUG:teuthology.orchestra.run.smithi053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/35b2d86cfd512f15ace2077050d20c8669933212/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-09T21:46:31.829 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-09T21:46:31.830 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:46:31.830 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-09T21:46:31.886 DEBUG:teuthology.orchestra.run.smithi053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-09T21:46:31.897 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-09T21:46:31.897 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/35b2d86cfd512f15ace2077050d20c8669933212/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-09T21:46:31.982 DEBUG:teuthology.orchestra.run.smithi053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-09T21:46:32.007 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-09T21:46:32.050 INFO:teuthology.orchestra.run.smithi053.stdout:check_obsoletes = 1 2023-07-09T21:46:32.053 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum clean all 2023-07-09T21:46:32.101 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-09T21:46:32.168 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2023-07-09T21:46:32.171 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2023-07-09T21:46:32.527 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-07-09T21:46:32.613 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-07-09T21:46:32.987 INFO:teuthology.orchestra.run.smithi053.stdout:44 files removed 2023-07-09T21:46:33.030 INFO:teuthology.orchestra.run.smithi184.stdout:44 files removed 2023-07-09T21:46:33.042 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-09T21:46:33.085 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-09T21:46:33.520 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-07-09T21:46:33.529 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-07-09T21:46:34.610 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 146 kB/s | 81 kB 00:00 2023-07-09T21:46:34.635 INFO:teuthology.orchestra.run.smithi053.stdout:ceph packages for x86_64 140 kB/s | 81 kB 00:00 2023-07-09T21:46:35.352 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 13 kB/s | 9.4 kB 00:00 2023-07-09T21:46:35.411 INFO:teuthology.orchestra.run.smithi053.stdout:ceph noarch packages 13 kB/s | 9.4 kB 00:00 2023-07-09T21:46:35.811 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 3.4 kB/s | 1.5 kB 00:00 2023-07-09T21:46:35.862 INFO:teuthology.orchestra.run.smithi053.stdout:ceph source packages 3.5 kB/s | 1.5 kB 00:00 2023-07-09T21:46:38.329 INFO:teuthology.orchestra.run.smithi053.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-07-09T21:46:38.353 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-07-09T21:46:39.421 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-07-09T21:46:43.654 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 490 kB/s | 24 kB 00:00 2023-07-09T21:46:44.739 INFO:teuthology.orchestra.run.smithi053.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 47 MB 00:01 2023-07-09T21:46:52.613 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 16 MB 00:14 2023-07-09T21:46:53.807 INFO:teuthology.orchestra.run.smithi053.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 47 MB/s | 53 MB 00:01 2023-07-09T21:46:56.685 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 168 kB/s | 24 kB 00:00 2023-07-09T21:46:57.812 INFO:teuthology.orchestra.run.smithi184.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 53 MB 00:01 2023-07-09T21:47:06.569 INFO:teuthology.orchestra.run.smithi053.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-09T21:47:06.570 INFO:teuthology.orchestra.run.smithi053.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-09T21:47:06.586 INFO:teuthology.orchestra.run.smithi053.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-09T21:47:06.587 INFO:teuthology.orchestra.run.smithi053.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-09T21:47:06.588 INFO:teuthology.orchestra.run.smithi053.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-09T21:47:06.590 INFO:teuthology.orchestra.run.smithi053.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-09T21:47:06.592 INFO:teuthology.orchestra.run.smithi053.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-09T21:47:06.596 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-09T21:47:06.597 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-09T21:47:06.746 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2023-07-09T21:47:06.759 INFO:teuthology.orchestra.run.smithi053.stdout:=========================================================================================================================== 2023-07-09T21:47:06.760 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2023-07-09T21:47:06.760 INFO:teuthology.orchestra.run.smithi053.stdout:=========================================================================================================================== 2023-07-09T21:47:06.760 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2023-07-09T21:47:06.760 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-09T21:47:06.760 INFO:teuthology.orchestra.run.smithi053.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-09T21:47:06.761 INFO:teuthology.orchestra.run.smithi053.stdout: ceph x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 6.4 k 2023-07-09T21:47:06.761 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 5.4 M 2023-07-09T21:47:06.761 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 853 k 2023-07-09T21:47:06.761 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 165 k 2023-07-09T21:47:06.761 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 1.6 M 2023-07-09T21:47:06.762 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 129 k 2023-07-09T21:47:06.762 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 1.7 M 2023-07-09T21:47:06.762 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 7.4 M 2023-07-09T21:47:06.762 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 47 k 2023-07-09T21:47:06.762 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 13 M 2023-07-09T21:47:06.762 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 48 M 2023-07-09T21:47:06.762 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 258 k 2023-07-09T21:47:06.763 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 164 k 2023-07-09T21:47:06.763 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 258 k 2023-07-09T21:47:06.763 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 18 k 2023-07-09T21:47:06.763 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-09T21:47:06.763 INFO:teuthology.orchestra.run.smithi053.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-09T21:47:06.763 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-09T21:47:06.763 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 31 k 2023-07-09T21:47:06.764 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 776 k 2023-07-09T21:47:06.764 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 139 k 2023-07-09T21:47:06.764 INFO:teuthology.orchestra.run.smithi053.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-09T21:47:06.764 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-09T21:47:06.764 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-09T21:47:06.764 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-09T21:47:06.764 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-09T21:47:06.764 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-09T21:47:06.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 196 k 2023-07-09T21:47:06.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 371 k 2023-07-09T21:47:06.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 363 k 2023-07-09T21:47:06.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 107 k 2023-07-09T21:47:06.765 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 94 k 2023-07-09T21:47:06.765 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 3.4 M 2023-07-09T21:47:06.765 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 179 k 2023-07-09T21:47:06.766 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-09T21:47:06.766 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrading: 2023-07-09T21:47:06.766 INFO:teuthology.orchestra.run.smithi053.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-09T21:47:06.766 INFO:teuthology.orchestra.run.smithi053.stdout: librados2 x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 3.7 M 2023-07-09T21:47:06.766 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 3.6 M 2023-07-09T21:47:06.766 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2023-07-09T21:47:06.766 INFO:teuthology.orchestra.run.smithi053.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-09T21:47:06.766 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 22 M 2023-07-09T21:47:06.767 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 23 k 2023-07-09T21:47:06.767 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 2.3 M 2023-07-09T21:47:06.767 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 240 k 2023-07-09T21:47:06.767 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 4.6 M 2023-07-09T21:47:06.767 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 18 M 2023-07-09T21:47:06.767 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 15 k 2023-07-09T21:47:06.767 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 24 k 2023-07-09T21:47:06.767 INFO:teuthology.orchestra.run.smithi053.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-09T21:47:06.768 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-09T21:47:06.768 INFO:teuthology.orchestra.run.smithi053.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-09T21:47:06.768 INFO:teuthology.orchestra.run.smithi053.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-09T21:47:06.768 INFO:teuthology.orchestra.run.smithi053.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-09T21:47:06.768 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 137 k 2023-07-09T21:47:06.768 INFO:teuthology.orchestra.run.smithi053.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-09T21:47:06.768 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-09T21:47:06.769 INFO:teuthology.orchestra.run.smithi053.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-09T21:47:06.769 INFO:teuthology.orchestra.run.smithi053.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-09T21:47:06.769 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-09T21:47:06.769 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-09T21:47:06.769 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 473 k 2023-07-09T21:47:06.769 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-09T21:47:06.769 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2 x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 6.7 M 2023-07-09T21:47:06.769 INFO:teuthology.orchestra.run.smithi053.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-09T21:47:06.770 INFO:teuthology.orchestra.run.smithi053.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-09T21:47:06.770 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-09T21:47:06.770 INFO:teuthology.orchestra.run.smithi053.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-09T21:47:06.770 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-09T21:47:06.770 INFO:teuthology.orchestra.run.smithi053.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-09T21:47:06.770 INFO:teuthology.orchestra.run.smithi053.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-09T21:47:06.770 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-09T21:47:06.771 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-09T21:47:06.771 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-09T21:47:06.771 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-09T21:47:06.771 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-09T21:47:06.771 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-09T21:47:06.771 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-09T21:47:06.771 INFO:teuthology.orchestra.run.smithi053.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-09T21:47:06.771 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-09T21:47:06.772 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 45 k 2023-07-09T21:47:06.772 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 119 k 2023-07-09T21:47:06.772 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-09T21:47:06.772 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-09T21:47:06.772 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-09T21:47:06.772 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-09T21:47:06.772 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-09T21:47:06.773 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-09T21:47:06.773 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-09T21:47:06.773 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-09T21:47:06.773 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-09T21:47:06.773 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-09T21:47:06.773 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-09T21:47:06.773 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-09T21:47:06.773 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-09T21:47:06.774 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-09T21:47:06.774 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-09T21:47:06.774 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-09T21:47:06.774 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-09T21:47:06.774 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-09T21:47:06.774 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-09T21:47:06.774 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-09T21:47:06.774 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-09T21:47:06.775 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-09T21:47:06.775 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-09T21:47:06.775 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-09T21:47:06.775 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-09T21:47:06.775 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-09T21:47:06.775 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-09T21:47:06.775 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-09T21:47:06.776 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-09T21:47:06.776 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-09T21:47:06.776 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-09T21:47:06.776 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-09T21:47:06.776 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-09T21:47:06.776 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-09T21:47:06.776 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-09T21:47:06.776 INFO:teuthology.orchestra.run.smithi053.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-09T21:47:06.777 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-09T21:47:06.777 INFO:teuthology.orchestra.run.smithi053.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-09T21:47:06.777 INFO:teuthology.orchestra.run.smithi053.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-09T21:47:06.777 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-09T21:47:06.777 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-09T21:47:06.777 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-09T21:47:06.777 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-09T21:47:06.777 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-09T21:47:06.778 INFO:teuthology.orchestra.run.smithi053.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-09T21:47:06.778 INFO:teuthology.orchestra.run.smithi053.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-09T21:47:06.778 INFO:teuthology.orchestra.run.smithi053.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-09T21:47:06.778 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-09T21:47:06.778 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-09T21:47:06.779 INFO:teuthology.orchestra.run.smithi053.stdout:Enabling module streams: 2023-07-09T21:47:06.779 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql 10 2023-07-09T21:47:06.779 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:47:06.779 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2023-07-09T21:47:06.779 INFO:teuthology.orchestra.run.smithi053.stdout:=========================================================================================================================== 2023-07-09T21:47:06.779 INFO:teuthology.orchestra.run.smithi053.stdout:Install 128 Packages 2023-07-09T21:47:06.779 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrade 3 Packages 2023-07-09T21:47:06.780 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:47:06.780 INFO:teuthology.orchestra.run.smithi184.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 37 MB/s | 47 MB 00:01 2023-07-09T21:47:06.781 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 205 M 2023-07-09T21:47:06.781 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2023-07-09T21:47:07.308 INFO:teuthology.orchestra.run.smithi053.stdout:(1/131): ceph-18.0.0-4759.g35b2d86c.el8.x86_64. 34 kB/s | 6.4 kB 00:00 2023-07-09T21:47:07.700 INFO:teuthology.orchestra.run.smithi053.stdout:(2/131): ceph-fuse-18.0.0-4759.g35b2d86c.el8.x8 2.1 MB/s | 853 kB 00:00 2023-07-09T21:47:07.800 INFO:teuthology.orchestra.run.smithi053.stdout:(3/131): ceph-immutable-object-cache-18.0.0-475 1.6 MB/s | 165 kB 00:00 2023-07-09T21:47:07.908 INFO:teuthology.orchestra.run.smithi053.stdout:(4/131): ceph-base-18.0.0-4759.g35b2d86c.el8.x8 6.8 MB/s | 5.4 MB 00:00 2023-07-09T21:47:08.100 INFO:teuthology.orchestra.run.smithi053.stdout:(5/131): ceph-mgr-18.0.0-4759.g35b2d86c.el8.x86 8.1 MB/s | 1.6 MB 00:00 2023-07-09T21:47:08.442 INFO:teuthology.orchestra.run.smithi053.stdout:(6/131): ceph-mds-18.0.0-4759.g35b2d86c.el8.x86 3.5 MB/s | 2.3 MB 00:00 2023-07-09T21:47:08.576 INFO:teuthology.orchestra.run.smithi053.stdout:(7/131): ceph-mon-18.0.0-4759.g35b2d86c.el8.x86 9.7 MB/s | 4.6 MB 00:00 2023-07-09T21:47:09.093 INFO:teuthology.orchestra.run.smithi053.stdout:(8/131): ceph-common-18.0.0-4759.g35b2d86c.el8. 11 MB/s | 22 MB 00:01 2023-07-09T21:47:09.160 INFO:teuthology.orchestra.run.smithi053.stdout:(9/131): ceph-selinux-18.0.0-4759.g35b2d86c.el8 367 kB/s | 24 kB 00:00 2023-07-09T21:47:09.843 INFO:teuthology.orchestra.run.smithi053.stdout:(10/131): ceph-radosgw-18.0.0-4759.g35b2d86c.el 11 MB/s | 13 MB 00:01 2023-07-09T21:47:09.935 INFO:teuthology.orchestra.run.smithi053.stdout:(11/131): cephfs-mirror-18.0.0-4759.g35b2d86c.e 2.8 MB/s | 258 kB 00:00 2023-07-09T21:47:10.027 INFO:teuthology.orchestra.run.smithi053.stdout:(12/131): libcephfs-devel-18.0.0-4759.g35b2d86c 340 kB/s | 31 kB 00:00 2023-07-09T21:47:10.136 INFO:teuthology.orchestra.run.smithi053.stdout:(13/131): libcephfs2-18.0.0-4759.g35b2d86c.el8. 7.0 MB/s | 776 kB 00:00 2023-07-09T21:47:10.219 INFO:teuthology.orchestra.run.smithi053.stdout:(14/131): libcephsqlite-18.0.0-4759.g35b2d86c.e 1.6 MB/s | 137 kB 00:00 2023-07-09T21:47:10.303 INFO:teuthology.orchestra.run.smithi053.stdout:(15/131): librados-devel-18.0.0-4759.g35b2d86c. 1.6 MB/s | 139 kB 00:00 2023-07-09T21:47:10.403 INFO:teuthology.orchestra.run.smithi053.stdout:(16/131): libradosstriper1-18.0.0-4759.g35b2d86 4.6 MB/s | 473 kB 00:00 2023-07-09T21:47:11.154 INFO:teuthology.orchestra.run.smithi053.stdout:(17/131): librgw2-18.0.0-4759.g35b2d86c.el8.x86 9.0 MB/s | 6.7 MB 00:00 2023-07-09T21:47:11.279 INFO:teuthology.orchestra.run.smithi053.stdout:(18/131): python3-ceph-argparse-18.0.0-4759.g35 358 kB/s | 45 kB 00:00 2023-07-09T21:47:11.371 INFO:teuthology.orchestra.run.smithi053.stdout:(19/131): python3-ceph-common-18.0.0-4759.g35b2 1.3 MB/s | 119 kB 00:00 2023-07-09T21:47:11.463 INFO:teuthology.orchestra.run.smithi053.stdout:(20/131): python3-cephfs-18.0.0-4759.g35b2d86c. 2.1 MB/s | 196 kB 00:00 2023-07-09T21:47:11.563 INFO:teuthology.orchestra.run.smithi053.stdout:(21/131): python3-rados-18.0.0-4759.g35b2d86c.e 3.6 MB/s | 371 kB 00:00 2023-07-09T21:47:11.664 INFO:teuthology.orchestra.run.smithi053.stdout:(22/131): python3-rbd-18.0.0-4759.g35b2d86c.el8 3.6 MB/s | 363 kB 00:00 2023-07-09T21:47:11.756 INFO:teuthology.orchestra.run.smithi053.stdout:(23/131): python3-rgw-18.0.0-4759.g35b2d86c.el8 1.1 MB/s | 107 kB 00:00 2023-07-09T21:47:11.839 INFO:teuthology.orchestra.run.smithi053.stdout:(24/131): rbd-fuse-18.0.0-4759.g35b2d86c.el8.x8 1.1 MB/s | 94 kB 00:00 2023-07-09T21:47:12.173 INFO:teuthology.orchestra.run.smithi053.stdout:(25/131): ceph-osd-18.0.0-4759.g35b2d86c.el8.x8 4.8 MB/s | 18 MB 00:03 2023-07-09T21:47:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:(26/131): ceph-test-18.0.0-4759.g35b2d86c.el8.x 14 MB/s | 48 MB 00:03 2023-07-09T21:47:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:(27/131): rbd-nbd-18.0.0-4759.g35b2d86c.el8.x86 384 kB/s | 179 kB 00:00 2023-07-09T21:47:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:(28/131): ceph-grafana-dashboards-18.0.0-4759.g 463 kB/s | 23 kB 00:00 2023-07-09T21:47:12.724 INFO:teuthology.orchestra.run.smithi053.stdout:(29/131): rbd-mirror-18.0.0-4759.g35b2d86c.el8. 3.9 MB/s | 3.4 MB 00:00 2023-07-09T21:47:12.749 INFO:teuthology.orchestra.run.smithi053.stdout:(30/131): ceph-mgr-cephadm-18.0.0-4759.g35b2d86 1.2 MB/s | 129 kB 00:00 2023-07-09T21:47:12.824 INFO:teuthology.orchestra.run.smithi053.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4759.g35 3.1 MB/s | 240 kB 00:00 2023-07-09T21:47:12.875 INFO:teuthology.orchestra.run.smithi053.stdout:(32/131): ceph-mgr-dashboard-18.0.0-4759.g35b2d 8.2 MB/s | 1.7 MB 00:00 2023-07-09T21:47:12.900 INFO:teuthology.orchestra.run.smithi053.stdout:(33/131): ceph-mgr-rook-18.0.0-4759.g35b2d86c.e 632 kB/s | 47 kB 00:00 2023-07-09T21:47:12.942 INFO:teuthology.orchestra.run.smithi053.stdout:(34/131): ceph-prometheus-alerts-18.0.0-4759.g3 218 kB/s | 15 kB 00:00 2023-07-09T21:47:12.967 INFO:teuthology.orchestra.run.smithi053.stdout:(35/131): ceph-volume-18.0.0-4759.g35b2d86c.el8 3.8 MB/s | 258 kB 00:00 2023-07-09T21:47:13.010 INFO:teuthology.orchestra.run.smithi053.stdout:(36/131): cephadm-18.0.0-4759.g35b2d86c.el8.noa 2.4 MB/s | 164 kB 00:00 2023-07-09T21:47:13.043 INFO:teuthology.orchestra.run.smithi053.stdout:(37/131): cephfs-top-18.0.0-4759.g35b2d86c.el8. 239 kB/s | 18 kB 00:00 2023-07-09T21:47:13.269 INFO:teuthology.orchestra.run.smithi053.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 14 MB/s | 7.4 MB 00:00 2023-07-09T21:47:13.660 INFO:teuthology.orchestra.run.smithi053.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 95 kB/s | 59 kB 00:00 2023-07-09T21:47:13.862 INFO:teuthology.orchestra.run.smithi053.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 127 kB/s | 75 kB 00:00 2023-07-09T21:47:13.913 INFO:teuthology.orchestra.run.smithi053.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 340 kB/s | 306 kB 00:00 2023-07-09T21:47:13.978 INFO:teuthology.orchestra.run.smithi053.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 373 kB/s | 44 kB 00:00 2023-07-09T21:47:14.098 INFO:teuthology.orchestra.run.smithi053.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 282 kB/s | 33 kB 00:00 2023-07-09T21:47:14.204 INFO:teuthology.orchestra.run.smithi053.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 634 kB/s | 185 kB 00:00 2023-07-09T21:47:14.229 INFO:teuthology.orchestra.run.smithi053.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 122 kB/s | 16 kB 00:00 2023-07-09T21:47:14.313 INFO:teuthology.orchestra.run.smithi053.stdout:(46/131): python3-asyncssh-2.7.0-2.el8.noarch.r 730 kB/s | 476 kB 00:00 2023-07-09T21:47:14.529 INFO:teuthology.orchestra.run.smithi053.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 530 kB/s | 173 kB 00:00 2023-07-09T21:47:14.555 INFO:teuthology.orchestra.run.smithi053.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 336 kB/s | 81 kB 00:00 2023-07-09T21:47:14.647 INFO:teuthology.orchestra.run.smithi053.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-07-09T21:47:14.672 INFO:teuthology.orchestra.run.smithi053.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 150 kB/s | 18 kB 00:00 2023-07-09T21:47:14.789 INFO:teuthology.orchestra.run.smithi053.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 418 kB/s | 49 kB 00:00 2023-07-09T21:47:14.873 INFO:teuthology.orchestra.run.smithi053.stdout:(52/131): python3-cherrypy-18.4.0-1.el8.noarch. 598 kB/s | 384 kB 00:00 2023-07-09T21:47:14.906 INFO:teuthology.orchestra.run.smithi053.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 502 kB/s | 59 kB 00:00 2023-07-09T21:47:14.990 INFO:teuthology.orchestra.run.smithi053.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 516 kB/s | 60 kB 00:00 2023-07-09T21:47:15.108 INFO:teuthology.orchestra.run.smithi053.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-07-09T21:47:15.218 INFO:teuthology.orchestra.run.smithi053.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 308 kB/s | 34 kB 00:00 2023-07-09T21:47:15.326 INFO:teuthology.orchestra.run.smithi053.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 675 kB/s | 283 kB 00:00 2023-07-09T21:47:15.454 INFO:teuthology.orchestra.run.smithi053.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 483 kB/s | 61 kB 00:00 2023-07-09T21:47:15.535 INFO:teuthology.orchestra.run.smithi053.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 620 kB/s | 196 kB 00:00 2023-07-09T21:47:15.560 INFO:teuthology.orchestra.run.smithi053.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 176 kB/s | 19 kB 00:00 2023-07-09T21:47:15.652 INFO:teuthology.orchestra.run.smithi053.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 205 kB/s | 24 kB 00:00 2023-07-09T21:47:15.677 INFO:teuthology.orchestra.run.smithi053.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 250 kB/s | 29 kB 00:00 2023-07-09T21:47:15.769 INFO:teuthology.orchestra.run.smithi053.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 236 kB/s | 27 kB 00:00 2023-07-09T21:47:16.061 INFO:teuthology.orchestra.run.smithi053.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 665 kB/s | 255 kB 00:00 2023-07-09T21:47:16.153 INFO:teuthology.orchestra.run.smithi053.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 655 kB/s | 251 kB 00:00 2023-07-09T21:47:16.178 INFO:teuthology.orchestra.run.smithi053.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 524 kB/s | 61 kB 00:00 2023-07-09T21:47:16.312 INFO:teuthology.orchestra.run.smithi053.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 172 kB/s | 23 kB 00:00 2023-07-09T21:47:16.346 INFO:teuthology.orchestra.run.smithi053.stdout:(68/131): python3-kubernetes-11.0.0-6.el8.noarc 703 kB/s | 1.2 MB 00:01 2023-07-09T21:47:16.588 INFO:teuthology.orchestra.run.smithi053.stdout:(69/131): python3-webtest-2.0.33-1.el8.noarch.r 196 kB/s | 85 kB 00:00 2023-07-09T21:47:16.613 INFO:teuthology.orchestra.run.smithi053.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 260 kB/s | 70 kB 00:00 2023-07-09T21:47:16.680 INFO:teuthology.orchestra.run.smithi053.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-07-09T21:47:16.722 INFO:teuthology.orchestra.run.smithi053.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-07-09T21:47:16.764 INFO:teuthology.orchestra.run.smithi053.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-07-09T21:47:16.815 INFO:teuthology.orchestra.run.smithi053.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-07-09T21:47:16.856 INFO:teuthology.orchestra.run.smithi053.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 940 kB/s | 39 kB 00:00 2023-07-09T21:47:16.923 INFO:teuthology.orchestra.run.smithi053.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-07-09T21:47:16.974 INFO:teuthology.orchestra.run.smithi053.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2023-07-09T21:47:17.016 INFO:teuthology.orchestra.run.smithi053.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-07-09T21:47:17.058 INFO:teuthology.orchestra.run.smithi053.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-07-09T21:47:17.125 INFO:teuthology.orchestra.run.smithi053.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-07-09T21:47:17.333 INFO:teuthology.orchestra.run.smithi053.stdout:(81/131): python3-scipy-1.0.0-21.module+el8.5.0 18 MB/s | 14 MB 00:00 2023-07-09T21:47:17.367 INFO:teuthology.orchestra.run.smithi053.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 803 kB/s | 27 kB 00:00 2023-07-09T21:47:17.409 INFO:teuthology.orchestra.run.smithi053.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-07-09T21:47:17.484 INFO:teuthology.orchestra.run.smithi053.stdout:(84/131): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-07-09T21:47:17.509 INFO:teuthology.orchestra.run.smithi053.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 439 kB/s | 44 kB 00:00 2023-07-09T21:47:17.560 INFO:teuthology.orchestra.run.smithi053.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-07-09T21:47:17.602 INFO:teuthology.orchestra.run.smithi053.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-07-09T21:47:17.627 INFO:teuthology.orchestra.run.smithi053.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2023-07-09T21:47:17.702 INFO:teuthology.orchestra.run.smithi053.stdout:(89/131): python3-numpy-1.14.3-10.el8.x86_64.rp 17 MB/s | 3.7 MB 00:00 2023-07-09T21:47:17.727 INFO:teuthology.orchestra.run.smithi053.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2023-07-09T21:47:17.753 INFO:teuthology.orchestra.run.smithi053.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-07-09T21:47:17.778 INFO:teuthology.orchestra.run.smithi053.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-07-09T21:47:17.820 INFO:teuthology.orchestra.run.smithi053.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-07-09T21:47:17.863 INFO:teuthology.orchestra.run.smithi053.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-07-09T21:47:18.004 INFO:teuthology.orchestra.run.smithi053.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 22 MB/s | 4.9 MB 00:00 2023-07-09T21:47:18.046 INFO:teuthology.orchestra.run.smithi053.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-07-09T21:47:18.147 INFO:teuthology.orchestra.run.smithi053.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-07-09T21:47:18.180 INFO:teuthology.orchestra.run.smithi053.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2023-07-09T21:47:18.215 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-09T21:47:18.216 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-09T21:47:18.231 INFO:teuthology.orchestra.run.smithi184.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-09T21:47:18.232 INFO:teuthology.orchestra.run.smithi184.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-09T21:47:18.233 INFO:teuthology.orchestra.run.smithi184.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-09T21:47:18.234 INFO:teuthology.orchestra.run.smithi184.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-09T21:47:18.236 INFO:teuthology.orchestra.run.smithi184.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-09T21:47:18.240 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-09T21:47:18.241 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-09T21:47:18.247 INFO:teuthology.orchestra.run.smithi053.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 12 MB/s | 808 kB 00:00 2023-07-09T21:47:18.331 INFO:teuthology.orchestra.run.smithi053.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 18 MB/s | 1.5 MB 00:00 2023-07-09T21:47:18.365 INFO:teuthology.orchestra.run.smithi053.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-07-09T21:47:18.381 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-07-09T21:47:18.393 INFO:teuthology.orchestra.run.smithi184.stdout:=========================================================================================================================== 2023-07-09T21:47:18.394 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-07-09T21:47:18.394 INFO:teuthology.orchestra.run.smithi184.stdout:=========================================================================================================================== 2023-07-09T21:47:18.394 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-07-09T21:47:18.394 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-09T21:47:18.394 INFO:teuthology.orchestra.run.smithi184.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-09T21:47:18.394 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 6.4 k 2023-07-09T21:47:18.394 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 5.4 M 2023-07-09T21:47:18.395 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 853 k 2023-07-09T21:47:18.395 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 165 k 2023-07-09T21:47:18.395 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 1.6 M 2023-07-09T21:47:18.395 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 129 k 2023-07-09T21:47:18.395 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 1.7 M 2023-07-09T21:47:18.395 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 7.4 M 2023-07-09T21:47:18.395 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 47 k 2023-07-09T21:47:18.396 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 13 M 2023-07-09T21:47:18.396 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 48 M 2023-07-09T21:47:18.396 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 258 k 2023-07-09T21:47:18.396 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 164 k 2023-07-09T21:47:18.396 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 258 k 2023-07-09T21:47:18.396 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 18 k 2023-07-09T21:47:18.396 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-09T21:47:18.397 INFO:teuthology.orchestra.run.smithi184.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-09T21:47:18.397 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-09T21:47:18.397 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 31 k 2023-07-09T21:47:18.397 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 776 k 2023-07-09T21:47:18.397 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 139 k 2023-07-09T21:47:18.397 INFO:teuthology.orchestra.run.smithi184.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-09T21:47:18.397 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-09T21:47:18.397 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-09T21:47:18.398 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-09T21:47:18.398 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-09T21:47:18.398 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-09T21:47:18.398 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 196 k 2023-07-09T21:47:18.398 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 371 k 2023-07-09T21:47:18.398 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 363 k 2023-07-09T21:47:18.398 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 107 k 2023-07-09T21:47:18.398 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 94 k 2023-07-09T21:47:18.399 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 3.4 M 2023-07-09T21:47:18.399 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 179 k 2023-07-09T21:47:18.399 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-09T21:47:18.399 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2023-07-09T21:47:18.399 INFO:teuthology.orchestra.run.smithi184.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-09T21:47:18.399 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 3.7 M 2023-07-09T21:47:18.399 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 3.6 M 2023-07-09T21:47:18.400 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-07-09T21:47:18.400 INFO:teuthology.orchestra.run.smithi184.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-09T21:47:18.400 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 22 M 2023-07-09T21:47:18.400 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 23 k 2023-07-09T21:47:18.400 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 2.3 M 2023-07-09T21:47:18.400 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 240 k 2023-07-09T21:47:18.400 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 4.6 M 2023-07-09T21:47:18.400 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 18 M 2023-07-09T21:47:18.401 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4759.g35b2d86c.el8 ceph-noarch 15 k 2023-07-09T21:47:18.401 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 24 k 2023-07-09T21:47:18.401 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-09T21:47:18.401 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-09T21:47:18.401 INFO:teuthology.orchestra.run.smithi184.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-09T21:47:18.401 INFO:teuthology.orchestra.run.smithi184.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-09T21:47:18.401 INFO:teuthology.orchestra.run.smithi184.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-09T21:47:18.402 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 137 k 2023-07-09T21:47:18.402 INFO:teuthology.orchestra.run.smithi184.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-09T21:47:18.402 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-09T21:47:18.402 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-09T21:47:18.402 INFO:teuthology.orchestra.run.smithi184.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-09T21:47:18.402 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-09T21:47:18.402 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-09T21:47:18.402 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 473 k 2023-07-09T21:47:18.403 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-09T21:47:18.403 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 6.7 M 2023-07-09T21:47:18.403 INFO:teuthology.orchestra.run.smithi184.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-09T21:47:18.403 INFO:teuthology.orchestra.run.smithi184.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-09T21:47:18.403 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-09T21:47:18.403 INFO:teuthology.orchestra.run.smithi184.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-09T21:47:18.403 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-09T21:47:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-09T21:47:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-09T21:47:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-09T21:47:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-09T21:47:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-09T21:47:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-09T21:47:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-09T21:47:18.405 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-09T21:47:18.405 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-09T21:47:18.405 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-09T21:47:18.405 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-09T21:47:18.405 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 45 k 2023-07-09T21:47:18.405 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:18.0.0-4759.g35b2d86c.el8 ceph 119 k 2023-07-09T21:47:18.405 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-09T21:47:18.405 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-09T21:47:18.406 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-09T21:47:18.406 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-09T21:47:18.406 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-09T21:47:18.406 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-09T21:47:18.406 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-09T21:47:18.406 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-09T21:47:18.406 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-09T21:47:18.406 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-09T21:47:18.407 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-09T21:47:18.407 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-09T21:47:18.407 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-09T21:47:18.407 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-09T21:47:18.407 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-09T21:47:18.407 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-09T21:47:18.407 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-09T21:47:18.408 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-09T21:47:18.408 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-09T21:47:18.408 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-09T21:47:18.408 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-09T21:47:18.408 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-09T21:47:18.408 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-09T21:47:18.408 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-09T21:47:18.408 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-09T21:47:18.409 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-09T21:47:18.409 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-09T21:47:18.409 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-09T21:47:18.409 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-09T21:47:18.409 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-09T21:47:18.409 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-09T21:47:18.409 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-09T21:47:18.410 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-09T21:47:18.410 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-09T21:47:18.410 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-09T21:47:18.410 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-09T21:47:18.410 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-09T21:47:18.410 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-09T21:47:18.410 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-09T21:47:18.410 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-09T21:47:18.411 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-09T21:47:18.411 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-09T21:47:18.411 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-09T21:47:18.411 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-09T21:47:18.411 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-09T21:47:18.411 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-09T21:47:18.411 INFO:teuthology.orchestra.run.smithi184.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-09T21:47:18.411 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-09T21:47:18.412 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-09T21:47:18.412 INFO:teuthology.orchestra.run.smithi184.stdout:Enabling module streams: 2023-07-09T21:47:18.412 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql 10 2023-07-09T21:47:18.412 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:47:18.412 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-07-09T21:47:18.412 INFO:teuthology.orchestra.run.smithi184.stdout:=========================================================================================================================== 2023-07-09T21:47:18.412 INFO:teuthology.orchestra.run.smithi184.stdout:Install 128 Packages 2023-07-09T21:47:18.413 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 3 Packages 2023-07-09T21:47:18.413 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:47:18.413 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 205 M 2023-07-09T21:47:18.414 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-07-09T21:47:18.448 INFO:teuthology.orchestra.run.smithi053.stdout:(102/131): postgresql-server-10.21-2.module+el8 17 MB/s | 5.1 MB 00:00 2023-07-09T21:47:18.473 INFO:teuthology.orchestra.run.smithi053.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.8 MB/s | 200 kB 00:00 2023-07-09T21:47:18.499 INFO:teuthology.orchestra.run.smithi053.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 852 kB/s | 43 kB 00:00 2023-07-09T21:47:18.524 INFO:teuthology.orchestra.run.smithi053.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-07-09T21:47:18.549 INFO:teuthology.orchestra.run.smithi053.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 959 kB/s | 48 kB 00:00 2023-07-09T21:47:18.575 INFO:teuthology.orchestra.run.smithi053.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-07-09T21:47:18.600 INFO:teuthology.orchestra.run.smithi053.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 849 kB/s | 43 kB 00:00 2023-07-09T21:47:18.625 INFO:teuthology.orchestra.run.smithi053.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-07-09T21:47:18.650 INFO:teuthology.orchestra.run.smithi053.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-07-09T21:47:18.684 INFO:teuthology.orchestra.run.smithi053.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-07-09T21:47:18.709 INFO:teuthology.orchestra.run.smithi053.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 321 kB/s | 19 kB 00:00 2023-07-09T21:47:18.734 INFO:teuthology.orchestra.run.smithi053.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-07-09T21:47:18.777 INFO:teuthology.orchestra.run.smithi053.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 8.1 MB/s | 559 kB 00:00 2023-07-09T21:47:18.802 INFO:teuthology.orchestra.run.smithi053.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 267 kB/s | 18 kB 00:00 2023-07-09T21:47:18.835 INFO:teuthology.orchestra.run.smithi053.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-07-09T21:47:18.865 INFO:teuthology.orchestra.run.smithi184.stdout:(1/131): ceph-18.0.0-4759.g35b2d86c.el8.x86_64. 55 kB/s | 6.4 kB 00:00 2023-07-09T21:47:18.877 INFO:teuthology.orchestra.run.smithi053.stdout:(117/131): thrift-0.13.0-2.el8.x86_64.rpm 692 kB/s | 1.7 MB 00:02 2023-07-09T21:47:18.911 INFO:teuthology.orchestra.run.smithi053.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.1 MB/s | 238 kB 00:00 2023-07-09T21:47:18.962 INFO:teuthology.orchestra.run.smithi053.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 866 kB/s | 72 kB 00:00 2023-07-09T21:47:18.986 INFO:teuthology.orchestra.run.smithi053.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2023-07-09T21:47:19.012 INFO:teuthology.orchestra.run.smithi053.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-07-09T21:47:19.046 INFO:teuthology.orchestra.run.smithi053.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.6 MB/s | 98 kB 00:00 2023-07-09T21:47:19.063 INFO:teuthology.orchestra.run.smithi053.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-07-09T21:47:19.080 INFO:teuthology.orchestra.run.smithi053.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-07-09T21:47:19.098 INFO:teuthology.orchestra.run.smithi184.stdout:(2/131): ceph-fuse-18.0.0-4759.g35b2d86c.el8.x8 3.6 MB/s | 853 kB 00:00 2023-07-09T21:47:19.130 INFO:teuthology.orchestra.run.smithi053.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-07-09T21:47:19.173 INFO:teuthology.orchestra.run.smithi184.stdout:(3/131): ceph-immutable-object-cache-18.0.0-475 2.2 MB/s | 165 kB 00:00 2023-07-09T21:47:19.181 INFO:teuthology.orchestra.run.smithi053.stdout:(126/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.7 MB/s | 2.3 MB 00:00 2023-07-09T21:47:19.206 INFO:teuthology.orchestra.run.smithi053.stdout:(127/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.3 MB/s | 171 kB 00:00 2023-07-09T21:47:19.239 INFO:teuthology.orchestra.run.smithi053.stdout:(128/131): NetworkManager-initscripts-updown-1. 1.2 MB/s | 138 kB 00:00 2023-07-09T21:47:19.289 INFO:teuthology.orchestra.run.smithi053.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-07-09T21:47:19.508 INFO:teuthology.orchestra.run.smithi184.stdout:(4/131): ceph-mds-18.0.0-4759.g35b2d86c.el8.x86 6.8 MB/s | 2.3 MB 00:00 2023-07-09T21:47:19.858 INFO:teuthology.orchestra.run.smithi184.stdout:(5/131): ceph-base-18.0.0-4759.g35b2d86c.el8.x8 4.9 MB/s | 5.4 MB 00:01 2023-07-09T21:47:19.899 INFO:teuthology.orchestra.run.smithi184.stdout:(6/131): ceph-mgr-18.0.0-4759.g35b2d86c.el8.x86 4.0 MB/s | 1.6 MB 00:00 2023-07-09T21:47:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:(130/131): librbd1-18.0.0-4759.g35b2d86c.el8.x8 2.4 MB/s | 3.6 MB 00:01 2023-07-09T21:47:20.773 INFO:teuthology.orchestra.run.smithi053.stdout:(131/131): librados2-18.0.0-4759.g35b2d86c.el8. 2.3 MB/s | 3.7 MB 00:01 2023-07-09T21:47:20.777 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2023-07-09T21:47:20.778 INFO:teuthology.orchestra.run.smithi053.stdout:Total 15 MB/s | 205 MB 00:14 2023-07-09T21:47:20.825 INFO:teuthology.orchestra.run.smithi184.stdout:(7/131): ceph-common-18.0.0-4759.g35b2d86c.el8. 11 MB/s | 22 MB 00:02 2023-07-09T21:47:20.892 INFO:teuthology.orchestra.run.smithi184.stdout:(8/131): ceph-mon-18.0.0-4759.g35b2d86c.el8.x86 4.5 MB/s | 4.6 MB 00:01 2023-07-09T21:47:20.992 INFO:teuthology.orchestra.run.smithi184.stdout:(9/131): ceph-selinux-18.0.0-4759.g35b2d86c.el8 244 kB/s | 24 kB 00:00 2023-07-09T21:47:22.009 INFO:teuthology.orchestra.run.smithi184.stdout:(10/131): ceph-radosgw-18.0.0-4759.g35b2d86c.el 11 MB/s | 13 MB 00:01 2023-07-09T21:47:22.192 INFO:teuthology.orchestra.run.smithi184.stdout:(11/131): ceph-osd-18.0.0-4759.g35b2d86c.el8.x8 7.7 MB/s | 18 MB 00:02 2023-07-09T21:47:22.217 INFO:teuthology.orchestra.run.smithi184.stdout:(12/131): cephfs-mirror-18.0.0-4759.g35b2d86c.e 1.2 MB/s | 258 kB 00:00 2023-07-09T21:47:22.251 INFO:teuthology.orchestra.run.smithi184.stdout:(13/131): libcephfs-devel-18.0.0-4759.g35b2d86c 535 kB/s | 31 kB 00:00 2023-07-09T21:47:22.293 INFO:teuthology.orchestra.run.smithi184.stdout:(14/131): libcephfs2-18.0.0-4759.g35b2d86c.el8. 10 MB/s | 776 kB 00:00 2023-07-09T21:47:22.318 INFO:teuthology.orchestra.run.smithi184.stdout:(15/131): libcephsqlite-18.0.0-4759.g35b2d86c.e 2.0 MB/s | 137 kB 00:00 2023-07-09T21:47:22.352 INFO:teuthology.orchestra.run.smithi184.stdout:(16/131): librados-devel-18.0.0-4759.g35b2d86c. 2.3 MB/s | 139 kB 00:00 2023-07-09T21:47:22.386 INFO:teuthology.orchestra.run.smithi184.stdout:(17/131): libradosstriper1-18.0.0-4759.g35b2d86 6.9 MB/s | 473 kB 00:00 2023-07-09T21:47:22.441 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2023-07-09T21:47:22.452 INFO:teuthology.orchestra.run.smithi184.stdout:(18/131): python3-ceph-argparse-18.0.0-4759.g35 675 kB/s | 45 kB 00:00 2023-07-09T21:47:22.536 INFO:teuthology.orchestra.run.smithi184.stdout:(19/131): python3-ceph-common-18.0.0-4759.g35b2 1.4 MB/s | 119 kB 00:00 2023-07-09T21:47:22.586 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2023-07-09T21:47:22.586 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2023-07-09T21:47:22.628 INFO:teuthology.orchestra.run.smithi184.stdout:(20/131): python3-cephfs-18.0.0-4759.g35b2d86c. 2.1 MB/s | 196 kB 00:00 2023-07-09T21:47:22.720 INFO:teuthology.orchestra.run.smithi184.stdout:(21/131): python3-rados-18.0.0-4759.g35b2d86c.e 4.0 MB/s | 371 kB 00:00 2023-07-09T21:47:22.845 INFO:teuthology.orchestra.run.smithi184.stdout:(22/131): librgw2-18.0.0-4759.g35b2d86c.el8.x86 14 MB/s | 6.7 MB 00:00 2023-07-09T21:47:22.879 INFO:teuthology.orchestra.run.smithi184.stdout:(23/131): python3-rbd-18.0.0-4759.g35b2d86c.el8 2.2 MB/s | 363 kB 00:00 2023-07-09T21:47:22.905 INFO:teuthology.orchestra.run.smithi184.stdout:(24/131): python3-rgw-18.0.0-4759.g35b2d86c.el8 1.8 MB/s | 107 kB 00:00 2023-07-09T21:47:22.939 INFO:teuthology.orchestra.run.smithi184.stdout:(25/131): rbd-fuse-18.0.0-4759.g35b2d86c.el8.x8 1.6 MB/s | 94 kB 00:00 2023-07-09T21:47:23.023 INFO:teuthology.orchestra.run.smithi184.stdout:(26/131): rbd-nbd-18.0.0-4759.g35b2d86c.el8.x86 2.1 MB/s | 179 kB 00:00 2023-07-09T21:47:23.089 INFO:teuthology.orchestra.run.smithi184.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4759.g 347 kB/s | 23 kB 00:00 2023-07-09T21:47:23.164 INFO:teuthology.orchestra.run.smithi184.stdout:(28/131): rbd-mirror-18.0.0-4759.g35b2d86c.el8. 13 MB/s | 3.4 MB 00:00 2023-07-09T21:47:23.189 INFO:teuthology.orchestra.run.smithi184.stdout:(29/131): ceph-mgr-cephadm-18.0.0-4759.g35b2d86 1.3 MB/s | 129 kB 00:00 2023-07-09T21:47:23.315 INFO:teuthology.orchestra.run.smithi184.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4759.g35b2d 11 MB/s | 1.7 MB 00:00 2023-07-09T21:47:23.398 INFO:teuthology.orchestra.run.smithi184.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4759.g35 2.8 MB/s | 240 kB 00:00 2023-07-09T21:47:23.457 INFO:teuthology.orchestra.run.smithi184.stdout:(32/131): ceph-mgr-rook-18.0.0-4759.g35b2d86c.e 816 kB/s | 47 kB 00:00 2023-07-09T21:47:23.515 INFO:teuthology.orchestra.run.smithi184.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4759.g3 249 kB/s | 15 kB 00:00 2023-07-09T21:47:23.591 INFO:teuthology.orchestra.run.smithi184.stdout:(34/131): ceph-volume-18.0.0-4759.g35b2d86c.el8 3.4 MB/s | 258 kB 00:00 2023-07-09T21:47:23.658 INFO:teuthology.orchestra.run.smithi184.stdout:(35/131): cephadm-18.0.0-4759.g35b2d86c.el8.noa 2.4 MB/s | 164 kB 00:00 2023-07-09T21:47:23.716 INFO:teuthology.orchestra.run.smithi184.stdout:(36/131): cephfs-top-18.0.0-4759.g35b2d86c.el8. 309 kB/s | 18 kB 00:00 2023-07-09T21:47:23.859 INFO:teuthology.orchestra.run.smithi184.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2023-07-09T21:47:23.917 INFO:teuthology.orchestra.run.smithi184.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2023-07-09T21:47:23.959 INFO:teuthology.orchestra.run.smithi184.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2023-07-09T21:47:23.984 INFO:teuthology.orchestra.run.smithi184.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 470 kB/s | 59 kB 00:00 2023-07-09T21:47:24.026 INFO:teuthology.orchestra.run.smithi184.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 7.0 MB/s | 476 kB 00:00 2023-07-09T21:47:24.052 INFO:teuthology.orchestra.run.smithi184.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 653 kB/s | 44 kB 00:00 2023-07-09T21:47:24.077 INFO:teuthology.orchestra.run.smithi184.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-07-09T21:47:24.102 INFO:teuthology.orchestra.run.smithi184.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 659 kB/s | 33 kB 00:00 2023-07-09T21:47:24.127 INFO:teuthology.orchestra.run.smithi184.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 326 kB/s | 16 kB 00:00 2023-07-09T21:47:24.162 INFO:teuthology.orchestra.run.smithi184.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2023-07-09T21:47:24.195 INFO:teuthology.orchestra.run.smithi184.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 5.6 MB/s | 384 kB 00:00 2023-07-09T21:47:24.220 INFO:teuthology.orchestra.run.smithi184.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-07-09T21:47:24.246 INFO:teuthology.orchestra.run.smithi184.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2023-07-09T21:47:24.271 INFO:teuthology.orchestra.run.smithi184.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 351 kB/s | 18 kB 00:00 2023-07-09T21:47:24.313 INFO:teuthology.orchestra.run.smithi184.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2023-07-09T21:47:24.355 INFO:teuthology.orchestra.run.smithi184.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 11 MB/s | 1.2 MB 00:00 2023-07-09T21:47:24.377 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2023-07-09T21:47:24.381 INFO:teuthology.orchestra.run.smithi184.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 878 kB/s | 59 kB 00:00 2023-07-09T21:47:24.381 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2023-07-09T21:47:24.406 INFO:teuthology.orchestra.run.smithi184.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-07-09T21:47:24.431 INFO:teuthology.orchestra.run.smithi184.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-07-09T21:47:24.448 INFO:teuthology.orchestra.run.smithi184.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 372 kB/s | 16 kB 00:00 2023-07-09T21:47:24.465 INFO:teuthology.orchestra.run.smithi184.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 1.0 MB/s | 34 kB 00:00 2023-07-09T21:47:24.490 INFO:teuthology.orchestra.run.smithi184.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 4.6 MB/s | 196 kB 00:00 2023-07-09T21:47:24.508 INFO:teuthology.orchestra.run.smithi184.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 1.4 MB/s | 61 kB 00:00 2023-07-09T21:47:24.524 INFO:teuthology.orchestra.run.smithi184.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 559 kB/s | 19 kB 00:00 2023-07-09T21:47:24.541 INFO:teuthology.orchestra.run.smithi184.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 710 kB/s | 24 kB 00:00 2023-07-09T21:47:24.559 INFO:teuthology.orchestra.run.smithi184.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 874 kB/s | 29 kB 00:00 2023-07-09T21:47:24.575 INFO:teuthology.orchestra.run.smithi184.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 825 kB/s | 27 kB 00:00 2023-07-09T21:47:24.601 INFO:teuthology.orchestra.run.smithi184.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 6.0 MB/s | 255 kB 00:00 2023-07-09T21:47:24.625 INFO:teuthology.orchestra.run.smithi184.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2023-07-09T21:47:24.651 INFO:teuthology.orchestra.run.smithi184.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-07-09T21:47:24.676 INFO:teuthology.orchestra.run.smithi184.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-07-09T21:47:24.701 INFO:teuthology.orchestra.run.smithi184.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 458 kB/s | 23 kB 00:00 2023-07-09T21:47:24.727 INFO:teuthology.orchestra.run.smithi184.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-09T21:47:24.785 INFO:teuthology.orchestra.run.smithi184.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 16 MB/s | 1.7 MB 00:00 2023-07-09T21:47:24.811 INFO:teuthology.orchestra.run.smithi184.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 562 kB/s | 47 kB 00:00 2023-07-09T21:47:24.861 INFO:teuthology.orchestra.run.smithi184.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 959 kB/s | 43 kB 00:00 2023-07-09T21:47:24.887 INFO:teuthology.orchestra.run.smithi184.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2023-07-09T21:47:24.920 INFO:teuthology.orchestra.run.smithi184.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-07-09T21:47:24.946 INFO:teuthology.orchestra.run.smithi184.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 825 kB/s | 48 kB 00:00 2023-07-09T21:47:24.971 INFO:teuthology.orchestra.run.smithi184.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-07-09T21:47:24.996 INFO:teuthology.orchestra.run.smithi184.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 850 kB/s | 43 kB 00:00 2023-07-09T21:47:25.022 INFO:teuthology.orchestra.run.smithi184.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-07-09T21:47:25.072 INFO:teuthology.orchestra.run.smithi184.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-07-09T21:47:25.114 INFO:teuthology.orchestra.run.smithi184.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.9 MB/s | 560 kB 00:00 2023-07-09T21:47:25.141 INFO:teuthology.orchestra.run.smithi184.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 278 kB/s | 19 kB 00:00 2023-07-09T21:47:25.165 INFO:teuthology.orchestra.run.smithi184.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-07-09T21:47:25.207 INFO:teuthology.orchestra.run.smithi184.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 8.2 MB/s | 559 kB 00:00 2023-07-09T21:47:25.232 INFO:teuthology.orchestra.run.smithi184.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 267 kB/s | 18 kB 00:00 2023-07-09T21:47:25.274 INFO:teuthology.orchestra.run.smithi184.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 8.9 MB/s | 605 kB 00:00 2023-07-09T21:47:25.708 INFO:teuthology.orchestra.run.smithi184.stdout:(86/131): ceph-test-18.0.0-4759.g35b2d86c.el8.x 10 MB/s | 48 MB 00:04 2023-07-09T21:47:25.741 INFO:teuthology.orchestra.run.smithi184.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 467 kB/s | 238 kB 00:00 2023-07-09T21:47:25.791 INFO:teuthology.orchestra.run.smithi184.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 1.8 MB/s | 83 kB 00:00 2023-07-09T21:47:25.817 INFO:teuthology.orchestra.run.smithi184.stdout:(89/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 666 kB/s | 72 kB 00:00 2023-07-09T21:47:25.842 INFO:teuthology.orchestra.run.smithi184.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-07-09T21:47:25.867 INFO:teuthology.orchestra.run.smithi184.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-07-09T21:47:25.893 INFO:teuthology.orchestra.run.smithi184.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-07-09T21:47:25.910 INFO:teuthology.orchestra.run.smithi184.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 920 kB/s | 39 kB 00:00 2023-07-09T21:47:25.952 INFO:teuthology.orchestra.run.smithi184.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-07-09T21:47:26.004 INFO:teuthology.orchestra.run.smithi184.stdout:(95/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 3.2 MB/s | 2.3 MB 00:00 2023-07-09T21:47:26.027 INFO:teuthology.orchestra.run.smithi184.stdout:(96/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.4 MB/s | 171 kB 00:00 2023-07-09T21:47:26.053 INFO:teuthology.orchestra.run.smithi184.stdout:(97/131): NetworkManager-initscripts-updown-1.3 1.3 MB/s | 138 kB 00:00 2023-07-09T21:47:26.078 INFO:teuthology.orchestra.run.smithi184.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-07-09T21:47:26.112 INFO:teuthology.orchestra.run.smithi184.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 922 kB/s | 54 kB 00:00 2023-07-09T21:47:26.145 INFO:teuthology.orchestra.run.smithi184.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2023-07-09T21:47:26.179 INFO:teuthology.orchestra.run.smithi184.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-07-09T21:47:26.204 INFO:teuthology.orchestra.run.smithi184.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 664 kB/s | 39 kB 00:00 2023-07-09T21:47:26.255 INFO:teuthology.orchestra.run.smithi184.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 8.9 MB/s | 688 kB 00:00 2023-07-09T21:47:26.297 INFO:teuthology.orchestra.run.smithi184.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 5.7 MB/s | 538 kB 00:00 2023-07-09T21:47:26.322 INFO:teuthology.orchestra.run.smithi184.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-07-09T21:47:26.355 INFO:teuthology.orchestra.run.smithi184.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-07-09T21:47:26.406 INFO:teuthology.orchestra.run.smithi184.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 8.3 MB/s | 713 kB 00:00 2023-07-09T21:47:26.448 INFO:teuthology.orchestra.run.smithi184.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 642 kB/s | 27 kB 00:00 2023-07-09T21:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.2 MB/s | 320 kB 00:00 2023-07-09T21:47:26.540 INFO:teuthology.orchestra.run.smithi184.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-07-09T21:47:26.640 INFO:teuthology.orchestra.run.smithi184.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 17 MB/s | 4.8 MB 00:00 2023-07-09T21:47:26.699 INFO:teuthology.orchestra.run.smithi184.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-07-09T21:47:26.749 INFO:teuthology.orchestra.run.smithi184.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 4.4 MB/s | 225 kB 00:00 2023-07-09T21:47:26.816 INFO:teuthology.orchestra.run.smithi184.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-07-09T21:47:26.841 INFO:teuthology.orchestra.run.smithi184.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 696 kB/s | 64 kB 00:00 2023-07-09T21:47:26.866 INFO:teuthology.orchestra.run.smithi184.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-07-09T21:47:26.892 INFO:teuthology.orchestra.run.smithi184.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 399 kB/s | 20 kB 00:00 2023-07-09T21:47:26.917 INFO:teuthology.orchestra.run.smithi184.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-07-09T21:47:26.968 INFO:teuthology.orchestra.run.smithi184.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 9.2 MB/s | 709 kB 00:00 2023-07-09T21:47:27.001 INFO:teuthology.orchestra.run.smithi184.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 5.8 MB/s | 198 kB 00:00 2023-07-09T21:47:27.168 INFO:teuthology.orchestra.run.smithi184.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 12 MB/s | 14 MB 00:01 2023-07-09T21:47:27.210 INFO:teuthology.orchestra.run.smithi184.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-07-09T21:47:27.260 INFO:teuthology.orchestra.run.smithi184.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-07-09T21:47:27.352 INFO:teuthology.orchestra.run.smithi184.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 11 MB/s | 4.9 MB 00:00 2023-07-09T21:47:27.411 INFO:teuthology.orchestra.run.smithi184.stdout:(125/131): postgresql-contrib-10.21-2.module+el 14 MB/s | 808 kB 00:00 2023-07-09T21:47:27.479 INFO:teuthology.orchestra.run.smithi184.stdout:(126/131): openblas-0.3.15-3.el8.x86_64.rpm 9.9 MB/s | 4.7 MB 00:00 2023-07-09T21:47:27.537 INFO:teuthology.orchestra.run.smithi184.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-07-09T21:47:27.628 INFO:teuthology.orchestra.run.smithi184.stdout:(128/131): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2023-07-09T21:47:27.687 INFO:teuthology.orchestra.run.smithi184.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-07-09T21:47:27.937 INFO:teuthology.orchestra.run.smithi184.stdout:(130/131): librados2-18.0.0-4759.g35b2d86c.el8. 8.0 MB/s | 3.7 MB 00:00 2023-07-09T21:47:28.096 INFO:teuthology.orchestra.run.smithi184.stdout:(131/131): librbd1-18.0.0-4759.g35b2d86c.el8.x8 6.4 MB/s | 3.6 MB 00:00 2023-07-09T21:47:28.099 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-07-09T21:47:28.100 INFO:teuthology.orchestra.run.smithi184.stdout:Total 21 MB/s | 205 MB 00:09 2023-07-09T21:47:29.321 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2023-07-09T21:47:29.498 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-09T21:47:29.672 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-09T21:47:29.704 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-07-09T21:47:29.838 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-07-09T21:47:29.838 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-07-09T21:47:29.888 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-09T21:47:30.041 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-09T21:47:30.190 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-09T21:47:30.391 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-09T21:47:30.890 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-09T21:47:31.116 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librados2-2:18.0.0-4759.g35b2d86c.el8.x86_64 6/134 2023-07-09T21:47:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:18.0.0-4759.g35b2d86c.el8.x86_64 6/134 2023-07-09T21:47:31.585 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-07-09T21:47:31.589 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-07-09T21:47:31.974 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librbd1-2:18.0.0-4759.g35b2d86c.el8.x86_64 7/134 2023-07-09T21:47:32.113 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:18.0.0-4759.g35b2d86c.el8.x86_64 7/134 2023-07-09T21:47:32.323 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs2-2:18.0.0-4759.g35b2d86c.el8.x86_64 8/134 2023-07-09T21:47:32.446 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs2-2:18.0.0-4759.g35b2d86c.el8.x86_64 8/134 2023-07-09T21:47:32.646 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rados-2:18.0.0-4759.g35b2d86c.el8.x86_64 9/134 2023-07-09T21:47:32.902 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-09T21:47:33.088 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-09T21:47:33.532 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-09T21:47:33.803 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-09T21:47:33.990 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephsqlite-2:18.0.0-4759.g35b2d86c.el8.x86_64 14/134 2023-07-09T21:47:34.122 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4759.g35b2d86c.el8.x86_64 14/134 2023-07-09T21:47:34.291 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libradosstriper1-2:18.0.0-4759.g35b2d86c.el8.x86 15/134 2023-07-09T21:47:34.387 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4759.g35b2d86c.el8.x86 15/134 2023-07-09T21:47:34.523 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-09T21:47:34.707 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-09T21:47:34.848 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-09T21:47:35.597 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-09T21:47:35.748 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-09T21:47:36.477 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-09T21:47:36.489 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-07-09T21:47:36.673 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-09T21:47:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-09T21:47:36.861 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-09T21:47:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-09T21:47:37.196 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-09T21:47:37.386 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-09T21:47:37.567 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-09T21:47:37.830 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-09T21:47:37.851 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-09T21:47:38.063 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-09T21:47:38.272 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-09T21:47:38.450 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-09T21:47:38.486 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:18.0.0-4759.g35b2d86c.el8.x86_64 5/134 2023-07-09T21:47:38.679 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-09T21:47:38.921 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-09T21:47:38.932 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:18.0.0-4759.g35b2d86c.el8.x86_64 5/134 2023-07-09T21:47:39.097 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-common-2:18.0.0-4759.g35b2d86c.el8. 26/134 2023-07-09T21:47:39.135 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:18.0.0-4759.g35b2d86c.el8.x86_64 6/134 2023-07-09T21:47:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-argparse-2:18.0.0-4759.g35b2d86c.el 27/134 2023-07-09T21:47:39.289 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:18.0.0-4759.g35b2d86c.el8.x86_64 6/134 2023-07-09T21:47:39.461 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:18.0.0-4759.g35b2d86c.el8.x86_64 7/134 2023-07-09T21:47:39.583 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:18.0.0-4759.g35b2d86c.el8.x86_64 7/134 2023-07-09T21:47:39.783 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:18.0.0-4759.g35b2d86c.el8.x86_64 8/134 2023-07-09T21:47:39.956 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-07-09T21:47:40.209 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-09T21:47:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cephfs-2:18.0.0-4759.g35b2d86c.el8.x86_6 28/134 2023-07-09T21:47:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-09T21:47:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-09T21:47:40.930 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-09T21:47:40.950 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-09T21:47:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-09T21:47:41.223 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-09T21:47:41.319 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:18.0.0-4759.g35b2d86c.el8.x86_64 14/134 2023-07-09T21:47:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-09T21:47:41.439 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4759.g35b2d86c.el8.x86_64 14/134 2023-07-09T21:47:41.610 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:18.0.0-4759.g35b2d86c.el8.x86 15/134 2023-07-09T21:47:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4759.g35b2d86c.el8.x86 15/134 2023-07-09T21:47:41.967 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-07-09T21:47:42.160 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-07-09T21:47:42.342 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-07-09T21:47:42.468 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-09T21:47:42.642 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-09T21:47:42.776 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-09T21:47:43.481 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-09T21:47:43.596 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-09T21:47:43.668 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-09T21:47:43.942 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-09T21:47:44.153 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-09T21:47:44.350 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-09T21:47:44.361 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-09T21:47:44.543 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rbd-2:18.0.0-4759.g35b2d86c.el8.x86_64 36/134 2023-07-09T21:47:44.551 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-07-09T21:47:44.754 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librados-devel-2:18.0.0-4759.g35b2d86c.el8.x86_6 37/134 2023-07-09T21:47:44.909 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-09T21:47:45.085 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-09T21:47:45.234 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-09T21:47:45.380 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-09T21:47:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-07-09T21:47:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-09T21:47:45.676 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-07-09T21:47:45.775 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-09T21:47:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-09T21:47:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-09T21:47:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-09T21:47:46.688 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-07-09T21:47:46.688 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-09T21:47:46.688 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:18.0.0-4759.g35b2d86c.el8. 26/134 2023-07-09T21:47:46.688 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:18.0.0-4759.g35b2d86c.el 27/134 2023-07-09T21:47:46.746 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:18.0.0-4759.g35b2d86c.el8.x86_6 28/134 2023-07-09T21:47:46.922 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-09T21:47:46.951 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-09T21:47:47.184 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-09T21:47:47.507 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-09T21:47:47.757 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-09T21:47:47.909 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-09T21:47:48.091 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-09T21:47:48.284 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-09T21:47:48.452 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-09T21:47:48.799 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-09T21:47:49.020 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-09T21:47:49.073 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-09T21:47:49.342 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-09T21:47:49.572 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-09T21:47:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-09T21:47:50.032 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-09T21:47:50.184 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-07-09T21:47:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-09T21:47:50.278 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-09T21:47:50.547 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-07-09T21:47:50.552 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-09T21:47:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-09T21:47:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-07-09T21:47:50.880 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-09T21:47:50.981 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-09T21:47:51.034 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-07-09T21:47:51.161 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-09T21:47:51.262 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-09T21:47:51.333 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-09T21:47:51.470 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-09T21:47:51.481 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-09T21:47:51.643 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:18.0.0-4759.g35b2d86c.el8.x86_64 36/134 2023-07-09T21:47:51.688 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-09T21:47:51.824 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:18.0.0-4759.g35b2d86c.el8.x86_6 37/134 2023-07-09T21:47:51.958 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-09T21:47:51.992 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-07-09T21:47:52.163 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-07-09T21:47:52.321 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-09T21:47:52.350 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-07-09T21:47:52.441 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-07-09T21:47:52.477 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-09T21:47:52.643 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-09T21:47:52.695 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-07-09T21:47:52.839 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-09T21:47:52.906 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-07-09T21:47:53.047 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-09T21:47:53.100 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-09T21:47:53.192 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-09T21:47:53.229 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-09T21:47:53.366 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-09T21:47:53.427 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-07-09T21:47:53.504 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-09T21:47:53.604 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-07-09T21:47:53.709 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-09T21:47:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-07-09T21:47:53.886 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-09T21:47:53.944 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-07-09T21:47:54.095 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-09T21:47:54.111 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-07-09T21:47:54.256 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-07-09T21:47:54.369 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-09T21:47:54.463 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-07-09T21:47:54.598 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-09T21:47:54.697 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-07-09T21:47:54.775 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-09T21:47:54.985 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-09T21:47:55.109 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-07-09T21:47:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-07-09T21:47:55.607 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-07-09T21:47:55.851 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-07-09T21:47:56.051 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-07-09T21:47:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-09T21:47:56.382 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-07-09T21:47:56.625 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-07-09T21:47:56.626 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-09T21:47:56.795 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-07-09T21:47:56.853 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-09T21:47:57.012 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-07-09T21:47:57.184 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-09T21:47:57.193 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-07-09T21:47:57.346 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-07-09T21:47:57.466 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-09T21:47:57.675 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-09T21:47:57.686 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-07-09T21:47:57.979 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-07-09T21:47:58.238 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-07-09T21:47:58.502 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-07-09T21:47:58.564 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-09T21:47:58.692 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-09T21:47:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librgw2-2:18.0.0-4759.g35b2d86c.el8.x86_64 92/134 2023-07-09T21:47:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librgw2-2:18.0.0-4759.g35b2d86c.el8.x86_64 92/134 2023-07-09T21:47:58.897 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-09T21:47:58.987 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 93/134 2023-07-09T21:47:59.163 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-09T21:47:59.382 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-09T21:47:59.537 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-09T21:47:59.695 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-09T21:47:59.923 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-09T21:48:00.148 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-09T21:48:00.355 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-09T21:48:00.519 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-09T21:48:00.681 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-09T21:48:00.916 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-09T21:48:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-09T21:48:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-09T21:48:01.569 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-09T21:48:01.791 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-09T21:48:01.958 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-09T21:48:02.163 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-09T21:48:03.478 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-09T21:48:03.751 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-09T21:48:03.970 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-09T21:48:04.068 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:18.0.0-4759.g35b2d86c.el8.x86_64 94/134 2023-07-09T21:48:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-09T21:48:04.303 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-common-2:18.0.0-4759.g35b2d86c.el8.x86_64 94/134 2023-07-09T21:48:04.560 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-09T21:48:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-09T21:48:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:18.0.0-4759.g35b2d86c.el8.x86_64 94/134 2023-07-09T21:48:05.306 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-base-2:18.0.0-4759.g35b2d86c.el8.x86_64 95/134 2023-07-09T21:48:05.432 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-base-2:18.0.0-4759.g35b2d86c.el8.x86_64 95/134 2023-07-09T21:48:05.553 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-selinux-2:18.0.0-4759.g35b2d86c.el8.x86_64 96/134 2023-07-09T21:48:05.630 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-09T21:48:05.789 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:18.0.0-4759.g35b2d86c.el8.x86_64 92/134 2023-07-09T21:48:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:18.0.0-4759.g35b2d86c.el8.x86_64 92/134 2023-07-09T21:48:06.056 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 93/134 2023-07-09T21:48:10.871 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:18.0.0-4759.g35b2d86c.el8.x86_64 94/134 2023-07-09T21:48:11.114 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:18.0.0-4759.g35b2d86c.el8.x86_64 94/134 2023-07-09T21:48:11.792 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:18.0.0-4759.g35b2d86c.el8.x86_64 94/134 2023-07-09T21:48:12.074 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:18.0.0-4759.g35b2d86c.el8.x86_64 95/134 2023-07-09T21:48:12.213 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:18.0.0-4759.g35b2d86c.el8.x86_64 95/134 2023-07-09T21:48:12.355 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:18.0.0-4759.g35b2d86c.el8.x86_64 96/134 2023-07-09T21:48:26.638 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4759.g35b2d86c.el8.x86_64 96/134 2023-07-09T21:48:26.639 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /sys 2023-07-09T21:48:26.639 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /proc 2023-07-09T21:48:26.639 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /dev 2023-07-09T21:48:26.640 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /run 2023-07-09T21:48:26.640 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /mnt 2023-07-09T21:48:26.640 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /var/tmp 2023-07-09T21:48:26.640 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /home 2023-07-09T21:48:26.641 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /tmp 2023-07-09T21:48:26.641 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /dev 2023-07-09T21:48:26.641 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:48:27.017 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-volume-2:18.0.0-4759.g35b2d86c.el8.noarch 97/134 2023-07-09T21:48:28.865 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-volume-2:18.0.0-4759.g35b2d86c.el8.noarch 97/134 2023-07-09T21:48:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-osd-2:18.0.0-4759.g35b2d86c.el8.x86_64 98/134 2023-07-09T21:48:29.318 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-osd-2:18.0.0-4759.g35b2d86c.el8.x86_64 98/134 2023-07-09T21:48:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mds-2:18.0.0-4759.g35b2d86c.el8.x86_64 99/134 2023-07-09T21:48:30.019 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mds-2:18.0.0-4759.g35b2d86c.el8.x86_64 99/134 2023-07-09T21:48:30.241 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mon-2:18.0.0-4759.g35b2d86c.el8.x86_64 100/134 2023-07-09T21:48:30.283 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mon-2:18.0.0-4759.g35b2d86c.el8.x86_64 100/134 2023-07-09T21:48:32.976 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4759.g35b2d86c.el8.x86_64 96/134 2023-07-09T21:48:32.977 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2023-07-09T21:48:32.977 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2023-07-09T21:48:32.977 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-07-09T21:48:32.978 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /run 2023-07-09T21:48:32.978 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2023-07-09T21:48:32.983 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2023-07-09T21:48:32.983 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2023-07-09T21:48:32.983 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2023-07-09T21:48:32.984 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-07-09T21:48:32.984 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:48:33.053 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:18.0.0-4759.g35b2d86c.el8.noarch 101/134 2023-07-09T21:48:33.214 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephadm-2:18.0.0-4759.g35b2d86c.el8.noarch 101/134 2023-07-09T21:48:33.349 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4759.g35b2d86c.e 102/134 2023-07-09T21:48:33.360 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:18.0.0-4759.g35b2d86c.el8.noarch 97/134 2023-07-09T21:48:33.547 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4759.g35b2d86c. 103/134 2023-07-09T21:48:33.757 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4759.g35b2d86c.el8.noa 104/134 2023-07-09T21:48:34.031 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4759.g35b2d86c.el8.noa 104/134 2023-07-09T21:48:34.226 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4759.g35b2d86c.el8.n 105/134 2023-07-09T21:48:35.092 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:18.0.0-4759.g35b2d86c.el8.noarch 97/134 2023-07-09T21:48:35.278 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:18.0.0-4759.g35b2d86c.el8.x86_64 98/134 2023-07-09T21:48:35.415 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4759.g35b2d86c.el8.n 105/134 2023-07-09T21:48:35.545 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:18.0.0-4759.g35b2d86c.el8.x86_64 98/134 2023-07-09T21:48:35.565 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4759.g35b 106/134 2023-07-09T21:48:35.699 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4759.g35b 106/134 2023-07-09T21:48:35.736 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:18.0.0-4759.g35b2d86c.el8.x86_64 99/134 2023-07-09T21:48:36.096 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4759.g35b2d86c.el 107/134 2023-07-09T21:48:36.262 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:18.0.0-4759.g35b2d86c.el8.x86_64 99/134 2023-07-09T21:48:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-2:18.0.0-4759.g35b2d86c.el8.x86_64 108/134 2023-07-09T21:48:36.334 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4759.g35b2d86c.el8.x86_64 108/134 2023-07-09T21:48:36.468 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:18.0.0-4759.g35b2d86c.el8.x86_64 100/134 2023-07-09T21:48:36.508 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:18.0.0-4759.g35b2d86c.el8.x86_64 100/134 2023-07-09T21:48:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-rook-2:18.0.0-4759.g35b2d86c.el8.noarch 109/134 2023-07-09T21:48:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4759.g35b2d86c.el8.noarch 109/134 2023-07-09T21:48:38.049 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-2:18.0.0-4759.g35b2d86c.el8.x86_64 110/134 2023-07-09T21:48:38.279 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-radosgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 111/134 2023-07-09T21:48:38.342 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 111/134 2023-07-09T21:48:38.482 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4759.g35b2d 112/134 2023-07-09T21:48:38.564 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4759.g35b2d 112/134 2023-07-09T21:48:38.715 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 113/134 2023-07-09T21:48:39.136 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:18.0.0-4759.g35b2d86c.el8.noarch 101/134 2023-07-09T21:48:39.148 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 113/134 2023-07-09T21:48:39.291 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 114/134 2023-07-09T21:48:39.330 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:18.0.0-4759.g35b2d86c.el8.noarch 101/134 2023-07-09T21:48:39.492 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4759.g35b2d86c.e 102/134 2023-07-09T21:48:39.697 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4759.g35b2d86c. 103/134 2023-07-09T21:48:39.892 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4759.g35b2d86c.el8.noa 104/134 2023-07-09T21:48:40.150 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4759.g35b2d86c.el8.noa 104/134 2023-07-09T21:48:40.360 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4759.g35b2d86c.el8.n 105/134 2023-07-09T21:48:41.478 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4759.g35b2d86c.el8.n 105/134 2023-07-09T21:48:41.658 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4759.g35b 106/134 2023-07-09T21:48:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4759.g35b 106/134 2023-07-09T21:48:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4759.g35b2d86c.el 107/134 2023-07-09T21:48:42.369 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:18.0.0-4759.g35b2d86c.el8.x86_64 108/134 2023-07-09T21:48:42.434 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4759.g35b2d86c.el8.x86_64 108/134 2023-07-09T21:48:42.617 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:18.0.0-4759.g35b2d86c.el8.noarch 109/134 2023-07-09T21:48:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4759.g35b2d86c.el8.noarch 109/134 2023-07-09T21:48:44.051 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:18.0.0-4759.g35b2d86c.el8.x86_64 110/134 2023-07-09T21:48:44.299 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 111/134 2023-07-09T21:48:44.359 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 111/134 2023-07-09T21:48:44.516 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4759.g35b2d 112/134 2023-07-09T21:48:44.578 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 114/134 2023-07-09T21:48:44.592 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4759.g35b2d 112/134 2023-07-09T21:48:44.758 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 113/134 2023-07-09T21:48:44.863 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-test-2:18.0.0-4759.g35b2d86c.el8.x86_64 115/134 2023-07-09T21:48:44.989 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-09T21:48:45.163 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 113/134 2023-07-09T21:48:45.258 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-09T21:48:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 114/134 2023-07-09T21:48:46.547 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-09T21:48:46.894 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-09T21:48:47.075 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-fuse-2:18.0.0-4759.g35b2d86c.el8.x86_64 119/134 2023-07-09T21:48:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-09T21:48:47.470 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs-devel-2:18.0.0-4759.g35b2d86c.el8.x86_ 121/134 2023-07-09T21:48:47.607 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-09T21:48:50.282 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 114/134 2023-07-09T21:48:50.998 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-09T21:48:51.247 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-09T21:48:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-09T21:48:51.499 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:18.0.0-4759.g35b2d86c.el8.x86_64 115/134 2023-07-09T21:48:51.511 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-top-2:18.0.0-4759.g35b2d86c.el8.noarch 124/134 2023-07-09T21:48:51.733 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-fuse-2:18.0.0-4759.g35b2d86c.el8.x86_64 125/134 2023-07-09T21:48:51.861 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-07-09T21:48:52.055 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-nbd-2:18.0.0-4759.g35b2d86c.el8.x86_64 126/134 2023-07-09T21:48:52.067 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:18.0.0-4759.g35b2d86c.el8.x86_64 117/134 2023-07-09T21:48:52.332 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-09T21:48:52.369 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-07-09T21:48:52.505 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-09T21:48:52.527 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-09T21:48:52.548 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-07-09T21:48:52.757 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-09T21:48:52.805 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-07-09T21:48:52.938 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-09T21:48:53.036 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-07-09T21:48:53.052 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-09T21:48:53.203 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:18.0.0-4759.g35b2d86c.el8.x86_ 121/134 2023-07-09T21:48:53.271 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-09T21:48:53.300 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-09T21:48:53.300 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-09T21:48:53.349 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-09T21:48:53.520 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-09T21:48:53.520 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-09T21:48:53.771 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-09T21:48:53.946 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-09T21:48:54.203 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-09T21:48:54.203 INFO:teuthology.orchestra.run.smithi053.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-09T21:48:54.203 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:48:54.820 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-2:18.0.0-4759.g35b2d86c.el8.x86_64 1/134 2023-07-09T21:48:54.820 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-base-2:18.0.0-4759.g35b2d86c.el8.x86_64 2/134 2023-07-09T21:48:54.820 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-common-2:18.0.0-4759.g35b2d86c.el8.x86_64 3/134 2023-07-09T21:48:54.820 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-fuse-2:18.0.0-4759.g35b2d86c.el8.x86_64 4/134 2023-07-09T21:48:54.821 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4759.g35b2d 5/134 2023-07-09T21:48:54.821 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mds-2:18.0.0-4759.g35b2d86c.el8.x86_64 6/134 2023-07-09T21:48:54.821 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-2:18.0.0-4759.g35b2d86c.el8.x86_64 7/134 2023-07-09T21:48:54.821 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mon-2:18.0.0-4759.g35b2d86c.el8.x86_64 8/134 2023-07-09T21:48:54.821 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-osd-2:18.0.0-4759.g35b2d86c.el8.x86_64 9/134 2023-07-09T21:48:54.821 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-radosgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 10/134 2023-07-09T21:48:54.821 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-selinux-2:18.0.0-4759.g35b2d86c.el8.x86_64 11/134 2023-07-09T21:48:54.822 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-test-2:18.0.0-4759.g35b2d86c.el8.x86_64 12/134 2023-07-09T21:48:54.822 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 13/134 2023-07-09T21:48:54.822 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs-devel-2:18.0.0-4759.g35b2d86c.el8.x86_ 14/134 2023-07-09T21:48:54.822 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs2-2:18.0.0-4759.g35b2d86c.el8.x86_64 15/134 2023-07-09T21:48:54.822 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephsqlite-2:18.0.0-4759.g35b2d86c.el8.x86_64 16/134 2023-07-09T21:48:54.822 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados-devel-2:18.0.0-4759.g35b2d86c.el8.x86_6 17/134 2023-07-09T21:48:54.822 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libradosstriper1-2:18.0.0-4759.g35b2d86c.el8.x86 18/134 2023-07-09T21:48:54.822 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librgw2-2:18.0.0-4759.g35b2d86c.el8.x86_64 19/134 2023-07-09T21:48:54.823 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4759.g35b2d86c.el 20/134 2023-07-09T21:48:54.823 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-common-2:18.0.0-4759.g35b2d86c.el8. 21/134 2023-07-09T21:48:54.823 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cephfs-2:18.0.0-4759.g35b2d86c.el8.x86_6 22/134 2023-07-09T21:48:54.823 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rados-2:18.0.0-4759.g35b2d86c.el8.x86_64 23/134 2023-07-09T21:48:54.823 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rbd-2:18.0.0-4759.g35b2d86c.el8.x86_64 24/134 2023-07-09T21:48:54.823 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 25/134 2023-07-09T21:48:54.830 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-fuse-2:18.0.0-4759.g35b2d86c.el8.x86_64 26/134 2023-07-09T21:48:54.830 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 27/134 2023-07-09T21:48:54.831 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-nbd-2:18.0.0-4759.g35b2d86c.el8.x86_64 28/134 2023-07-09T21:48:54.831 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4759.g35b2d86c. 29/134 2023-07-09T21:48:54.831 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4759.g35b2d86c.el8.noa 30/134 2023-07-09T21:48:54.831 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4759.g35b2d86c.el8.n 31/134 2023-07-09T21:48:54.831 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4759.g35b 32/134 2023-07-09T21:48:54.831 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4759.g35b2d86c.el 33/134 2023-07-09T21:48:54.831 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4759.g35b2d86c.el8.noarch 34/134 2023-07-09T21:48:54.832 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4759.g35b2d86c.e 35/134 2023-07-09T21:48:54.832 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-volume-2:18.0.0-4759.g35b2d86c.el8.noarch 36/134 2023-07-09T21:48:54.832 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephadm-2:18.0.0-4759.g35b2d86c.el8.noarch 37/134 2023-07-09T21:48:54.832 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-top-2:18.0.0-4759.g35b2d86c.el8.noarch 38/134 2023-07-09T21:48:54.832 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-09T21:48:54.832 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-09T21:48:54.832 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-09T21:48:54.833 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-09T21:48:54.833 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-09T21:48:54.833 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-09T21:48:54.833 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-09T21:48:54.833 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-09T21:48:54.833 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-09T21:48:54.833 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-09T21:48:54.833 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-09T21:48:54.834 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-09T21:48:54.834 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-09T21:48:54.834 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-09T21:48:54.834 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-09T21:48:54.834 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-09T21:48:54.834 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-09T21:48:54.834 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-09T21:48:54.834 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-09T21:48:54.835 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-09T21:48:54.835 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-09T21:48:54.835 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-09T21:48:54.835 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-09T21:48:54.835 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-09T21:48:54.835 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-09T21:48:54.835 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-09T21:48:54.836 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-09T21:48:54.836 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-09T21:48:54.836 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-09T21:48:54.836 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-09T21:48:54.836 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-09T21:48:54.836 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-09T21:48:54.836 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-09T21:48:54.836 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-09T21:48:54.837 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-09T21:48:54.837 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-09T21:48:54.837 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-09T21:48:54.837 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-09T21:48:54.837 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-09T21:48:54.837 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-09T21:48:54.837 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-09T21:48:54.837 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-09T21:48:54.838 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-09T21:48:54.838 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-09T21:48:54.838 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-09T21:48:54.838 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-09T21:48:54.838 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-09T21:48:54.838 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-09T21:48:54.838 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-09T21:48:54.839 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-09T21:48:54.839 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-09T21:48:54.839 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-09T21:48:54.839 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-09T21:48:54.839 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-09T21:48:54.839 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-09T21:48:54.839 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-09T21:48:54.839 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-09T21:48:54.840 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-09T21:48:54.840 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-09T21:48:54.840 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-09T21:48:54.840 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-09T21:48:54.840 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-09T21:48:54.840 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-09T21:48:54.840 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-09T21:48:54.841 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-09T21:48:54.841 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-09T21:48:54.841 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-09T21:48:54.841 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-09T21:48:54.841 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-09T21:48:54.841 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-09T21:48:54.841 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-09T21:48:54.842 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-09T21:48:54.842 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-09T21:48:54.842 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-09T21:48:54.842 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-09T21:48:54.842 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-09T21:48:54.842 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-09T21:48:54.842 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-09T21:48:54.842 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-09T21:48:54.843 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-09T21:48:54.843 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-09T21:48:54.843 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-09T21:48:54.843 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-09T21:48:54.843 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-09T21:48:54.843 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-09T21:48:54.843 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-09T21:48:54.843 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-09T21:48:54.844 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-09T21:48:54.844 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-09T21:48:54.844 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-09T21:48:54.844 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:18.0.0-4759.g35b2d86c.el8.x86_64 129/134 2023-07-09T21:48:54.844 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-09T21:48:54.844 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:18.0.0-4759.g35b2d86c.el8.x86_64 131/134 2023-07-09T21:48:54.844 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-09T21:48:54.845 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-09T21:48:56.620 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-09T21:48:56.881 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-09T21:48:56.918 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-09T21:48:57.182 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-top-2:18.0.0-4759.g35b2d86c.el8.noarch 124/134 2023-07-09T21:48:57.390 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:18.0.0-4759.g35b2d86c.el8.x86_64 125/134 2023-07-09T21:48:57.540 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-09T21:48:57.540 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:04 ago on Sun 09 Jul 2023 09:46:53 PM UTC. 2023-07-09T21:48:57.693 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:18.0.0-4759.g35b2d86c.el8.x86_64 126/134 2023-07-09T21:48:58.055 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-09T21:48:58.230 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-07-09T21:48:58.335 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-07-09T21:48:58.555 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-07-09T21:48:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-07-09T21:48:58.771 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-09T21:48:58.793 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-09T21:48:58.958 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-07-09T21:48:58.959 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-09T21:48:59.170 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-09T21:48:59.170 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-09T21:48:59.435 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-09T21:48:59.621 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-09T21:48:59.870 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-09T21:48:59.871 INFO:teuthology.orchestra.run.smithi184.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-09T21:48:59.871 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:00.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:18.0.0-4759.g35b2d86c.el8.x86_64 1/134 2023-07-09T21:49:00.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:18.0.0-4759.g35b2d86c.el8.x86_64 2/134 2023-07-09T21:49:00.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:18.0.0-4759.g35b2d86c.el8.x86_64 3/134 2023-07-09T21:49:00.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:18.0.0-4759.g35b2d86c.el8.x86_64 4/134 2023-07-09T21:49:00.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4759.g35b2d 5/134 2023-07-09T21:49:00.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:18.0.0-4759.g35b2d86c.el8.x86_64 6/134 2023-07-09T21:49:00.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:18.0.0-4759.g35b2d86c.el8.x86_64 7/134 2023-07-09T21:49:00.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:18.0.0-4759.g35b2d86c.el8.x86_64 8/134 2023-07-09T21:49:00.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:18.0.0-4759.g35b2d86c.el8.x86_64 9/134 2023-07-09T21:49:00.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 10/134 2023-07-09T21:49:00.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:18.0.0-4759.g35b2d86c.el8.x86_64 11/134 2023-07-09T21:49:00.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:18.0.0-4759.g35b2d86c.el8.x86_64 12/134 2023-07-09T21:49:00.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 13/134 2023-07-09T21:49:00.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:18.0.0-4759.g35b2d86c.el8.x86_ 14/134 2023-07-09T21:49:00.479 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:18.0.0-4759.g35b2d86c.el8.x86_64 15/134 2023-07-09T21:49:00.479 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:18.0.0-4759.g35b2d86c.el8.x86_64 16/134 2023-07-09T21:49:00.479 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:18.0.0-4759.g35b2d86c.el8.x86_6 17/134 2023-07-09T21:49:00.479 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:18.0.0-4759.g35b2d86c.el8.x86 18/134 2023-07-09T21:49:00.479 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:18.0.0-4759.g35b2d86c.el8.x86_64 19/134 2023-07-09T21:49:00.479 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4759.g35b2d86c.el 20/134 2023-07-09T21:49:00.479 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:18.0.0-4759.g35b2d86c.el8. 21/134 2023-07-09T21:49:00.480 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:18.0.0-4759.g35b2d86c.el8.x86_6 22/134 2023-07-09T21:49:00.480 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:18.0.0-4759.g35b2d86c.el8.x86_64 23/134 2023-07-09T21:49:00.480 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:18.0.0-4759.g35b2d86c.el8.x86_64 24/134 2023-07-09T21:49:00.480 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 25/134 2023-07-09T21:49:00.480 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:18.0.0-4759.g35b2d86c.el8.x86_64 26/134 2023-07-09T21:49:00.480 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 27/134 2023-07-09T21:49:00.480 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:18.0.0-4759.g35b2d86c.el8.x86_64 28/134 2023-07-09T21:49:00.481 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4759.g35b2d86c. 29/134 2023-07-09T21:49:00.481 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4759.g35b2d86c.el8.noa 30/134 2023-07-09T21:49:00.481 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4759.g35b2d86c.el8.n 31/134 2023-07-09T21:49:00.481 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4759.g35b 32/134 2023-07-09T21:49:00.481 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4759.g35b2d86c.el 33/134 2023-07-09T21:49:00.481 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4759.g35b2d86c.el8.noarch 34/134 2023-07-09T21:49:00.481 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4759.g35b2d86c.e 35/134 2023-07-09T21:49:00.482 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:18.0.0-4759.g35b2d86c.el8.noarch 36/134 2023-07-09T21:49:00.482 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:18.0.0-4759.g35b2d86c.el8.noarch 37/134 2023-07-09T21:49:00.482 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-top-2:18.0.0-4759.g35b2d86c.el8.noarch 38/134 2023-07-09T21:49:00.483 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-09T21:49:00.483 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-09T21:49:00.483 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-09T21:49:00.483 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-09T21:49:00.483 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-09T21:49:00.483 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-09T21:49:00.483 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-09T21:49:00.484 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-09T21:49:00.484 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-09T21:49:00.484 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-09T21:49:00.484 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-09T21:49:00.484 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-09T21:49:00.484 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-09T21:49:00.484 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-09T21:49:00.485 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-09T21:49:00.485 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-09T21:49:00.485 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-09T21:49:00.485 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-09T21:49:00.485 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-09T21:49:00.485 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-09T21:49:00.485 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-09T21:49:00.485 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-09T21:49:00.486 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-09T21:49:00.486 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-09T21:49:00.486 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-09T21:49:00.486 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-09T21:49:00.486 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-09T21:49:00.486 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-09T21:49:00.486 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-09T21:49:00.486 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-09T21:49:00.487 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-09T21:49:00.487 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-09T21:49:00.487 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-09T21:49:00.487 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-07-09T21:49:00.487 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-07-09T21:49:00.488 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-07-09T21:49:00.488 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-07-09T21:49:00.488 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-07-09T21:49:00.488 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-07-09T21:49:00.488 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-07-09T21:49:00.488 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-07-09T21:49:00.489 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-07-09T21:49:00.489 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-07-09T21:49:00.489 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-07-09T21:49:00.489 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-07-09T21:49:00.489 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-07-09T21:49:00.489 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-07-09T21:49:00.489 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-07-09T21:49:00.490 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-07-09T21:49:00.490 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-07-09T21:49:00.490 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-07-09T21:49:00.490 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-07-09T21:49:00.490 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-07-09T21:49:00.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-07-09T21:49:00.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-07-09T21:49:00.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-07-09T21:49:00.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-07-09T21:49:00.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-07-09T21:49:00.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-07-09T21:49:00.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-07-09T21:49:00.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-07-09T21:49:00.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-07-09T21:49:00.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-07-09T21:49:00.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-07-09T21:49:00.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-07-09T21:49:00.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-07-09T21:49:00.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-07-09T21:49:00.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-07-09T21:49:00.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-07-09T21:49:00.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-07-09T21:49:00.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-07-09T21:49:00.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-07-09T21:49:00.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-07-09T21:49:00.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-07-09T21:49:00.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-07-09T21:49:00.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-07-09T21:49:00.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-07-09T21:49:00.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-07-09T21:49:00.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-07-09T21:49:00.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-07-09T21:49:00.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-07-09T21:49:00.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-07-09T21:49:00.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-07-09T21:49:00.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-07-09T21:49:00.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-07-09T21:49:00.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-07-09T21:49:00.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-07-09T21:49:00.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-07-09T21:49:00.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-07-09T21:49:00.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-07-09T21:49:00.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:18.0.0-4759.g35b2d86c.el8.x86_64 129/134 2023-07-09T21:49:00.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-09T21:49:00.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:18.0.0-4759.g35b2d86c.el8.x86_64 131/134 2023-07-09T21:49:00.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-09T21:49:00.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-09T21:49:00.625 INFO:teuthology.orchestra.run.smithi053.stdout:Installed products updated. 2023-07-09T21:49:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:00.877 INFO:teuthology.orchestra.run.smithi053.stdout:Upgraded: 2023-07-09T21:49:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-09T21:49:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: librados2-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.877 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2023-07-09T21:49:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-09T21:49:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: automake-1.16.1-7.el8.noarch 2023-07-09T21:49:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: bison-3.0.4-10.el8.x86_64 2023-07-09T21:49:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-09T21:49:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: flex-2.6.1-9.el8.x86_64 2023-07-09T21:49:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-09T21:49:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-09T21:49:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: jq-1.6-3.el8.x86_64 2023-07-09T21:49:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-09T21:49:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-09T21:49:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-09T21:49:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-09T21:49:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-09T21:49:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-09T21:49:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: libpq-13.5-1.el8.x86_64 2023-07-09T21:49:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-09T21:49:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-09T21:49:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-09T21:49:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-09T21:49:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-09T21:49:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-09T21:49:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-09T21:49:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-09T21:49:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-09T21:49:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-09T21:49:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-09T21:49:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-09T21:49:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-09T21:49:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-09T21:49:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-09T21:49:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-09T21:49:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-09T21:49:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-09T21:49:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-09T21:49:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-09T21:49:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-09T21:49:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-09T21:49:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-09T21:49:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-09T21:49:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-09T21:49:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-09T21:49:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-09T21:49:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-09T21:49:00.888 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-09T21:49:00.888 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-09T21:49:00.888 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-09T21:49:00.888 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-09T21:49:00.888 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-09T21:49:00.888 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-09T21:49:00.888 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-09T21:49:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-09T21:49:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-09T21:49:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-09T21:49:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-09T21:49:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-09T21:49:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-09T21:49:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-09T21:49:00.890 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-09T21:49:00.890 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-09T21:49:00.890 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-09T21:49:00.890 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-09T21:49:00.890 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-09T21:49:00.890 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend-2.6-1.el8.noarch 2023-07-09T21:49:00.890 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-09T21:49:00.890 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-09T21:49:00.891 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-09T21:49:00.891 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-09T21:49:00.891 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-09T21:49:00.891 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-09T21:49:00.892 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.892 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.892 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-09T21:49:00.892 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-09T21:49:00.892 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.892 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-09T21:49:00.892 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-09T21:49:00.893 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-09T21:49:00.893 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-09T21:49:00.893 INFO:teuthology.orchestra.run.smithi053.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-09T21:49:00.893 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-09T21:49:00.893 INFO:teuthology.orchestra.run.smithi053.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-09T21:49:00.894 INFO:teuthology.orchestra.run.smithi053.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-09T21:49:00.894 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-09T21:49:00.894 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-09T21:49:00.894 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-09T21:49:00.894 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-09T21:49:00.895 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-09T21:49:00.895 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.895 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.895 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:00.895 INFO:teuthology.orchestra.run.smithi053.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-09T21:49:00.896 INFO:teuthology.orchestra.run.smithi053.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-09T21:49:00.896 INFO:teuthology.orchestra.run.smithi053.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-09T21:49:00.896 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-09T21:49:00.896 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-09T21:49:00.897 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-09T21:49:00.897 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:00.898 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2023-07-09T21:49:01.164 DEBUG:teuthology.parallel:result is None 2023-07-09T21:49:03.233 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-09T21:49:03.234 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:57 ago on Sun 09 Jul 2023 09:47:06 PM UTC. 2023-07-09T21:49:06.383 INFO:teuthology.orchestra.run.smithi184.stdout:Installed products updated. 2023-07-09T21:49:06.625 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:06.626 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2023-07-09T21:49:06.626 INFO:teuthology.orchestra.run.smithi184.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-09T21:49:06.626 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.626 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.626 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-07-09T21:49:06.626 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-09T21:49:06.627 INFO:teuthology.orchestra.run.smithi184.stdout: automake-1.16.1-7.el8.noarch 2023-07-09T21:49:06.627 INFO:teuthology.orchestra.run.smithi184.stdout: bison-3.0.4-10.el8.x86_64 2023-07-09T21:49:06.627 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.627 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.627 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.627 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.628 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:06.628 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.628 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.628 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.628 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:06.629 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:06.629 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:06.629 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:06.629 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:06.629 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.629 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.629 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:06.630 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.630 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.630 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.630 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:06.630 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:06.630 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.630 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top-2:18.0.0-4759.g35b2d86c.el8.noarch 2023-07-09T21:49:06.631 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-09T21:49:06.631 INFO:teuthology.orchestra.run.smithi184.stdout: flex-2.6.1-9.el8.x86_64 2023-07-09T21:49:06.631 INFO:teuthology.orchestra.run.smithi184.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-09T21:49:06.631 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-09T21:49:06.631 INFO:teuthology.orchestra.run.smithi184.stdout: jq-1.6-3.el8.x86_64 2023-07-09T21:49:06.631 INFO:teuthology.orchestra.run.smithi184.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-09T21:49:06.632 INFO:teuthology.orchestra.run.smithi184.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-09T21:49:06.632 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-09T21:49:06.632 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.632 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.632 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.633 INFO:teuthology.orchestra.run.smithi184.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-09T21:49:06.633 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-09T21:49:06.633 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-09T21:49:06.633 INFO:teuthology.orchestra.run.smithi184.stdout: libpq-13.5-1.el8.x86_64 2023-07-09T21:49:06.633 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-09T21:49:06.634 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-09T21:49:06.634 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.634 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.634 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-09T21:49:06.634 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.634 INFO:teuthology.orchestra.run.smithi184.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-09T21:49:06.634 INFO:teuthology.orchestra.run.smithi184.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-09T21:49:06.635 INFO:teuthology.orchestra.run.smithi184.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-09T21:49:06.635 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-09T21:49:06.635 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-09T21:49:06.635 INFO:teuthology.orchestra.run.smithi184.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-09T21:49:06.635 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-09T21:49:06.635 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-09T21:49:06.635 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-09T21:49:06.635 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-09T21:49:06.636 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-09T21:49:06.636 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-09T21:49:06.636 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-09T21:49:06.636 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-09T21:49:06.636 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-09T21:49:06.636 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-09T21:49:06.636 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-09T21:49:06.637 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-09T21:49:06.637 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-09T21:49:06.637 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-09T21:49:06.637 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-09T21:49:06.637 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-09T21:49:06.637 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.637 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.638 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.638 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-09T21:49:06.638 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-09T21:49:06.638 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-09T21:49:06.638 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-09T21:49:06.639 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-09T21:49:06.639 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-09T21:49:06.639 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-09T21:49:06.639 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-09T21:49:06.639 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-09T21:49:06.639 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-09T21:49:06.640 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-09T21:49:06.640 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-09T21:49:06.640 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-09T21:49:06.640 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-09T21:49:06.640 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-09T21:49:06.640 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-09T21:49:06.640 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-09T21:49:06.641 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-09T21:49:06.641 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-09T21:49:06.641 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-09T21:49:06.641 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-09T21:49:06.641 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-09T21:49:06.641 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-2.6-1.el8.noarch 2023-07-09T21:49:06.641 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-09T21:49:06.642 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-09T21:49:06.642 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-09T21:49:06.642 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-09T21:49:06.642 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-09T21:49:06.642 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-09T21:49:06.642 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.642 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.643 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-09T21:49:06.643 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-09T21:49:06.643 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.643 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-09T21:49:06.643 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-09T21:49:06.643 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-09T21:49:06.643 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-09T21:49:06.643 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-09T21:49:06.644 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-09T21:49:06.644 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-09T21:49:06.644 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-09T21:49:06.644 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-09T21:49:06.644 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-09T21:49:06.644 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-09T21:49:06.644 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-09T21:49:06.645 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-09T21:49:06.645 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.645 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.645 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:18.0.0-4759.g35b2d86c.el8.x86_64 2023-07-09T21:49:06.645 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-09T21:49:06.645 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-09T21:49:06.645 INFO:teuthology.orchestra.run.smithi184.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-09T21:49:06.645 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-09T21:49:06.646 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-09T21:49:06.646 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-09T21:49:06.646 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:06.646 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-07-09T21:49:07.676 DEBUG:teuthology.parallel:result is None 2023-07-09T21:49:07.676 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T21:49:07.819 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-09T21:49:07.874 INFO:teuthology.orchestra.run.smithi053.stdout:18.0.0-4759.g35b2d86c.el8 2023-07-09T21:49:07.875 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4759.g35b2d86c.el8 2023-07-09T21:49:07.875 INFO:teuthology.task.install:The correct ceph version 18.0.0-4759.g35b2d86c is installed. 2023-07-09T21:49:07.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T21:49:08.019 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-09T21:49:08.075 INFO:teuthology.orchestra.run.smithi184.stdout:18.0.0-4759.g35b2d86c.el8 2023-07-09T21:49:08.076 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4759.g35b2d86c.el8 2023-07-09T21:49:08.076 INFO:teuthology.task.install:The correct ceph version 18.0.0-4759.g35b2d86c is installed. 2023-07-09T21:49:08.077 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-09T21:49:08.077 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:08.077 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-09T21:49:08.167 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:08.167 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-09T21:49:08.258 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-09T21:49:08.258 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:08.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2023-07-09T21:49:08.328 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-09T21:49:08.438 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:08.439 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2023-07-09T21:49:08.509 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-09T21:49:08.617 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-09T21:49:08.617 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:08.617 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-09T21:49:08.686 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-09T21:49:08.798 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:08.799 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-09T21:49:08.866 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-09T21:49:08.973 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-09T21:49:08.974 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:08.974 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2023-07-09T21:49:09.044 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-09T21:49:09.158 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:09.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2023-07-09T21:49:09.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-09T21:49:09.337 INFO:teuthology.run_tasks:Running task ceph... 2023-07-09T21:49:09.411 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-09T21:49:09.412 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2023-07-09T21:49:09.417 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2023-07-09T21:49:09.485 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-09T21:49:09.485 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-09T21:49:09.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-09T21:49:09.557 INFO:tasks.ceph:Creating extra log directories... 2023-07-09T21:49:09.558 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-09T21:49:09.562 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-09T21:49:09.636 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-09T21:49:09.637 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-09T21:49:09.637 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-09T21:49:09.637 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:09.638 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-09T21:49:09.679 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-09T21:49:09.884 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-09T21:49:09.954 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:09.954 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-09T21:49:09.998 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-09T21:49:10.218 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-09T21:49:10.292 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-09T21:49:10.292 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-09T21:49:10.293 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692', 'branch': 'wip-rishabh-2023Jul9', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}', 'email': None, 'first_in_suite': False, 'job_id': '7331692', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Jul9'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Jul9', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Jul9', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '35b2d86cfd512f15ace2077050d20c8669933212', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi184.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots', 'tasks.cephfs.test_volumes.TestSubvolumeSnapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b53f236c1077f1d295baafb9e0ca9a4b447019d7', 'timestamp': '2023-07-09_20:19:09', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-09T21:49:10.293 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-09T21:49:10.298 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-09T21:49:10.340 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2023-07-09T21:49:10.383 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2023-07-09T21:49:10.452 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:10.452 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2023-07-09T21:49:10.495 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-09T21:49:10.495 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2023-07-09T21:49:10.579 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-09T21:49:10.580 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:49:10.580 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-07-09T21:49:10.580 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:49:10.580 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-07-09T21:49:10.580 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-07-09 21:48:54.328632145 +0000 2023-07-09T21:49:10.580 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-07-09 21:45:49.980680074 +0000 2023-07-09T21:49:10.580 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-07-09 21:45:49.980680074 +0000 2023-07-09T21:49:10.581 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2023-07-09 21:45:49.958680496 +0000 2023-07-09T21:49:10.581 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-09T21:49:10.687 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-07-09T21:49:10.687 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-07-09T21:49:10.687 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000223705 s, 2.3 MB/s 2023-07-09T21:49:10.689 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-09T21:49:10.733 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2023-07-09T21:49:10.818 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-09T21:49:10.818 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:49:10.818 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-07-09T21:49:10.819 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:49:10.819 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-07-09T21:49:10.819 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-07-09 21:48:54.329632126 +0000 2023-07-09T21:49:10.819 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-07-09 21:45:50.802664306 +0000 2023-07-09T21:49:10.819 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-07-09 21:45:50.802664306 +0000 2023-07-09T21:49:10.819 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2023-07-09 21:45:50.777664786 +0000 2023-07-09T21:49:10.819 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-09T21:49:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-07-09T21:49:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-07-09T21:49:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000185764 s, 2.8 MB/s 2023-07-09T21:49:10.925 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-09T21:49:10.969 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2023-07-09T21:49:11.053 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-09T21:49:11.054 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:49:11.054 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-07-09T21:49:11.054 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:49:11.054 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-07-09T21:49:11.054 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-07-09 21:48:54.329632126 +0000 2023-07-09T21:49:11.054 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-07-09 21:45:51.621648597 +0000 2023-07-09T21:49:11.054 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-07-09 21:45:51.621648597 +0000 2023-07-09T21:49:11.055 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2023-07-09 21:45:51.597649057 +0000 2023-07-09T21:49:11.055 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-09T21:49:11.159 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-07-09T21:49:11.159 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-07-09T21:49:11.160 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000182461 s, 2.8 MB/s 2023-07-09T21:49:11.162 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-09T21:49:11.206 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2023-07-09T21:49:11.290 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-09T21:49:11.290 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:49:11.291 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-07-09T21:49:11.291 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:49:11.291 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-07-09T21:49:11.291 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-07-09 21:48:54.329632126 +0000 2023-07-09T21:49:11.291 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-07-09 21:45:52.463632446 +0000 2023-07-09T21:49:11.291 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-07-09 21:45:52.463632446 +0000 2023-07-09T21:49:11.291 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2023-07-09 21:45:52.439632906 +0000 2023-07-09T21:49:11.292 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-09T21:49:11.395 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-07-09T21:49:11.396 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-07-09T21:49:11.396 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000186712 s, 2.7 MB/s 2023-07-09T21:49:11.398 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-09T21:49:11.442 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T21:49:11.443 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:11.443 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2023-07-09T21:49:11.485 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-09T21:49:11.485 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2023-07-09T21:49:11.569 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-09T21:49:11.569 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:49:11.569 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-07-09T21:49:11.570 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:49:11.570 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-07-09T21:49:11.570 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-07-09 21:49:00.000556338 +0000 2023-07-09T21:49:11.570 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-07-09 21:43:42.619532569 +0000 2023-07-09T21:49:11.571 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-07-09 21:43:42.619532569 +0000 2023-07-09T21:49:11.571 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2023-07-09 21:43:42.591533124 +0000 2023-07-09T21:49:11.571 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-09T21:49:11.673 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-07-09T21:49:11.674 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-07-09T21:49:11.674 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000315 s, 1.6 MB/s 2023-07-09T21:49:11.676 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-09T21:49:11.722 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2023-07-09T21:49:11.808 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-09T21:49:11.808 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:49:11.808 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-07-09T21:49:11.808 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:49:11.809 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-07-09T21:49:11.809 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-07-09 21:49:00.000556338 +0000 2023-07-09T21:49:11.809 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-07-09 21:43:43.437516358 +0000 2023-07-09T21:49:11.809 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-07-09 21:43:43.437516358 +0000 2023-07-09T21:49:11.809 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2023-07-09 21:43:43.411516873 +0000 2023-07-09T21:49:11.809 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-09T21:49:11.916 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-07-09T21:49:11.916 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-07-09T21:49:11.916 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000279781 s, 1.8 MB/s 2023-07-09T21:49:11.918 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-09T21:49:11.963 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2023-07-09T21:49:12.047 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-09T21:49:12.048 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:49:12.048 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-07-09T21:49:12.048 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:49:12.048 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-07-09T21:49:12.048 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-07-09 21:49:00.000556338 +0000 2023-07-09T21:49:12.049 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-07-09 21:43:44.252500207 +0000 2023-07-09T21:49:12.049 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-07-09 21:43:44.252500207 +0000 2023-07-09T21:49:12.049 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2023-07-09 21:43:44.228500683 +0000 2023-07-09T21:49:12.049 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-09T21:49:12.157 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-07-09T21:49:12.158 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-07-09T21:49:12.158 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000297604 s, 1.7 MB/s 2023-07-09T21:49:12.159 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-09T21:49:12.202 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2023-07-09T21:49:12.284 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-09T21:49:12.285 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:49:12.285 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-07-09T21:49:12.285 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:49:12.285 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-07-09T21:49:12.286 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-07-09 21:49:00.000556338 +0000 2023-07-09T21:49:12.286 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-07-09 21:43:45.063484136 +0000 2023-07-09T21:49:12.286 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-07-09 21:43:45.063484136 +0000 2023-07-09T21:49:12.286 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2023-07-09 21:43:45.037484651 +0000 2023-07-09T21:49:12.286 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-09T21:49:12.388 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-07-09T21:49:12.388 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-07-09T21:49:12.389 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000508573 s, 1.0 MB/s 2023-07-09T21:49:12.391 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-09T21:49:12.434 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T21:49:12.434 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-09T21:49:12.434 INFO:tasks.ceph:Generating config... 2023-07-09T21:49:12.435 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-09T21:49:12.436 INFO:tasks.ceph:[client] debug client = 20 2023-07-09T21:49:12.436 INFO:tasks.ceph:[client] debug ms = 1 2023-07-09T21:49:12.436 INFO:tasks.ceph:[client] pid file = 2023-07-09T21:49:12.436 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-09T21:49:12.437 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-09T21:49:12.437 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-09T21:49:12.437 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-09T21:49:12.437 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-09T21:49:12.438 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-09T21:49:12.438 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-09T21:49:12.438 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-09T21:49:12.438 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-09T21:49:12.438 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-09T21:49:12.439 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-09T21:49:12.439 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-09T21:49:12.439 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-09T21:49:12.439 INFO:tasks.ceph:[mgr] debug client = 20 2023-07-09T21:49:12.439 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-07-09T21:49:12.440 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-09T21:49:12.440 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-09T21:49:12.440 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-09T21:49:12.440 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-09T21:49:12.440 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-09T21:49:12.441 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-09T21:49:12.441 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-09T21:49:12.441 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-09T21:49:12.441 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-09T21:49:12.441 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-09T21:49:12.442 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-09T21:49:12.442 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-09T21:49:12.442 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-09T21:49:12.442 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-09T21:49:12.442 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-09T21:49:12.443 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-09T21:49:12.443 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-09T21:49:12.443 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-09T21:49:12.443 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-09T21:49:12.443 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-09T21:49:12.444 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-09T21:49:12.444 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-09T21:49:12.444 INFO:tasks.ceph:Setting up mon.a... 2023-07-09T21:49:12.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-09T21:49:12.546 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.keyring 2023-07-09T21:49:12.552 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-09T21:49:12.655 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-09T21:49:12.725 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.53'), ('mon.b', '172.21.15.184'), ('mon.c', '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]')] 2023-07-09T21:49:12.726 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.53,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-09T21:49:12.727 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:12.728 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-09T21:49:12.772 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.53 --add b 172.21.15.184 --addv c '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:12.902 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: generated fsid 25d21351-dc09-4310-b56b-79a331e4aa31 2023-07-09T21:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = pacific 2023-07-09T21:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 0 2023-07-09T21:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout:fsid 25d21351-dc09-4310-b56b-79a331e4aa31 2023-07-09T21:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout:last_changed 2023-07-09T21:49:12.902660+0000 2023-07-09T21:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout:created 2023-07-09T21:49:12.902660+0000 2023-07-09T21:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout:min_mon_release 16 (pacific) 2023-07-09T21:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout:election_strategy: 1 2023-07-09T21:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout:0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2023-07-09T21:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2023-07-09T21:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout:2: [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] mon.c 2023-07-09T21:49:12.905 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-09T21:49:12.906 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-09T21:49:12.949 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 25d21351-dc09-4310-b56b-79a331e4aa31... 2023-07-09T21:49:12.950 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-09T21:49:12.993 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-09T21:49:13.112 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2023-07-09T21:49:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2023-07-09T21:49:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-09T21:49:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2023-07-09T21:49:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2023-07-09T21:49:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2023-07-09T21:49:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2023-07-09T21:49:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2023-07-09T21:49:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2023-07-09T21:49:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2023-07-09T21:49:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-09T21:49:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2023-07-09T21:49:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2023-07-09T21:49:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-09T21:49:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2023-07-09T21:49:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2023-07-09T21:49:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2023-07-09T21:49:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2023-07-09T21:49:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2023-07-09T21:49:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2023-07-09T21:49:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2023-07-09T21:49:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2023-07-09T21:49:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-09T21:49:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-09T21:49:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2023-07-09T21:49:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-09T21:49:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2023-07-09T21:49:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2023-07-09T21:49:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2023-07-09T21:49:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2023-07-09T21:49:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2023-07-09T21:49:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = "172.21.15.53,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-07-09T21:49:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on skipped message = False 2023-07-09T21:49:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = 25d21351-dc09-4310-b56b-79a331e4aa31 2023-07-09T21:49:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.119 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2023-07-09T21:49:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2023-07-09T21:49:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2023-07-09T21:49:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2023-07-09T21:49:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2023-07-09T21:49:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2023-07-09T21:49:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2023-07-09T21:49:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2023-07-09T21:49:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2023-07-09T21:49:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2023-07-09T21:49:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2023-07-09T21:49:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2023-07-09T21:49:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2023-07-09T21:49:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2023-07-09T21:49:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2023-07-09T21:49:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2023-07-09T21:49:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2023-07-09T21:49:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2023-07-09T21:49:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2023-07-09T21:49:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: bdev async discard = True 2023-07-09T21:49:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: bdev enable discard = True 2023-07-09T21:49:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore allocator = bitmap 2023-07-09T21:49:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2023-07-09T21:49:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2023-07-09T21:49:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 1/20 2023-07-09T21:49:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 1/20 2023-07-09T21:49:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-07-09T21:49:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2023-07-09T21:49:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 4/10 2023-07-09T21:49:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2023-07-09T21:49:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2023-07-09T21:49:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2023-07-09T21:49:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2023-07-09T21:49:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2023-07-09T21:49:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2023-07-09T21:49:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.125 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2023-07-09T21:49:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-07-09T21:49:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2023-07-09T21:49:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2023-07-09T21:49:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2023-07-09T21:49:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2023-07-09T21:49:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2023-07-09T21:49:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2023-07-09T21:49:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: debug client = 20 2023-07-09T21:49:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: debug finisher = 20 2023-07-09T21:49:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.126 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2023-07-09T21:49:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-07-09T21:49:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2023-07-09T21:49:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2023-07-09T21:49:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2023-07-09T21:49:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2023-07-09T21:49:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2023-07-09T21:49:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2023-07-09T21:49:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2023-07-09T21:49:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2023-07-09T21:49:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2023-07-09T21:49:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-09T21:49:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2023-07-09T21:49:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2023-07-09T21:49:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2023-07-09T21:49:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-09T21:49:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-09T21:49:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2023-07-09T21:49:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2023-07-09T21:49:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2023-07-09T21:49:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: mon op complaint time = 120 2023-07-09T21:49:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:13.129 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2023-07-09T21:49:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2023-07-09T21:49:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2023-07-09T21:49:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2023-07-09T21:49:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-09T21:49:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-09T21:49:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: client mount timeout = 600 2023-07-09T21:49:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: debug client = 20 2023-07-09T21:49:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-07-09T21:49:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = "" 2023-07-09T21:49:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2023-07-09T21:49:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2023-07-09T21:49:13.131 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2023-07-09T21:49:13.131 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.b] 2023-07-09T21:49:13.131 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.c] 2023-07-09T21:49:13.131 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2023-07-09T21:49:13.131 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2023-07-09T21:49:13.132 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2023-07-09T21:49:13.132 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2023-07-09T21:49:13.132 INFO:teuthology.orchestra.run.smithi053.stdout:[mds] 2023-07-09T21:49:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds = 20 2023-07-09T21:49:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds balancer = 20 2023-07-09T21:49:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-07-09T21:49:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug frag = True 2023-07-09T21:49:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug scatterstat = True 2023-07-09T21:49:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: mds op complaint time = 180 2023-07-09T21:49:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: mds verify scatter = True 2023-07-09T21:49:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2023-07-09T21:49:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2023-07-09T21:49:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2023-07-09T21:49:13.134 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2023-07-09T21:49:13.134 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2023-07-09T21:49:13.134 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-09T21:49:13.134 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2023-07-09T21:49:13.134 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.134 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2023-07-09T21:49:13.135 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.135 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2023-07-09T21:49:13.135 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.135 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2023-07-09T21:49:13.135 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2023-07-09T21:49:13.135 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.135 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2023-07-09T21:49:13.136 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2023-07-09T21:49:13.136 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.136 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-09T21:49:13.136 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2023-07-09T21:49:13.136 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.136 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2023-07-09T21:49:13.136 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-09T21:49:13.136 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.137 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2023-07-09T21:49:13.137 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.137 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2023-07-09T21:49:13.137 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2023-07-09T21:49:13.137 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2023-07-09T21:49:13.137 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2023-07-09T21:49:13.137 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2023-07-09T21:49:13.137 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2023-07-09T21:49:13.138 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2023-07-09T21:49:13.138 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-09T21:49:13.138 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-09T21:49:13.138 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2023-07-09T21:49:13.138 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.138 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-09T21:49:13.138 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.138 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2023-07-09T21:49:13.139 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.139 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2023-07-09T21:49:13.139 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.139 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2023-07-09T21:49:13.139 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2023-07-09T21:49:13.139 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2023-07-09T21:49:13.139 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.53,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-07-09T21:49:13.139 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on skipped message = False 2023-07-09T21:49:13.140 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = 25d21351-dc09-4310-b56b-79a331e4aa31 2023-07-09T21:49:13.140 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.140 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2023-07-09T21:49:13.140 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2023-07-09T21:49:13.140 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.140 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2023-07-09T21:49:13.140 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2023-07-09T21:49:13.141 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2023-07-09T21:49:13.141 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.141 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2023-07-09T21:49:13.141 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2023-07-09T21:49:13.141 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.141 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2023-07-09T21:49:13.141 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2023-07-09T21:49:13.141 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2023-07-09T21:49:13.142 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.142 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2023-07-09T21:49:13.142 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2023-07-09T21:49:13.142 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.142 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2023-07-09T21:49:13.142 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.142 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2023-07-09T21:49:13.142 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.143 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2023-07-09T21:49:13.143 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.143 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2023-07-09T21:49:13.143 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2023-07-09T21:49:13.143 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.143 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2023-07-09T21:49:13.143 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2023-07-09T21:49:13.143 INFO:teuthology.orchestra.run.smithi184.stdout: bdev async discard = True 2023-07-09T21:49:13.144 INFO:teuthology.orchestra.run.smithi184.stdout: bdev enable discard = True 2023-07-09T21:49:13.144 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore allocator = bitmap 2023-07-09T21:49:13.144 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2023-07-09T21:49:13.144 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2023-07-09T21:49:13.144 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 1/20 2023-07-09T21:49:13.144 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 1/20 2023-07-09T21:49:13.144 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-07-09T21:49:13.144 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2023-07-09T21:49:13.145 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 4/10 2023-07-09T21:49:13.145 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2023-07-09T21:49:13.145 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2023-07-09T21:49:13.145 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2023-07-09T21:49:13.145 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2023-07-09T21:49:13.145 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2023-07-09T21:49:13.145 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-07-09T21:49:13.145 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.146 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2023-07-09T21:49:13.146 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-07-09T21:49:13.146 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2023-07-09T21:49:13.146 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-07-09T21:49:13.146 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-07-09T21:49:13.146 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-07-09T21:49:13.146 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-07-09T21:49:13.146 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2023-07-09T21:49:13.147 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2023-07-09T21:49:13.147 INFO:teuthology.orchestra.run.smithi184.stdout: debug finisher = 20 2023-07-09T21:49:13.147 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.147 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2023-07-09T21:49:13.147 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-07-09T21:49:13.147 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-07-09T21:49:13.147 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2023-07-09T21:49:13.147 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-07-09T21:49:13.148 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2023-07-09T21:49:13.148 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2023-07-09T21:49:13.148 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-07-09T21:49:13.148 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2023-07-09T21:49:13.148 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2023-07-09T21:49:13.148 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-07-09T21:49:13.148 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.148 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-09T21:49:13.149 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2023-07-09T21:49:13.149 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2023-07-09T21:49:13.149 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.149 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2023-07-09T21:49:13.149 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-09T21:49:13.149 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-09T21:49:13.149 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.150 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2023-07-09T21:49:13.150 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2023-07-09T21:49:13.150 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.150 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2023-07-09T21:49:13.150 INFO:teuthology.orchestra.run.smithi184.stdout: mon op complaint time = 120 2023-07-09T21:49:13.150 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-09T21:49:13.150 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2023-07-09T21:49:13.150 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2023-07-09T21:49:13.151 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2023-07-09T21:49:13.151 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2023-07-09T21:49:13.151 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-09T21:49:13.151 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-09T21:49:13.151 INFO:teuthology.orchestra.run.smithi184.stdout: client mount timeout = 600 2023-07-09T21:49:13.151 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2023-07-09T21:49:13.151 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-07-09T21:49:13.152 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = "" 2023-07-09T21:49:13.152 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-07-09T21:49:13.152 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-07-09T21:49:13.152 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2023-07-09T21:49:13.152 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2023-07-09T21:49:13.152 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2023-07-09T21:49:13.152 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-07-09T21:49:13.153 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-07-09T21:49:13.153 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-07-09T21:49:13.153 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-07-09T21:49:13.153 INFO:teuthology.orchestra.run.smithi184.stdout:[mds] 2023-07-09T21:49:13.153 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds = 20 2023-07-09T21:49:13.153 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds balancer = 20 2023-07-09T21:49:13.153 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-07-09T21:49:13.153 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug frag = True 2023-07-09T21:49:13.154 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug scatterstat = True 2023-07-09T21:49:13.154 INFO:teuthology.orchestra.run.smithi184.stdout: mds op complaint time = 180 2023-07-09T21:49:13.154 INFO:teuthology.orchestra.run.smithi184.stdout: mds verify scatter = True 2023-07-09T21:49:13.154 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-07-09T21:49:13.154 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-07-09T21:49:13.154 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-07-09T21:49:13.156 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-09T21:49:13.156 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-09T21:49:13.271 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-09T21:49:13.271 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:13.272 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-09T21:49:13.315 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:13.315 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-09T21:49:13.397 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:49:13.398 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:13.398 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-09T21:49:13.398 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-09T21:49:13.536 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:13.536 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:13.618 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:49:13.619 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:13.619 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-09T21:49:13.619 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-09T21:49:13.714 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:13.714 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:13.797 INFO:tasks.ceph:Setting up mon nodes... 2023-07-09T21:49:13.798 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-09T21:49:13.798 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-09T21:49:13.931 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-09T21:49:13.938 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-09T21:49:14.089 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-09T21:49:14.096 INFO:tasks.ceph:Setting up mds nodes... 2023-07-09T21:49:14.096 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-09T21:49:14.224 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-09T21:49:14.230 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-09T21:49:14.301 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-09T21:49:14.432 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-09T21:49:14.438 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-09T21:49:14.508 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-09T21:49:14.634 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-09T21:49:14.639 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-09T21:49:14.709 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-09T21:49:14.833 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-09T21:49:14.839 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-09T21:49:14.908 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-09T21:49:14.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-09T21:49:15.008 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-09T21:49:15.042 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-09T21:49:15.148 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-09T21:49:15.180 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-09T21:49:15.275 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-09T21:49:15.309 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-09T21:49:15.405 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-09T21:49:15.440 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-09T21:49:15.440 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-09T21:49:15.440 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-09T21:49:15.513 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T21:49:15.513 INFO:tasks.ceph:role: osd.0 2023-07-09T21:49:15.513 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:49:15.514 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-09T21:49:15.583 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:49:15.584 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:49:15.584 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:49:15.584 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:49:15.585 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:49:15.585 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:49:15.585 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:49:15.585 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:49:15.586 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:49:15.586 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:49:15.607 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-07-09T21:49:15.611 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-07-09T21:49:15.611 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-09T21:49:15.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-09T21:49:15.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-09T21:49:15.874 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T21:49:15.875 INFO:tasks.ceph:role: osd.1 2023-07-09T21:49:15.875 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:49:15.875 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-09T21:49:15.945 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:49:15.945 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:49:15.946 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:49:15.946 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:49:15.946 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:49:15.946 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:49:15.946 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:49:15.947 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:49:15.947 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:49:15.947 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:49:15.969 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-07-09T21:49:15.973 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-07-09T21:49:15.973 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-09T21:49:16.081 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-09T21:49:16.156 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-09T21:49:16.231 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T21:49:16.231 INFO:tasks.ceph:role: osd.2 2023-07-09T21:49:16.232 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:49:16.232 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-09T21:49:16.303 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:49:16.303 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:49:16.303 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:49:16.304 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:49:16.304 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:49:16.304 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:49:16.304 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:49:16.304 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:49:16.304 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:49:16.305 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:49:16.327 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-07-09T21:49:16.330 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-07-09T21:49:16.330 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-09T21:49:16.436 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-09T21:49:16.513 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-09T21:49:16.581 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T21:49:16.582 INFO:tasks.ceph:role: osd.3 2023-07-09T21:49:16.582 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:49:16.582 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-09T21:49:16.651 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:49:16.652 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:49:16.652 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:49:16.652 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:49:16.652 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:49:16.652 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:49:16.652 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:49:16.652 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:49:16.653 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:49:16.653 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:49:16.675 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-07-09T21:49:16.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-07-09T21:49:16.680 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-09T21:49:16.791 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-09T21:49:16.867 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:17.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:17.415+0000 7fd0c1775640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-09T21:49:17.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:17.415+0000 7fd0c1775640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-09T21:49:17.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:17.415+0000 7fd0c1775640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-09T21:49:17.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:17.415+0000 7fd0c1775640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-09T21:49:17.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:17.416+0000 7fd0c1775640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-09T21:49:17.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:17.417+0000 7fd0c1775640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-09T21:49:20.344 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-09T21:49:20.416 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:20.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:20.523+0000 7f83140f3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-09T21:49:20.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:20.523+0000 7f83140f3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-09T21:49:20.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:20.523+0000 7f83140f3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-09T21:49:20.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:20.523+0000 7f83140f3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-09T21:49:20.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:20.523+0000 7f83140f3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-09T21:49:20.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:20.525+0000 7f83140f3640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-09T21:49:23.461 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-09T21:49:23.532 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:23.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:23.640+0000 7fa6c3d98640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-09T21:49:23.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:23.640+0000 7fa6c3d98640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-09T21:49:23.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:23.640+0000 7fa6c3d98640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-09T21:49:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:23.640+0000 7fa6c3d98640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-09T21:49:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:23.640+0000 7fa6c3d98640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-09T21:49:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:23.641+0000 7fa6c3d98640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-09T21:49:26.587 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-09T21:49:26.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:26.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:26.775+0000 7fc5179da640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-09T21:49:26.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:26.775+0000 7fc5179da640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-09T21:49:26.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:26.776+0000 7fc5179da640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-09T21:49:26.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:26.776+0000 7fc5179da640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-09T21:49:26.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:26.776+0000 7fc5179da640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-09T21:49:26.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:26.777+0000 7fc5179da640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-09T21:49:29.705 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-09T21:49:29.777 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-09T21:49:29.847 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T21:49:29.848 INFO:tasks.ceph:role: osd.4 2023-07-09T21:49:29.848 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:49:29.849 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-09T21:49:29.921 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:49:29.921 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:49:29.922 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:49:29.922 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:49:29.922 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:49:29.922 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:49:29.922 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:49:29.922 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:49:29.922 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:49:29.922 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:49:30.346 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-07-09T21:49:30.350 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-07-09T21:49:30.350 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-09T21:49:30.554 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-09T21:49:30.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-09T21:49:30.708 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T21:49:30.709 INFO:tasks.ceph:role: osd.5 2023-07-09T21:49:30.709 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:49:30.709 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-09T21:49:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:49:30.787 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:49:30.787 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:49:30.787 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:49:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:49:30.787 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:49:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:49:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:49:30.787 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:49:30.788 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:49:31.211 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-07-09T21:49:31.215 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-07-09T21:49:31.216 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-09T21:49:31.357 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-09T21:49:31.435 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-09T21:49:31.504 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T21:49:31.504 INFO:tasks.ceph:role: osd.6 2023-07-09T21:49:31.505 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:49:31.505 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-09T21:49:31.587 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:49:31.587 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:49:31.587 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:49:31.588 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:49:31.588 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:49:31.588 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:49:31.588 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:49:31.588 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:49:31.588 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:49:31.588 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:49:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-07-09T21:49:32.036 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-07-09T21:49:32.036 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-09T21:49:32.237 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-09T21:49:32.316 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-09T21:49:32.384 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T21:49:32.385 INFO:tasks.ceph:role: osd.7 2023-07-09T21:49:32.385 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:49:32.385 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-09T21:49:32.461 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:49:32.462 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:49:32.462 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:49:32.462 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:49:32.462 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:49:32.462 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:49:32.462 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:49:32.463 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:49:32.463 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:49:32.463 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:49:32.898 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-07-09T21:49:32.902 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-07-09T21:49:32.902 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-09T21:49:33.021 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-09T21:49:33.100 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:33.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:33.228+0000 7f4571dff640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-09T21:49:33.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:33.229+0000 7f4571dff640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-09T21:49:33.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:33.229+0000 7f4571dff640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-09T21:49:33.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:33.229+0000 7f4571dff640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-09T21:49:33.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:33.229+0000 7f4571dff640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-09T21:49:33.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:33.231+0000 7f4571dff640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-09T21:49:36.168 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-09T21:49:36.236 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:36.341 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:36.339+0000 7f713e606640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-09T21:49:36.341 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:36.340+0000 7f713e606640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-09T21:49:36.341 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:36.340+0000 7f713e606640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-09T21:49:36.341 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:36.340+0000 7f713e606640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-09T21:49:36.341 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:36.340+0000 7f713e606640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-09T21:49:36.342 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:36.341+0000 7f713e606640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-09T21:49:39.285 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-09T21:49:39.356 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:39.460 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:39.459+0000 7f6ecbc0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-09T21:49:39.461 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:39.459+0000 7f6ecbc0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-09T21:49:39.461 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:39.459+0000 7f6ecbc0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-09T21:49:39.461 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:39.459+0000 7f6ecbc0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-09T21:49:39.461 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:39.459+0000 7f6ecbc0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-09T21:49:39.461 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:39.461+0000 7f6ecbc0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-09T21:49:40.294 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:49:40.299 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:49:42.383 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-09T21:49:42.451 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:42.557 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:42.556+0000 7f8834b32640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-09T21:49:42.558 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:42.556+0000 7f8834b32640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-09T21:49:42.558 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:42.556+0000 7f8834b32640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-09T21:49:42.559 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:42.556+0000 7f8834b32640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-09T21:49:42.559 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:42.556+0000 7f8834b32640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-09T21:49:42.560 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:42.558+0000 7f8834b32640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-09T21:49:45.483 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-09T21:49:45.550 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-09T21:49:45.550 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:45.551 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-09T21:49:45.621 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:45.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-09T21:49:45.729 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:45.729 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-09T21:49:45.835 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:45.836 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-09T21:49:45.944 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:45.944 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-09T21:49:46.051 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:46.051 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-09T21:49:46.157 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:46.158 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-09T21:49:46.265 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:46.265 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-09T21:49:46.335 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:46.335 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-09T21:49:46.443 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:46.444 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-09T21:49:46.550 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:46.551 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-09T21:49:46.657 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:46.658 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-09T21:49:46.767 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:46.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-09T21:49:46.876 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:46.876 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-09T21:49:46.985 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:46.986 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-09T21:49:47.032 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:47.032 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-09T21:49:47.116 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:47.116 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-09T21:49:47.158 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:47.158 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-09T21:49:47.240 INFO:tasks.ceph:Adding keys to all mons... 2023-07-09T21:49:47.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-09T21:49:47.246 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-09T21:49:47.307 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.y] 2023-07-09T21:49:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBZK6tkteqHNxAA4inbbYz6IZ2Yc+cfFCe7hQ== 2023-07-09T21:49:47.308 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2023-07-09T21:49:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBaK6tkzRxYDRAAimNrYVSgnlKa/LcrJM21Og== 2023-07-09T21:49:47.308 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2023-07-09T21:49:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBaK6tkhe7KGRAAoeCtYxjFHSSnSUZwu4nZ9A== 2023-07-09T21:49:47.308 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2023-07-09T21:49:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBdK6tkdB3PGBAAFoeYIhy2uqAJUSbLbJdRTQ== 2023-07-09T21:49:47.308 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2023-07-09T21:49:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBgK6tk19Y+HxAA91lQzKiiljQEMVmfr2bxWw== 2023-07-09T21:49:47.309 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2023-07-09T21:49:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBjK6tkNiE1JhAAWcZYxoAyD+PVfSI/0KnFfA== 2023-07-09T21:49:47.309 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2023-07-09T21:49:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBmK6tkPAJJLhAARFLACX0SY7u+6K1BOmSmdA== 2023-07-09T21:49:47.309 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2023-07-09T21:49:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBaK6tkwFBVBRAACJgXwd/fdCczDXJ/14KcKQ== 2023-07-09T21:49:47.310 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2023-07-09T21:49:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBaK6tkki/UJRAAsJcmnMjVZOJNndECUAkiVg== 2023-07-09T21:49:47.310 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2023-07-09T21:49:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBaK6tkRxOwMRAA+WhKRURpXJz9LaBKWuzEJw== 2023-07-09T21:49:47.310 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.4] 2023-07-09T21:49:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBtK6tksG3BDRAARy/avAmY0FyArpZdnZY/sQ== 2023-07-09T21:49:47.310 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.5] 2023-07-09T21:49:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBwK6tkAHBNFBAA7ikYVig77uKzs7LWtMS8WA== 2023-07-09T21:49:47.311 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.6] 2023-07-09T21:49:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBzK6tk9g9sGxAA//58pDJnkGJ32EBykgrJiA== 2023-07-09T21:49:47.311 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.7] 2023-07-09T21:49:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQB2K6tkBBQ0IRAACJjUm5wbHKWR6p6ILZCCww== 2023-07-09T21:49:47.311 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2023-07-09T21:49:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBbK6tkVu19ABAApbFrRRJdrT0qBJ/fG9bEVA== 2023-07-09T21:49:47.312 INFO:teuthology.orchestra.run.smithi053.stdout:[client.2] 2023-07-09T21:49:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBbK6tkuTXHCBAAygsg7Xz9oRO8nT8glKJU4Q== 2023-07-09T21:49:47.312 INFO:teuthology.orchestra.run.smithi053.stdout:[client.1] 2023-07-09T21:49:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBbK6tksBxtEBAAqiQuZQNUaBcgRM4F/pgJXg== 2023-07-09T21:49:47.312 INFO:teuthology.orchestra.run.smithi053.stdout:[client.3] 2023-07-09T21:49:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBbK6tkiMUjGBAADn+j9WGS506PTPaSG9MJGA== 2023-07-09T21:49:47.346 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.y] 2023-07-09T21:49:47.346 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBZK6tkteqHNxAA4inbbYz6IZ2Yc+cfFCe7hQ== 2023-07-09T21:49:47.346 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-07-09T21:49:47.346 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBaK6tkzRxYDRAAimNrYVSgnlKa/LcrJM21Og== 2023-07-09T21:49:47.347 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-07-09T21:49:47.347 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBaK6tkhe7KGRAAoeCtYxjFHSSnSUZwu4nZ9A== 2023-07-09T21:49:47.347 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2023-07-09T21:49:47.347 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBdK6tkdB3PGBAAFoeYIhy2uqAJUSbLbJdRTQ== 2023-07-09T21:49:47.347 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2023-07-09T21:49:47.347 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBgK6tk19Y+HxAA91lQzKiiljQEMVmfr2bxWw== 2023-07-09T21:49:47.347 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2023-07-09T21:49:47.347 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBjK6tkNiE1JhAAWcZYxoAyD+PVfSI/0KnFfA== 2023-07-09T21:49:47.348 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.3] 2023-07-09T21:49:47.348 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBmK6tkPAJJLhAARFLACX0SY7u+6K1BOmSmdA== 2023-07-09T21:49:47.348 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2023-07-09T21:49:47.348 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBaK6tkwFBVBRAACJgXwd/fdCczDXJ/14KcKQ== 2023-07-09T21:49:47.348 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-07-09T21:49:47.348 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBaK6tkki/UJRAAsJcmnMjVZOJNndECUAkiVg== 2023-07-09T21:49:47.348 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-07-09T21:49:47.349 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBaK6tkRxOwMRAA+WhKRURpXJz9LaBKWuzEJw== 2023-07-09T21:49:47.349 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.4] 2023-07-09T21:49:47.349 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBtK6tksG3BDRAARy/avAmY0FyArpZdnZY/sQ== 2023-07-09T21:49:47.349 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.5] 2023-07-09T21:49:47.349 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBwK6tkAHBNFBAA7ikYVig77uKzs7LWtMS8WA== 2023-07-09T21:49:47.349 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.6] 2023-07-09T21:49:47.349 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBzK6tk9g9sGxAA//58pDJnkGJ32EBykgrJiA== 2023-07-09T21:49:47.350 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.7] 2023-07-09T21:49:47.350 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQB2K6tkBBQ0IRAACJjUm5wbHKWR6p6ILZCCww== 2023-07-09T21:49:47.350 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2023-07-09T21:49:47.350 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBbK6tkVu19ABAApbFrRRJdrT0qBJ/fG9bEVA== 2023-07-09T21:49:47.350 INFO:teuthology.orchestra.run.smithi184.stdout:[client.2] 2023-07-09T21:49:47.350 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBbK6tkuTXHCBAAygsg7Xz9oRO8nT8glKJU4Q== 2023-07-09T21:49:47.350 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2023-07-09T21:49:47.351 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBbK6tksBxtEBAAqiQuZQNUaBcgRM4F/pgJXg== 2023-07-09T21:49:47.351 INFO:teuthology.orchestra.run.smithi184.stdout:[client.3] 2023-07-09T21:49:47.351 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBbK6tkiMUjGBAADn+j9WGS506PTPaSG9MJGA== 2023-07-09T21:49:47.352 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-09T21:49:47.358 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-09T21:49:47.505 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:49:47.509 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:49:47.623 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:49:47.627 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:49:47.738 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:47.742 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:47.848 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:47.853 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:47.962 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:47.967 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:48.079 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:48.084 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:48.194 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-09T21:49:48.199 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-09T21:49:48.313 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:49:48.317 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:49:48.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:49:48.436 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:49:48.550 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:48.555 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:48.663 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:48.667 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:48.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:48.779 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:48.887 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:48.892 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:49:49.000 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:49:49.004 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:49:49.118 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:49:49.126 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:49:49.243 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:49:49.248 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:49:49.362 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:49:49.367 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:49:49.478 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-09T21:49:49.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-09T21:49:49.546 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-09T21:49:49.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-09T21:49:49.737 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-09T21:49:49.806 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-09T21:49:49.932 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-09T21:49:50.000 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-09T21:49:50.070 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-09T21:49:50.190 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-09T21:49:50.259 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:50.264 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:49:50.306 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-09T21:49:50.306 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-09T21:49:50.307 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-09T21:49:50.348 INFO:tasks.ceph.mon.a:Started 2023-07-09T21:49:50.348 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-09T21:49:50.349 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-09T21:49:50.353 INFO:tasks.ceph.mon.b:Started 2023-07-09T21:49:50.353 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-09T21:49:50.353 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-09T21:49:50.359 INFO:tasks.ceph.mon.c:Started 2023-07-09T21:49:50.359 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-09T21:49:50.360 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-09T21:49:50.360 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-09T21:49:50.364 INFO:tasks.ceph.mgr.y:Started 2023-07-09T21:49:50.364 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-09T21:49:50.364 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-09T21:49:50.368 INFO:tasks.ceph.mgr.x:Started 2023-07-09T21:49:50.369 INFO:tasks.ceph:Setting crush tunables to default 2023-07-09T21:49:50.369 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd crush tunables default 2023-07-09T21:49:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.567+0000 7ff4cdfff700 1 Processor -- start 2023-07-09T21:49:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.567+0000 7ff4cdfff700 1 -- start start 2023-07-09T21:49:50.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.569+0000 7ff4cdfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:50.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.569+0000 7ff4cdfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:50.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.569+0000 7ff4cdfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c80b8e80 con 0x7ff4c80b25d0 2023-07-09T21:49:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.569+0000 7ff4cdfff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c80d14a0 con 0x7ff4c80b3ff0 2023-07-09T21:49:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.569+0000 7ff4cdfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80b1e30 con 0x7ff4c80d0b10 2023-07-09T21:49:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.569+0000 7ff4c77fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.570+0000 7ff4c77fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59608/0 (socket says 172.21.15.53:59608) 2023-07-09T21:49:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.570+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 learned_addr learned my addr 172.21.15.53:0/2801299672 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:49:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.570+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 msgr2=0x7ff4c80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-09T21:49:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.570+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 msgr2=0x7ff4c80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:49:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.570+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:49:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.570+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:49:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.570+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.570+0000 7ff4c6ffd700 1 -- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 msgr2=0x7ff4c80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-09T21:49:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.570+0000 7ff4c6ffd700 1 -- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 msgr2=0x7ff4c80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:49:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.570+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:49:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.570+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:49:50.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.771+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:50.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.771+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:50.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.771+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 msgr2=0x7ff4c80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-09T21:49:50.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.771+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 msgr2=0x7ff4c80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:49:50.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.771+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:49:50.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.771+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:49:50.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.771+0000 7ff4c6ffd700 1 -- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 msgr2=0x7ff4c80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-09T21:49:50.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.771+0000 7ff4c6ffd700 1 -- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 msgr2=0x7ff4c80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:49:50.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.771+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:49:50.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:50.771+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:49:51.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.172+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:51.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.172+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:51.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.172+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 msgr2=0x7ff4c80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-09T21:49:51.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.172+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 msgr2=0x7ff4c80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:49:51.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.172+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:49:51.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.172+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-09T21:49:51.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.172+0000 7ff4c6ffd700 1 -- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 msgr2=0x7ff4c80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-09T21:49:51.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.172+0000 7ff4c6ffd700 1 -- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 msgr2=0x7ff4c80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:49:51.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.172+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:49:51.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.172+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-09T21:49:51.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.973+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:51.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.973+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:51.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.974+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 msgr2=0x7ff4c80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-09T21:49:51.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.974+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 msgr2=0x7ff4c80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:49:51.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.974+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:49:51.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.974+0000 7ff4c6ffd700 1 -- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 msgr2=0x7ff4c80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-09T21:49:51.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.974+0000 7ff4c6ffd700 1 -- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 msgr2=0x7ff4c80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:49:51.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.974+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:49:51.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.974+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-09T21:49:51.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:51.974+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-09T21:49:53.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.569+0000 7ff4c57fa700 1 -- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 msgr2=0x7ff4c80d0f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:49:53.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.569+0000 7ff4c57fa700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4c80d0b10 0x7ff4c80d0f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:53.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.569+0000 7ff4c57fa700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 msgr2=0x7ff4c80b43c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:49:53.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.569+0000 7ff4c57fa700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.53:3300/0 conn(0x7ff4c80b3ff0 0x7ff4c80b43c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:53.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.569+0000 7ff4c57fa700 1 -- 172.21.15.53:0/2801299672 >> v1:172.21.15.184:6789/0 conn(0x7ff4c80b25d0 legacy=0x7ff4c80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:53.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.569+0000 7ff4c57fa700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:53.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.569+0000 7ff4c57fa700 1 -- 172.21.15.53:0/2801299672 --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c80afaa0 con 0x7ff4b40062a0 2023-07-09T21:49:53.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.569+0000 7ff4c57fa700 1 -- 172.21.15.53:0/2801299672 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c80d14a0 con 0x7ff4b4003770 2023-07-09T21:49:53.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.570+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:53.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.570+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 msgr2=0x7ff4b4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-09T21:49:53.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.570+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 msgr2=0x7ff4b4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:49:53.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.570+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:49:53.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.570+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:49:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.771+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:53.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.771+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 msgr2=0x7ff4b4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-09T21:49:53.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.771+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 msgr2=0x7ff4b4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:49:53.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.771+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:49:53.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:53.771+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:49:54.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:54.172+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:54.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:54.172+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 msgr2=0x7ff4b4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-09T21:49:54.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:54.172+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 msgr2=0x7ff4b4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:49:54.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:54.172+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:49:54.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:54.172+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-09T21:49:54.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:54.974+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:54.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:54.974+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 msgr2=0x7ff4b4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-09T21:49:54.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:54.974+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 msgr2=0x7ff4b4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:49:54.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:54.974+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:49:54.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:54.974+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-09T21:49:55.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 -- 172.21.15.53:0/2801299672 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541907519 0 0) 0x7ff4c80afaa0 con 0x7ff4b40062a0 2023-07-09T21:49:55.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 -- 172.21.15.53:0/2801299672 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b00035b0 con 0x7ff4b40062a0 2023-07-09T21:49:55.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 -- 172.21.15.53:0/2801299672 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 151019391 0 0) 0x7ff4b00035b0 con 0x7ff4b40062a0 2023-07-09T21:49:55.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 -- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 msgr2=0x7ff4b4005bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:49:55.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 --2- 172.21.15.53:0/2801299672 >> v2:172.21.15.184:3300/0 conn(0x7ff4b4003770 0x7ff4b4005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:55.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 -- 172.21.15.53:0/2801299672 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b400b010 con 0x7ff4b40062a0 2023-07-09T21:49:55.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 -- 172.21.15.53:0/2801299672 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7ff4bc00e590 con 0x7ff4b40062a0 2023-07-09T21:49:55.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 -- 172.21.15.53:0/2801299672 >> v1:172.21.15.53:6789/0 conn(0x7ff4b40062a0 legacy=0x7ff4b4008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:55.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c7fff700 1 -- 172.21.15.53:0/2801299672 reap_dead start 2023-07-09T21:49:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b0003a50 0x7ff4b0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4b0004850 0x7ff4b0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4b0005400 0x7ff4b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 -- 172.21.15.53:0/2801299672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80d14a0 con 0x7ff4b0003a50 2023-07-09T21:49:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 -- 172.21.15.53:0/2801299672 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b000c2a0 con 0x7ff4b0004850 2023-07-09T21:49:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.776+0000 7ff4c67fc700 1 -- 172.21.15.53:0/2801299672 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b000c460 con 0x7ff4b0005400 2023-07-09T21:49:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.777+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b0003a50 0x7ff4b0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.777+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4b0004850 0x7ff4b0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.777+0000 7ff4c7fff700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4b0005400 0x7ff4b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.777+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4b0005400 msgr2=0x7ff4b000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:49:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.777+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4b0005400 0x7ff4b000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.777+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4b0004850 msgr2=0x7ff4b0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:49:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.777+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4b0004850 0x7ff4b0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:55.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.777+0000 7ff4c77fe700 1 -- 172.21.15.53:0/2801299672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b00035b0 con 0x7ff4b0003a50 2023-07-09T21:49:55.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.777+0000 7ff4c7fff700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4b0005400 0x7ff4b000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:49:55.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.777+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b0003a50 0x7ff4b0003e40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8019ac0 tx=0x7ff4b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644a17f867b084cd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:55.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.778+0000 7ff4c67fc700 1 -- 172.21.15.53:0/2801299672 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b801e070 con 0x7ff4b0003a50 2023-07-09T21:49:55.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.778+0000 7ff4c67fc700 1 -- 172.21.15.53:0/2801299672 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b800c040 con 0x7ff4b0003a50 2023-07-09T21:49:55.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.778+0000 7ff4c67fc700 1 -- 172.21.15.53:0/2801299672 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8004240 con 0x7ff4b0003a50 2023-07-09T21:49:55.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.778+0000 7ff4cdfff700 1 -- 172.21.15.53:0/2801299672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b0003a50 msgr2=0x7ff4b0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:55.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.778+0000 7ff4cdfff700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b0003a50 0x7ff4b0003e40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8019ac0 tx=0x7ff4b0005880 comp rx=0 tx=0).stop 2023-07-09T21:49:55.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.778+0000 7ff4cdfff700 1 -- 172.21.15.53:0/2801299672 shutdown_connections 2023-07-09T21:49:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.778+0000 7ff4cdfff700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4b0005400 0x7ff4b000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.778+0000 7ff4cdfff700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4b0004850 0x7ff4b0004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.778+0000 7ff4cdfff700 1 --2- 172.21.15.53:0/2801299672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b0003a50 0x7ff4b0003e40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.779+0000 7ff4cdfff700 1 -- 172.21.15.53:0/2801299672 >> 172.21.15.53:0/2801299672 conn(0x7ff4c809c1b0 msgr2=0x7ff4c80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.779+0000 7ff4cdfff700 1 -- 172.21.15.53:0/2801299672 shutdown_connections 2023-07-09T21:49:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.779+0000 7ff4cdfff700 1 -- 172.21.15.53:0/2801299672 wait complete. 2023-07-09T21:49:55.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.782+0000 7ff4cdfff700 1 Processor -- start 2023-07-09T21:49:55.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.782+0000 7ff4cdfff700 1 -- start start 2023-07-09T21:49:55.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.783+0000 7ff4cdfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4b0003a50 0x7ff4c80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:55.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.783+0000 7ff4cdfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4b0004850 0x7ff4c80cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:55.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.783+0000 7ff4cdfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b0005400 0x7ff4c80cf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.783+0000 7ff4cdfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80cdab0 con 0x7ff4b0005400 2023-07-09T21:49:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.784+0000 7ff4cdfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80cdd30 con 0x7ff4b0004850 2023-07-09T21:49:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.784+0000 7ff4cdfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80ce010 con 0x7ff4b0003a50 2023-07-09T21:49:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.784+0000 7ff4c7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b0005400 0x7ff4c80cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.784+0000 7ff4c7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b0005400 0x7ff4c80cf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49552/0 (socket says 172.21.15.53:49552) 2023-07-09T21:49:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.784+0000 7ff4c6ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4b0004850 0x7ff4c80cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.784+0000 7ff4c7fff700 1 -- 172.21.15.53:0/4063728557 learned_addr learned my addr 172.21.15.53:0/4063728557 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:49:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.784+0000 7ff4c77fe700 1 --2- 172.21.15.53:0/4063728557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4b0003a50 0x7ff4c80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.784+0000 7ff4c7fff700 1 -- 172.21.15.53:0/4063728557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4b0003a50 msgr2=0x7ff4c80cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.784+0000 7ff4c7fff700 1 --2- 172.21.15.53:0/4063728557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4b0003a50 0x7ff4c80cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.784+0000 7ff4c7fff700 1 -- 172.21.15.53:0/4063728557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4b0004850 msgr2=0x7ff4c80cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.784+0000 7ff4c7fff700 1 --2- 172.21.15.53:0/4063728557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4b0004850 0x7ff4c80cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.784+0000 7ff4c7fff700 1 -- 172.21.15.53:0/4063728557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c80ce2f0 con 0x7ff4b0005400 2023-07-09T21:49:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.784+0000 7ff4c6ffd700 1 --2- 172.21.15.53:0/4063728557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4b0004850 0x7ff4c80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:49:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.785+0000 7ff4c7fff700 1 --2- 172.21.15.53:0/4063728557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b0005400 0x7ff4c80cf160 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff4c808d250 tx=0x7ff4c000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.785+0000 7ff4affff700 1 -- 172.21.15.53:0/4063728557 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000b590 con 0x7ff4b0005400 2023-07-09T21:49:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.785+0000 7ff4affff700 1 -- 172.21.15.53:0/4063728557 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c000b6f0 con 0x7ff4b0005400 2023-07-09T21:49:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.785+0000 7ff4affff700 1 -- 172.21.15.53:0/4063728557 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000baa0 con 0x7ff4b0005400 2023-07-09T21:49:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.785+0000 7ff4cdfff700 1 -- 172.21.15.53:0/4063728557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c80ce5d0 con 0x7ff4b0005400 2023-07-09T21:49:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.785+0000 7ff4cdfff700 1 -- 172.21.15.53:0/4063728557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c80cce40 con 0x7ff4b0005400 2023-07-09T21:49:55.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.786+0000 7ff4affff700 1 -- 172.21.15.53:0/4063728557 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff4c000bc00 con 0x7ff4b0005400 2023-07-09T21:49:55.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.787+0000 7ff4cdfff700 1 -- 172.21.15.53:0/4063728557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c80ceaf0 con 0x7ff4b0005400 2023-07-09T21:49:55.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.787+0000 7ff4affff700 1 -- 172.21.15.53:0/4063728557 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff4c0003a00 con 0x7ff4b0005400 2023-07-09T21:49:55.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.790+0000 7ff4affff700 1 -- 172.21.15.53:0/4063728557 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff4c80ceaf0 con 0x7ff4b0005400 2023-07-09T21:49:55.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.874+0000 7ff4cdfff700 1 -- 172.21.15.53:0/4063728557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff4c8074350 con 0x7ff4b0005400 2023-07-09T21:49:55.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.877+0000 7ff4affff700 1 -- 172.21.15.53:0/4063728557 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff4c0018070 con 0x7ff4b0005400 2023-07-09T21:49:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.878+0000 7ff4cdfff700 1 -- 172.21.15.53:0/4063728557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b0005400 msgr2=0x7ff4c80cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.878+0000 7ff4cdfff700 1 --2- 172.21.15.53:0/4063728557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b0005400 0x7ff4c80cf160 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff4c808d250 tx=0x7ff4c000ddc0 comp rx=0 tx=0).stop 2023-07-09T21:49:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.878+0000 7ff4cdfff700 1 -- 172.21.15.53:0/4063728557 shutdown_connections 2023-07-09T21:49:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.878+0000 7ff4cdfff700 1 --2- 172.21.15.53:0/4063728557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b0005400 0x7ff4c80cf160 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.878+0000 7ff4cdfff700 1 --2- 172.21.15.53:0/4063728557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4b0003a50 0x7ff4c80cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.878+0000 7ff4cdfff700 1 --2- 172.21.15.53:0/4063728557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4b0004850 0x7ff4c80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:55.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.878+0000 7ff4cdfff700 1 -- 172.21.15.53:0/4063728557 >> 172.21.15.53:0/4063728557 conn(0x7ff4c809c1b0 msgr2=0x7ff4c80b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:55.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.878+0000 7ff4cdfff700 1 -- 172.21.15.53:0/4063728557 shutdown_connections 2023-07-09T21:49:55.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:55.878+0000 7ff4cdfff700 1 -- 172.21.15.53:0/4063728557 wait complete. 2023-07-09T21:49:55.880 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2023-07-09T21:49:55.896 INFO:tasks.ceph:check_enable_crimson: False 2023-07-09T21:49:55.897 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-09T21:49:55.897 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:55.897 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-09T21:49:55.942 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:55.941+0000 7fa5b7b9c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:49:55.965 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:55.965 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-09T21:49:56.026 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:56.025+0000 7fa5b7b9c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:49:56.072 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:56.073 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-09T21:49:56.119 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:56.118+0000 7fa5b7b9c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:49:56.180 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:49:56.180 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-09T21:49:56.216 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:56.215+0000 7fa5b7b9c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:49:56.286 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:56.286 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-09T21:49:56.360 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:56.361 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-09T21:49:56.407 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:56.405+0000 7fa5b7b9c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:49:56.480 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:56.481 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-09T21:49:56.587 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:49:56.587 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-09T21:49:56.669 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:49:56.668+0000 7f2d8b365200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:49:56.694 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 282d22e7-b7e6-46cd-a8ca-9e7191bb271e 0 2023-07-09T21:49:56.757 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:49:56.756+0000 7f2d8b365200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:49:56.855 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:49:56.854+0000 7f2d8b365200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:49:56.856 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:56.855+0000 7fa5b7b9c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:49:56.926 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.925+0000 7f431e9ff700 1 Processor -- start 2023-07-09T21:49:56.926 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.925+0000 7f431e9ff700 1 -- start start 2023-07-09T21:49:56.928 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.926+0000 7f431e9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f43180cf030 0x7f43180cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:56.928 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.926+0000 7f431e9ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43180d39d0 0x7f43181608c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:56.928 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.926+0000 7f431e9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43180cd8e0 con 0x7f43180cfdd0 2023-07-09T21:49:56.928 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.926+0000 7f431e9ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43180d0220 con 0x7f43180d39d0 2023-07-09T21:49:56.928 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.926+0000 7f431e9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43180d2760 con 0x7f43180cf030 2023-07-09T21:49:56.929 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.927+0000 7f431cf9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43180d39d0 0x7f43181608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:56.929 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.927+0000 7f431cf9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43180d39d0 0x7f43181608c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.184:54268/0 (socket says 172.21.15.184:54268) 2023-07-09T21:49:56.929 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.927+0000 7f431cf9c700 1 -- 172.21.15.184:0/1804882573 learned_addr learned my addr 172.21.15.184:0/1804882573 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:56.929 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.927+0000 7f4317fff700 1 --2- 172.21.15.184:0/1804882573 >> v2:172.21.15.184:3300/0 conn(0x7f43180cf030 0x7f43180cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:56.931 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.927+0000 7f431cf9c700 1 -- 172.21.15.184:0/1804882573 >> v2:172.21.15.184:3300/0 conn(0x7f43180cf030 msgr2=0x7f43180cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:49:56.931 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.927+0000 7f431cf9c700 1 --2- 172.21.15.184:0/1804882573 >> v2:172.21.15.184:3300/0 conn(0x7f43180cf030 0x7f43180cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:56.931 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.927+0000 7f431cf9c700 1 -- 172.21.15.184:0/1804882573 >> v1:172.21.15.184:6789/0 conn(0x7f43180cfdd0 legacy=0x7f43181601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:56.931 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.927+0000 7f431cf9c700 1 -- 172.21.15.184:0/1804882573 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43180d1740 con 0x7f43180d39d0 2023-07-09T21:49:56.931 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.927+0000 7f4317fff700 1 --2- 172.21.15.184:0/1804882573 >> v2:172.21.15.184:3300/0 conn(0x7f43180cf030 0x7f43180cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:49:56.931 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.927+0000 7f431cf9c700 1 --2- 172.21.15.184:0/1804882573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180d39d0 0x7f43181608c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f43180cf860 tx=0x7f431000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcdff1e43187af13 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:56.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.928+0000 7f4316ffd700 1 -- 172.21.15.184:0/1804882573 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000e070 con 0x7f43180d39d0 2023-07-09T21:49:56.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.928+0000 7f4316ffd700 1 -- 172.21.15.184:0/1804882573 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431000b9c0 con 0x7f43180d39d0 2023-07-09T21:49:56.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.928+0000 7f4316ffd700 1 -- 172.21.15.184:0/1804882573 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000bd70 con 0x7f43180d39d0 2023-07-09T21:49:56.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.928+0000 7f431e9ff700 1 -- 172.21.15.184:0/1804882573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180d39d0 msgr2=0x7f43181608c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:56.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.928+0000 7f431e9ff700 1 --2- 172.21.15.184:0/1804882573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180d39d0 0x7f43181608c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f43180cf860 tx=0x7f431000b330 comp rx=0 tx=0).stop 2023-07-09T21:49:56.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.928+0000 7f431e9ff700 1 -- 172.21.15.184:0/1804882573 shutdown_connections 2023-07-09T21:49:56.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.928+0000 7f431e9ff700 1 --2- 172.21.15.184:0/1804882573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180d39d0 0x7f43181608c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:56.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.928+0000 7f431e9ff700 1 --2- 172.21.15.184:0/1804882573 >> v2:172.21.15.184:3300/0 conn(0x7f43180cf030 0x7f43180cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:56.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.928+0000 7f431e9ff700 1 -- 172.21.15.184:0/1804882573 >> 172.21.15.184:0/1804882573 conn(0x7f431806c170 msgr2=0x7f431806c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:56.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.929+0000 7f431e9ff700 1 -- 172.21.15.184:0/1804882573 shutdown_connections 2023-07-09T21:49:56.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.929+0000 7f431e9ff700 1 -- 172.21.15.184:0/1804882573 wait complete. 2023-07-09T21:49:56.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.931+0000 7f431e9ff700 1 Processor -- start 2023-07-09T21:49:56.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.932+0000 7f431e9ff700 1 -- start start 2023-07-09T21:49:56.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.933+0000 7f431e9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180cf030 0x7f43180ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:56.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.933+0000 7f431e9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43180cfdd0 0x7f43180ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:56.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.933+0000 7f431e9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43180d39d0 0x7f43180cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:56.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.933+0000 7f431e9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43180c9f50 con 0x7f43180cf030 2023-07-09T21:49:56.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.933+0000 7f431e9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43180ca210 con 0x7f43180cfdd0 2023-07-09T21:49:56.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.933+0000 7f431e9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43180ca4f0 con 0x7f43180d39d0 2023-07-09T21:49:56.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.933+0000 7f43177fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43180cfdd0 0x7f43180ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:56.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.933+0000 7f431cf9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43180d39d0 0x7f43180cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:56.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.933+0000 7f43177fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43180cfdd0 0x7f43180ad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:37292/0 (socket says 172.21.15.184:37292) 2023-07-09T21:49:56.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.933+0000 7f43177fe700 1 -- 172.21.15.184:0/1255536913 learned_addr learned my addr 172.21.15.184:0/1255536913 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:56.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.934+0000 7f4317fff700 1 --2- 172.21.15.184:0/1255536913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180cf030 0x7f43180ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:56.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.934+0000 7f43177fe700 1 -- 172.21.15.184:0/1255536913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43180d39d0 msgr2=0x7f43180cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:56.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.934+0000 7f43177fe700 1 --2- 172.21.15.184:0/1255536913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43180d39d0 0x7f43180cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:56.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.934+0000 7f43177fe700 1 -- 172.21.15.184:0/1255536913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180cf030 msgr2=0x7f43180ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:56.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.934+0000 7f43177fe700 1 --2- 172.21.15.184:0/1255536913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180cf030 0x7f43180ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:56.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.934+0000 7f43177fe700 1 -- 172.21.15.184:0/1255536913 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4310009b30 con 0x7f43180cfdd0 2023-07-09T21:49:56.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.934+0000 7f4317fff700 1 --2- 172.21.15.184:0/1255536913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180cf030 0x7f43180ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:49:56.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.934+0000 7f431cf9c700 1 --2- 172.21.15.184:0/1255536913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43180d39d0 0x7f43180cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:49:56.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.934+0000 7f43177fe700 1 --2- 172.21.15.184:0/1255536913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43180cfdd0 0x7f43180ad650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f430c00c450 tx=0x7f430c00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:56.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.934+0000 7f4314ff9700 1 -- 172.21.15.184:0/1255536913 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c0052d0 con 0x7f43180cfdd0 2023-07-09T21:49:56.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.934+0000 7f4314ff9700 1 -- 172.21.15.184:0/1255536913 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430c005430 con 0x7f43180cfdd0 2023-07-09T21:49:56.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.934+0000 7f431e9ff700 1 -- 172.21.15.184:0/1255536913 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43180ca7d0 con 0x7f43180cfdd0 2023-07-09T21:49:56.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.934+0000 7f4314ff9700 1 -- 172.21.15.184:0/1255536913 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c0038c0 con 0x7f43180cfdd0 2023-07-09T21:49:56.940 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.935+0000 7f431e9ff700 1 -- 172.21.15.184:0/1255536913 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43180abc20 con 0x7f43180cfdd0 2023-07-09T21:49:56.940 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.935+0000 7f4314ff9700 1 -- 172.21.15.184:0/1255536913 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f430c003d20 con 0x7f43180cfdd0 2023-07-09T21:49:56.940 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.935+0000 7f4314ff9700 1 -- 172.21.15.184:0/1255536913 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f430c01c780 con 0x7f43180cfdd0 2023-07-09T21:49:56.940 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.936+0000 7f431e9ff700 1 -- 172.21.15.184:0/1255536913 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43180abde0 con 0x7f43180cfdd0 2023-07-09T21:49:56.940 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:56.939+0000 7f4314ff9700 1 -- 172.21.15.184:0/1255536913 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f430c017070 con 0x7f43180cfdd0 2023-07-09T21:49:56.956 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:56.955+0000 7fa5b7b9c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:49:56.956 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:49:56.955+0000 7f2d8b365200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:49:57.026 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.025+0000 7f431e9ff700 1 -- 172.21.15.184:0/1255536913 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "282d22e7-b7e6-46cd-a8ca-9e7191bb271e", "id": 0} v 0) v1 -- 0x7f43180cac90 con 0x7f43180cfdd0 2023-07-09T21:49:57.030 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.029+0000 7f4314ff9700 1 -- 172.21.15.184:0/1255536913 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "282d22e7-b7e6-46cd-a8ca-9e7191bb271e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f430c011d10 con 0x7f43180cfdd0 2023-07-09T21:49:57.030 INFO:teuthology.orchestra.run.smithi184.stdout:0 2023-07-09T21:49:57.031 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.030+0000 7f431e9ff700 1 -- 172.21.15.184:0/1255536913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43180cfdd0 msgr2=0x7f43180ad650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.031 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.030+0000 7f431e9ff700 1 --2- 172.21.15.184:0/1255536913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43180cfdd0 0x7f43180ad650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f430c00c450 tx=0x7f430c00c760 comp rx=0 tx=0).stop 2023-07-09T21:49:57.031 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.030+0000 7f431e9ff700 1 -- 172.21.15.184:0/1255536913 shutdown_connections 2023-07-09T21:49:57.032 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.030+0000 7f431e9ff700 1 --2- 172.21.15.184:0/1255536913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43180d39d0 0x7f43180cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.032 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.030+0000 7f431e9ff700 1 --2- 172.21.15.184:0/1255536913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180cf030 0x7f43180ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.032 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.030+0000 7f431e9ff700 1 --2- 172.21.15.184:0/1255536913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43180cfdd0 0x7f43180ad650 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.032 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.030+0000 7f431e9ff700 1 -- 172.21.15.184:0/1255536913 >> 172.21.15.184:0/1255536913 conn(0x7f431806c170 msgr2=0x7f43180b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:57.032 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.030+0000 7f431e9ff700 1 -- 172.21.15.184:0/1255536913 shutdown_connections 2023-07-09T21:49:57.032 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.030+0000 7f431e9ff700 1 -- 172.21.15.184:0/1255536913 wait complete. 2023-07-09T21:49:57.048 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 4a0566a8-107d-4bc6-9c16-af686ea0f58f 1 2023-07-09T21:49:57.111 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:57.110+0000 7fa5b7b9c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:49:57.141 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:49:57.140+0000 7f2d8b365200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:49:57.216 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:57.215+0000 7fa5b7b9c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:49:57.238 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.236+0000 7f2dc59ff700 1 Processor -- start 2023-07-09T21:49:57.238 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.236+0000 7f2dc59ff700 1 -- start start 2023-07-09T21:49:57.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.237+0000 7f2dc59ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2dc00b3ff0 0x7f2dc00b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.237+0000 7f2dc59ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2dc00d0b10 0x7f2dc00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.238+0000 7f2dc59ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc00b8e80 con 0x7f2dc00b25d0 2023-07-09T21:49:57.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.238+0000 7f2dc59ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc00d14d0 con 0x7f2dc00b3ff0 2023-07-09T21:49:57.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.238+0000 7f2dc59ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc00b1e30 con 0x7f2dc00d0b10 2023-07-09T21:49:57.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.238+0000 7f2dbe7fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2dc00d0b10 0x7f2dc00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.240 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.238+0000 7f2dbe7fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2dc00d0b10 0x7f2dc00d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:37308/0 (socket says 172.21.15.184:37308) 2023-07-09T21:49:57.240 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.238+0000 7f2dbe7fc700 1 -- 172.21.15.184:0/2336124661 learned_addr learned my addr 172.21.15.184:0/2336124661 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:57.240 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.238+0000 7f2dbeffd700 1 --2- 172.21.15.184:0/2336124661 >> v2:172.21.15.53:3300/0 conn(0x7f2dc00b3ff0 0x7f2dc00b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.241 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.238+0000 7f2dbe7fc700 1 -- 172.21.15.184:0/2336124661 >> v2:172.21.15.53:3300/0 conn(0x7f2dc00b3ff0 msgr2=0x7f2dc00b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:49:57.241 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.238+0000 7f2dbe7fc700 1 --2- 172.21.15.184:0/2336124661 >> v2:172.21.15.53:3300/0 conn(0x7f2dc00b3ff0 0x7f2dc00b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.241 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.238+0000 7f2dbe7fc700 1 -- 172.21.15.184:0/2336124661 >> v1:172.21.15.53:6789/0 conn(0x7f2dc00b25d0 legacy=0x7f2dc00b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.238+0000 7f2dbe7fc700 1 -- 172.21.15.184:0/2336124661 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc00afaa0 con 0x7f2dc00d0b10 2023-07-09T21:49:57.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.239+0000 7f2dbe7fc700 1 --2- 172.21.15.184:0/2336124661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc00d0b10 0x7f2dc00d0f90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2dc009c8e0 tx=0x7f2db4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd1799c33c844c2a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:57.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.239+0000 7f2dbdffb700 1 -- 172.21.15.184:0/2336124661 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4011830 con 0x7f2dc00d0b10 2023-07-09T21:49:57.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.239+0000 7f2dbdffb700 1 -- 172.21.15.184:0/2336124661 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db4011990 con 0x7f2dc00d0b10 2023-07-09T21:49:57.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.239+0000 7f2dbdffb700 1 -- 172.21.15.184:0/2336124661 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4011d20 con 0x7f2dc00d0b10 2023-07-09T21:49:57.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.239+0000 7f2dc59ff700 1 -- 172.21.15.184:0/2336124661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc00d0b10 msgr2=0x7f2dc00d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.239+0000 7f2dc59ff700 1 --2- 172.21.15.184:0/2336124661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc00d0b10 0x7f2dc00d0f90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2dc009c8e0 tx=0x7f2db4009bd0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.240+0000 7f2dc59ff700 1 -- 172.21.15.184:0/2336124661 shutdown_connections 2023-07-09T21:49:57.243 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.240+0000 7f2dc59ff700 1 --2- 172.21.15.184:0/2336124661 >> v2:172.21.15.53:3300/0 conn(0x7f2dc00b3ff0 0x7f2dc00b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.243 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.240+0000 7f2dc59ff700 1 --2- 172.21.15.184:0/2336124661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc00d0b10 0x7f2dc00d0f90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.243 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.240+0000 7f2dc59ff700 1 -- 172.21.15.184:0/2336124661 >> 172.21.15.184:0/2336124661 conn(0x7f2dc009c1b0 msgr2=0x7f2dc00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:57.243 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.240+0000 7f2dc59ff700 1 -- 172.21.15.184:0/2336124661 shutdown_connections 2023-07-09T21:49:57.243 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.240+0000 7f2dc59ff700 1 -- 172.21.15.184:0/2336124661 wait complete. 2023-07-09T21:49:57.245 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.241+0000 7f2dc59ff700 1 Processor -- start 2023-07-09T21:49:57.245 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.242+0000 7f2dc59ff700 1 -- start start 2023-07-09T21:49:57.245 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.242+0000 7f2dc59ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc00b25d0 0x7f2dc00cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.245 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.242+0000 7f2dc59ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dc00b3ff0 0x7f2dc01f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.242+0000 7f2dc59ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dc00d0b10 0x7f2dc00cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.242+0000 7f2dc59ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00cbde0 con 0x7f2dc00b3ff0 2023-07-09T21:49:57.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.243+0000 7f2dc59ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00cd680 con 0x7f2dc00b25d0 2023-07-09T21:49:57.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.243+0000 7f2dc59ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00cd960 con 0x7f2dc00d0b10 2023-07-09T21:49:57.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.243+0000 7f2dbeffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc00b25d0 0x7f2dc00cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.243+0000 7f2dbeffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc00b25d0 0x7f2dc00cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:37314/0 (socket says 172.21.15.184:37314) 2023-07-09T21:49:57.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.243+0000 7f2dbe7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dc00b3ff0 0x7f2dc01f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.247 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.243+0000 7f2dbeffd700 1 -- 172.21.15.184:0/1875677758 learned_addr learned my addr 172.21.15.184:0/1875677758 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:57.247 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.243+0000 7f2dbf7fe700 1 --2- 172.21.15.184:0/1875677758 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dc00d0b10 0x7f2dc00cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.247 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.243+0000 7f2dbeffd700 1 -- 172.21.15.184:0/1875677758 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dc00d0b10 msgr2=0x7f2dc00cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.247 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.243+0000 7f2dbeffd700 1 --2- 172.21.15.184:0/1875677758 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dc00d0b10 0x7f2dc00cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.247 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.243+0000 7f2dbeffd700 1 -- 172.21.15.184:0/1875677758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dc00b3ff0 msgr2=0x7f2dc01f2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.247 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.243+0000 7f2dbeffd700 1 --2- 172.21.15.184:0/1875677758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dc00b3ff0 0x7f2dc01f2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.247 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.243+0000 7f2dbeffd700 1 -- 172.21.15.184:0/1875677758 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db4009550 con 0x7f2dc00b25d0 2023-07-09T21:49:57.247 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.243+0000 7f2dbe7fc700 1 --2- 172.21.15.184:0/1875677758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dc00b3ff0 0x7f2dc01f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:49:57.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.244+0000 7f2dbeffd700 1 --2- 172.21.15.184:0/1875677758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc00b25d0 0x7f2dc00cb8a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2db000e9d0 tx=0x7f2db000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:57.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.244+0000 7f2da7fff700 1 -- 172.21.15.184:0/1875677758 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db0009730 con 0x7f2dc00b25d0 2023-07-09T21:49:57.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.244+0000 7f2da7fff700 1 -- 172.21.15.184:0/1875677758 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db000ee70 con 0x7f2dc00b25d0 2023-07-09T21:49:57.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.244+0000 7f2da7fff700 1 -- 172.21.15.184:0/1875677758 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db000ca70 con 0x7f2dc00b25d0 2023-07-09T21:49:57.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.244+0000 7f2dc59ff700 1 -- 172.21.15.184:0/1875677758 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc00cdc40 con 0x7f2dc00b25d0 2023-07-09T21:49:57.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.244+0000 7f2dc59ff700 1 -- 172.21.15.184:0/1875677758 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc00ce200 con 0x7f2dc00b25d0 2023-07-09T21:49:57.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.244+0000 7f2da7fff700 1 -- 172.21.15.184:0/1875677758 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2db0013470 con 0x7f2dc00b25d0 2023-07-09T21:49:57.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.244+0000 7f2da7fff700 1 -- 172.21.15.184:0/1875677758 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f2db0005dd0 con 0x7f2dc00b25d0 2023-07-09T21:49:57.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.245+0000 7f2dc59ff700 1 -- 172.21.15.184:0/1875677758 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc00ce420 con 0x7f2dc00b25d0 2023-07-09T21:49:57.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.247+0000 7f2da7fff700 1 -- 172.21.15.184:0/1875677758 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2db003bb00 con 0x7f2dc00b25d0 2023-07-09T21:49:57.334 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.333+0000 7f2dc59ff700 1 -- 172.21.15.184:0/1875677758 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4a0566a8-107d-4bc6-9c16-af686ea0f58f", "id": 1} v 0) v1 -- 0x7f2dc0074350 con 0x7f2dc00b25d0 2023-07-09T21:49:57.338 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.337+0000 7f2da7fff700 1 -- 172.21.15.184:0/1875677758 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a0566a8-107d-4bc6-9c16-af686ea0f58f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2db002a070 con 0x7f2dc00b25d0 2023-07-09T21:49:57.338 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-07-09T21:49:57.339 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.338+0000 7f2dc59ff700 1 -- 172.21.15.184:0/1875677758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc00b25d0 msgr2=0x7f2dc00cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.339 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.338+0000 7f2dc59ff700 1 --2- 172.21.15.184:0/1875677758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc00b25d0 0x7f2dc00cb8a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2db000e9d0 tx=0x7f2db000ece0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.339 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.338+0000 7f2dc59ff700 1 -- 172.21.15.184:0/1875677758 shutdown_connections 2023-07-09T21:49:57.340 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.338+0000 7f2dc59ff700 1 --2- 172.21.15.184:0/1875677758 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dc00d0b10 0x7f2dc00cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.340 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.338+0000 7f2dc59ff700 1 --2- 172.21.15.184:0/1875677758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc00b25d0 0x7f2dc00cb8a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.340 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.338+0000 7f2dc59ff700 1 --2- 172.21.15.184:0/1875677758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dc00b3ff0 0x7f2dc01f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.340 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.338+0000 7f2dc59ff700 1 -- 172.21.15.184:0/1875677758 >> 172.21.15.184:0/1875677758 conn(0x7f2dc009c1b0 msgr2=0x7f2dc015edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:57.340 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.338+0000 7f2dc59ff700 1 -- 172.21.15.184:0/1875677758 shutdown_connections 2023-07-09T21:49:57.341 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.338+0000 7f2dc59ff700 1 -- 172.21.15.184:0/1875677758 wait complete. 2023-07-09T21:49:57.357 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 016d7aac-bd5c-445f-97f4-4b904cc4036e 2 2023-07-09T21:49:57.549 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.548+0000 7f75b97ff700 1 Processor -- start 2023-07-09T21:49:57.549 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.548+0000 7f75b97ff700 1 -- start start 2023-07-09T21:49:57.550 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.549+0000 7f75b97ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f75b40b3ff0 0x7f75b40b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.550 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.549+0000 7f75b97ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b40d0b10 0x7f75b40d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.551 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.549+0000 7f75b97ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b40b8e80 con 0x7f75b40b25d0 2023-07-09T21:49:57.551 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.549+0000 7f75b97ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b40d14a0 con 0x7f75b40b3ff0 2023-07-09T21:49:57.551 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.549+0000 7f75b97ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b40b1e30 con 0x7f75b40d0b10 2023-07-09T21:49:57.551 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.549+0000 7f75b2ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f75b40b3ff0 0x7f75b40b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.551 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.549+0000 7f75b27fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b40d0b10 0x7f75b40d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.551 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.549+0000 7f75b2ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f75b40b3ff0 0x7f75b40b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:37324/0 (socket says 172.21.15.184:37324) 2023-07-09T21:49:57.551 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.549+0000 7f75b2ffd700 1 -- 172.21.15.184:0/1787222549 learned_addr learned my addr 172.21.15.184:0/1787222549 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:57.552 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:49:57.551+0000 7f2d8b365200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:49:57.553 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.550+0000 7f75b27fc700 1 -- 172.21.15.184:0/1787222549 >> v2:172.21.15.184:3300/0 conn(0x7f75b40b3ff0 msgr2=0x7f75b40b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:49:57.553 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.550+0000 7f75b27fc700 1 --2- 172.21.15.184:0/1787222549 >> v2:172.21.15.184:3300/0 conn(0x7f75b40b3ff0 0x7f75b40b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.553 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.550+0000 7f75b27fc700 1 -- 172.21.15.184:0/1787222549 >> v1:172.21.15.53:6789/0 conn(0x7f75b40b25d0 legacy=0x7f75b40b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.554 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.550+0000 7f75b27fc700 1 -- 172.21.15.184:0/1787222549 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b40afaa0 con 0x7f75b40d0b10 2023-07-09T21:49:57.554 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.550+0000 7f75b2ffd700 1 --2- 172.21.15.184:0/1787222549 >> v2:172.21.15.184:3300/0 conn(0x7f75b40b3ff0 0x7f75b40b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:49:57.554 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.550+0000 7f75b27fc700 1 --2- 172.21.15.184:0/1787222549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b40d0b10 0x7f75b40d0f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009840 tx=0x7f75a8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17abce2b422a3502 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:57.554 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.550+0000 7f75b1ffb700 1 -- 172.21.15.184:0/1787222549 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8011830 con 0x7f75b40d0b10 2023-07-09T21:49:57.554 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.550+0000 7f75b1ffb700 1 -- 172.21.15.184:0/1787222549 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a8011990 con 0x7f75b40d0b10 2023-07-09T21:49:57.554 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.550+0000 7f75b1ffb700 1 -- 172.21.15.184:0/1787222549 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8011d20 con 0x7f75b40d0b10 2023-07-09T21:49:57.554 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.551+0000 7f75b97ff700 1 -- 172.21.15.184:0/1787222549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b40d0b10 msgr2=0x7f75b40d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.555 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.551+0000 7f75b97ff700 1 --2- 172.21.15.184:0/1787222549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b40d0b10 0x7f75b40d0f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009840 tx=0x7f75a8009b50 comp rx=0 tx=0).stop 2023-07-09T21:49:57.555 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.551+0000 7f75b97ff700 1 -- 172.21.15.184:0/1787222549 shutdown_connections 2023-07-09T21:49:57.555 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.551+0000 7f75b97ff700 1 --2- 172.21.15.184:0/1787222549 >> v2:172.21.15.184:3300/0 conn(0x7f75b40b3ff0 0x7f75b40b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.555 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.551+0000 7f75b97ff700 1 --2- 172.21.15.184:0/1787222549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b40d0b10 0x7f75b40d0f60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.555 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.551+0000 7f75b97ff700 1 -- 172.21.15.184:0/1787222549 >> 172.21.15.184:0/1787222549 conn(0x7f75b409c1b0 msgr2=0x7f75b40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:57.555 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.551+0000 7f75b97ff700 1 -- 172.21.15.184:0/1787222549 shutdown_connections 2023-07-09T21:49:57.555 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.551+0000 7f75b97ff700 1 -- 172.21.15.184:0/1787222549 wait complete. 2023-07-09T21:49:57.557 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.553+0000 7f75b97ff700 1 Processor -- start 2023-07-09T21:49:57.557 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.553+0000 7f75b97ff700 1 -- start start 2023-07-09T21:49:57.558 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.554+0000 7f75b97ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b40b25d0 0x7f75b40caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.558 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.554+0000 7f75b97ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b40b3ff0 0x7f75b4159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.558 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.554+0000 7f75b97ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b40d0b10 0x7f75b40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.558 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.554+0000 7f75b97ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b40cb820 con 0x7f75b40d0b10 2023-07-09T21:49:57.558 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.554+0000 7f75b97ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b415e100 con 0x7f75b40b25d0 2023-07-09T21:49:57.558 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.554+0000 7f75b97ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b415e3e0 con 0x7f75b40b3ff0 2023-07-09T21:49:57.558 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.554+0000 7f75b2ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b40b25d0 0x7f75b40caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.559 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.554+0000 7f75b2ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b40b25d0 0x7f75b40caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:37334/0 (socket says 172.21.15.184:37334) 2023-07-09T21:49:57.559 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.554+0000 7f75b27fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b40b3ff0 0x7f75b4159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.559 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.554+0000 7f75b2ffd700 1 -- 172.21.15.184:0/2562693065 learned_addr learned my addr 172.21.15.184:0/2562693065 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:57.559 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.554+0000 7f75b37fe700 1 --2- 172.21.15.184:0/2562693065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b40d0b10 0x7f75b40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.559 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.555+0000 7f75b2ffd700 1 -- 172.21.15.184:0/2562693065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b40b3ff0 msgr2=0x7f75b4159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.559 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.555+0000 7f75b2ffd700 1 --2- 172.21.15.184:0/2562693065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b40b3ff0 0x7f75b4159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.559 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.555+0000 7f75b2ffd700 1 -- 172.21.15.184:0/2562693065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b40d0b10 msgr2=0x7f75b40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.559 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.555+0000 7f75b2ffd700 1 --2- 172.21.15.184:0/2562693065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b40d0b10 0x7f75b40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.560 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.555+0000 7f75b2ffd700 1 -- 172.21.15.184:0/2562693065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4009550 con 0x7f75b40b25d0 2023-07-09T21:49:57.560 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.555+0000 7f75b37fe700 1 --2- 172.21.15.184:0/2562693065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b40d0b10 0x7f75b40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:49:57.560 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.555+0000 7f75b2ffd700 1 --2- 172.21.15.184:0/2562693065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b40b25d0 0x7f75b40caff0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f75a400ebe0 tx=0x7f75a400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:57.560 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.555+0000 7f759b7fe700 1 -- 172.21.15.184:0/2562693065 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a400c850 con 0x7f75b40b25d0 2023-07-09T21:49:57.560 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.555+0000 7f759b7fe700 1 -- 172.21.15.184:0/2562693065 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a400c9b0 con 0x7f75b40b25d0 2023-07-09T21:49:57.560 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.555+0000 7f75b97ff700 1 -- 172.21.15.184:0/2562693065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a80094a0 con 0x7f75b40b25d0 2023-07-09T21:49:57.560 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.555+0000 7f759b7fe700 1 -- 172.21.15.184:0/2562693065 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a400cd20 con 0x7f75b40b25d0 2023-07-09T21:49:57.561 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.555+0000 7f75b97ff700 1 -- 172.21.15.184:0/2562693065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b415e9a0 con 0x7f75b40b25d0 2023-07-09T21:49:57.561 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.555+0000 7f759b7fe700 1 -- 172.21.15.184:0/2562693065 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f75a4005d20 con 0x7f75b40b25d0 2023-07-09T21:49:57.561 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.556+0000 7f759b7fe700 1 -- 172.21.15.184:0/2562693065 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f75a40068e0 con 0x7f75b40b25d0 2023-07-09T21:49:57.561 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.556+0000 7f75b97ff700 1 -- 172.21.15.184:0/2562693065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b4074350 con 0x7f75b40b25d0 2023-07-09T21:49:57.561 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.559+0000 7f759b7fe700 1 -- 172.21.15.184:0/2562693065 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f75a4021060 con 0x7f75b40b25d0 2023-07-09T21:49:57.646 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.645+0000 7f75b97ff700 1 -- 172.21.15.184:0/2562693065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "016d7aac-bd5c-445f-97f4-4b904cc4036e", "id": 2} v 0) v1 -- 0x7f75b408b870 con 0x7f75b40b25d0 2023-07-09T21:49:57.649 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:49:57.648+0000 7f2d8b365200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:49:57.650 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.649+0000 7f759b7fe700 1 -- 172.21.15.184:0/2562693065 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "016d7aac-bd5c-445f-97f4-4b904cc4036e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f75a4029020 con 0x7f75b40b25d0 2023-07-09T21:49:57.650 INFO:teuthology.orchestra.run.smithi184.stdout:2 2023-07-09T21:49:57.651 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.650+0000 7f75b97ff700 1 -- 172.21.15.184:0/2562693065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b40b25d0 msgr2=0x7f75b40caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.651 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.650+0000 7f75b97ff700 1 --2- 172.21.15.184:0/2562693065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b40b25d0 0x7f75b40caff0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f75a400ebe0 tx=0x7f75a400eef0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.652 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.650+0000 7f75b97ff700 1 -- 172.21.15.184:0/2562693065 shutdown_connections 2023-07-09T21:49:57.652 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.650+0000 7f75b97ff700 1 --2- 172.21.15.184:0/2562693065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b40d0b10 0x7f75b40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.652 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.650+0000 7f75b97ff700 1 --2- 172.21.15.184:0/2562693065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b40b25d0 0x7f75b40caff0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.652 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.650+0000 7f75b97ff700 1 --2- 172.21.15.184:0/2562693065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b40b3ff0 0x7f75b4159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.652 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.650+0000 7f75b97ff700 1 -- 172.21.15.184:0/2562693065 >> 172.21.15.184:0/2562693065 conn(0x7f75b409c1b0 msgr2=0x7f75b40b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:57.653 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.650+0000 7f75b97ff700 1 -- 172.21.15.184:0/2562693065 shutdown_connections 2023-07-09T21:49:57.653 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.650+0000 7f75b97ff700 1 -- 172.21.15.184:0/2562693065 wait complete. 2023-07-09T21:49:57.670 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 9a0bb860-f0aa-48e1-91c6-c2c1bab811d2 3 2023-07-09T21:49:57.761 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:57.760+0000 7fa5b7b9c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:49:57.803 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:49:57.802+0000 7f2d8b365200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:49:57.863 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.862+0000 7f68523ff700 1 Processor -- start 2023-07-09T21:49:57.864 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.862+0000 7f68523ff700 1 -- start start 2023-07-09T21:49:57.865 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.863+0000 7f68523ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f684c0b4600 0x7f684c0cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.865 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.864+0000 7f68523ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f684c0b6f00 0x7f684c0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.865 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.864+0000 7f68523ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684c15cd60 con 0x7f684c0d0260 2023-07-09T21:49:57.866 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.864+0000 7f68523ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684c0d1550 con 0x7f684c0b4600 2023-07-09T21:49:57.866 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.864+0000 7f68523ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0d2d90 con 0x7f684c0b6f00 2023-07-09T21:49:57.866 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.864+0000 7f684bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f684c0b4600 0x7f684c0cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.866 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.864+0000 7f685099c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f684c0b6f00 0x7f684c0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.866 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.864+0000 7f684bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f684c0b4600 0x7f684c0cfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:37338/0 (socket says 172.21.15.184:37338) 2023-07-09T21:49:57.866 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.864+0000 7f684bfff700 1 -- 172.21.15.184:0/1428192084 learned_addr learned my addr 172.21.15.184:0/1428192084 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:57.867 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.864+0000 7f684bfff700 1 -- 172.21.15.184:0/1428192084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f684c0b6f00 msgr2=0x7f684c0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:49:57.867 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.864+0000 7f684bfff700 1 --2- 172.21.15.184:0/1428192084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f684c0b6f00 0x7f684c0cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.867 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.864+0000 7f684bfff700 1 -- 172.21.15.184:0/1428192084 >> v1:172.21.15.53:6789/0 conn(0x7f684c0d0260 legacy=0x7f684c0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.867 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.864+0000 7f684bfff700 1 -- 172.21.15.184:0/1428192084 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c0cf340 con 0x7f684c0b4600 2023-07-09T21:49:57.868 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.865+0000 7f684bfff700 1 --2- 172.21.15.184:0/1428192084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684c0b4600 0x7f684c0cfd20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f683c0098f0 tx=0x7f683c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32c3e9e36d51bda2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:57.868 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.865+0000 7f684b7fe700 1 -- 172.21.15.184:0/1428192084 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c011830 con 0x7f684c0b4600 2023-07-09T21:49:57.868 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.865+0000 7f684b7fe700 1 -- 172.21.15.184:0/1428192084 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c011990 con 0x7f684c0b4600 2023-07-09T21:49:57.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.865+0000 7f684b7fe700 1 -- 172.21.15.184:0/1428192084 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c011d20 con 0x7f684c0b4600 2023-07-09T21:49:57.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.865+0000 7f68523ff700 1 -- 172.21.15.184:0/1428192084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684c0b4600 msgr2=0x7f684c0cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.865+0000 7f68523ff700 1 --2- 172.21.15.184:0/1428192084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684c0b4600 0x7f684c0cfd20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f683c0098f0 tx=0x7f683c009c00 comp rx=0 tx=0).stop 2023-07-09T21:49:57.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.866+0000 7f68523ff700 1 -- 172.21.15.184:0/1428192084 shutdown_connections 2023-07-09T21:49:57.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.866+0000 7f68523ff700 1 --2- 172.21.15.184:0/1428192084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f684c0b6f00 0x7f684c0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.866+0000 7f68523ff700 1 --2- 172.21.15.184:0/1428192084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684c0b4600 0x7f684c0cfd20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.866+0000 7f68523ff700 1 -- 172.21.15.184:0/1428192084 >> 172.21.15.184:0/1428192084 conn(0x7f684c09c200 msgr2=0x7f684c0d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:57.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.866+0000 7f68523ff700 1 -- 172.21.15.184:0/1428192084 shutdown_connections 2023-07-09T21:49:57.870 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.866+0000 7f68523ff700 1 -- 172.21.15.184:0/1428192084 wait complete. 2023-07-09T21:49:57.871 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.867+0000 7f68523ff700 1 Processor -- start 2023-07-09T21:49:57.872 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.868+0000 7f68523ff700 1 -- start start 2023-07-09T21:49:57.872 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.868+0000 7f68523ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f684c0b6f00 0x7f684c153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.872 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.868+0000 7f68523ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684c0d0260 0x7f684c1f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.872 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.868+0000 7f68523ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f684c1498c0 0x7f684c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:57.872 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.868+0000 7f68523ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c1548a0 con 0x7f684c1498c0 2023-07-09T21:49:57.872 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.868+0000 7f68523ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c153c90 con 0x7f684c0d0260 2023-07-09T21:49:57.873 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.868+0000 7f68523ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684c153f70 con 0x7f684c0b6f00 2023-07-09T21:49:57.873 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.869+0000 7f684bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f684c0b6f00 0x7f684c153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.873 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.869+0000 7f6843fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684c0d0260 0x7f684c1f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.873 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.869+0000 7f684bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f684c0b6f00 0x7f684c153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:39926/0 (socket says 172.21.15.184:39926) 2023-07-09T21:49:57.873 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.869+0000 7f684bfff700 1 -- 172.21.15.184:0/2595752506 learned_addr learned my addr 172.21.15.184:0/2595752506 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:57.874 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.869+0000 7f685099c700 1 --2- 172.21.15.184:0/2595752506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f684c1498c0 0x7f684c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:57.874 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.869+0000 7f684bfff700 1 -- 172.21.15.184:0/2595752506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684c0d0260 msgr2=0x7f684c1f21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.874 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.869+0000 7f684bfff700 1 --2- 172.21.15.184:0/2595752506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684c0d0260 0x7f684c1f21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.874 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.869+0000 7f684bfff700 1 -- 172.21.15.184:0/2595752506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f684c1498c0 msgr2=0x7f684c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.874 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.869+0000 7f684bfff700 1 --2- 172.21.15.184:0/2595752506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f684c1498c0 0x7f684c154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.874 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.869+0000 7f684bfff700 1 -- 172.21.15.184:0/2595752506 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c009550 con 0x7f684c0b6f00 2023-07-09T21:49:57.874 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.869+0000 7f6843fff700 1 --2- 172.21.15.184:0/2595752506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684c0d0260 0x7f684c1f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:49:57.874 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.869+0000 7f684bfff700 1 --2- 172.21.15.184:0/2595752506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f684c0b6f00 0x7f684c153440 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f683c000c00 tx=0x7f683c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:57.875 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.870+0000 7f68497fa700 1 -- 172.21.15.184:0/2595752506 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c004400 con 0x7f684c0b6f00 2023-07-09T21:49:57.875 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.870+0000 7f68497fa700 1 -- 172.21.15.184:0/2595752506 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c01f070 con 0x7f684c0b6f00 2023-07-09T21:49:57.875 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.870+0000 7f68523ff700 1 -- 172.21.15.184:0/2595752506 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684c154250 con 0x7f684c0b6f00 2023-07-09T21:49:57.875 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.870+0000 7f68497fa700 1 -- 172.21.15.184:0/2595752506 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0038e0 con 0x7f684c0b6f00 2023-07-09T21:49:57.875 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.870+0000 7f68523ff700 1 -- 172.21.15.184:0/2595752506 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684c153980 con 0x7f684c0b6f00 2023-07-09T21:49:57.875 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.870+0000 7f68497fa700 1 -- 172.21.15.184:0/2595752506 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f683c021030 con 0x7f684c0b6f00 2023-07-09T21:49:57.875 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.870+0000 7f68497fa700 1 -- 172.21.15.184:0/2595752506 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f683c01a450 con 0x7f684c0b6f00 2023-07-09T21:49:57.876 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.871+0000 7f68523ff700 1 -- 172.21.15.184:0/2595752506 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684c074350 con 0x7f684c0b6f00 2023-07-09T21:49:57.876 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.874+0000 7f68497fa700 1 -- 172.21.15.184:0/2595752506 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f683c015020 con 0x7f684c0b6f00 2023-07-09T21:49:57.908 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:49:57.907+0000 7f2d8b365200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:49:57.961 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.960+0000 7f68523ff700 1 -- 172.21.15.184:0/2595752506 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9a0bb860-f0aa-48e1-91c6-c2c1bab811d2", "id": 3} v 0) v1 -- 0x7f684c15ca00 con 0x7f684c0b6f00 2023-07-09T21:49:57.969 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.968+0000 7f68497fa700 1 -- 172.21.15.184:0/2595752506 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9a0bb860-f0aa-48e1-91c6-c2c1bab811d2", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f683c003d40 con 0x7f684c0b6f00 2023-07-09T21:49:57.970 INFO:teuthology.orchestra.run.smithi184.stdout:3 2023-07-09T21:49:57.970 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.969+0000 7f68523ff700 1 -- 172.21.15.184:0/2595752506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f684c0b6f00 msgr2=0x7f684c153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:57.971 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.969+0000 7f68523ff700 1 --2- 172.21.15.184:0/2595752506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f684c0b6f00 0x7f684c153440 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f683c000c00 tx=0x7f683c004750 comp rx=0 tx=0).stop 2023-07-09T21:49:57.971 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.969+0000 7f68523ff700 1 -- 172.21.15.184:0/2595752506 shutdown_connections 2023-07-09T21:49:57.971 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.969+0000 7f68523ff700 1 --2- 172.21.15.184:0/2595752506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f684c1498c0 0x7f684c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.971 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.969+0000 7f68523ff700 1 --2- 172.21.15.184:0/2595752506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f684c0b6f00 0x7f684c153440 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.971 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.969+0000 7f68523ff700 1 --2- 172.21.15.184:0/2595752506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684c0d0260 0x7f684c1f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:57.971 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.969+0000 7f68523ff700 1 -- 172.21.15.184:0/2595752506 >> 172.21.15.184:0/2595752506 conn(0x7f684c09c200 msgr2=0x7f684c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:57.971 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.969+0000 7f68523ff700 1 -- 172.21.15.184:0/2595752506 shutdown_connections 2023-07-09T21:49:57.972 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:57.970+0000 7f68523ff700 1 -- 172.21.15.184:0/2595752506 wait complete. 2023-07-09T21:49:57.988 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new fa07c13d-5240-4815-ab88-67c32e36e515 4 2023-07-09T21:49:58.178 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.177+0000 7f8ac19ff700 1 Processor -- start 2023-07-09T21:49:58.178 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.177+0000 7f8ac19ff700 1 -- start start 2023-07-09T21:49:58.179 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.178+0000 7f8ac19ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc069f30 0x7f8abc06a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.180 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.178+0000 7f8ac19ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8abc1601d0 0x7f8abc160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.180 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.178+0000 7f8ac19ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc0cdba0 con 0x7f8abc071650 2023-07-09T21:49:58.180 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.178+0000 7f8ac19ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc06a8e0 con 0x7f8abc1601d0 2023-07-09T21:49:58.181 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.178+0000 7f8ac19ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0cf370 con 0x7f8abc069f30 2023-07-09T21:49:58.181 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.178+0000 7f8aba7fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc069f30 0x7f8abc06a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.181 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.179+0000 7f8aba7fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc069f30 0x7f8abc06a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:39938/0 (socket says 172.21.15.184:39938) 2023-07-09T21:49:58.181 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.179+0000 7f8aba7fc700 1 -- 172.21.15.184:0/2338952194 learned_addr learned my addr 172.21.15.184:0/2338952194 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:58.181 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.179+0000 7f8abb7fe700 1 --2- 172.21.15.184:0/2338952194 >> v2:172.21.15.184:3300/0 conn(0x7f8abc1601d0 0x7f8abc160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.183 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.179+0000 7f8abb7fe700 1 -- 172.21.15.184:0/2338952194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc069f30 msgr2=0x7f8abc06a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:49:58.183 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.179+0000 7f8abb7fe700 1 --2- 172.21.15.184:0/2338952194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc069f30 0x7f8abc06a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.183 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.179+0000 7f8abb7fe700 1 -- 172.21.15.184:0/2338952194 >> v1:172.21.15.53:6789/0 conn(0x7f8abc071650 legacy=0x7f8abc0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:58.183 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.179+0000 7f8abb7fe700 1 -- 172.21.15.184:0/2338952194 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc0cf650 con 0x7f8abc1601d0 2023-07-09T21:49:58.184 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.179+0000 7f8aba7fc700 1 --2- 172.21.15.184:0/2338952194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc069f30 0x7f8abc06a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:49:58.184 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.179+0000 7f8ab9ffb700 1 -- 172.21.15.184:0/2338952194 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025389553 0 0) 0x7f8abc0cdba0 con 0x7f8abc071650 2023-07-09T21:49:58.184 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.179+0000 7f8abb7fe700 1 --2- 172.21.15.184:0/2338952194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc1601d0 0x7f8abc160650 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009d90 tx=0x7f8ab400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53da895911759b56 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:58.184 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.180+0000 7f8ab9ffb700 1 -- 172.21.15.184:0/2338952194 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400e070 con 0x7f8abc1601d0 2023-07-09T21:49:58.184 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.180+0000 7f8ab9ffb700 1 -- 172.21.15.184:0/2338952194 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab400bb20 con 0x7f8abc1601d0 2023-07-09T21:49:58.184 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.180+0000 7f8ab9ffb700 1 -- 172.21.15.184:0/2338952194 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4012430 con 0x7f8abc1601d0 2023-07-09T21:49:58.185 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.180+0000 7f8ac19ff700 1 -- 172.21.15.184:0/2338952194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc1601d0 msgr2=0x7f8abc160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:58.185 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.180+0000 7f8ac19ff700 1 --2- 172.21.15.184:0/2338952194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc1601d0 0x7f8abc160650 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009d90 tx=0x7f8ab400b330 comp rx=0 tx=0).stop 2023-07-09T21:49:58.185 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.180+0000 7f8ac19ff700 1 -- 172.21.15.184:0/2338952194 shutdown_connections 2023-07-09T21:49:58.185 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.180+0000 7f8ac19ff700 1 --2- 172.21.15.184:0/2338952194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc1601d0 0x7f8abc160650 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.185 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.180+0000 7f8ac19ff700 1 --2- 172.21.15.184:0/2338952194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc069f30 0x7f8abc06a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.185 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.180+0000 7f8ac19ff700 1 -- 172.21.15.184:0/2338952194 >> 172.21.15.184:0/2338952194 conn(0x7f8abc0cc640 msgr2=0x7f8abc0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:58.185 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.180+0000 7f8ac19ff700 1 -- 172.21.15.184:0/2338952194 shutdown_connections 2023-07-09T21:49:58.186 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.180+0000 7f8ac19ff700 1 -- 172.21.15.184:0/2338952194 wait complete. 2023-07-09T21:49:58.186 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.182+0000 7f8ac19ff700 1 Processor -- start 2023-07-09T21:49:58.186 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.182+0000 7f8ac19ff700 1 -- start start 2023-07-09T21:49:58.188 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.183+0000 7f8ac19ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc069f30 0x7f8abc155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.188 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.183+0000 7f8ac19ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc071650 0x7f8abc0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.189 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.183+0000 7f8ac19ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc1601d0 0x7f8abc0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.189 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.183+0000 7f8ac19ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0b2a90 con 0x7f8abc069f30 2023-07-09T21:49:58.189 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.183+0000 7f8ac19ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0b0310 con 0x7f8abc071650 2023-07-09T21:49:58.189 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.183+0000 7f8ac19ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0b05f0 con 0x7f8abc1601d0 2023-07-09T21:49:58.189 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.183+0000 7f8aba7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc071650 0x7f8abc0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.189 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.183+0000 7f8abb7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc1601d0 0x7f8abc0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.190 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.183+0000 7f8aba7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc071650 0x7f8abc0b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:37376/0 (socket says 172.21.15.184:37376) 2023-07-09T21:49:58.190 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.183+0000 7f8aba7fc700 1 -- 172.21.15.184:0/1315372244 learned_addr learned my addr 172.21.15.184:0/1315372244 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:58.190 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.183+0000 7f8abaffd700 1 --2- 172.21.15.184:0/1315372244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc069f30 0x7f8abc155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.190 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.184+0000 7f8aba7fc700 1 -- 172.21.15.184:0/1315372244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc1601d0 msgr2=0x7f8abc0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:58.190 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.184+0000 7f8aba7fc700 1 --2- 172.21.15.184:0/1315372244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc1601d0 0x7f8abc0b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.190 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.184+0000 7f8aba7fc700 1 -- 172.21.15.184:0/1315372244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc069f30 msgr2=0x7f8abc155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:58.190 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.184+0000 7f8aba7fc700 1 --2- 172.21.15.184:0/1315372244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc069f30 0x7f8abc155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.191 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.184+0000 7f8aba7fc700 1 -- 172.21.15.184:0/1315372244 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab0009550 con 0x7f8abc071650 2023-07-09T21:49:58.191 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.184+0000 7f8aba7fc700 1 --2- 172.21.15.184:0/1315372244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc071650 0x7f8abc0b18b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000ebe0 tx=0x7f8ab000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:58.191 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.184+0000 7f8aa3fff700 1 -- 172.21.15.184:0/1315372244 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab000c850 con 0x7f8abc071650 2023-07-09T21:49:58.191 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.184+0000 7f8aa3fff700 1 -- 172.21.15.184:0/1315372244 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab000c9b0 con 0x7f8abc071650 2023-07-09T21:49:58.191 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.184+0000 7f8ac19ff700 1 -- 172.21.15.184:0/1315372244 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab4009a70 con 0x7f8abc071650 2023-07-09T21:49:58.191 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.184+0000 7f8aa3fff700 1 -- 172.21.15.184:0/1315372244 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab000cd40 con 0x7f8abc071650 2023-07-09T21:49:58.191 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.184+0000 7f8ac19ff700 1 -- 172.21.15.184:0/1315372244 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc0b0bb0 con 0x7f8abc071650 2023-07-09T21:49:58.192 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.185+0000 7f8aa3fff700 1 -- 172.21.15.184:0/1315372244 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8ab0005d20 con 0x7f8abc071650 2023-07-09T21:49:58.192 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.185+0000 7f8aa3fff700 1 -- 172.21.15.184:0/1315372244 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f8ab0006840 con 0x7f8abc071650 2023-07-09T21:49:58.192 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.186+0000 7f8ac19ff700 1 -- 172.21.15.184:0/1315372244 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc074350 con 0x7f8abc071650 2023-07-09T21:49:58.192 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.188+0000 7f8aa3fff700 1 -- 172.21.15.184:0/1315372244 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8ab0021060 con 0x7f8abc071650 2023-07-09T21:49:58.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.298+0000 7f8ac19ff700 1 -- 172.21.15.184:0/1315372244 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fa07c13d-5240-4815-ab88-67c32e36e515", "id": 4} v 0) v1 -- 0x7f8abc0710e0 con 0x7f8abc071650 2023-07-09T21:49:58.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.306+0000 7f8aa3fff700 1 -- 172.21.15.184:0/1315372244 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa07c13d-5240-4815-ab88-67c32e36e515", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ab0029020 con 0x7f8abc071650 2023-07-09T21:49:58.308 INFO:teuthology.orchestra.run.smithi184.stdout:4 2023-07-09T21:49:58.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.308+0000 7f8ac19ff700 1 -- 172.21.15.184:0/1315372244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc071650 msgr2=0x7f8abc0b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:58.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.308+0000 7f8ac19ff700 1 --2- 172.21.15.184:0/1315372244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc071650 0x7f8abc0b18b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000ebe0 tx=0x7f8ab000eef0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.308+0000 7f8ac19ff700 1 -- 172.21.15.184:0/1315372244 shutdown_connections 2023-07-09T21:49:58.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.308+0000 7f8ac19ff700 1 --2- 172.21.15.184:0/1315372244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc1601d0 0x7f8abc0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.308+0000 7f8ac19ff700 1 --2- 172.21.15.184:0/1315372244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc069f30 0x7f8abc155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.310 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.308+0000 7f8ac19ff700 1 --2- 172.21.15.184:0/1315372244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc071650 0x7f8abc0b18b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.310 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.308+0000 7f8ac19ff700 1 -- 172.21.15.184:0/1315372244 >> 172.21.15.184:0/1315372244 conn(0x7f8abc0cc640 msgr2=0x7f8abc0cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:58.310 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.308+0000 7f8ac19ff700 1 -- 172.21.15.184:0/1315372244 shutdown_connections 2023-07-09T21:49:58.310 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.308+0000 7f8ac19ff700 1 -- 172.21.15.184:0/1315372244 wait complete. 2023-07-09T21:49:58.331 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e 5 2023-07-09T21:49:58.448 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:49:58.446+0000 7f2d8b365200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:49:58.500 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:58.499+0000 7fa5b7b9c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-09T21:49:58.526 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.524+0000 7f385d5ff700 1 Processor -- start 2023-07-09T21:49:58.526 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.524+0000 7f385d5ff700 1 -- start start 2023-07-09T21:49:58.529 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f385d5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38580cd430 0x7f38580cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.529 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f385d5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f38580d22d0 0x7f38580b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.529 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f385d5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580d02a0 con 0x7f38580b4860 2023-07-09T21:49:58.530 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f385d5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38580b5210 con 0x7f38580d22d0 2023-07-09T21:49:58.530 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f385d5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580cfce0 con 0x7f38580cd430 2023-07-09T21:49:58.530 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f38577fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f38580d22d0 0x7f38580b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.530 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f3856ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38580cd430 0x7f38580cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.530 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f38577fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f38580d22d0 0x7f38580b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:37388/0 (socket says 172.21.15.184:37388) 2023-07-09T21:49:58.531 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f38577fe700 1 -- 172.21.15.184:0/781687255 learned_addr learned my addr 172.21.15.184:0/781687255 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:58.531 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f384ffff700 1 --1- 172.21.15.184:0/781687255 >> v1:172.21.15.184:6789/0 conn(0x7f38580b4860 0x7f38581601f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:51364/0 (socket says 172.21.15.184:51364) 2023-07-09T21:49:58.531 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f38577fe700 1 -- 172.21.15.184:0/781687255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38580cd430 msgr2=0x7f38580cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:49:58.531 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f38577fe700 1 --2- 172.21.15.184:0/781687255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38580cd430 0x7f38580cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.531 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f38577fe700 1 -- 172.21.15.184:0/781687255 >> v1:172.21.15.184:6789/0 conn(0x7f38580b4860 legacy=0x7f38581601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:58.531 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f38577fe700 1 -- 172.21.15.184:0/781687255 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580cffc0 con 0x7f38580d22d0 2023-07-09T21:49:58.532 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.526+0000 7f38567fc700 1 -- 172.21.15.184:0/781687255 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223326576 0 0) 0x7f38580d02a0 con 0x7f38580b4860 2023-07-09T21:49:58.532 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.527+0000 7f38577fe700 1 --2- 172.21.15.184:0/781687255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38580d22d0 0x7f38580b4cd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3850009e50 tx=0x7f385000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca14a2d1f94be67a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:58.532 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.527+0000 7f38567fc700 1 -- 172.21.15.184:0/781687255 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385000e070 con 0x7f38580d22d0 2023-07-09T21:49:58.532 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.527+0000 7f38567fc700 1 -- 172.21.15.184:0/781687255 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385000b910 con 0x7f38580d22d0 2023-07-09T21:49:58.532 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.527+0000 7f38567fc700 1 -- 172.21.15.184:0/781687255 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385000bcc0 con 0x7f38580d22d0 2023-07-09T21:49:58.532 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.528+0000 7f385d5ff700 1 -- 172.21.15.184:0/781687255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38580d22d0 msgr2=0x7f38580b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:58.532 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.528+0000 7f385d5ff700 1 --2- 172.21.15.184:0/781687255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38580d22d0 0x7f38580b4cd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3850009e50 tx=0x7f385000b330 comp rx=0 tx=0).stop 2023-07-09T21:49:58.533 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.528+0000 7f385d5ff700 1 -- 172.21.15.184:0/781687255 shutdown_connections 2023-07-09T21:49:58.533 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.528+0000 7f385d5ff700 1 --2- 172.21.15.184:0/781687255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38580d22d0 0x7f38580b4cd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.533 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.528+0000 7f385d5ff700 1 --2- 172.21.15.184:0/781687255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38580cd430 0x7f38580cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.533 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.528+0000 7f385d5ff700 1 -- 172.21.15.184:0/781687255 >> 172.21.15.184:0/781687255 conn(0x7f3858066860 msgr2=0x7f385806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:58.533 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.528+0000 7f385d5ff700 1 -- 172.21.15.184:0/781687255 shutdown_connections 2023-07-09T21:49:58.533 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.528+0000 7f385d5ff700 1 -- 172.21.15.184:0/781687255 wait complete. 2023-07-09T21:49:58.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.529+0000 7f385d5ff700 1 Processor -- start 2023-07-09T21:49:58.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.530+0000 7f385d5ff700 1 -- start start 2023-07-09T21:49:58.536 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f385d5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38580b4860 0x7f38580c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.536 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f385d5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38580cd430 0x7f38580cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.536 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f385d5ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38580d22d0 0x7f38580cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.536 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f385d5ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385815d6d0 con 0x7f38580d22d0 2023-07-09T21:49:58.536 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f385d5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580c6c80 con 0x7f38580b4860 2023-07-09T21:49:58.536 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f385d5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580ca960 con 0x7f38580cd430 2023-07-09T21:49:58.536 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f3856ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38580b4860 0x7f38580c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f3856ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38580b4860 0x7f38580c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:37398/0 (socket says 172.21.15.184:37398) 2023-07-09T21:49:58.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f3856ffd700 1 -- 172.21.15.184:0/3942664588 learned_addr learned my addr 172.21.15.184:0/3942664588 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:58.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f384ffff700 1 --2- 172.21.15.184:0/3942664588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38580cd430 0x7f38580cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f38577fe700 1 --2- 172.21.15.184:0/3942664588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38580d22d0 0x7f38580cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f3856ffd700 1 -- 172.21.15.184:0/3942664588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38580cd430 msgr2=0x7f38580cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:58.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f3856ffd700 1 --2- 172.21.15.184:0/3942664588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38580cd430 0x7f38580cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f3856ffd700 1 -- 172.21.15.184:0/3942664588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38580d22d0 msgr2=0x7f38580cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:58.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f3856ffd700 1 --2- 172.21.15.184:0/3942664588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38580d22d0 0x7f38580cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f3856ffd700 1 -- 172.21.15.184:0/3942664588 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3850009b30 con 0x7f38580b4860 2023-07-09T21:49:58.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.531+0000 7f38577fe700 1 --2- 172.21.15.184:0/3942664588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38580d22d0 0x7f38580cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:49:58.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.532+0000 7f3856ffd700 1 --2- 172.21.15.184:0/3942664588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38580b4860 0x7f38580c8c90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f384800e9b0 tx=0x7f384800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:58.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.532+0000 7f384f7fe700 1 -- 172.21.15.184:0/3942664588 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848009710 con 0x7f38580b4860 2023-07-09T21:49:58.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.532+0000 7f384f7fe700 1 -- 172.21.15.184:0/3942664588 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384800c850 con 0x7f38580b4860 2023-07-09T21:49:58.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.532+0000 7f384f7fe700 1 -- 172.21.15.184:0/3942664588 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384800cbc0 con 0x7f38580b4860 2023-07-09T21:49:58.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.532+0000 7f385d5ff700 1 -- 172.21.15.184:0/3942664588 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38580cac00 con 0x7f38580b4860 2023-07-09T21:49:58.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.532+0000 7f385d5ff700 1 -- 172.21.15.184:0/3942664588 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38580c6910 con 0x7f38580b4860 2023-07-09T21:49:58.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.532+0000 7f384f7fe700 1 -- 172.21.15.184:0/3942664588 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3848005d20 con 0x7f38580b4860 2023-07-09T21:49:58.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.532+0000 7f384f7fe700 1 -- 172.21.15.184:0/3942664588 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f38480067f0 con 0x7f38580b4860 2023-07-09T21:49:58.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.533+0000 7f385d5ff700 1 -- 172.21.15.184:0/3942664588 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38580c6f60 con 0x7f38580b4860 2023-07-09T21:49:58.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.537+0000 7f384f7fe700 1 -- 172.21.15.184:0/3942664588 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3848021060 con 0x7f38580b4860 2023-07-09T21:49:58.624 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.623+0000 7f385d5ff700 1 -- 172.21.15.184:0/3942664588 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e", "id": 5} v 0) v1 -- 0x7f3858074350 con 0x7f38580b4860 2023-07-09T21:49:58.631 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.629+0000 7f384f7fe700 1 -- 172.21.15.184:0/3942664588 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3848017070 con 0x7f38580b4860 2023-07-09T21:49:58.631 INFO:teuthology.orchestra.run.smithi184.stdout:5 2023-07-09T21:49:58.632 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.630+0000 7f385d5ff700 1 -- 172.21.15.184:0/3942664588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38580b4860 msgr2=0x7f38580c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:58.632 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.630+0000 7f385d5ff700 1 --2- 172.21.15.184:0/3942664588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38580b4860 0x7f38580c8c90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f384800e9b0 tx=0x7f384800ecc0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.632 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.630+0000 7f385d5ff700 1 -- 172.21.15.184:0/3942664588 shutdown_connections 2023-07-09T21:49:58.633 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.630+0000 7f385d5ff700 1 --2- 172.21.15.184:0/3942664588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38580d22d0 0x7f38580cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.633 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.630+0000 7f385d5ff700 1 --2- 172.21.15.184:0/3942664588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38580b4860 0x7f38580c8c90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.633 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.630+0000 7f385d5ff700 1 --2- 172.21.15.184:0/3942664588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38580cd430 0x7f38580cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.633 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.631+0000 7f385d5ff700 1 -- 172.21.15.184:0/3942664588 >> 172.21.15.184:0/3942664588 conn(0x7f3858066860 msgr2=0x7f38580cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:58.633 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.631+0000 7f385d5ff700 1 -- 172.21.15.184:0/3942664588 shutdown_connections 2023-07-09T21:49:58.634 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.631+0000 7f385d5ff700 1 -- 172.21.15.184:0/3942664588 wait complete. 2023-07-09T21:49:58.650 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 54260f3c-7279-4c91-a6c4-790d620b90bf 6 2023-07-09T21:49:58.702 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:58.701+0000 7fa5b7b9c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:49:58.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.841+0000 7faa53dff700 1 Processor -- start 2023-07-09T21:49:58.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.842+0000 7faa53dff700 1 -- start start 2023-07-09T21:49:58.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.843+0000 7faa53dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faa4c0b4600 0x7faa4c0cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.843+0000 7faa53dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0d0260 0x7faa4c0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.843+0000 7faa53dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7faa4c0cda80 0x7faa4c0cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.843+0000 7faa53dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c0d1550 con 0x7faa4c0b4600 2023-07-09T21:49:58.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.843+0000 7faa53dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c0d2d90 con 0x7faa4c0cda80 2023-07-09T21:49:58.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.843+0000 7faa53dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c15cd60 con 0x7faa4c0d0260 2023-07-09T21:49:58.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.843+0000 7faa5139a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0d0260 0x7faa4c0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.843+0000 7faa5239c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7faa4c0cda80 0x7faa4c0cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.843+0000 7faa5139a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0d0260 0x7faa4c0cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:39968/0 (socket says 172.21.15.184:39968) 2023-07-09T21:49:58.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.843+0000 7faa5139a700 1 -- 172.21.15.184:0/2637872660 learned_addr learned my addr 172.21.15.184:0/2637872660 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:58.846 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.843+0000 7faa51b9b700 1 --2- 172.21.15.184:0/2637872660 >> v2:172.21.15.53:3300/0 conn(0x7faa4c0b4600 0x7faa4c0cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.847 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.844+0000 7faa5239c700 1 -- 172.21.15.184:0/2637872660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0d0260 msgr2=0x7faa4c0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:49:58.847 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.844+0000 7faa5239c700 1 --2- 172.21.15.184:0/2637872660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0d0260 0x7faa4c0cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.847 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.844+0000 7faa5239c700 1 -- 172.21.15.184:0/2637872660 >> v2:172.21.15.53:3300/0 conn(0x7faa4c0b4600 msgr2=0x7faa4c0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:49:58.847 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.844+0000 7faa5239c700 1 --2- 172.21.15.184:0/2637872660 >> v2:172.21.15.53:3300/0 conn(0x7faa4c0b4600 0x7faa4c0cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.847 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.844+0000 7faa5239c700 1 -- 172.21.15.184:0/2637872660 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0cf340 con 0x7faa4c0cda80 2023-07-09T21:49:58.848 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.844+0000 7faa5139a700 1 --2- 172.21.15.184:0/2637872660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0d0260 0x7faa4c0cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:49:58.848 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.844+0000 7faa51b9b700 1 --2- 172.21.15.184:0/2637872660 >> v2:172.21.15.53:3300/0 conn(0x7faa4c0b4600 0x7faa4c0cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:49:58.848 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.844+0000 7faa5239c700 1 --2- 172.21.15.184:0/2637872660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c0cda80 0x7faa4c0cdf00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faa4c08d430 tx=0x7faa4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7ba1b9077ea46a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:58.848 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.844+0000 7faa50b99700 1 -- 172.21.15.184:0/2637872660 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4400e070 con 0x7faa4c0cda80 2023-07-09T21:49:58.848 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.844+0000 7faa50b99700 1 -- 172.21.15.184:0/2637872660 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4400bb20 con 0x7faa4c0cda80 2023-07-09T21:49:58.848 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.844+0000 7faa50b99700 1 -- 172.21.15.184:0/2637872660 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44012430 con 0x7faa4c0cda80 2023-07-09T21:49:58.848 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.845+0000 7faa53dff700 1 -- 172.21.15.184:0/2637872660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c0cda80 msgr2=0x7faa4c0cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:58.849 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.845+0000 7faa53dff700 1 --2- 172.21.15.184:0/2637872660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c0cda80 0x7faa4c0cdf00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faa4c08d430 tx=0x7faa4400b330 comp rx=0 tx=0).stop 2023-07-09T21:49:58.849 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.845+0000 7faa53dff700 1 -- 172.21.15.184:0/2637872660 shutdown_connections 2023-07-09T21:49:58.849 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.845+0000 7faa53dff700 1 --2- 172.21.15.184:0/2637872660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c0cda80 0x7faa4c0cdf00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.849 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.845+0000 7faa53dff700 1 --2- 172.21.15.184:0/2637872660 >> v2:172.21.15.53:3300/0 conn(0x7faa4c0b4600 0x7faa4c0cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.849 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.845+0000 7faa53dff700 1 --2- 172.21.15.184:0/2637872660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0d0260 0x7faa4c0cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.849 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.845+0000 7faa53dff700 1 -- 172.21.15.184:0/2637872660 >> 172.21.15.184:0/2637872660 conn(0x7faa4c09c200 msgr2=0x7faa4c0d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:58.849 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.845+0000 7faa53dff700 1 -- 172.21.15.184:0/2637872660 shutdown_connections 2023-07-09T21:49:58.850 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.845+0000 7faa53dff700 1 -- 172.21.15.184:0/2637872660 wait complete. 2023-07-09T21:49:58.851 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.848+0000 7faa53dff700 1 Processor -- start 2023-07-09T21:49:58.851 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.848+0000 7faa53dff700 1 -- start start 2023-07-09T21:49:58.851 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa53dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0cda80 0x7faa4c1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.851 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa53dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa4c0d0260 0x7faa4c0c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.851 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa53dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c0c7c30 0x7faa4c0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:58.852 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa53dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c159a10 con 0x7faa4c0d0260 2023-07-09T21:49:58.852 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa53dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0c80a0 con 0x7faa4c0c7c30 2023-07-09T21:49:58.852 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa53dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0ccc00 con 0x7faa4c0cda80 2023-07-09T21:49:58.852 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa51b9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0cda80 0x7faa4c1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.852 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa51b9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0cda80 0x7faa4c1594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:39982/0 (socket says 172.21.15.184:39982) 2023-07-09T21:49:58.852 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa51b9b700 1 -- 172.21.15.184:0/1840631424 learned_addr learned my addr 172.21.15.184:0/1840631424 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:58.852 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa5239c700 1 --2- 172.21.15.184:0/1840631424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c0c7c30 0x7faa4c0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.853 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa5139a700 1 --2- 172.21.15.184:0/1840631424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa4c0d0260 0x7faa4c0c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:58.854 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa5239c700 1 -- 172.21.15.184:0/1840631424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0cda80 msgr2=0x7faa4c1594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:58.854 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa5239c700 1 --2- 172.21.15.184:0/1840631424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0cda80 0x7faa4c1594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.854 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa5239c700 1 -- 172.21.15.184:0/1840631424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa4c0d0260 msgr2=0x7faa4c0c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:58.854 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa5239c700 1 --2- 172.21.15.184:0/1840631424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa4c0d0260 0x7faa4c0c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:58.854 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa5239c700 1 -- 172.21.15.184:0/1840631424 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c009550 con 0x7faa4c0c7c30 2023-07-09T21:49:58.854 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.850+0000 7faa51b9b700 1 --2- 172.21.15.184:0/1840631424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0cda80 0x7faa4c1594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:49:58.855 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.851+0000 7faa5239c700 1 --2- 172.21.15.184:0/1840631424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c0c7c30 0x7faa4c0cb410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faa44016000 tx=0x7faa44004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:58.855 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.851+0000 7faa427fc700 1 -- 172.21.15.184:0/1840631424 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44004840 con 0x7faa4c0c7c30 2023-07-09T21:49:58.855 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.851+0000 7faa427fc700 1 -- 172.21.15.184:0/1840631424 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa44020070 con 0x7faa4c0c7c30 2023-07-09T21:49:58.855 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.851+0000 7faa53dff700 1 -- 172.21.15.184:0/1840631424 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa44009a70 con 0x7faa4c0c7c30 2023-07-09T21:49:58.855 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.851+0000 7faa427fc700 1 -- 172.21.15.184:0/1840631424 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa440276c0 con 0x7faa4c0c7c30 2023-07-09T21:49:58.855 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.851+0000 7faa53dff700 1 -- 172.21.15.184:0/1840631424 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c0cbff0 con 0x7faa4c0c7c30 2023-07-09T21:49:58.855 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.851+0000 7faa427fc700 1 -- 172.21.15.184:0/1840631424 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faa44027b20 con 0x7faa4c0c7c30 2023-07-09T21:49:58.855 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.851+0000 7faa427fc700 1 -- 172.21.15.184:0/1840631424 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7faa44022070 con 0x7faa4c0c7c30 2023-07-09T21:49:58.856 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.852+0000 7faa53dff700 1 -- 172.21.15.184:0/1840631424 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c074350 con 0x7faa4c0c7c30 2023-07-09T21:49:58.856 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:58.855+0000 7faa427fc700 1 -- 172.21.15.184:0/1840631424 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7faa440127f0 con 0x7faa4c0c7c30 2023-07-09T21:49:59.009 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.008+0000 7faa53dff700 1 -- 172.21.15.184:0/1840631424 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "54260f3c-7279-4c91-a6c4-790d620b90bf", "id": 6} v 0) v1 -- 0x7faa4c15e080 con 0x7faa4c0c7c30 2023-07-09T21:49:59.015 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.014+0000 7faa427fc700 1 -- 172.21.15.184:0/1840631424 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "54260f3c-7279-4c91-a6c4-790d620b90bf", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7faa440370b0 con 0x7faa4c0c7c30 2023-07-09T21:49:59.016 INFO:teuthology.orchestra.run.smithi184.stdout:6 2023-07-09T21:49:59.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.015+0000 7faa53dff700 1 -- 172.21.15.184:0/1840631424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c0c7c30 msgr2=0x7faa4c0cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:59.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.015+0000 7faa53dff700 1 --2- 172.21.15.184:0/1840631424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c0c7c30 0x7faa4c0cb410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faa44016000 tx=0x7faa44004ad0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.015+0000 7faa53dff700 1 -- 172.21.15.184:0/1840631424 shutdown_connections 2023-07-09T21:49:59.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.015+0000 7faa53dff700 1 --2- 172.21.15.184:0/1840631424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c0c7c30 0x7faa4c0cb410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.015+0000 7faa53dff700 1 --2- 172.21.15.184:0/1840631424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0cda80 0x7faa4c1594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.015+0000 7faa53dff700 1 --2- 172.21.15.184:0/1840631424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa4c0d0260 0x7faa4c0c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.015+0000 7faa53dff700 1 -- 172.21.15.184:0/1840631424 >> 172.21.15.184:0/1840631424 conn(0x7faa4c09c200 msgr2=0x7faa4c15e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:59.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.015+0000 7faa53dff700 1 -- 172.21.15.184:0/1840631424 shutdown_connections 2023-07-09T21:49:59.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.015+0000 7faa53dff700 1 -- 172.21.15.184:0/1840631424 wait complete. 2023-07-09T21:49:59.033 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 319b0584-fb9b-4adf-a4be-9fa598581cb1 7 2023-07-09T21:49:59.174 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:49:59.173+0000 7f2d8b365200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-09T21:49:59.223 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.221+0000 7f14b0fff700 1 Processor -- start 2023-07-09T21:49:59.223 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.222+0000 7f14b0fff700 1 -- start start 2023-07-09T21:49:59.224 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.223+0000 7f14b0fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f14ac0d1220 0x7f14ac0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:59.224 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.223+0000 7f14b0fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac0b8e80 con 0x7f14ac0b0e20 2023-07-09T21:49:59.224 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.223+0000 7f14b0fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac0afaa0 con 0x7f14ac0b3ff0 2023-07-09T21:49:59.224 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.223+0000 7f14b0fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ac0afd80 con 0x7f14ac0d1220 2023-07-09T21:49:59.225 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.223+0000 7f14a9d9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f14ac0d1220 0x7f14ac0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:59.225 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.223+0000 7f14aa59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f14ac0b3ff0 0x7f14ac0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:51370/0 (socket says 172.21.15.184:51370) 2023-07-09T21:49:59.225 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.223+0000 7f14a9d9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f14ac0d1220 0x7f14ac0b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:37434/0 (socket says 172.21.15.184:37434) 2023-07-09T21:49:59.225 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.223+0000 7f14aa59c700 1 -- 172.21.15.184:0/2193536352 learned_addr learned my addr 172.21.15.184:0/2193536352 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-07-09T21:49:59.226 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.224+0000 7f14a9d9b700 1 -- 172.21.15.184:0/2193536352 >> v1:172.21.15.184:6789/0 conn(0x7f14ac0b3ff0 legacy=0x7f14ac0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:59.226 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.224+0000 7f14a9d9b700 1 -- 172.21.15.184:0/2193536352 >> v1:172.21.15.53:6789/0 conn(0x7f14ac0b0e20 legacy=0x7f14ac0b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:59.226 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.224+0000 7f14a9d9b700 1 -- 172.21.15.184:0/2193536352 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac0b0060 con 0x7f14ac0d1220 2023-07-09T21:49:59.227 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.224+0000 7f14a9d9b700 1 --2- 172.21.15.184:0/2193536352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ac0d1220 0x7f14ac0b43c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009840 tx=0x7f14a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d397482393a86e4a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:59.227 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.224+0000 7f14a959a700 1 -- 172.21.15.184:0/2193536352 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0011830 con 0x7f14ac0d1220 2023-07-09T21:49:59.227 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.224+0000 7f14a959a700 1 -- 172.21.15.184:0/2193536352 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a0011990 con 0x7f14ac0d1220 2023-07-09T21:49:59.227 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.224+0000 7f14a959a700 1 -- 172.21.15.184:0/2193536352 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0011d20 con 0x7f14ac0d1220 2023-07-09T21:49:59.227 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.225+0000 7f14b0fff700 1 -- 172.21.15.184:0/2193536352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ac0d1220 msgr2=0x7f14ac0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:59.227 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.225+0000 7f14b0fff700 1 --2- 172.21.15.184:0/2193536352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ac0d1220 0x7f14ac0b43c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009840 tx=0x7f14a0009b50 comp rx=0 tx=0).stop 2023-07-09T21:49:59.227 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.225+0000 7f14b0fff700 1 -- 172.21.15.184:0/2193536352 shutdown_connections 2023-07-09T21:49:59.228 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.225+0000 7f14b0fff700 1 --2- 172.21.15.184:0/2193536352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ac0d1220 0x7f14ac0b43c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.228 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.225+0000 7f14b0fff700 1 -- 172.21.15.184:0/2193536352 >> 172.21.15.184:0/2193536352 conn(0x7f14ac09c1b0 msgr2=0x7f14ac0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:59.228 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.225+0000 7f14b0fff700 1 -- 172.21.15.184:0/2193536352 shutdown_connections 2023-07-09T21:49:59.228 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.225+0000 7f14b0fff700 1 -- 172.21.15.184:0/2193536352 wait complete. 2023-07-09T21:49:59.229 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.227+0000 7f14b0fff700 1 Processor -- start 2023-07-09T21:49:59.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.227+0000 7f14b0fff700 1 -- start start 2023-07-09T21:49:59.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14b0fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ac0b0e20 0x7f14ac1f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:59.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14b0fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14ac0b3ff0 0x7f14ac15edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:59.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14b0fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ac0d1220 0x7f14ac15f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:59.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14b0fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0cb060 con 0x7f14ac0b3ff0 2023-07-09T21:49:59.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14b0fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0cbbe0 con 0x7f14ac0b0e20 2023-07-09T21:49:59.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14b0fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0cb2b0 con 0x7f14ac0d1220 2023-07-09T21:49:59.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14aa59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ac0b0e20 0x7f14ac1f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:59.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14aa59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ac0b0e20 0x7f14ac1f3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:37444/0 (socket says 172.21.15.184:37444) 2023-07-09T21:49:59.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14aa59c700 1 -- 172.21.15.184:0/3908218132 learned_addr learned my addr 172.21.15.184:0/3908218132 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-09T21:49:59.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14aad9d700 1 --2- 172.21.15.184:0/3908218132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ac0d1220 0x7f14ac15f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:59.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14a9d9b700 1 --2- 172.21.15.184:0/3908218132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14ac0b3ff0 0x7f14ac15edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:59.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14aad9d700 1 -- 172.21.15.184:0/3908218132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ac0b0e20 msgr2=0x7f14ac1f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:59.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14aad9d700 1 --2- 172.21.15.184:0/3908218132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ac0b0e20 0x7f14ac1f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14aad9d700 1 -- 172.21.15.184:0/3908218132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14ac0b3ff0 msgr2=0x7f14ac15edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:59.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14aad9d700 1 --2- 172.21.15.184:0/3908218132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14ac0b3ff0 0x7f14ac15edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14aad9d700 1 -- 172.21.15.184:0/3908218132 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a00094a0 con 0x7f14ac0d1220 2023-07-09T21:49:59.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.228+0000 7f14aa59c700 1 --2- 172.21.15.184:0/3908218132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ac0b0e20 0x7f14ac1f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:49:59.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.229+0000 7f14aad9d700 1 --2- 172.21.15.184:0/3908218132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ac0d1220 0x7f14ac15f300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f14a400cbc0 tx=0x7f14a400ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:59.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.229+0000 7f149affd700 1 -- 172.21.15.184:0/3908218132 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4003c00 con 0x7f14ac0d1220 2023-07-09T21:49:59.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.229+0000 7f149affd700 1 -- 172.21.15.184:0/3908218132 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4003d60 con 0x7f14ac0d1220 2023-07-09T21:49:59.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.229+0000 7f14b0fff700 1 -- 172.21.15.184:0/3908218132 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ac0cb590 con 0x7f14ac0d1220 2023-07-09T21:49:59.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.229+0000 7f149affd700 1 -- 172.21.15.184:0/3908218132 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400aa40 con 0x7f14ac0d1220 2023-07-09T21:49:59.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.229+0000 7f14b0fff700 1 -- 172.21.15.184:0/3908218132 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ac1f3590 con 0x7f14ac0d1220 2023-07-09T21:49:59.234 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.229+0000 7f149affd700 1 -- 172.21.15.184:0/3908218132 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f14a40050d0 con 0x7f14ac0d1220 2023-07-09T21:49:59.234 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.230+0000 7f149affd700 1 -- 172.21.15.184:0/3908218132 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f14a4012680 con 0x7f14ac0d1220 2023-07-09T21:49:59.234 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.230+0000 7f14b0fff700 1 -- 172.21.15.184:0/3908218132 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ac074350 con 0x7f14ac0d1220 2023-07-09T21:49:59.234 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.233+0000 7f149affd700 1 -- 172.21.15.184:0/3908218132 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f14ac0b8e80 con 0x7f14ac0d1220 2023-07-09T21:49:59.322 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.321+0000 7f14b0fff700 1 -- 172.21.15.184:0/3908218132 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "319b0584-fb9b-4adf-a4be-9fa598581cb1", "id": 7} v 0) v1 -- 0x7f14ac0b05f0 con 0x7f14ac0d1220 2023-07-09T21:49:59.327 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.326+0000 7f149affd700 1 -- 172.21.15.184:0/3908218132 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "319b0584-fb9b-4adf-a4be-9fa598581cb1", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f14a4005380 con 0x7f14ac0d1220 2023-07-09T21:49:59.327 INFO:teuthology.orchestra.run.smithi184.stdout:7 2023-07-09T21:49:59.328 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.327+0000 7f14b0fff700 1 -- 172.21.15.184:0/3908218132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ac0d1220 msgr2=0x7f14ac15f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:59.328 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.327+0000 7f14b0fff700 1 --2- 172.21.15.184:0/3908218132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ac0d1220 0x7f14ac15f300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f14a400cbc0 tx=0x7f14a400ced0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.328 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.327+0000 7f14b0fff700 1 -- 172.21.15.184:0/3908218132 shutdown_connections 2023-07-09T21:49:59.329 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.327+0000 7f14b0fff700 1 --2- 172.21.15.184:0/3908218132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ac0d1220 0x7f14ac15f300 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.329 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.327+0000 7f14b0fff700 1 --2- 172.21.15.184:0/3908218132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ac0b0e20 0x7f14ac1f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.329 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.327+0000 7f14b0fff700 1 --2- 172.21.15.184:0/3908218132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14ac0b3ff0 0x7f14ac15edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.329 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.327+0000 7f14b0fff700 1 -- 172.21.15.184:0/3908218132 >> 172.21.15.184:0/3908218132 conn(0x7f14ac09c1b0 msgr2=0x7f14ac0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:59.329 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.327+0000 7f14b0fff700 1 -- 172.21.15.184:0/3908218132 shutdown_connections 2023-07-09T21:49:59.329 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-09T21:49:59.327+0000 7f14b0fff700 1 -- 172.21.15.184:0/3908218132 wait complete. 2023-07-09T21:49:59.345 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-09T21:49:59.346 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-09T21:49:59.352 INFO:tasks.ceph.osd.0:Started 2023-07-09T21:49:59.352 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-09T21:49:59.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-09T21:49:59.357 INFO:tasks.ceph.osd.1:Started 2023-07-09T21:49:59.357 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-09T21:49:59.358 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-09T21:49:59.363 INFO:tasks.ceph.osd.2:Started 2023-07-09T21:49:59.363 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-09T21:49:59.364 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-09T21:49:59.369 INFO:tasks.ceph.osd.3:Started 2023-07-09T21:49:59.369 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-09T21:49:59.370 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-09T21:49:59.370 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:49:59.367+0000 7f2d8b365200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:49:59.374 INFO:tasks.ceph.osd.4:Started 2023-07-09T21:49:59.375 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-09T21:49:59.375 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-09T21:49:59.379 INFO:tasks.ceph.osd.5:Started 2023-07-09T21:49:59.379 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-09T21:49:59.379 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-09T21:49:59.384 INFO:tasks.ceph.osd.6:Started 2023-07-09T21:49:59.385 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-09T21:49:59.385 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-09T21:49:59.391 INFO:tasks.ceph.osd.7:Started 2023-07-09T21:49:59.392 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:49:59.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.658+0000 7f1add7ff700 1 Processor -- start 2023-07-09T21:49:59.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.658+0000 7f1add7ff700 1 -- start start 2023-07-09T21:49:59.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.660+0000 7f1add7ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1ad80b1e00 0x7f1ad80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:59.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.660+0000 7f1add7ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1ad80d1220 0x7f1ad80afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:59.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.660+0000 7f1add7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad80d2ce0 con 0x7f1ad80b2350 2023-07-09T21:49:59.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.660+0000 7f1add7ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad80b3350 con 0x7f1ad80b1e00 2023-07-09T21:49:59.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.660+0000 7f1add7ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad80b3630 con 0x7f1ad80d1220 2023-07-09T21:49:59.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.660+0000 7f1ad77fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1ad80d1220 0x7f1ad80afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:59.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.660+0000 7f1ad77fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1ad80d1220 0x7f1ad80afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:58330/0 (socket says 172.21.15.53:58330) 2023-07-09T21:49:59.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.660+0000 7f1ad77fe700 1 -- 172.21.15.53:0/442969307 learned_addr learned my addr 172.21.15.53:0/442969307 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:49:59.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.660+0000 7f1ad6ffd700 1 --2- 172.21.15.53:0/442969307 >> v2:172.21.15.53:3300/0 conn(0x7f1ad80b1e00 0x7f1ad80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:59.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.661+0000 7f1ad5ffb700 1 -- 172.21.15.53:0/442969307 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264685523 0 0) 0x7f1ad80d2ce0 con 0x7f1ad80b2350 2023-07-09T21:49:59.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.661+0000 7f1ad5ffb700 1 -- 172.21.15.53:0/442969307 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ac00035b0 con 0x7f1ad80b2350 2023-07-09T21:49:59.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.661+0000 7f1ad77fe700 1 -- 172.21.15.53:0/442969307 >> v2:172.21.15.53:3300/0 conn(0x7f1ad80b1e00 msgr2=0x7f1ad80b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:49:59.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.661+0000 7f1ad77fe700 1 --2- 172.21.15.53:0/442969307 >> v2:172.21.15.53:3300/0 conn(0x7f1ad80b1e00 0x7f1ad80b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.661+0000 7f1ad77fe700 1 -- 172.21.15.53:0/442969307 >> v1:172.21.15.184:6789/0 conn(0x7f1ad80b2350 legacy=0x7f1ad80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:59.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.661+0000 7f1ad77fe700 1 -- 172.21.15.53:0/442969307 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad80b3910 con 0x7f1ad80d1220 2023-07-09T21:49:59.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.661+0000 7f1ad77fe700 1 --2- 172.21.15.53:0/442969307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ad80d1220 0x7f1ad80afac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1ad809c8e0 tx=0x7f1ad000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5b5bd8b6689a258 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:59.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.661+0000 7f1ad5ffb700 1 -- 172.21.15.53:0/442969307 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000e070 con 0x7f1ad80d1220 2023-07-09T21:49:59.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.661+0000 7f1ad5ffb700 1 -- 172.21.15.53:0/442969307 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad000b910 con 0x7f1ad80d1220 2023-07-09T21:49:59.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.661+0000 7f1ad5ffb700 1 -- 172.21.15.53:0/442969307 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000bcc0 con 0x7f1ad80d1220 2023-07-09T21:49:59.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.662+0000 7f1add7ff700 1 -- 172.21.15.53:0/442969307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ad80d1220 msgr2=0x7f1ad80afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:59.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.662+0000 7f1add7ff700 1 --2- 172.21.15.53:0/442969307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ad80d1220 0x7f1ad80afac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1ad809c8e0 tx=0x7f1ad000b330 comp rx=0 tx=0).stop 2023-07-09T21:49:59.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.662+0000 7f1add7ff700 1 -- 172.21.15.53:0/442969307 shutdown_connections 2023-07-09T21:49:59.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.662+0000 7f1add7ff700 1 --2- 172.21.15.53:0/442969307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ad80d1220 0x7f1ad80afac0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.662+0000 7f1add7ff700 1 --2- 172.21.15.53:0/442969307 >> v2:172.21.15.53:3300/0 conn(0x7f1ad80b1e00 0x7f1ad80b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.662+0000 7f1add7ff700 1 -- 172.21.15.53:0/442969307 >> 172.21.15.53:0/442969307 conn(0x7f1ad809c1d0 msgr2=0x7f1ad80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:59.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.662+0000 7f1add7ff700 1 -- 172.21.15.53:0/442969307 shutdown_connections 2023-07-09T21:49:59.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.662+0000 7f1add7ff700 1 -- 172.21.15.53:0/442969307 wait complete. 2023-07-09T21:49:59.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.664+0000 7f1add7ff700 1 Processor -- start 2023-07-09T21:49:59.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.664+0000 7f1add7ff700 1 -- start start 2023-07-09T21:49:59.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.665+0000 7f1add7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ad80b1e00 0x7f1ad80c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:59.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.665+0000 7f1add7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ad80b2350 0x7f1ad8151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:59.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.665+0000 7f1add7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ad80d1220 0x7f1ad8151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:49:59.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.665+0000 7f1add7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8151dd0 con 0x7f1ad80d1220 2023-07-09T21:49:59.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.665+0000 7f1add7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80b7e20 con 0x7f1ad80b2350 2023-07-09T21:49:59.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.665+0000 7f1add7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80b6d80 con 0x7f1ad80b1e00 2023-07-09T21:49:59.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.665+0000 7f1ad77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ad80d1220 0x7f1ad8151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:59.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.665+0000 7f1ad77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ad80d1220 0x7f1ad8151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49638/0 (socket says 172.21.15.53:49638) 2023-07-09T21:49:59.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.665+0000 7f1ad77fe700 1 -- 172.21.15.53:0/4044224104 learned_addr learned my addr 172.21.15.53:0/4044224104 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:49:59.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.665+0000 7f1ad67fc700 1 --2- 172.21.15.53:0/4044224104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ad80b2350 0x7f1ad8151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.665+0000 7f1ad6ffd700 1 --2- 172.21.15.53:0/4044224104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ad80b1e00 0x7f1ad80c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:49:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.666+0000 7f1ad77fe700 1 -- 172.21.15.53:0/4044224104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ad80b1e00 msgr2=0x7f1ad80c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.666+0000 7f1ad77fe700 1 --2- 172.21.15.53:0/4044224104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ad80b1e00 0x7f1ad80c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.666+0000 7f1ad77fe700 1 -- 172.21.15.53:0/4044224104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ad80b2350 msgr2=0x7f1ad8151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.666+0000 7f1ad77fe700 1 --2- 172.21.15.53:0/4044224104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ad80b2350 0x7f1ad8151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.666+0000 7f1ad77fe700 1 -- 172.21.15.53:0/4044224104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad0009b30 con 0x7f1ad80d1220 2023-07-09T21:49:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.666+0000 7f1ad77fe700 1 --2- 172.21.15.53:0/4044224104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ad80d1220 0x7f1ad8151890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000b370 tx=0x7f1ad0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:49:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.666+0000 7f1abf7fe700 1 -- 172.21.15.53:0/4044224104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0004880 con 0x7f1ad80d1220 2023-07-09T21:49:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.666+0000 7f1abf7fe700 1 -- 172.21.15.53:0/4044224104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad00099b0 con 0x7f1ad80d1220 2023-07-09T21:49:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.666+0000 7f1abf7fe700 1 -- 172.21.15.53:0/4044224104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad001c680 con 0x7f1ad80d1220 2023-07-09T21:49:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.666+0000 7f1add7ff700 1 -- 172.21.15.53:0/4044224104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad80b7060 con 0x7f1ad80d1220 2023-07-09T21:49:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.666+0000 7f1add7ff700 1 -- 172.21.15.53:0/4044224104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad80b7620 con 0x7f1ad80d1220 2023-07-09T21:49:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.667+0000 7f1abf7fe700 1 -- 172.21.15.53:0/4044224104 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1ad001cae0 con 0x7f1ad80d1220 2023-07-09T21:49:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.667+0000 7f1abf7fe700 1 -- 172.21.15.53:0/4044224104 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1ad0025e40 con 0x7f1ad80d1220 2023-07-09T21:49:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.667+0000 7f1add7ff700 1 -- 172.21.15.53:0/4044224104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad804e280 con 0x7f1ad80d1220 2023-07-09T21:49:59.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.670+0000 7f1abf7fe700 1 -- 172.21.15.53:0/4044224104 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1ad0020070 con 0x7f1ad80d1220 2023-07-09T21:49:59.683 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:59.682+0000 7fa5b7b9c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:49:59.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.745+0000 7f1add7ff700 1 -- 172.21.15.53:0/4044224104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ad808c5a0 con 0x7f1ad80d1220 2023-07-09T21:49:59.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.746+0000 7f1abf7fe700 1 -- 172.21.15.53:0/4044224104 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1ad0025770 con 0x7f1ad80d1220 2023-07-09T21:49:59.748 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:49:59.748 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":10,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:49:59.323314+0000","last_up_change":"0.000000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:49:59.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.747+0000 7f1add7ff700 1 -- 172.21.15.53:0/4044224104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ad80d1220 msgr2=0x7f1ad8151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:49:59.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.747+0000 7f1add7ff700 1 --2- 172.21.15.53:0/4044224104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ad80d1220 0x7f1ad8151890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000b370 tx=0x7f1ad0004ad0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.747+0000 7f1add7ff700 1 -- 172.21.15.53:0/4044224104 shutdown_connections 2023-07-09T21:49:59.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.747+0000 7f1add7ff700 1 --2- 172.21.15.53:0/4044224104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ad80d1220 0x7f1ad8151890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.747+0000 7f1add7ff700 1 --2- 172.21.15.53:0/4044224104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ad80b1e00 0x7f1ad80c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.747+0000 7f1add7ff700 1 --2- 172.21.15.53:0/4044224104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ad80b2350 0x7f1ad8151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:49:59.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.747+0000 7f1add7ff700 1 -- 172.21.15.53:0/4044224104 >> 172.21.15.53:0/4044224104 conn(0x7f1ad809c1d0 msgr2=0x7f1ad80b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:49:59.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.747+0000 7f1add7ff700 1 -- 172.21.15.53:0/4044224104 shutdown_connections 2023-07-09T21:49:59.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:49:59.747+0000 7f1add7ff700 1 -- 172.21.15.53:0/4044224104 wait complete. 2023-07-09T21:49:59.766 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-09T21:49:59.766 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-09T21:49:59.782 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:59.781+0000 7fa5b7b9c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:49:59.961 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:49:59.959+0000 7fa5b7b9c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:50:00.058 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-07-09T21:50:00.057+0000 7f3b9835a640 -1 Falling back to public interface 2023-07-09T21:50:00.075 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-07-09T21:50:00.074+0000 7f14e468e640 -1 Falling back to public interface 2023-07-09T21:50:00.075 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-07-09T21:50:00.074+0000 7ff63af23640 -1 Falling back to public interface 2023-07-09T21:50:00.077 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-07-09T21:50:00.076+0000 7f15ff6cb640 -1 Falling back to public interface 2023-07-09T21:50:00.081 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-07-09T21:50:00.080+0000 7fd95f1a7640 -1 Falling back to public interface 2023-07-09T21:50:00.108 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-07-09T21:50:00.107+0000 7fc52e36d640 -1 Falling back to public interface 2023-07-09T21:50:00.109 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-07-09T21:50:00.108+0000 7f5515a0d640 -1 Falling back to public interface 2023-07-09T21:50:00.119 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-07-09T21:50:00.118+0000 7f6066063640 -1 Falling back to public interface 2023-07-09T21:50:00.260 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:50:00.259+0000 7fa5b7b9c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-09T21:50:00.326 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:50:00.325+0000 7f2d8b365200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:50:00.358 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:50:00.357+0000 7fa5b7b9c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:50:00.428 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:50:00.427+0000 7f2d8b365200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:50:00.571 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-09T21:50:00.611 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:50:00.610+0000 7f2d8b365200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:50:00.692 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:50:00.691+0000 7fa5b7b9c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:50:00.748 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.747+0000 7f29da9ff700 1 Processor -- start 2023-07-09T21:50:00.749 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.747+0000 7f29da9ff700 1 -- start start 2023-07-09T21:50:00.750 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.748+0000 7f29da9ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29d40b1e00 0x7f29d40b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:00.750 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.748+0000 7f29da9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f29d40b2350 0x7f29d40d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:00.750 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29da9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d40d1050 0x7f29d40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:00.750 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29da9ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d40d14d0 con 0x7f29d40b1e00 2023-07-09T21:50:00.751 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29da9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d40d2ce0 con 0x7f29d40b2350 2023-07-09T21:50:00.751 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29da9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d40b3350 con 0x7f29d40d1050 2023-07-09T21:50:00.751 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29d3fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29d40b1e00 0x7f29d40b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:00.751 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29d3fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29d40b1e00 0x7f29d40b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49640/0 (socket says 172.21.15.53:49640) 2023-07-09T21:50:00.751 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29d3fff700 1 -- 172.21.15.53:0/2106937355 learned_addr learned my addr 172.21.15.53:0/2106937355 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:00.751 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29d37fe700 1 --2- 172.21.15.53:0/2106937355 >> v2:172.21.15.184:3300/0 conn(0x7f29d40b2350 0x7f29d40d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:00.751 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29d8f9c700 1 --2- 172.21.15.53:0/2106937355 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d40d1050 0x7f29d40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:00.753 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29d3fff700 1 -- 172.21.15.53:0/2106937355 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d40d1050 msgr2=0x7f29d40afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:00.753 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29d3fff700 1 --2- 172.21.15.53:0/2106937355 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d40d1050 0x7f29d40afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:00.753 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29d3fff700 1 -- 172.21.15.53:0/2106937355 >> v2:172.21.15.184:3300/0 conn(0x7f29d40b2350 msgr2=0x7f29d40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:00.753 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29d3fff700 1 --2- 172.21.15.53:0/2106937355 >> v2:172.21.15.184:3300/0 conn(0x7f29d40b2350 0x7f29d40d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:00.753 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.749+0000 7f29d3fff700 1 -- 172.21.15.53:0/2106937355 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40b3630 con 0x7f29d40b1e00 2023-07-09T21:50:00.753 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.750+0000 7f29d3fff700 1 --2- 172.21.15.53:0/2106937355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29d40b1e00 0x7f29d40b43f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f29d4072140 tx=0x7f29c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bacdc16b4982429 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:00.754 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.750+0000 7f29d2ffd700 1 -- 172.21.15.53:0/2106937355 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4005e30 con 0x7f29d40b1e00 2023-07-09T21:50:00.754 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.750+0000 7f29d2ffd700 1 -- 172.21.15.53:0/2106937355 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c4004030 con 0x7f29d40b1e00 2023-07-09T21:50:00.754 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.750+0000 7f29d2ffd700 1 -- 172.21.15.53:0/2106937355 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c40043e0 con 0x7f29d40b1e00 2023-07-09T21:50:00.754 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.750+0000 7f29da9ff700 1 -- 172.21.15.53:0/2106937355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29d40b1e00 msgr2=0x7f29d40b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:00.754 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.750+0000 7f29da9ff700 1 --2- 172.21.15.53:0/2106937355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29d40b1e00 0x7f29d40b43f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f29d4072140 tx=0x7f29c4009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:00.754 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.751+0000 7f29da9ff700 1 -- 172.21.15.53:0/2106937355 shutdown_connections 2023-07-09T21:50:00.754 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.751+0000 7f29da9ff700 1 --2- 172.21.15.53:0/2106937355 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d40d1050 0x7f29d40afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:00.754 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.751+0000 7f29da9ff700 1 --2- 172.21.15.53:0/2106937355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29d40b1e00 0x7f29d40b43f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:00.755 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.751+0000 7f29da9ff700 1 --2- 172.21.15.53:0/2106937355 >> v2:172.21.15.184:3300/0 conn(0x7f29d40b2350 0x7f29d40d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:00.755 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.751+0000 7f29da9ff700 1 -- 172.21.15.53:0/2106937355 >> 172.21.15.53:0/2106937355 conn(0x7f29d409c1d0 msgr2=0x7f29d40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:00.755 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.751+0000 7f29da9ff700 1 -- 172.21.15.53:0/2106937355 shutdown_connections 2023-07-09T21:50:00.755 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.751+0000 7f29da9ff700 1 -- 172.21.15.53:0/2106937355 wait complete. 2023-07-09T21:50:00.758 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.753+0000 7f29da9ff700 1 Processor -- start 2023-07-09T21:50:00.758 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.753+0000 7f29da9ff700 1 -- start start 2023-07-09T21:50:00.758 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.754+0000 7f29da9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d40b1e00 0x7f29d40cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:00.758 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.754+0000 7f29da9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29d40b2350 0x7f29d40cff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:00.758 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.754+0000 7f29da9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29d40d1050 0x7f29d41584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:00.759 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.754+0000 7f29da9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d4158a00 con 0x7f29d40d1050 2023-07-09T21:50:00.759 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.754+0000 7f29da9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d41e84a0 con 0x7f29d40b2350 2023-07-09T21:50:00.759 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.754+0000 7f29da9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d40ce660 con 0x7f29d40b1e00 2023-07-09T21:50:00.759 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.754+0000 7f29d8f9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29d40d1050 0x7f29d41584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:00.759 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.754+0000 7f29d37fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29d40b2350 0x7f29d40cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:00.759 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.754+0000 7f29d3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d40b1e00 0x7f29d40cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:00.759 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.754+0000 7f29d8f9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29d40d1050 0x7f29d41584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49644/0 (socket says 172.21.15.53:49644) 2023-07-09T21:50:00.760 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.754+0000 7f29d37fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29d40b2350 0x7f29d40cff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:58356/0 (socket says 172.21.15.53:58356) 2023-07-09T21:50:00.760 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.754+0000 7f29d8f9c700 1 -- 172.21.15.53:0/1412759831 learned_addr learned my addr 172.21.15.53:0/1412759831 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:00.760 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.755+0000 7f29d37fe700 1 -- 172.21.15.53:0/1412759831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d40b1e00 msgr2=0x7f29d40cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:00.760 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.755+0000 7f29d37fe700 1 --2- 172.21.15.53:0/1412759831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d40b1e00 0x7f29d40cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:00.760 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.755+0000 7f29d37fe700 1 -- 172.21.15.53:0/1412759831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29d40d1050 msgr2=0x7f29d41584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:00.760 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.755+0000 7f29d37fe700 1 --2- 172.21.15.53:0/1412759831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29d40d1050 0x7f29d41584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:00.761 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.755+0000 7f29d37fe700 1 -- 172.21.15.53:0/1412759831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c4009500 con 0x7f29d40b2350 2023-07-09T21:50:00.761 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.755+0000 7f29d8f9c700 1 --2- 172.21.15.53:0/1412759831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29d40d1050 0x7f29d41584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:50:00.761 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.755+0000 7f29d37fe700 1 --2- 172.21.15.53:0/1412759831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29d40b2350 0x7f29d40cff20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f29c800e8a0 tx=0x7f29c800ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:00.761 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.755+0000 7f29d0ff9700 1 -- 172.21.15.53:0/1412759831 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8013680 con 0x7f29d40b2350 2023-07-09T21:50:00.761 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.755+0000 7f29d0ff9700 1 -- 172.21.15.53:0/1412759831 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c80137e0 con 0x7f29d40b2350 2023-07-09T21:50:00.761 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.755+0000 7f29da9ff700 1 -- 172.21.15.53:0/1412759831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d41e7b70 con 0x7f29d40b2350 2023-07-09T21:50:00.761 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.755+0000 7f29d0ff9700 1 -- 172.21.15.53:0/1412759831 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8013b70 con 0x7f29d40b2350 2023-07-09T21:50:00.762 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.755+0000 7f29da9ff700 1 -- 172.21.15.53:0/1412759831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d41e8130 con 0x7f29d40b2350 2023-07-09T21:50:00.762 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.755+0000 7f29d0ff9700 1 -- 172.21.15.53:0/1412759831 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f29c8005a20 con 0x7f29d40b2350 2023-07-09T21:50:00.762 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.756+0000 7f29d0ff9700 1 -- 172.21.15.53:0/1412759831 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f29c8005cd0 con 0x7f29d40b2350 2023-07-09T21:50:00.762 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.756+0000 7f29da9ff700 1 -- 172.21.15.53:0/1412759831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d406c570 con 0x7f29d40b2350 2023-07-09T21:50:00.763 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.759+0000 7f29d0ff9700 1 -- 172.21.15.53:0/1412759831 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f29c8021060 con 0x7f29d40b2350 2023-07-09T21:50:00.835 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.834+0000 7f29da9ff700 1 -- 172.21.15.53:0/1412759831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29d404e280 con 0x7f29d40b2350 2023-07-09T21:50:00.835 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.834+0000 7f29d0ff9700 1 -- 172.21.15.53:0/1412759831 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f29c8029020 con 0x7f29d40b2350 2023-07-09T21:50:00.836 INFO:teuthology.misc.health.smithi053.stdout: 2023-07-09T21:50:00.836 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":10,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:49:59.323314+0000","last_up_change":"0.000000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:50:00.837 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.836+0000 7f29da9ff700 1 -- 172.21.15.53:0/1412759831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29d40b2350 msgr2=0x7f29d40cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:00.837 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.836+0000 7f29da9ff700 1 --2- 172.21.15.53:0/1412759831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29d40b2350 0x7f29d40cff20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f29c800e8a0 tx=0x7f29c800ebb0 comp rx=0 tx=0).stop 2023-07-09T21:50:00.838 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.836+0000 7f29da9ff700 1 -- 172.21.15.53:0/1412759831 shutdown_connections 2023-07-09T21:50:00.838 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.836+0000 7f29da9ff700 1 --2- 172.21.15.53:0/1412759831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29d40d1050 0x7f29d41584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:00.838 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.836+0000 7f29da9ff700 1 --2- 172.21.15.53:0/1412759831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d40b1e00 0x7f29d40cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:00.838 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.836+0000 7f29da9ff700 1 --2- 172.21.15.53:0/1412759831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29d40b2350 0x7f29d40cff20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:00.838 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.836+0000 7f29da9ff700 1 -- 172.21.15.53:0/1412759831 >> 172.21.15.53:0/1412759831 conn(0x7f29d409c1d0 msgr2=0x7f29d40b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:00.839 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.836+0000 7f29da9ff700 1 -- 172.21.15.53:0/1412759831 shutdown_connections 2023-07-09T21:50:00.839 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:00.836+0000 7f29da9ff700 1 -- 172.21.15.53:0/1412759831 wait complete. 2023-07-09T21:50:00.852 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-09T21:50:00.923 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:50:00.922+0000 7f2d8b365200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-09T21:50:00.971 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:50:00.970+0000 7fa5b7b9c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:50:01.022 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:50:01.021+0000 7f2d8b365200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:50:01.169 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:50:01.168+0000 7fa5b7b9c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:50:01.315 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:50:01.314+0000 7fa5b7b9c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:50:01.360 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:50:01.359+0000 7f2d8b365200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:50:01.504 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:50:01.502+0000 7fa5b7b9c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:50:01.644 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:50:01.643+0000 7f2d8b365200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:50:01.840 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:50:01.839+0000 7fa5b7b9c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:50:01.850 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:50:01.849+0000 7f2d8b365200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:50:02.001 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:50:02.000+0000 7f2d8b365200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:50:02.074 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:50:02.073+0000 7fa5b7b9c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:50:02.194 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:50:02.193+0000 7f2d8b365200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:50:02.529 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:50:02.528+0000 7f2d8b365200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:50:02.788 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:50:02.786+0000 7f2d8b365200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:50:02.827 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:50:02.825+0000 7fa5b7b9c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:50:03.628 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-07-09T21:50:03.627+0000 7f15ff6cb640 -1 osd.6 0 log_to_monitors true 2023-07-09T21:50:03.666 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-07-09T21:50:03.664+0000 7fd95f1a7640 -1 osd.0 0 log_to_monitors true 2023-07-09T21:50:03.667 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-07-09T21:50:03.666+0000 7ff63af23640 -1 osd.2 0 log_to_monitors true 2023-07-09T21:50:03.684 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-07-09T21:50:03.682+0000 7f5515a0d640 -1 osd.7 0 log_to_monitors true 2023-07-09T21:50:03.704 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-07-09T21:50:03.702+0000 7f2d8b365200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:50:03.723 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-07-09T21:50:03.722+0000 7f6066063640 -1 osd.3 0 log_to_monitors true 2023-07-09T21:50:03.854 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:50:03.853+0000 7fa56b5fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-09T21:50:03.855 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:50:03.854+0000 7fa56b5fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-09T21:50:03.868 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-07-09T21:50:03.867+0000 7f3b9835a640 -1 osd.4 0 log_to_monitors true 2023-07-09T21:50:03.890 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-07-09T21:50:03.889+0000 7f14e468e640 -1 osd.5 0 log_to_monitors true 2023-07-09T21:50:03.923 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-07-09T21:50:03.922+0000 7fc52e36d640 -1 osd.1 0 log_to_monitors true 2023-07-09T21:50:06.049 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-07-09T21:50:06.048+0000 7ff6295f6700 -1 osd.2 0 waiting for initial osdmap 2023-07-09T21:50:06.077 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-07-09T21:50:06.076+0000 7ff6215fb700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:50:06.390 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-07-09T21:50:06.389+0000 7fd94d7f6700 -1 osd.0 0 waiting for initial osdmap 2023-07-09T21:50:06.408 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-07-09T21:50:06.407+0000 7fd9457fb700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:50:06.501 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-07-09T21:50:06.500+0000 7f60547f6700 -1 osd.3 0 waiting for initial osdmap 2023-07-09T21:50:06.513 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-07-09T21:50:06.512+0000 7f604c7fb700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:50:06.898 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-07-09T21:50:06.897+0000 7f15eddf6700 -1 osd.6 0 waiting for initial osdmap 2023-07-09T21:50:06.932 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-07-09T21:50:06.931+0000 7f15e5dfb700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:50:06.937 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-07-09T21:50:06.935+0000 7f55041f6700 -1 osd.7 0 waiting for initial osdmap 2023-07-09T21:50:06.938 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-07-09T21:50:06.937+0000 7f14d2df6700 -1 osd.5 0 waiting for initial osdmap 2023-07-09T21:50:06.971 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-07-09T21:50:06.970+0000 7f54fc1fb700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:50:06.972 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-07-09T21:50:06.971+0000 7f14cadfb700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:50:07.124 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-07-09T21:50:07.123+0000 7fc51c9f6700 -1 osd.1 0 waiting for initial osdmap 2023-07-09T21:50:07.141 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-07-09T21:50:07.140+0000 7fc5149fb700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:50:07.658 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-09T21:50:07.719 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-07-09T21:50:07.718+0000 7f3b869f6700 -1 osd.4 0 waiting for initial osdmap 2023-07-09T21:50:07.743 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-07-09T21:50:07.742+0000 7f3b7e9fb700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:50:07.842 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.840+0000 7f495cfff700 1 Processor -- start 2023-07-09T21:50:07.842 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.841+0000 7f495cfff700 1 -- start start 2023-07-09T21:50:07.844 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.842+0000 7f495cfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49580d1220 0x7f49580b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:07.844 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.842+0000 7f495cfff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49580d2ce0 con 0x7f49580b2350 2023-07-09T21:50:07.844 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.843+0000 7f495cfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49580b3350 con 0x7f49580b1e00 2023-07-09T21:50:07.844 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.843+0000 7f495cfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49580b3630 con 0x7f49580d1220 2023-07-09T21:50:07.844 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.843+0000 7f4956d9d700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f49580b2350 0x7f49580afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56546/0 (socket says 172.21.15.53:56546) 2023-07-09T21:50:07.844 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.843+0000 7f4956d9d700 1 -- 172.21.15.53:0/161416597 learned_addr learned my addr 172.21.15.53:0/161416597 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:07.845 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.843+0000 7f494ffff700 1 --2- 172.21.15.53:0/161416597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49580d1220 0x7f49580b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:07.846 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.843+0000 7f4955d9b700 1 -- 172.21.15.53:0/161416597 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351160779 0 0) 0x7f49580d2ce0 con 0x7f49580b2350 2023-07-09T21:50:07.846 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.843+0000 7f4955d9b700 1 -- 172.21.15.53:0/161416597 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49440035b0 con 0x7f49580b2350 2023-07-09T21:50:07.846 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.843+0000 7f4955d9b700 1 -- 172.21.15.53:0/161416597 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1064028348 0 0) 0x7f49580b3350 con 0x7f49580b1e00 2023-07-09T21:50:07.846 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.843+0000 7f494ffff700 1 -- 172.21.15.53:0/161416597 >> v1:172.21.15.184:6789/0 conn(0x7f49580b1e00 legacy=0x7f49580d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:07.846 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.843+0000 7f494ffff700 1 -- 172.21.15.53:0/161416597 >> v1:172.21.15.53:6789/0 conn(0x7f49580b2350 legacy=0x7f49580afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:07.847 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.843+0000 7f494ffff700 1 -- 172.21.15.53:0/161416597 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49580b3910 con 0x7f49580d1220 2023-07-09T21:50:07.847 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.844+0000 7f494ffff700 1 --2- 172.21.15.53:0/161416597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49580d1220 0x7f49580b43f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4940009870 tx=0x7f4940009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af484cf82a4be8ac server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:07.847 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.844+0000 7f4955d9b700 1 -- 172.21.15.53:0/161416597 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940011830 con 0x7f49580d1220 2023-07-09T21:50:07.847 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.844+0000 7f4955d9b700 1 -- 172.21.15.53:0/161416597 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4940011990 con 0x7f49580d1220 2023-07-09T21:50:07.847 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.844+0000 7f4955d9b700 1 -- 172.21.15.53:0/161416597 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940011d20 con 0x7f49580d1220 2023-07-09T21:50:07.847 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.844+0000 7f495cfff700 1 -- 172.21.15.53:0/161416597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49580d1220 msgr2=0x7f49580b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:07.847 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.844+0000 7f495cfff700 1 --2- 172.21.15.53:0/161416597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49580d1220 0x7f49580b43f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4940009870 tx=0x7f4940009b80 comp rx=0 tx=0).stop 2023-07-09T21:50:07.848 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.844+0000 7f495cfff700 1 -- 172.21.15.53:0/161416597 shutdown_connections 2023-07-09T21:50:07.848 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.844+0000 7f495cfff700 1 --2- 172.21.15.53:0/161416597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49580d1220 0x7f49580b43f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:07.848 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.844+0000 7f495cfff700 1 -- 172.21.15.53:0/161416597 >> 172.21.15.53:0/161416597 conn(0x7f495809c1d0 msgr2=0x7f49580d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:07.848 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.845+0000 7f495cfff700 1 -- 172.21.15.53:0/161416597 shutdown_connections 2023-07-09T21:50:07.848 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.845+0000 7f495cfff700 1 -- 172.21.15.53:0/161416597 wait complete. 2023-07-09T21:50:07.850 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.846+0000 7f495cfff700 1 Processor -- start 2023-07-09T21:50:07.850 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.846+0000 7f495cfff700 1 -- start start 2023-07-09T21:50:07.850 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.847+0000 7f495cfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49580b1e00 0x7f49580c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:07.850 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.847+0000 7f495cfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49580b2350 0x7f495815af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:07.850 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.847+0000 7f495cfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49580d1220 0x7f495815b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:07.851 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.847+0000 7f495cfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49580c8000 con 0x7f49580b1e00 2023-07-09T21:50:07.851 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.847+0000 7f495cfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49580cd570 con 0x7f49580b2350 2023-07-09T21:50:07.851 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.847+0000 7f495cfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49580cb840 con 0x7f49580d1220 2023-07-09T21:50:07.851 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f495659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49580b1e00 0x7f49580c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:07.851 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f495659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49580b1e00 0x7f49580c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49026/0 (socket says 172.21.15.53:49026) 2023-07-09T21:50:07.851 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f495659c700 1 -- 172.21.15.53:0/2986352977 learned_addr learned my addr 172.21.15.53:0/2986352977 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:07.851 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f494ffff700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49580b2350 0x7f495815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:07.852 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f4956d9d700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49580d1220 0x7f495815b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:07.852 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f495659c700 1 -- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49580d1220 msgr2=0x7f495815b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:07.852 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f495659c700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49580d1220 0x7f495815b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:07.852 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f495659c700 1 -- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49580b2350 msgr2=0x7f495815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:07.852 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f495659c700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49580b2350 0x7f495815af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:07.852 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f495659c700 1 -- 172.21.15.53:0/2986352977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49400094a0 con 0x7f49580b1e00 2023-07-09T21:50:07.852 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f495659c700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49580b1e00 0x7f49580c5c10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f494800c4f0 tx=0x7f494800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:07.853 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f494effd700 1 -- 172.21.15.53:0/2986352977 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49480054e0 con 0x7f49580b1e00 2023-07-09T21:50:07.853 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f494effd700 1 -- 172.21.15.53:0/2986352977 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49480036d0 con 0x7f49580b1e00 2023-07-09T21:50:07.853 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.848+0000 7f494effd700 1 -- 172.21.15.53:0/2986352977 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948003a60 con 0x7f49580b1e00 2023-07-09T21:50:07.853 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.849+0000 7f495cfff700 1 -- 172.21.15.53:0/2986352977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49580c6ef0 con 0x7f49580b1e00 2023-07-09T21:50:07.853 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.849+0000 7f495cfff700 1 -- 172.21.15.53:0/2986352977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49580cb4d0 con 0x7f49580b1e00 2023-07-09T21:50:07.854 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.850+0000 7f495cfff700 1 -- 172.21.15.53:0/2986352977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495804e280 con 0x7f49580b1e00 2023-07-09T21:50:07.854 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.851+0000 7f494effd700 1 -- 172.21.15.53:0/2986352977 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f4948003bc0 con 0x7f49580b1e00 2023-07-09T21:50:07.854 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.852+0000 7f494effd700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f493806ac50 0x7f493806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:07.854 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.852+0000 7f494effd700 1 -- 172.21.15.53:0/2986352977 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3911+0+0 (secure 0 0 0) 0x7f4948087f30 con 0x7f49580b1e00 2023-07-09T21:50:07.855 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.852+0000 7f494ffff700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f493806ac50 0x7f493806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:07.855 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.853+0000 7f494ffff700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f493806ac50 0x7f493806d100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f49580d1610 tx=0x7f494001c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:07.857 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:07.857+0000 7f494effd700 1 -- 172.21.15.53:0/2986352977 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4948053920 con 0x7f49580b1e00 2023-07-09T21:50:08.071 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.070+0000 7f495cfff700 1 -- 172.21.15.53:0/2986352977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f495806a700 con 0x7f49580b1e00 2023-07-09T21:50:08.072 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.071+0000 7f494effd700 1 -- 172.21.15.53:0/2986352977 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9936 (secure 0 0 0) 0x7f4948017020 con 0x7f49580b1e00 2023-07-09T21:50:08.072 INFO:teuthology.misc.health.smithi053.stdout: 2023-07-09T21:50:08.072 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":14,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:07.052151+0000","last_up_change":"2023-07-09T21:50:07.052151+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:50:08.075 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.073+0000 7f495cfff700 1 -- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f493806ac50 msgr2=0x7f493806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:08.075 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.073+0000 7f495cfff700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f493806ac50 0x7f493806d100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f49580d1610 tx=0x7f494001c040 comp rx=0 tx=0).stop 2023-07-09T21:50:08.075 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.073+0000 7f495cfff700 1 -- 172.21.15.53:0/2986352977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49580b1e00 msgr2=0x7f49580c5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:08.075 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.073+0000 7f495cfff700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49580b1e00 0x7f49580c5c10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f494800c4f0 tx=0x7f494800c800 comp rx=0 tx=0).stop 2023-07-09T21:50:08.075 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.073+0000 7f495cfff700 1 -- 172.21.15.53:0/2986352977 shutdown_connections 2023-07-09T21:50:08.075 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.073+0000 7f495cfff700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f493806ac50 0x7f493806d100 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:08.076 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.073+0000 7f495cfff700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49580d1220 0x7f495815b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:08.076 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.073+0000 7f495cfff700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49580b1e00 0x7f49580c5c10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:08.076 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.073+0000 7f495cfff700 1 --2- 172.21.15.53:0/2986352977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49580b2350 0x7f495815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:08.076 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.073+0000 7f495cfff700 1 -- 172.21.15.53:0/2986352977 >> 172.21.15.53:0/2986352977 conn(0x7f495809c1d0 msgr2=0x7f49580afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:08.076 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.074+0000 7f495cfff700 1 -- 172.21.15.53:0/2986352977 shutdown_connections 2023-07-09T21:50:08.076 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:08.074+0000 7f495cfff700 1 -- 172.21.15.53:0/2986352977 wait complete. 2023-07-09T21:50:08.090 DEBUG:teuthology.misc:6 of 8 OSDs are up 2023-07-09T21:50:10.491 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:50:10.495 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:50:14.896 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-09T21:50:15.082 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.081+0000 7f0e163ff700 1 Processor -- start 2023-07-09T21:50:15.082 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.081+0000 7f0e163ff700 1 -- start start 2023-07-09T21:50:15.083 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.082+0000 7f0e163ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0e100b2350 0x7f0e100b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:15.083 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.082+0000 7f0e163ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e100d2ce0 con 0x7f0e100d1220 2023-07-09T21:50:15.084 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.082+0000 7f0e163ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e100b3350 con 0x7f0e100b1e00 2023-07-09T21:50:15.084 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.082+0000 7f0e163ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e100b3630 con 0x7f0e100b2350 2023-07-09T21:50:15.084 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.082+0000 7f0e0f7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0e100d1220 0x7f0e100afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45516/0 (socket says 172.21.15.53:45516) 2023-07-09T21:50:15.084 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.082+0000 7f0e0f7fe700 1 -- 172.21.15.53:0/1663603026 learned_addr learned my addr 172.21.15.53:0/1663603026 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:15.084 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.082+0000 7f0e1499c700 1 --2- 172.21.15.53:0/1663603026 >> v2:172.21.15.53:3300/0 conn(0x7f0e100b2350 0x7f0e100b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:15.085 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.083+0000 7f0e1499c700 1 -- 172.21.15.53:0/1663603026 >> v1:172.21.15.184:6789/0 conn(0x7f0e100b1e00 legacy=0x7f0e100d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:15.086 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.083+0000 7f0e1499c700 1 -- 172.21.15.53:0/1663603026 >> v1:172.21.15.53:6789/0 conn(0x7f0e100d1220 legacy=0x7f0e100afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:15.086 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.083+0000 7f0e1499c700 1 -- 172.21.15.53:0/1663603026 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e100b3910 con 0x7f0e100b2350 2023-07-09T21:50:15.086 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.083+0000 7f0e0effd700 1 -- 172.21.15.53:0/1663603026 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809645928 0 0) 0x7f0e100d2ce0 con 0x7f0e100d1220 2023-07-09T21:50:15.086 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.083+0000 7f0e1499c700 1 --2- 172.21.15.53:0/1663603026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e100b2350 0x7f0e100b43f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009d90 tx=0x7f0e0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6739998853a570 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:15.086 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.083+0000 7f0e0effd700 1 -- 172.21.15.53:0/1663603026 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0800e070 con 0x7f0e100b2350 2023-07-09T21:50:15.086 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.083+0000 7f0e0effd700 1 -- 172.21.15.53:0/1663603026 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0800bb90 con 0x7f0e100b2350 2023-07-09T21:50:15.086 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.083+0000 7f0e0effd700 1 -- 172.21.15.53:0/1663603026 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08003a20 con 0x7f0e100b2350 2023-07-09T21:50:15.087 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.084+0000 7f0e163ff700 1 -- 172.21.15.53:0/1663603026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e100b2350 msgr2=0x7f0e100b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:15.087 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.084+0000 7f0e163ff700 1 --2- 172.21.15.53:0/1663603026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e100b2350 0x7f0e100b43f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009d90 tx=0x7f0e0800b330 comp rx=0 tx=0).stop 2023-07-09T21:50:15.087 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.084+0000 7f0e163ff700 1 -- 172.21.15.53:0/1663603026 shutdown_connections 2023-07-09T21:50:15.087 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.084+0000 7f0e163ff700 1 --2- 172.21.15.53:0/1663603026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e100b2350 0x7f0e100b43f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:15.087 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.084+0000 7f0e163ff700 1 -- 172.21.15.53:0/1663603026 >> 172.21.15.53:0/1663603026 conn(0x7f0e1009c1d0 msgr2=0x7f0e100d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:15.087 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.084+0000 7f0e163ff700 1 -- 172.21.15.53:0/1663603026 shutdown_connections 2023-07-09T21:50:15.087 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.084+0000 7f0e163ff700 1 -- 172.21.15.53:0/1663603026 wait complete. 2023-07-09T21:50:15.089 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.086+0000 7f0e163ff700 1 Processor -- start 2023-07-09T21:50:15.089 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.086+0000 7f0e163ff700 1 -- start start 2023-07-09T21:50:15.090 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e163ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e100b1e00 0x7f0e100cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:15.090 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e163ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e100b2350 0x7f0e100cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:15.090 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e163ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e100d1220 0x7f0e100cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:15.090 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e163ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100c6b10 con 0x7f0e100b1e00 2023-07-09T21:50:15.090 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e163ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100cc040 con 0x7f0e100d1220 2023-07-09T21:50:15.090 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e163ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100cc320 con 0x7f0e100b2350 2023-07-09T21:50:15.090 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e0ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e100b1e00 0x7f0e100cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:15.091 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e0ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e100b1e00 0x7f0e100cf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46086/0 (socket says 172.21.15.53:46086) 2023-07-09T21:50:15.091 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e0ffff700 1 -- 172.21.15.53:0/378225531 learned_addr learned my addr 172.21.15.53:0/378225531 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:15.091 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e1499c700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e100d1220 0x7f0e100cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:15.091 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e0f7fe700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e100b2350 0x7f0e100cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:15.091 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e0ffff700 1 -- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e100b2350 msgr2=0x7f0e100cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:15.091 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e0ffff700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e100b2350 0x7f0e100cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:15.091 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e0ffff700 1 -- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e100d1220 msgr2=0x7f0e100cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:15.092 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e0ffff700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e100d1220 0x7f0e100cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:15.092 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e0ffff700 1 -- 172.21.15.53:0/378225531 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e08009a70 con 0x7f0e100b1e00 2023-07-09T21:50:15.092 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e1499c700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e100d1220 0x7f0e100cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:15.092 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.087+0000 7f0e0f7fe700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e100b2350 0x7f0e100cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:15.092 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.088+0000 7f0e0ffff700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e100b1e00 0x7f0e100cf3b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000c4b0 tx=0x7f0e0000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:15.092 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.088+0000 7f0e0cff9700 1 -- 172.21.15.53:0/378225531 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e00011790 con 0x7f0e100b1e00 2023-07-09T21:50:15.092 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.088+0000 7f0e0cff9700 1 -- 172.21.15.53:0/378225531 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e000118f0 con 0x7f0e100b1e00 2023-07-09T21:50:15.092 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.088+0000 7f0e0cff9700 1 -- 172.21.15.53:0/378225531 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e00011ca0 con 0x7f0e100b1e00 2023-07-09T21:50:15.093 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.088+0000 7f0e163ff700 1 -- 172.21.15.53:0/378225531 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e100cc600 con 0x7f0e100b1e00 2023-07-09T21:50:15.093 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.088+0000 7f0e163ff700 1 -- 172.21.15.53:0/378225531 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e100cefa0 con 0x7f0e100b1e00 2023-07-09T21:50:15.093 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.089+0000 7f0e163ff700 1 -- 172.21.15.53:0/378225531 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e100cf1c0 con 0x7f0e100b1e00 2023-07-09T21:50:15.094 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.090+0000 7f0e0cff9700 1 -- 172.21.15.53:0/378225531 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e0001c460 con 0x7f0e100b1e00 2023-07-09T21:50:15.094 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.092+0000 7f0e0cff9700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0dfc06ace0 0x7f0dfc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:15.094 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.092+0000 7f0e0cff9700 1 -- 172.21.15.53:0/378225531 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0e00088f20 con 0x7f0e100b1e00 2023-07-09T21:50:15.094 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.092+0000 7f0e0f7fe700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0dfc06ace0 0x7f0dfc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:15.094 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.093+0000 7f0e0f7fe700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0dfc06ace0 0x7f0dfc06d190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e100cec90 tx=0x7f0e04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:15.098 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.097+0000 7f0e0cff9700 1 -- 172.21.15.53:0/378225531 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0e000543e0 con 0x7f0e100b1e00 2023-07-09T21:50:15.308 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.307+0000 7f0e163ff700 1 -- 172.21.15.53:0/378225531 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e1004e280 con 0x7f0e100b1e00 2023-07-09T21:50:15.309 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.308+0000 7f0e0cff9700 1 -- 172.21.15.53:0/378225531 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f0e00057a00 con 0x7f0e100b1e00 2023-07-09T21:50:15.310 INFO:teuthology.misc.health.smithi053.stdout: 2023-07-09T21:50:15.310 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":18,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:11.141920+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:50:15.312 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.311+0000 7f0e163ff700 1 -- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0dfc06ace0 msgr2=0x7f0dfc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:15.312 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.311+0000 7f0e163ff700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0dfc06ace0 0x7f0dfc06d190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e100cec90 tx=0x7f0e04009040 comp rx=0 tx=0).stop 2023-07-09T21:50:15.313 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.311+0000 7f0e163ff700 1 -- 172.21.15.53:0/378225531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e100b1e00 msgr2=0x7f0e100cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:15.313 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.311+0000 7f0e163ff700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e100b1e00 0x7f0e100cf3b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000c4b0 tx=0x7f0e0000c870 comp rx=0 tx=0).stop 2023-07-09T21:50:15.313 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.311+0000 7f0e163ff700 1 -- 172.21.15.53:0/378225531 shutdown_connections 2023-07-09T21:50:15.313 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.311+0000 7f0e163ff700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0dfc06ace0 0x7f0dfc06d190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:15.313 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.311+0000 7f0e163ff700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e100d1220 0x7f0e100cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:15.313 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.311+0000 7f0e163ff700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e100b1e00 0x7f0e100cf3b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:15.313 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.311+0000 7f0e163ff700 1 --2- 172.21.15.53:0/378225531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e100b2350 0x7f0e100cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:15.314 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.311+0000 7f0e163ff700 1 -- 172.21.15.53:0/378225531 >> 172.21.15.53:0/378225531 conn(0x7f0e1009c1d0 msgr2=0x7f0e100d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:15.314 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.311+0000 7f0e163ff700 1 -- 172.21.15.53:0/378225531 shutdown_connections 2023-07-09T21:50:15.314 INFO:teuthology.misc.health.smithi053.stderr:2023-07-09T21:50:15.311+0000 7f0e163ff700 1 -- 172.21.15.53:0/378225531 wait complete. 2023-07-09T21:50:15.328 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-09T21:50:15.329 INFO:tasks.ceph:Creating RBD pool 2023-07-09T21:50:15.329 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-09T21:50:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.520+0000 7f1e6cdff700 1 Processor -- start 2023-07-09T21:50:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.521+0000 7f1e6cdff700 1 -- start start 2023-07-09T21:50:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.522+0000 7f1e6cdff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1e680d1220 0x7f1e680b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.522+0000 7f1e6cdff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e680b8e80 con 0x7f1e680b0e20 2023-07-09T21:50:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.522+0000 7f1e6cdff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e680afaa0 con 0x7f1e680b3ff0 2023-07-09T21:50:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.522+0000 7f1e6cdff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e680afd80 con 0x7f1e680d1220 2023-07-09T21:50:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.523+0000 7f1e66d9d700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1e680b0e20 0x7f1e680b1220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45520/0 (socket says 172.21.15.53:45520) 2023-07-09T21:50:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.523+0000 7f1e66d9d700 1 -- 172.21.15.53:0/3275679662 learned_addr learned my addr 172.21.15.53:0/3275679662 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.523+0000 7f1e5ffff700 1 --2- 172.21.15.53:0/3275679662 >> v2:172.21.15.184:3300/0 conn(0x7f1e680d1220 0x7f1e680b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.523+0000 7f1e65d9b700 1 -- 172.21.15.53:0/3275679662 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397885695 0 0) 0x7f1e60001490 con 0x7f1e680b0e20 2023-07-09T21:50:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.523+0000 7f1e65d9b700 1 -- 172.21.15.53:0/3275679662 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e540035b0 con 0x7f1e680b0e20 2023-07-09T21:50:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.523+0000 7f1e5ffff700 1 -- 172.21.15.53:0/3275679662 >> v1:172.21.15.184:6789/0 conn(0x7f1e680b3ff0 legacy=0x7f1e680d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.523+0000 7f1e65d9b700 1 -- 172.21.15.53:0/3275679662 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3382691876 0 0) 0x7f1e540035b0 con 0x7f1e680b0e20 2023-07-09T21:50:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.523+0000 7f1e5ffff700 1 -- 172.21.15.53:0/3275679662 >> v1:172.21.15.53:6789/0 conn(0x7f1e680b0e20 legacy=0x7f1e680b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.523+0000 7f1e5ffff700 1 -- 172.21.15.53:0/3275679662 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e680b0060 con 0x7f1e680d1220 2023-07-09T21:50:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.524+0000 7f1e5ffff700 1 --2- 172.21.15.53:0/3275679662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e680d1220 0x7f1e680b43c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009840 tx=0x7f1e50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28d850907fc1e877 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.526+0000 7f1e65d9b700 1 -- 172.21.15.53:0/3275679662 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60001b80 con 0x7f1e680d1220 2023-07-09T21:50:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.526+0000 7f1e65d9b700 1 -- 172.21.15.53:0/3275679662 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e50004030 con 0x7f1e680d1220 2023-07-09T21:50:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.526+0000 7f1e65d9b700 1 -- 172.21.15.53:0/3275679662 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e500043c0 con 0x7f1e680d1220 2023-07-09T21:50:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.526+0000 7f1e6cdff700 1 -- 172.21.15.53:0/3275679662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e680d1220 msgr2=0x7f1e680b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.526+0000 7f1e6cdff700 1 --2- 172.21.15.53:0/3275679662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e680d1220 0x7f1e680b43c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009840 tx=0x7f1e50009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.527+0000 7f1e6cdff700 1 -- 172.21.15.53:0/3275679662 shutdown_connections 2023-07-09T21:50:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.527+0000 7f1e6cdff700 1 --2- 172.21.15.53:0/3275679662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e680d1220 0x7f1e680b43c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.527+0000 7f1e6cdff700 1 -- 172.21.15.53:0/3275679662 >> 172.21.15.53:0/3275679662 conn(0x7f1e6809c1b0 msgr2=0x7f1e680d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.527+0000 7f1e6cdff700 1 -- 172.21.15.53:0/3275679662 shutdown_connections 2023-07-09T21:50:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.527+0000 7f1e6cdff700 1 -- 172.21.15.53:0/3275679662 wait complete. 2023-07-09T21:50:15.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.528+0000 7f1e6cdff700 1 Processor -- start 2023-07-09T21:50:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.529+0000 7f1e6cdff700 1 -- start start 2023-07-09T21:50:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.529+0000 7f1e6cdff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e680b0e20 0x7f1e6815b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.529+0000 7f1e6cdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e680b3ff0 0x7f1e6815f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.529+0000 7f1e6cdff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e680d1220 0x7f1e680b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.529+0000 7f1e6cdff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6815ff10 con 0x7f1e680d1220 2023-07-09T21:50:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.529+0000 7f1e6cdff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6815cdb0 con 0x7f1e680b0e20 2023-07-09T21:50:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.529+0000 7f1e6cdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6815d090 con 0x7f1e680b3ff0 2023-07-09T21:50:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.530+0000 7f1e66d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e680d1220 0x7f1e680b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.530+0000 7f1e66d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e680d1220 0x7f1e680b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46090/0 (socket says 172.21.15.53:46090) 2023-07-09T21:50:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.530+0000 7f1e66d9d700 1 -- 172.21.15.53:0/1792618485 learned_addr learned my addr 172.21.15.53:0/1792618485 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.530+0000 7f1e5ffff700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e680b3ff0 0x7f1e6815f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.530+0000 7f1e6659c700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e680b0e20 0x7f1e6815b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:15.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.530+0000 7f1e66d9d700 1 -- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e680b3ff0 msgr2=0x7f1e6815f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:15.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.530+0000 7f1e66d9d700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e680b3ff0 0x7f1e6815f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:15.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.530+0000 7f1e66d9d700 1 -- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e680b0e20 msgr2=0x7f1e6815b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:15.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.530+0000 7f1e66d9d700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e680b0e20 0x7f1e6815b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:15.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.530+0000 7f1e66d9d700 1 -- 172.21.15.53:0/1792618485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e500094a0 con 0x7f1e680d1220 2023-07-09T21:50:15.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.531+0000 7f1e66d9d700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e680d1220 0x7f1e680b4b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000cc90 tx=0x7f1e6000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:15.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.531+0000 7f1e5effd700 1 -- 172.21.15.53:0/1792618485 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6000aad0 con 0x7f1e680d1220 2023-07-09T21:50:15.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.531+0000 7f1e5effd700 1 -- 172.21.15.53:0/1792618485 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6000ac30 con 0x7f1e680d1220 2023-07-09T21:50:15.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.531+0000 7f1e6cdff700 1 -- 172.21.15.53:0/1792618485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6815d370 con 0x7f1e680d1220 2023-07-09T21:50:15.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.531+0000 7f1e5effd700 1 -- 172.21.15.53:0/1792618485 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e600070d0 con 0x7f1e680d1220 2023-07-09T21:50:15.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.531+0000 7f1e6cdff700 1 -- 172.21.15.53:0/1792618485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6815d930 con 0x7f1e680d1220 2023-07-09T21:50:15.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.532+0000 7f1e6cdff700 1 -- 172.21.15.53:0/1792618485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e68074350 con 0x7f1e680d1220 2023-07-09T21:50:15.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.533+0000 7f1e5effd700 1 -- 172.21.15.53:0/1792618485 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e60007230 con 0x7f1e680d1220 2023-07-09T21:50:15.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.534+0000 7f1e5effd700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e4806ace0 0x7f1e4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:15.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.534+0000 7f1e5effd700 1 -- 172.21.15.53:0/1792618485 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1e60088b20 con 0x7f1e680d1220 2023-07-09T21:50:15.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.535+0000 7f1e6659c700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e4806ace0 0x7f1e4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:15.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.535+0000 7f1e6659c700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e4806ace0 0x7f1e4806d190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e680d0390 tx=0x7f1e58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:15.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.539+0000 7f1e5effd700 1 -- 172.21.15.53:0/1792618485 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1e60053f60 con 0x7f1e680d1220 2023-07-09T21:50:15.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:15.749+0000 7f1e6cdff700 1 -- 172.21.15.53:0/1792618485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f1e680b8e80 con 0x7f1e680d1220 2023-07-09T21:50:16.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.528+0000 7f1e5effd700 1 -- 172.21.15.53:0/1792618485 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v19) v1 ==== 109+0+0 (secure 0 0 0) 0x7f1e680b8e80 con 0x7f1e680d1220 2023-07-09T21:50:16.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.532+0000 7f1e6cdff700 1 -- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e4806ace0 msgr2=0x7f1e4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:16.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.532+0000 7f1e6cdff700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e4806ace0 0x7f1e4806d190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e680d0390 tx=0x7f1e58009040 comp rx=0 tx=0).stop 2023-07-09T21:50:16.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.532+0000 7f1e6cdff700 1 -- 172.21.15.53:0/1792618485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e680d1220 msgr2=0x7f1e680b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:16.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.532+0000 7f1e6cdff700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e680d1220 0x7f1e680b4b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000cc90 tx=0x7f1e6000a060 comp rx=0 tx=0).stop 2023-07-09T21:50:16.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.532+0000 7f1e6cdff700 1 -- 172.21.15.53:0/1792618485 shutdown_connections 2023-07-09T21:50:16.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.532+0000 7f1e6cdff700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e4806ace0 0x7f1e4806d190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:16.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.532+0000 7f1e6cdff700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e680d1220 0x7f1e680b4b90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:16.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.532+0000 7f1e6cdff700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e680b0e20 0x7f1e6815b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:16.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.532+0000 7f1e6cdff700 1 --2- 172.21.15.53:0/1792618485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e680b3ff0 0x7f1e6815f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:16.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.532+0000 7f1e6cdff700 1 -- 172.21.15.53:0/1792618485 >> 172.21.15.53:0/1792618485 conn(0x7f1e6809c1b0 msgr2=0x7f1e680b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:16.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.533+0000 7f1e6cdff700 1 -- 172.21.15.53:0/1792618485 shutdown_connections 2023-07-09T21:50:16.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.533+0000 7f1e6cdff700 1 -- 172.21.15.53:0/1792618485 wait complete. 2023-07-09T21:50:16.536 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'rbd' created 2023-07-09T21:50:16.555 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-09T21:50:16.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.753+0000 7f2b6b1ff700 1 Processor -- start 2023-07-09T21:50:16.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.754+0000 7f2b6b1ff700 1 -- start start 2023-07-09T21:50:16.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.755+0000 7f2b6b1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2b640d28a0 0x7f2b6415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:16.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.755+0000 7f2b6b1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b640d0a30 0x7f2b640d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:16.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.755+0000 7f2b6b1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b640d2c70 con 0x7f2b64160350 2023-07-09T21:50:16.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.755+0000 7f2b6b1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b640d3de0 con 0x7f2b640d28a0 2023-07-09T21:50:16.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.755+0000 7f2b6b1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6415ccf0 con 0x7f2b640d0a30 2023-07-09T21:50:16.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.755+0000 7f2b68f9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2b640d28a0 0x7f2b6415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:16.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.755+0000 7f2b63fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b640d0a30 0x7f2b640d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:16.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.755+0000 7f2b6979c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2b64160350 0x7f2b641607d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:33856/0 (socket says 172.21.15.53:33856) 2023-07-09T21:50:16.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.755+0000 7f2b6979c700 1 -- 172.21.15.53:0/307185321 learned_addr learned my addr 172.21.15.53:0/307185321 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:16.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.756+0000 7f2b637fe700 1 -- 172.21.15.53:0/307185321 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399838880 0 0) 0x7f2b640d2c70 con 0x7f2b64160350 2023-07-09T21:50:16.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.756+0000 7f2b637fe700 1 -- 172.21.15.53:0/307185321 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b540035b0 con 0x7f2b64160350 2023-07-09T21:50:16.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.756+0000 7f2b63fff700 1 -- 172.21.15.53:0/307185321 >> v2:172.21.15.184:3300/0 conn(0x7f2b640d28a0 msgr2=0x7f2b6415c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:16.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.756+0000 7f2b63fff700 1 --2- 172.21.15.53:0/307185321 >> v2:172.21.15.184:3300/0 conn(0x7f2b640d28a0 0x7f2b6415c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:16.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.756+0000 7f2b63fff700 1 -- 172.21.15.53:0/307185321 >> v1:172.21.15.184:6789/0 conn(0x7f2b64160350 legacy=0x7f2b641607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:16.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.756+0000 7f2b63fff700 1 -- 172.21.15.53:0/307185321 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b640d0190 con 0x7f2b640d0a30 2023-07-09T21:50:16.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.756+0000 7f2b68f9b700 1 --2- 172.21.15.53:0/307185321 >> v2:172.21.15.184:3300/0 conn(0x7f2b640d28a0 0x7f2b6415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:50:16.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.756+0000 7f2b63fff700 1 --2- 172.21.15.53:0/307185321 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b640d0a30 0x7f2b640d0ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009840 tx=0x7f2b50009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2eec2d8c6bbd066 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:16.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.756+0000 7f2b637fe700 1 -- 172.21.15.53:0/307185321 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50011830 con 0x7f2b640d0a30 2023-07-09T21:50:16.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.756+0000 7f2b637fe700 1 -- 172.21.15.53:0/307185321 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b50011990 con 0x7f2b640d0a30 2023-07-09T21:50:16.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.756+0000 7f2b637fe700 1 -- 172.21.15.53:0/307185321 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50011d20 con 0x7f2b640d0a30 2023-07-09T21:50:16.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.757+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/307185321 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b640d0a30 msgr2=0x7f2b640d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:16.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.757+0000 7f2b6b1ff700 1 --2- 172.21.15.53:0/307185321 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b640d0a30 0x7f2b640d0ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009840 tx=0x7f2b50009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:16.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.757+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/307185321 shutdown_connections 2023-07-09T21:50:16.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.757+0000 7f2b6b1ff700 1 --2- 172.21.15.53:0/307185321 >> v2:172.21.15.184:3300/0 conn(0x7f2b640d28a0 0x7f2b6415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:16.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.757+0000 7f2b6b1ff700 1 --2- 172.21.15.53:0/307185321 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b640d0a30 0x7f2b640d0ea0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:16.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.757+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/307185321 >> 172.21.15.53:0/307185321 conn(0x7f2b6409c1b0 msgr2=0x7f2b640d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:16.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.757+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/307185321 shutdown_connections 2023-07-09T21:50:16.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.757+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/307185321 wait complete. 2023-07-09T21:50:16.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.759+0000 7f2b6b1ff700 1 Processor -- start 2023-07-09T21:50:16.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.759+0000 7f2b6b1ff700 1 -- start start 2023-07-09T21:50:16.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.760+0000 7f2b6b1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b640d0a30 0x7f2b640b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:16.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.760+0000 7f2b6b1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b640d28a0 0x7f2b640b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:16.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.760+0000 7f2b6b1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64160350 0x7f2b640b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:16.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.760+0000 7f2b6b1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640b33f0 con 0x7f2b64160350 2023-07-09T21:50:16.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.760+0000 7f2b6b1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640c7a40 con 0x7f2b640d28a0 2023-07-09T21:50:16.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.760+0000 7f2b6b1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640b2b50 con 0x7f2b640d0a30 2023-07-09T21:50:16.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.760+0000 7f2b6979c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64160350 0x7f2b640b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:16.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.760+0000 7f2b68f9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b640d0a30 0x7f2b640b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:16.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.760+0000 7f2b6979c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64160350 0x7f2b640b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46096/0 (socket says 172.21.15.53:46096) 2023-07-09T21:50:16.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.760+0000 7f2b6979c700 1 -- 172.21.15.53:0/1438305302 learned_addr learned my addr 172.21.15.53:0/1438305302 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:16.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.760+0000 7f2b68f9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b640d0a30 0x7f2b640b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:45474/0 (socket says 172.21.15.53:45474) 2023-07-09T21:50:16.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.760+0000 7f2b63fff700 1 --2- 172.21.15.53:0/1438305302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b640d28a0 0x7f2b640b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:16.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.761+0000 7f2b6979c700 1 -- 172.21.15.53:0/1438305302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b640d0a30 msgr2=0x7f2b640b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:16.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.761+0000 7f2b6979c700 1 --2- 172.21.15.53:0/1438305302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b640d0a30 0x7f2b640b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:16.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.761+0000 7f2b6979c700 1 -- 172.21.15.53:0/1438305302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b640d28a0 msgr2=0x7f2b640b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:16.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.761+0000 7f2b6979c700 1 --2- 172.21.15.53:0/1438305302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b640d28a0 0x7f2b640b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:16.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.761+0000 7f2b6979c700 1 -- 172.21.15.53:0/1438305302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b580094a0 con 0x7f2b64160350 2023-07-09T21:50:16.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.761+0000 7f2b6979c700 1 --2- 172.21.15.53:0/1438305302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64160350 0x7f2b640b0590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00cb40 tx=0x7f2b5c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:16.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.761+0000 7f2b617fa700 1 -- 172.21.15.53:0/1438305302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c00a980 con 0x7f2b64160350 2023-07-09T21:50:16.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.761+0000 7f2b617fa700 1 -- 172.21.15.53:0/1438305302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5c00aae0 con 0x7f2b64160350 2023-07-09T21:50:16.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.761+0000 7f2b617fa700 1 -- 172.21.15.53:0/1438305302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c00ae50 con 0x7f2b64160350 2023-07-09T21:50:16.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.761+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/1438305302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b500094a0 con 0x7f2b64160350 2023-07-09T21:50:16.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.761+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/1438305302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b640b3110 con 0x7f2b64160350 2023-07-09T21:50:16.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.762+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/1438305302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b64074350 con 0x7f2b64160350 2023-07-09T21:50:16.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.764+0000 7f2b617fa700 1 -- 172.21.15.53:0/1438305302 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b5c01b3b0 con 0x7f2b64160350 2023-07-09T21:50:16.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.766+0000 7f2b617fa700 1 --2- 172.21.15.53:0/1438305302 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2b4806ace0 0x7f2b4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:16.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.766+0000 7f2b617fa700 1 -- 172.21.15.53:0/1438305302 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f2b5c088be0 con 0x7f2b64160350 2023-07-09T21:50:16.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.766+0000 7f2b68f9b700 1 --2- 172.21.15.53:0/1438305302 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2b4806ace0 0x7f2b4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:16.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.767+0000 7f2b68f9b700 1 --2- 172.21.15.53:0/1438305302 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2b4806ace0 0x7f2b4806d190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009d70 tx=0x7f2b58009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:16.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.770+0000 7f2b617fa700 1 -- 172.21.15.53:0/1438305302 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2b5c054130 con 0x7f2b64160350 2023-07-09T21:50:16.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:16.979+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/1438305302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2b640c7b80 con 0x7f2b64160350 2023-07-09T21:50:17.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.534+0000 7f2b617fa700 1 -- 172.21.15.53:0/1438305302 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v20) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2b5c057750 con 0x7f2b64160350 2023-07-09T21:50:17.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.538+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/1438305302 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2b4806ace0 msgr2=0x7f2b4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:17.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.538+0000 7f2b6b1ff700 1 --2- 172.21.15.53:0/1438305302 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2b4806ace0 0x7f2b4806d190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009d70 tx=0x7f2b58009210 comp rx=0 tx=0).stop 2023-07-09T21:50:17.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.538+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/1438305302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64160350 msgr2=0x7f2b640b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:17.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.538+0000 7f2b6b1ff700 1 --2- 172.21.15.53:0/1438305302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64160350 0x7f2b640b0590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00cb40 tx=0x7f2b5c00ce50 comp rx=0 tx=0).stop 2023-07-09T21:50:17.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.538+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/1438305302 shutdown_connections 2023-07-09T21:50:17.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.538+0000 7f2b6b1ff700 1 --2- 172.21.15.53:0/1438305302 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2b4806ace0 0x7f2b4806d190 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:17.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.538+0000 7f2b6b1ff700 1 --2- 172.21.15.53:0/1438305302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64160350 0x7f2b640b0590 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:17.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.538+0000 7f2b6b1ff700 1 --2- 172.21.15.53:0/1438305302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b640d0a30 0x7f2b640b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:17.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.538+0000 7f2b6b1ff700 1 --2- 172.21.15.53:0/1438305302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b640d28a0 0x7f2b640b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:17.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.538+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/1438305302 >> 172.21.15.53:0/1438305302 conn(0x7f2b6409c1b0 msgr2=0x7f2b640b8400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:17.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.538+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/1438305302 shutdown_connections 2023-07-09T21:50:17.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.538+0000 7f2b6b1ff700 1 -- 172.21.15.53:0/1438305302 wait complete. 2023-07-09T21:50:17.542 INFO:teuthology.orchestra.run.smithi053.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-09T21:50:17.560 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-09T21:50:17.560 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T21:50:17.561 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T21:50:17.565 INFO:tasks.ceph.mds.a:Started 2023-07-09T21:50:17.565 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T21:50:17.566 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T21:50:17.570 INFO:tasks.ceph.mds.c:Started 2023-07-09T21:50:17.571 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T21:50:17.571 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T21:50:17.576 INFO:tasks.ceph.mds.b:Started 2023-07-09T21:50:17.576 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T21:50:17.577 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T21:50:17.581 INFO:tasks.ceph.mds.d:Started 2023-07-09T21:50:17.581 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-09T21:50:17.582 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:50:17.723 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-07-09T21:50:17.725 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-07-09T21:50:17.727 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-07-09T21:50:17.728 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-07-09T21:50:17.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.795+0000 7f72225ff700 1 Processor -- start 2023-07-09T21:50:17.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.795+0000 7f72225ff700 1 -- start start 2023-07-09T21:50:17.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f72225ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f721c0b1e00 0x7f721c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:17.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f72225ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f721c0b2350 0x7f721c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:17.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f72225ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f721c0d1050 0x7f721c0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:17.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f72225ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0d14a0 con 0x7f721c0b2350 2023-07-09T21:50:17.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f72225ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0d2ce0 con 0x7f721c0d1050 2023-07-09T21:50:17.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f72225ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0b3350 con 0x7f721c0b1e00 2023-07-09T21:50:17.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f721b7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f721c0b2350 0x7f721c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:17.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f721b7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f721c0b2350 0x7f721c0d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46116/0 (socket says 172.21.15.53:46116) 2023-07-09T21:50:17.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f721b7fe700 1 -- 172.21.15.53:0/526092635 learned_addr learned my addr 172.21.15.53:0/526092635 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:17.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f721bfff700 1 --2- 172.21.15.53:0/526092635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f721c0b1e00 0x7f721c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f7220b9c700 1 --2- 172.21.15.53:0/526092635 >> v2:172.21.15.184:3300/0 conn(0x7f721c0d1050 0x7f721c0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f721b7fe700 1 -- 172.21.15.53:0/526092635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f721c0b1e00 msgr2=0x7f721c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f721b7fe700 1 --2- 172.21.15.53:0/526092635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f721c0b1e00 0x7f721c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f721b7fe700 1 -- 172.21.15.53:0/526092635 >> v2:172.21.15.184:3300/0 conn(0x7f721c0d1050 msgr2=0x7f721c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f721b7fe700 1 --2- 172.21.15.53:0/526092635 >> v2:172.21.15.184:3300/0 conn(0x7f721c0d1050 0x7f721c0afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f721b7fe700 1 -- 172.21.15.53:0/526092635 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c0b3630 con 0x7f721c0b2350 2023-07-09T21:50:17.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.797+0000 7f7220b9c700 1 --2- 172.21.15.53:0/526092635 >> v2:172.21.15.184:3300/0 conn(0x7f721c0d1050 0x7f721c0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:17.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.798+0000 7f721b7fe700 1 --2- 172.21.15.53:0/526092635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f721c0b2350 0x7f721c0d0b10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f721c0b3280 tx=0x7f7210009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320af9fd151970c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:17.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.798+0000 7f721affd700 1 -- 172.21.15.53:0/526092635 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210011830 con 0x7f721c0b2350 2023-07-09T21:50:17.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.798+0000 7f721affd700 1 -- 172.21.15.53:0/526092635 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7210011990 con 0x7f721c0b2350 2023-07-09T21:50:17.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.798+0000 7f721affd700 1 -- 172.21.15.53:0/526092635 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210011d20 con 0x7f721c0b2350 2023-07-09T21:50:17.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.798+0000 7f72225ff700 1 -- 172.21.15.53:0/526092635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f721c0b2350 msgr2=0x7f721c0d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:17.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.798+0000 7f72225ff700 1 --2- 172.21.15.53:0/526092635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f721c0b2350 0x7f721c0d0b10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f721c0b3280 tx=0x7f7210009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.798+0000 7f72225ff700 1 -- 172.21.15.53:0/526092635 shutdown_connections 2023-07-09T21:50:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.798+0000 7f72225ff700 1 --2- 172.21.15.53:0/526092635 >> v2:172.21.15.184:3300/0 conn(0x7f721c0d1050 0x7f721c0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.798+0000 7f72225ff700 1 --2- 172.21.15.53:0/526092635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f721c0b1e00 0x7f721c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.798+0000 7f72225ff700 1 --2- 172.21.15.53:0/526092635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f721c0b2350 0x7f721c0d0b10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.798+0000 7f72225ff700 1 -- 172.21.15.53:0/526092635 >> 172.21.15.53:0/526092635 conn(0x7f721c09c1d0 msgr2=0x7f721c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.799+0000 7f72225ff700 1 -- 172.21.15.53:0/526092635 shutdown_connections 2023-07-09T21:50:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.799+0000 7f72225ff700 1 -- 172.21.15.53:0/526092635 wait complete. 2023-07-09T21:50:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.800+0000 7f72225ff700 1 Processor -- start 2023-07-09T21:50:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.801+0000 7f72225ff700 1 -- start start 2023-07-09T21:50:17.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.801+0000 7f72225ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f721c0b1e00 0x7f721c0c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:17.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.801+0000 7f72225ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f721c0b2350 0x7f721c1f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:17.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f72225ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f721c0d1050 0x7f721c0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:17.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f72225ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c1f34d0 con 0x7f721c0b1e00 2023-07-09T21:50:17.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f72225ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0b70f0 con 0x7f721c0b2350 2023-07-09T21:50:17.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f72225ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0c6270 con 0x7f721c0d1050 2023-07-09T21:50:17.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f721bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f721c0b1e00 0x7f721c0c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:17.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f721bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f721c0b1e00 0x7f721c0c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46120/0 (socket says 172.21.15.53:46120) 2023-07-09T21:50:17.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f721bfff700 1 -- 172.21.15.53:0/848544896 learned_addr learned my addr 172.21.15.53:0/848544896 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:17.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f721b7fe700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f721c0b2350 0x7f721c1f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:17.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f7220b9c700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f721c0d1050 0x7f721c0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:17.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f721bfff700 1 -- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f721c0d1050 msgr2=0x7f721c0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:17.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f721bfff700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f721c0d1050 0x7f721c0cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:17.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f721bfff700 1 -- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f721c0b2350 msgr2=0x7f721c1f2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:17.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f721bfff700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f721c0b2350 0x7f721c1f2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:17.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.802+0000 7f721bfff700 1 -- 172.21.15.53:0/848544896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7210009550 con 0x7f721c0b1e00 2023-07-09T21:50:17.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.803+0000 7f721bfff700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f721c0b1e00 0x7f721c0c5d30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f720c00e870 tx=0x7f720c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:17.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.803+0000 7f7218ff9700 1 -- 172.21.15.53:0/848544896 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c005a20 con 0x7f721c0b1e00 2023-07-09T21:50:17.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.803+0000 7f7218ff9700 1 -- 172.21.15.53:0/848544896 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c005b80 con 0x7f721c0b1e00 2023-07-09T21:50:17.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.803+0000 7f72225ff700 1 -- 172.21.15.53:0/848544896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c0b6dc0 con 0x7f721c0b1e00 2023-07-09T21:50:17.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.803+0000 7f7218ff9700 1 -- 172.21.15.53:0/848544896 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c013680 con 0x7f721c0b1e00 2023-07-09T21:50:17.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.803+0000 7f72225ff700 1 -- 172.21.15.53:0/848544896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c1f2eb0 con 0x7f721c0b1e00 2023-07-09T21:50:17.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.804+0000 7f72225ff700 1 -- 172.21.15.53:0/848544896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c0b73d0 con 0x7f721c0b1e00 2023-07-09T21:50:17.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.805+0000 7f7218ff9700 1 -- 172.21.15.53:0/848544896 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f720c0137e0 con 0x7f721c0b1e00 2023-07-09T21:50:17.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.806+0000 7f7218ff9700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f720806ace0 0x7f720806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:17.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.806+0000 7f7218ff9700 1 -- 172.21.15.53:0/848544896 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f720c089220 con 0x7f721c0b1e00 2023-07-09T21:50:17.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.806+0000 7f721b7fe700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f720806ace0 0x7f720806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:17.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.807+0000 7f721b7fe700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f720806ace0 0x7f720806d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7210009840 tx=0x7f7210008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:17.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:17.810+0000 7f7218ff9700 1 -- 172.21.15.53:0/848544896 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f720c058020 con 0x7f721c0b1e00 2023-07-09T21:50:18.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.019+0000 7f72225ff700 1 -- 172.21.15.53:0/848544896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f721c04e280 con 0x7f721c0b1e00 2023-07-09T21:50:18.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.020+0000 7f7218ff9700 1 -- 172.21.15.53:0/848544896 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14625 (secure 0 0 0) 0x7f720c057bb0 con 0x7f721c0b1e00 2023-07-09T21:50:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:18.022 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:17.527375+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:50:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.023+0000 7f72225ff700 1 -- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f720806ace0 msgr2=0x7f720806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.023+0000 7f72225ff700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f720806ace0 0x7f720806d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7210009840 tx=0x7f7210008030 comp rx=0 tx=0).stop 2023-07-09T21:50:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.023+0000 7f72225ff700 1 -- 172.21.15.53:0/848544896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f721c0b1e00 msgr2=0x7f721c0c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.023+0000 7f72225ff700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f721c0b1e00 0x7f721c0c5d30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f720c00e870 tx=0x7f720c00eb80 comp rx=0 tx=0).stop 2023-07-09T21:50:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.023+0000 7f72225ff700 1 -- 172.21.15.53:0/848544896 shutdown_connections 2023-07-09T21:50:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.023+0000 7f72225ff700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f720806ace0 0x7f720806d190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.023+0000 7f72225ff700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f721c0d1050 0x7f721c0cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.023+0000 7f72225ff700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f721c0b1e00 0x7f721c0c5d30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.023+0000 7f72225ff700 1 --2- 172.21.15.53:0/848544896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f721c0b2350 0x7f721c1f2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.023+0000 7f72225ff700 1 -- 172.21.15.53:0/848544896 >> 172.21.15.53:0/848544896 conn(0x7f721c09c1d0 msgr2=0x7f721c1555b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.023+0000 7f72225ff700 1 -- 172.21.15.53:0/848544896 shutdown_connections 2023-07-09T21:50:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.023+0000 7f72225ff700 1 -- 172.21.15.53:0/848544896 wait complete. 2023-07-09T21:50:18.042 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:50:18.043 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:50:18.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.244+0000 7effcdfff700 1 Processor -- start 2023-07-09T21:50:18.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.244+0000 7effcdfff700 1 -- start start 2023-07-09T21:50:18.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.245+0000 7effcdfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7effc80d1220 0x7effc80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.245+0000 7effcdfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 0x7effc80b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.245+0000 7effcdfff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc80b8e80 con 0x7effc80b3ff0 2023-07-09T21:50:18.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.245+0000 7effcdfff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc80afaa0 con 0x7effc80d1220 2023-07-09T21:50:18.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.245+0000 7effcdfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc80afd80 con 0x7effc80b0e20 2023-07-09T21:50:18.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc77fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7effc80b3ff0 0x7effc80d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45544/0 (socket says 172.21.15.53:45544) 2023-07-09T21:50:18.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc77fe700 1 -- 172.21.15.53:0/3034210144 learned_addr learned my addr 172.21.15.53:0/3034210144 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:18.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc7fff700 1 --2- 172.21.15.53:0/3034210144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 0x7effc80b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617347369 0 0) 0x7effb8001110 con 0x7effc80b3ff0 2023-07-09T21:50:18.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc6ffd700 1 --2- 172.21.15.53:0/3034210144 >> v2:172.21.15.184:3300/0 conn(0x7effc80d1220 0x7effc80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effb00035b0 con 0x7effc80b3ff0 2023-07-09T21:50:18.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2982100301 0 0) 0x7effb00035b0 con 0x7effc80b3ff0 2023-07-09T21:50:18.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 msgr2=0x7effc80b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:18.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc67fc700 1 --2- 172.21.15.53:0/3034210144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 0x7effc80b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 >> v2:172.21.15.184:3300/0 conn(0x7effc80d1220 msgr2=0x7effc80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:18.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc67fc700 1 --2- 172.21.15.53:0/3034210144 >> v2:172.21.15.184:3300/0 conn(0x7effc80d1220 0x7effc80b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80b0060 con 0x7effc80b3ff0 2023-07-09T21:50:18.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7effb8001800 con 0x7effc80b3ff0 2023-07-09T21:50:18.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.246+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 >> v1:172.21.15.53:6789/0 conn(0x7effc80b3ff0 legacy=0x7effc80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:18.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc67fc700 1 --2- 172.21.15.53:0/3034210144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7effb0003a00 0x7effb0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc67fc700 1 --2- 172.21.15.53:0/3034210144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 0x7effb0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc67fc700 1 --2- 172.21.15.53:0/3034210144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effb0004d90 0x7effb0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80afaa0 con 0x7effb0004d90 2023-07-09T21:50:18.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80afd80 con 0x7effb0003a00 2023-07-09T21:50:18.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb000ba40 con 0x7effc80b0e20 2023-07-09T21:50:18.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc77fe700 1 --2- 172.21.15.53:0/3034210144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7effb0003a00 0x7effb0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc6ffd700 1 --2- 172.21.15.53:0/3034210144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 0x7effb0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc7fff700 1 --2- 172.21.15.53:0/3034210144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effb0004d90 0x7effb0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc6ffd700 1 -- 172.21.15.53:0/3034210144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7effb0003a00 msgr2=0x7effb0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:18.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc6ffd700 1 --2- 172.21.15.53:0/3034210144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7effb0003a00 0x7effb0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc6ffd700 1 -- 172.21.15.53:0/3034210144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effb0004d90 msgr2=0x7effb0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:18.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc6ffd700 1 --2- 172.21.15.53:0/3034210144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effb0004d90 0x7effb0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc6ffd700 1 -- 172.21.15.53:0/3034210144 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb00035b0 con 0x7effc80b0e20 2023-07-09T21:50:18.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.247+0000 7effc6ffd700 1 --2- 172.21.15.53:0/3034210144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 0x7effb0004850 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7effbc009b60 tx=0x7effb0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db203673d3308aca server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:18.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.248+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc00e660 con 0x7effc80b0e20 2023-07-09T21:50:18.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.248+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc00e7c0 con 0x7effc80b0e20 2023-07-09T21:50:18.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.248+0000 7effc67fc700 1 -- 172.21.15.53:0/3034210144 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc00eb30 con 0x7effc80b0e20 2023-07-09T21:50:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.248+0000 7effcdfff700 1 -- 172.21.15.53:0/3034210144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 msgr2=0x7effb0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.248+0000 7effcdfff700 1 --2- 172.21.15.53:0/3034210144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 0x7effb0004850 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7effbc009b60 tx=0x7effb0005880 comp rx=0 tx=0).stop 2023-07-09T21:50:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.248+0000 7effc7fff700 1 -- 172.21.15.53:0/3034210144 reap_dead start 2023-07-09T21:50:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.248+0000 7effcdfff700 1 -- 172.21.15.53:0/3034210144 shutdown_connections 2023-07-09T21:50:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.248+0000 7effcdfff700 1 -- 172.21.15.53:0/3034210144 >> 172.21.15.53:0/3034210144 conn(0x7effc809c1b0 msgr2=0x7effc80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.248+0000 7effcdfff700 1 -- 172.21.15.53:0/3034210144 shutdown_connections 2023-07-09T21:50:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.248+0000 7effcdfff700 1 -- 172.21.15.53:0/3034210144 wait complete. 2023-07-09T21:50:18.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.250+0000 7effcdfff700 1 Processor -- start 2023-07-09T21:50:18.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.251+0000 7effcdfff700 1 -- start start 2023-07-09T21:50:18.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.251+0000 7effcdfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 0x7effc80cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.251+0000 7effcdfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7effc815a870 0x7effc80d0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effcdfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effc80b43c0 0x7effc80b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effcdfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80b4d70 con 0x7effc80b43c0 2023-07-09T21:50:18.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effcdfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80d0850 con 0x7effc815a870 2023-07-09T21:50:18.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effcdfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc80cdbe0 con 0x7effc80b0e20 2023-07-09T21:50:18.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effc7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effc80b43c0 0x7effc80b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effc7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effc80b43c0 0x7effc80b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46150/0 (socket says 172.21.15.53:46150) 2023-07-09T21:50:18.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effc7fff700 1 -- 172.21.15.53:0/376498792 learned_addr learned my addr 172.21.15.53:0/376498792 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:18.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effc77fe700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 0x7effc80cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effc6ffd700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7effc815a870 0x7effc80d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effc7fff700 1 -- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 msgr2=0x7effc80cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:18.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effc7fff700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 0x7effc80cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effc7fff700 1 -- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7effc815a870 msgr2=0x7effc80d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:18.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effc7fff700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7effc815a870 0x7effc80d0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effc7fff700 1 -- 172.21.15.53:0/376498792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80cdec0 con 0x7effc80b43c0 2023-07-09T21:50:18.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effc77fe700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 0x7effc80cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:50:18.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.252+0000 7effc7fff700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effc80b43c0 0x7effc80b4830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7effc808d250 tx=0x7effc0011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:18.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.253+0000 7effaffff700 1 -- 172.21.15.53:0/376498792 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000e040 con 0x7effc80b43c0 2023-07-09T21:50:18.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.253+0000 7effaffff700 1 -- 172.21.15.53:0/376498792 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc000f040 con 0x7effc80b43c0 2023-07-09T21:50:18.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.253+0000 7effcdfff700 1 -- 172.21.15.53:0/376498792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc80ca0b0 con 0x7effc80b43c0 2023-07-09T21:50:18.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.253+0000 7effaffff700 1 -- 172.21.15.53:0/376498792 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000f8f0 con 0x7effc80b43c0 2023-07-09T21:50:18.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.253+0000 7effcdfff700 1 -- 172.21.15.53:0/376498792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc815ace0 con 0x7effc80b43c0 2023-07-09T21:50:18.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.254+0000 7effcdfff700 1 -- 172.21.15.53:0/376498792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc8074350 con 0x7effc80b43c0 2023-07-09T21:50:18.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.255+0000 7effaffff700 1 -- 172.21.15.53:0/376498792 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7effc000fa50 con 0x7effc80b43c0 2023-07-09T21:50:18.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.256+0000 7effaffff700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7effb406ace0 0x7effb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.256+0000 7effaffff700 1 -- 172.21.15.53:0/376498792 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7effc0089550 con 0x7effc80b43c0 2023-07-09T21:50:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.256+0000 7effc77fe700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7effb406ace0 0x7effb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.257+0000 7effc77fe700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7effb406ace0 0x7effb406d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7effb8000fb0 tx=0x7effb8007a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.260+0000 7effaffff700 1 -- 172.21.15.53:0/376498792 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7effc00548b0 con 0x7effc80b43c0 2023-07-09T21:50:18.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.470+0000 7effcdfff700 1 -- 172.21.15.53:0/376498792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7effc8073800 con 0x7effc80b43c0 2023-07-09T21:50:18.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.470+0000 7effaffff700 1 -- 172.21.15.53:0/376498792 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7effc0057ed0 con 0x7effc80b43c0 2023-07-09T21:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:50:18.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.472+0000 7effcdfff700 1 -- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7effb406ace0 msgr2=0x7effb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:18.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.472+0000 7effcdfff700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7effb406ace0 0x7effb406d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7effb8000fb0 tx=0x7effb8007a30 comp rx=0 tx=0).stop 2023-07-09T21:50:18.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.472+0000 7effcdfff700 1 -- 172.21.15.53:0/376498792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effc80b43c0 msgr2=0x7effc80b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:18.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.472+0000 7effcdfff700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effc80b43c0 0x7effc80b4830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7effc808d250 tx=0x7effc0011eb0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.472+0000 7effcdfff700 1 -- 172.21.15.53:0/376498792 shutdown_connections 2023-07-09T21:50:18.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.472+0000 7effcdfff700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7effb406ace0 0x7effb406d190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.472+0000 7effcdfff700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effc80b43c0 0x7effc80b4830 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.472+0000 7effcdfff700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7effc80b0e20 0x7effc80cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.472+0000 7effcdfff700 1 --2- 172.21.15.53:0/376498792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7effc815a870 0x7effc80d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.472+0000 7effcdfff700 1 -- 172.21.15.53:0/376498792 >> 172.21.15.53:0/376498792 conn(0x7effc809c1b0 msgr2=0x7effc80d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:18.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.472+0000 7effcdfff700 1 -- 172.21.15.53:0/376498792 shutdown_connections 2023-07-09T21:50:18.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.472+0000 7effcdfff700 1 -- 172.21.15.53:0/376498792 wait complete. 2023-07-09T21:50:18.491 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:50:18.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.710+0000 7f1fc3fff700 1 Processor -- start 2023-07-09T21:50:18.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.710+0000 7f1fc3fff700 1 -- start start 2023-07-09T21:50:18.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.711+0000 7f1fc3fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1fbc0b3ff0 0x7f1fbc0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.711+0000 7f1fc3fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1fbc0d0b10 0x7f1fbc0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.711+0000 7f1fc3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fbc0b25d0 0x7f1fbc0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.711+0000 7f1fc3fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fbc0d14d0 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.711+0000 7f1fc3fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fbc0b8e80 con 0x7f1fbc0d0b10 2023-07-09T21:50:18.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.711+0000 7f1fc3fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc0afaa0 con 0x7f1fbc0b25d0 2023-07-09T21:50:18.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.711+0000 7f1fc1d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1fbc0b3ff0 0x7f1fbc0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.711+0000 7f1fc1d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1fbc0b3ff0 0x7f1fbc0b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46154/0 (socket says 172.21.15.53:46154) 2023-07-09T21:50:18.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.711+0000 7f1fc1d9b700 1 -- 172.21.15.53:0/1317777593 learned_addr learned my addr 172.21.15.53:0/1317777593 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:18.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.712+0000 7f1fc159a700 1 --2- 172.21.15.53:0/1317777593 >> v2:172.21.15.184:3300/0 conn(0x7f1fbc0d0b10 0x7f1fbc0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.712+0000 7f1fc259c700 1 --2- 172.21.15.53:0/1317777593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fbc0b25d0 0x7f1fbc0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.712+0000 7f1fc1d9b700 1 -- 172.21.15.53:0/1317777593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fbc0b25d0 msgr2=0x7f1fbc0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:18.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.712+0000 7f1fc1d9b700 1 --2- 172.21.15.53:0/1317777593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fbc0b25d0 0x7f1fbc0b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.712+0000 7f1fc1d9b700 1 -- 172.21.15.53:0/1317777593 >> v2:172.21.15.184:3300/0 conn(0x7f1fbc0d0b10 msgr2=0x7f1fbc0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:18.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.712+0000 7f1fc1d9b700 1 --2- 172.21.15.53:0/1317777593 >> v2:172.21.15.184:3300/0 conn(0x7f1fbc0d0b10 0x7f1fbc0d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.712+0000 7f1fc1d9b700 1 -- 172.21.15.53:0/1317777593 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc0afd80 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.712+0000 7f1fc1d9b700 1 --2- 172.21.15.53:0/1317777593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc0b3ff0 0x7f1fbc0b43c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc09c8e0 tx=0x7f1fb8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149275e3e4aa16a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.712+0000 7f1fc0d99700 1 -- 172.21.15.53:0/1317777593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800b870 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.712+0000 7f1fc0d99700 1 -- 172.21.15.53:0/1317777593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb800b9d0 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.712+0000 7f1fc0d99700 1 -- 172.21.15.53:0/1317777593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800bd60 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.713+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1317777593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc0b3ff0 msgr2=0x7f1fbc0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.713+0000 7f1fc3fff700 1 --2- 172.21.15.53:0/1317777593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc0b3ff0 0x7f1fbc0b43c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc09c8e0 tx=0x7f1fb8009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.713+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1317777593 shutdown_connections 2023-07-09T21:50:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.713+0000 7f1fc3fff700 1 --2- 172.21.15.53:0/1317777593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fbc0b25d0 0x7f1fbc0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.713+0000 7f1fc3fff700 1 --2- 172.21.15.53:0/1317777593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc0b3ff0 0x7f1fbc0b43c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.713+0000 7f1fc3fff700 1 --2- 172.21.15.53:0/1317777593 >> v2:172.21.15.184:3300/0 conn(0x7f1fbc0d0b10 0x7f1fbc0d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.713+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1317777593 >> 172.21.15.53:0/1317777593 conn(0x7f1fbc09c1b0 msgr2=0x7f1fbc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:18.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.713+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1317777593 shutdown_connections 2023-07-09T21:50:18.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.713+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1317777593 wait complete. 2023-07-09T21:50:18.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.715+0000 7f1fc3fff700 1 Processor -- start 2023-07-09T21:50:18.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.715+0000 7f1fc3fff700 1 -- start start 2023-07-09T21:50:18.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fbc0b25d0 0x7f1fbc15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc0b3ff0 0x7f1fbc0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc3fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fbc0d0b10 0x7f1fbc0ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc3fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc0cd570 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc3fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc09d980 con 0x7f1fbc0d0b10 2023-07-09T21:50:18.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc3fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc0cab80 con 0x7f1fbc0b25d0 2023-07-09T21:50:18.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc159a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc0b3ff0 0x7f1fbc0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc159a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc0b3ff0 0x7f1fbc0ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46160/0 (socket says 172.21.15.53:46160) 2023-07-09T21:50:18.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc159a700 1 -- 172.21.15.53:0/1493215729 learned_addr learned my addr 172.21.15.53:0/1493215729 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:18.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc1d9b700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fbc0b25d0 0x7f1fbc15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc259c700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fbc0d0b10 0x7f1fbc0ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc159a700 1 -- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fbc0b25d0 msgr2=0x7f1fbc15b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:18.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc159a700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fbc0b25d0 0x7f1fbc15b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.716+0000 7f1fc159a700 1 -- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fbc0d0b10 msgr2=0x7f1fbc0ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:18.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.717+0000 7f1fc159a700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fbc0d0b10 0x7f1fbc0ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.717+0000 7f1fc159a700 1 -- 172.21.15.53:0/1493215729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb8009550 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.717+0000 7f1fc159a700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc0b3ff0 0x7f1fbc0ca010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00d830 tx=0x7f1fac00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:18.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.717+0000 7f1fb27fc700 1 -- 172.21.15.53:0/1493215729 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0125f0 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.717+0000 7f1fb27fc700 1 -- 172.21.15.53:0/1493215729 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac012750 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.717+0000 7f1fb27fc700 1 -- 172.21.15.53:0/1493215729 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac012b00 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.717+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1493215729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fbc0cae60 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.717+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1493215729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fbc0cd7c0 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.718+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1493215729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fbc0cd980 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.719+0000 7f1fb27fc700 1 -- 172.21.15.53:0/1493215729 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1fac012c60 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.721+0000 7f1fb27fc700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1fa006ace0 0x7f1fa006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:18.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.721+0000 7f1fb27fc700 1 -- 172.21.15.53:0/1493215729 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1fac0894b0 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.721+0000 7f1fc1d9b700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1fa006ace0 0x7f1fa006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:18.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.722+0000 7f1fc1d9b700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1fa006ace0 0x7f1fa006d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8000c00 tx=0x7f1fb8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:18.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.725+0000 7f1fb27fc700 1 -- 172.21.15.53:0/1493215729 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1fac054820 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.931+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1493215729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1fbc0cdb30 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.931+0000 7f1fb27fc700 1 -- 172.21.15.53:0/1493215729 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1fac057e40 con 0x7f1fbc0b3ff0 2023-07-09T21:50:18.934 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:50:18.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.934+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1fa006ace0 msgr2=0x7f1fa006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:18.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.934+0000 7f1fc3fff700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1fa006ace0 0x7f1fa006d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8000c00 tx=0x7f1fb8008030 comp rx=0 tx=0).stop 2023-07-09T21:50:18.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.934+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1493215729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc0b3ff0 msgr2=0x7f1fbc0ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:18.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.934+0000 7f1fc3fff700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc0b3ff0 0x7f1fbc0ca010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00d830 tx=0x7f1fac00db40 comp rx=0 tx=0).stop 2023-07-09T21:50:18.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.934+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1493215729 shutdown_connections 2023-07-09T21:50:18.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.934+0000 7f1fc3fff700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1fa006ace0 0x7f1fa006d190 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.934+0000 7f1fc3fff700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fbc0d0b10 0x7f1fbc0ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.934+0000 7f1fc3fff700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fbc0b25d0 0x7f1fbc15b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.934+0000 7f1fc3fff700 1 --2- 172.21.15.53:0/1493215729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc0b3ff0 0x7f1fbc0ca010 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:18.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.934+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1493215729 >> 172.21.15.53:0/1493215729 conn(0x7f1fbc09c1b0 msgr2=0x7f1fbc06b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:18.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.934+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1493215729 shutdown_connections 2023-07-09T21:50:18.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:18.934+0000 7f1fc3fff700 1 -- 172.21.15.53:0/1493215729 wait complete. 2023-07-09T21:50:18.954 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:50:19.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.151+0000 7f82c95ff700 1 Processor -- start 2023-07-09T21:50:19.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.151+0000 7f82c95ff700 1 -- start start 2023-07-09T21:50:19.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.152+0000 7f82c95ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f82c40cf510 0x7f82c4069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.152+0000 7f82c95ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c40cf8e0 con 0x7f82c406a470 2023-07-09T21:50:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.152+0000 7f82c95ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c40cd320 con 0x7f82c406db30 2023-07-09T21:50:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.152+0000 7f82c95ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c40ce750 con 0x7f82c40cf510 2023-07-09T21:50:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.153+0000 7f82c27fc700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f82c406a470 0x7f82c406d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45552/0 (socket says 172.21.15.53:45552) 2023-07-09T21:50:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.153+0000 7f82c27fc700 1 -- 172.21.15.53:0/1876088202 learned_addr learned my addr 172.21.15.53:0/1876088202 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:19.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.153+0000 7f82c2ffd700 1 --2- 172.21.15.53:0/1876088202 >> v2:172.21.15.184:3300/0 conn(0x7f82c40cf510 0x7f82c4069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.153+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775535724 0 0) 0x7f82c40cf8e0 con 0x7f82c406a470 2023-07-09T21:50:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.153+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82ac0035b0 con 0x7f82c406a470 2023-07-09T21:50:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.153+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1024122602 0 0) 0x7f82ac0035b0 con 0x7f82c406a470 2023-07-09T21:50:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.153+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 >> v2:172.21.15.184:3300/0 conn(0x7f82c40cf510 msgr2=0x7f82c4069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.153+0000 7f82c1ffb700 1 --2- 172.21.15.53:0/1876088202 >> v2:172.21.15.184:3300/0 conn(0x7f82c40cf510 0x7f82c4069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.153+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 >> v1:172.21.15.184:6789/0 conn(0x7f82c406db30 legacy=0x7f82c4070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.153+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c40cea30 con 0x7f82c406a470 2023-07-09T21:50:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.153+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f82b8001670 con 0x7f82c406a470 2023-07-09T21:50:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.153+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 >> v1:172.21.15.53:6789/0 conn(0x7f82c406a470 legacy=0x7f82c406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c1ffb700 1 --2- 172.21.15.53:0/1876088202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ac003a00 0x7f82ac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c1ffb700 1 --2- 172.21.15.53:0/1876088202 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82ac004850 0x7f82ac004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c1ffb700 1 --2- 172.21.15.53:0/1876088202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82ac005200 0x7f82ac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c40ce750 con 0x7f82ac003a00 2023-07-09T21:50:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac00c080 con 0x7f82ac005200 2023-07-09T21:50:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac00c240 con 0x7f82ac004850 2023-07-09T21:50:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c2ffd700 1 --2- 172.21.15.53:0/1876088202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ac003a00 0x7f82ac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c27fc700 1 --2- 172.21.15.53:0/1876088202 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82ac004850 0x7f82ac004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c37fe700 1 --2- 172.21.15.53:0/1876088202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82ac005200 0x7f82ac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c2ffd700 1 -- 172.21.15.53:0/1876088202 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82ac004850 msgr2=0x7f82ac004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c2ffd700 1 --2- 172.21.15.53:0/1876088202 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82ac004850 0x7f82ac004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c2ffd700 1 -- 172.21.15.53:0/1876088202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82ac005200 msgr2=0x7f82ac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c2ffd700 1 --2- 172.21.15.53:0/1876088202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82ac005200 0x7f82ac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c2ffd700 1 -- 172.21.15.53:0/1876088202 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac0035b0 con 0x7f82ac003a00 2023-07-09T21:50:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c37fe700 1 -- 172.21.15.53:0/1876088202 reap_dead start 2023-07-09T21:50:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c27fc700 1 --2- 172.21.15.53:0/1876088202 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82ac004850 0x7f82ac004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.154+0000 7f82c2ffd700 1 --2- 172.21.15.53:0/1876088202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ac003a00 0x7f82ac003e10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009b60 tx=0x7f82ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47076b1553f20286 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.155+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b400e6c0 con 0x7f82ac003a00 2023-07-09T21:50:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.155+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b400e820 con 0x7f82ac003a00 2023-07-09T21:50:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.155+0000 7f82c1ffb700 1 -- 172.21.15.53:0/1876088202 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b400eb90 con 0x7f82ac003a00 2023-07-09T21:50:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.155+0000 7f82c95ff700 1 -- 172.21.15.53:0/1876088202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ac003a00 msgr2=0x7f82ac003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.155+0000 7f82c95ff700 1 --2- 172.21.15.53:0/1876088202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ac003a00 0x7f82ac003e10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009b60 tx=0x7f82ac005880 comp rx=0 tx=0).stop 2023-07-09T21:50:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.155+0000 7f82c95ff700 1 -- 172.21.15.53:0/1876088202 shutdown_connections 2023-07-09T21:50:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.155+0000 7f82c95ff700 1 --2- 172.21.15.53:0/1876088202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ac003a00 0x7f82ac003e10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.155+0000 7f82c95ff700 1 -- 172.21.15.53:0/1876088202 >> 172.21.15.53:0/1876088202 conn(0x7f82c40b16c0 msgr2=0x7f82c40b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.155+0000 7f82c95ff700 1 -- 172.21.15.53:0/1876088202 shutdown_connections 2023-07-09T21:50:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.155+0000 7f82c95ff700 1 -- 172.21.15.53:0/1876088202 wait complete. 2023-07-09T21:50:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.157+0000 7f82c95ff700 1 Processor -- start 2023-07-09T21:50:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.157+0000 7f82c95ff700 1 -- start start 2023-07-09T21:50:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.158+0000 7f82c95ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82ac003a00 0x7f82c415aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.158+0000 7f82c95ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c4152840 0x7f82c4152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.158+0000 7f82c95ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82c4151cb0 0x7f82c4152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.158+0000 7f82c95ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c4152670 con 0x7f82c4152840 2023-07-09T21:50:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.158+0000 7f82c95ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c415fbe0 con 0x7f82ac003a00 2023-07-09T21:50:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.158+0000 7f82c95ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c415f620 con 0x7f82c4151cb0 2023-07-09T21:50:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.158+0000 7f82c27fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c4152840 0x7f82c4152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.158+0000 7f82c27fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c4152840 0x7f82c4152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46178/0 (socket says 172.21.15.53:46178) 2023-07-09T21:50:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.158+0000 7f82c27fc700 1 -- 172.21.15.53:0/2253297322 learned_addr learned my addr 172.21.15.53:0/2253297322 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82c2ffd700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82ac003a00 0x7f82c415aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82c27fc700 1 -- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82c4151cb0 msgr2=0x7f82c4152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82c37fe700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82c4151cb0 0x7f82c4152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82c27fc700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82c4151cb0 0x7f82c4152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82c27fc700 1 -- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82ac003a00 msgr2=0x7f82c415aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82c27fc700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82ac003a00 0x7f82c415aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82c27fc700 1 -- 172.21.15.53:0/2253297322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c415f900 con 0x7f82c4152840 2023-07-09T21:50:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82c2ffd700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82ac003a00 0x7f82c415aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82c37fe700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82c4151cb0 0x7f82c4152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82c27fc700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c4152840 0x7f82c4152cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f82b800e780 tx=0x7f82b800eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82ab7fe700 1 -- 172.21.15.53:0/2253297322 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8012590 con 0x7f82c4152840 2023-07-09T21:50:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82ab7fe700 1 -- 172.21.15.53:0/2253297322 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b80126f0 con 0x7f82c4152840 2023-07-09T21:50:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82ab7fe700 1 -- 172.21.15.53:0/2253297322 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8012a60 con 0x7f82c4152840 2023-07-09T21:50:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.159+0000 7f82c95ff700 1 -- 172.21.15.53:0/2253297322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c40b3c90 con 0x7f82c4152840 2023-07-09T21:50:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.160+0000 7f82c95ff700 1 -- 172.21.15.53:0/2253297322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c415d270 con 0x7f82c4152840 2023-07-09T21:50:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.161+0000 7f82c95ff700 1 -- 172.21.15.53:0/2253297322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c40b3af0 con 0x7f82c4152840 2023-07-09T21:50:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.161+0000 7f82ab7fe700 1 -- 172.21.15.53:0/2253297322 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f82b8012bc0 con 0x7f82c4152840 2023-07-09T21:50:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.162+0000 7f82ab7fe700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f82b006ace0 0x7f82b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.163+0000 7f82ab7fe700 1 -- 172.21.15.53:0/2253297322 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f82b8088f90 con 0x7f82c4152840 2023-07-09T21:50:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.163+0000 7f82c2ffd700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f82b006ace0 0x7f82b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.164+0000 7f82c2ffd700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f82b006ace0 0x7f82b006d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f82b40090b0 tx=0x7f82b4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.167+0000 7f82ab7fe700 1 -- 172.21.15.53:0/2253297322 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f82c40b3af0 con 0x7f82c4152840 2023-07-09T21:50:19.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.420+0000 7f82c95ff700 1 -- 172.21.15.53:0/2253297322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82c40b41b0 con 0x7f82c4152840 2023-07-09T21:50:19.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.421+0000 7f82ab7fe700 1 -- 172.21.15.53:0/2253297322 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f82c40b41b0 con 0x7f82c4152840 2023-07-09T21:50:19.423 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:19.424 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3421374491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3421374491},{"type":"v1","addr":"172.21.15.53:6835","nonce":3421374491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1569539203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":1569539203},{"type":"v1","addr":"172.21.15.184:6837","nonce":1569539203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3569510065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3569510065},{"type":"v1","addr":"172.21.15.53:6834","nonce":3569510065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4306,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/3002520227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3002520227},{"type":"v1","addr":"172.21.15.184:6836","nonce":3002520227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-09T21:50:19.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.423+0000 7f82c95ff700 1 -- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f82b006ace0 msgr2=0x7f82b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.423+0000 7f82c95ff700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f82b006ace0 0x7f82b006d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f82b40090b0 tx=0x7f82b4008030 comp rx=0 tx=0).stop 2023-07-09T21:50:19.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.423+0000 7f82c95ff700 1 -- 172.21.15.53:0/2253297322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c4152840 msgr2=0x7f82c4152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.423+0000 7f82c95ff700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c4152840 0x7f82c4152cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f82b800e780 tx=0x7f82b800eb40 comp rx=0 tx=0).stop 2023-07-09T21:50:19.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.423+0000 7f82c95ff700 1 -- 172.21.15.53:0/2253297322 shutdown_connections 2023-07-09T21:50:19.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.423+0000 7f82c95ff700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f82b006ace0 0x7f82b006d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.423+0000 7f82c95ff700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82c4151cb0 0x7f82c4152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.423+0000 7f82c95ff700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82ac003a00 0x7f82c415aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.423+0000 7f82c95ff700 1 --2- 172.21.15.53:0/2253297322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c4152840 0x7f82c4152cb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.423+0000 7f82c95ff700 1 -- 172.21.15.53:0/2253297322 >> 172.21.15.53:0/2253297322 conn(0x7f82c40b16c0 msgr2=0x7f82c406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:19.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.423+0000 7f82c95ff700 1 -- 172.21.15.53:0/2253297322 shutdown_connections 2023-07-09T21:50:19.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.424+0000 7f82c95ff700 1 -- 172.21.15.53:0/2253297322 wait complete. 2023-07-09T21:50:19.427 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 3 2023-07-09T21:50:19.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:50:19.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.642+0000 7f00b35ff700 1 Processor -- start 2023-07-09T21:50:19.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.642+0000 7f00b35ff700 1 -- start start 2023-07-09T21:50:19.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.643+0000 7f00b35ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f00ac0d1220 0x7f00ac0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:19.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.643+0000 7f00b35ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ac0d2ce0 con 0x7f00ac0b1e00 2023-07-09T21:50:19.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.643+0000 7f00b35ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ac0b3350 con 0x7f00ac0b2350 2023-07-09T21:50:19.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.643+0000 7f00b35ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00ac0b3630 con 0x7f00ac0d1220 2023-07-09T21:50:19.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.643+0000 7f00b139b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f00ac0b1e00 0x7f00ac0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45554/0 (socket says 172.21.15.53:45554) 2023-07-09T21:50:19.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.643+0000 7f00b139b700 1 -- 172.21.15.53:0/3167890969 learned_addr learned my addr 172.21.15.53:0/3167890969 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:19.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.643+0000 7f00b0b9a700 1 --2- 172.21.15.53:0/3167890969 >> v2:172.21.15.53:3300/0 conn(0x7f00ac0d1220 0x7f00ac0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:19.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.644+0000 7f00a3fff700 1 -- 172.21.15.53:0/3167890969 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071409864 0 0) 0x7f00ac0d2ce0 con 0x7f00ac0b1e00 2023-07-09T21:50:19.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.644+0000 7f00a3fff700 1 -- 172.21.15.53:0/3167890969 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00980035b0 con 0x7f00ac0b1e00 2023-07-09T21:50:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.644+0000 7f00b0b9a700 1 -- 172.21.15.53:0/3167890969 >> v1:172.21.15.184:6789/0 conn(0x7f00ac0b2350 legacy=0x7f00ac0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.644+0000 7f00b0b9a700 1 -- 172.21.15.53:0/3167890969 >> v1:172.21.15.53:6789/0 conn(0x7f00ac0b1e00 legacy=0x7f00ac0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.644+0000 7f00b0b9a700 1 -- 172.21.15.53:0/3167890969 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ac0b3910 con 0x7f00ac0d1220 2023-07-09T21:50:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.644+0000 7f00b0b9a700 1 --2- 172.21.15.53:0/3167890969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ac0d1220 0x7f00ac0b43f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f009c009840 tx=0x7f009c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fc352de020b022 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.644+0000 7f00a3fff700 1 -- 172.21.15.53:0/3167890969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c011830 con 0x7f00ac0d1220 2023-07-09T21:50:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.644+0000 7f00a3fff700 1 -- 172.21.15.53:0/3167890969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c011990 con 0x7f00ac0d1220 2023-07-09T21:50:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.644+0000 7f00a3fff700 1 -- 172.21.15.53:0/3167890969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c011d20 con 0x7f00ac0d1220 2023-07-09T21:50:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.645+0000 7f00b35ff700 1 -- 172.21.15.53:0/3167890969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ac0d1220 msgr2=0x7f00ac0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.645+0000 7f00b35ff700 1 --2- 172.21.15.53:0/3167890969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ac0d1220 0x7f00ac0b43f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f009c009840 tx=0x7f009c009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.645+0000 7f00b35ff700 1 -- 172.21.15.53:0/3167890969 shutdown_connections 2023-07-09T21:50:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.645+0000 7f00b35ff700 1 --2- 172.21.15.53:0/3167890969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ac0d1220 0x7f00ac0b43f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.645+0000 7f00b35ff700 1 -- 172.21.15.53:0/3167890969 >> 172.21.15.53:0/3167890969 conn(0x7f00ac09c1d0 msgr2=0x7f00ac0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.645+0000 7f00b35ff700 1 -- 172.21.15.53:0/3167890969 shutdown_connections 2023-07-09T21:50:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.645+0000 7f00b35ff700 1 -- 172.21.15.53:0/3167890969 wait complete. 2023-07-09T21:50:19.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.647+0000 7f00b35ff700 1 Processor -- start 2023-07-09T21:50:19.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.647+0000 7f00b35ff700 1 -- start start 2023-07-09T21:50:19.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.648+0000 7f00b35ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00ac0b1e00 0x7f00ac14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:19.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.648+0000 7f00b35ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ac0b2350 0x7f00ac0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.648+0000 7f00b35ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ac0d1220 0x7f00ac0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.648+0000 7f00b35ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac0ca010 con 0x7f00ac0d1220 2023-07-09T21:50:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.648+0000 7f00b35ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac14bc90 con 0x7f00ac0b2350 2023-07-09T21:50:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.648+0000 7f00b35ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac0ca1f0 con 0x7f00ac0b1e00 2023-07-09T21:50:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.648+0000 7f00b1b9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ac0d1220 0x7f00ac0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.648+0000 7f00b1b9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ac0d1220 0x7f00ac0cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46202/0 (socket says 172.21.15.53:46202) 2023-07-09T21:50:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.648+0000 7f00b139b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00ac0b1e00 0x7f00ac14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.648+0000 7f00b1b9c700 1 -- 172.21.15.53:0/4291364844 learned_addr learned my addr 172.21.15.53:0/4291364844 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.648+0000 7f00b0b9a700 1 --2- 172.21.15.53:0/4291364844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ac0b2350 0x7f00ac0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.649+0000 7f00b1b9c700 1 -- 172.21.15.53:0/4291364844 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00ac0b1e00 msgr2=0x7f00ac14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.649+0000 7f00b1b9c700 1 --2- 172.21.15.53:0/4291364844 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00ac0b1e00 0x7f00ac14b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.649+0000 7f00b1b9c700 1 -- 172.21.15.53:0/4291364844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ac0b2350 msgr2=0x7f00ac0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.649+0000 7f00b1b9c700 1 --2- 172.21.15.53:0/4291364844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ac0b2350 0x7f00ac0ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.649+0000 7f00b1b9c700 1 -- 172.21.15.53:0/4291364844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c0094a0 con 0x7f00ac0d1220 2023-07-09T21:50:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.649+0000 7f00b1b9c700 1 --2- 172.21.15.53:0/4291364844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ac0d1220 0x7f00ac0cf720 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00a400c500 tx=0x7f00a400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:19.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.649+0000 7f00a1ffb700 1 -- 172.21.15.53:0/4291364844 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a40052d0 con 0x7f00ac0d1220 2023-07-09T21:50:19.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.649+0000 7f00a1ffb700 1 -- 172.21.15.53:0/4291364844 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a4005430 con 0x7f00ac0d1220 2023-07-09T21:50:19.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.649+0000 7f00b35ff700 1 -- 172.21.15.53:0/4291364844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ac0ca4d0 con 0x7f00ac0d1220 2023-07-09T21:50:19.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.649+0000 7f00a1ffb700 1 -- 172.21.15.53:0/4291364844 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a40038c0 con 0x7f00ac0d1220 2023-07-09T21:50:19.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.649+0000 7f00b35ff700 1 -- 172.21.15.53:0/4291364844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ac0c8270 con 0x7f00ac0d1220 2023-07-09T21:50:19.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.650+0000 7f00b35ff700 1 -- 172.21.15.53:0/4291364844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ac04e280 con 0x7f00ac0d1220 2023-07-09T21:50:19.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.651+0000 7f00a1ffb700 1 -- 172.21.15.53:0/4291364844 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00a4003a20 con 0x7f00ac0d1220 2023-07-09T21:50:19.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.653+0000 7f00a1ffb700 1 --2- 172.21.15.53:0/4291364844 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f009006ace0 0x7f009006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.653+0000 7f00a1ffb700 1 -- 172.21.15.53:0/4291364844 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f00a4088510 con 0x7f00ac0d1220 2023-07-09T21:50:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.653+0000 7f00b139b700 1 --2- 172.21.15.53:0/4291364844 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f009006ace0 0x7f009006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.654+0000 7f00b139b700 1 --2- 172.21.15.53:0/4291364844 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f009006ace0 0x7f009006d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f00a8001460 tx=0x7f00a80017d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.657+0000 7f00a1ffb700 1 -- 172.21.15.53:0/4291364844 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f00a4053870 con 0x7f00ac0d1220 2023-07-09T21:50:19.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.869+0000 7f00b35ff700 1 -- 172.21.15.53:0/4291364844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00ac08c5a0 con 0x7f00ac0d1220 2023-07-09T21:50:19.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.870+0000 7f00a1ffb700 1 -- 172.21.15.53:0/4291364844 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+14612 (secure 0 0 0) 0x7f00a4056e90 con 0x7f00ac0d1220 2023-07-09T21:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":21,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:18.532503+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:50:19.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.872+0000 7f00b35ff700 1 -- 172.21.15.53:0/4291364844 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f009006ace0 msgr2=0x7f009006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.872+0000 7f00b35ff700 1 --2- 172.21.15.53:0/4291364844 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f009006ace0 0x7f009006d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f00a8001460 tx=0x7f00a80017d0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.872+0000 7f00b35ff700 1 -- 172.21.15.53:0/4291364844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ac0d1220 msgr2=0x7f00ac0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:19.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.872+0000 7f00b35ff700 1 --2- 172.21.15.53:0/4291364844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ac0d1220 0x7f00ac0cf720 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00a400c500 tx=0x7f00a400c810 comp rx=0 tx=0).stop 2023-07-09T21:50:19.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.872+0000 7f00b35ff700 1 -- 172.21.15.53:0/4291364844 shutdown_connections 2023-07-09T21:50:19.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.872+0000 7f00b35ff700 1 --2- 172.21.15.53:0/4291364844 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f009006ace0 0x7f009006d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.872+0000 7f00b35ff700 1 --2- 172.21.15.53:0/4291364844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ac0d1220 0x7f00ac0cf720 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.872+0000 7f00b35ff700 1 --2- 172.21.15.53:0/4291364844 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00ac0b1e00 0x7f00ac14b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.872+0000 7f00b35ff700 1 --2- 172.21.15.53:0/4291364844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ac0b2350 0x7f00ac0ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:19.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.872+0000 7f00b35ff700 1 -- 172.21.15.53:0/4291364844 >> 172.21.15.53:0/4291364844 conn(0x7f00ac09c1d0 msgr2=0x7f00ac0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:19.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.872+0000 7f00b35ff700 1 -- 172.21.15.53:0/4291364844 shutdown_connections 2023-07-09T21:50:19.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:19.872+0000 7f00b35ff700 1 -- 172.21.15.53:0/4291364844 wait complete. 2023-07-09T21:50:19.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:50:19.893 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:50:20.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.094+0000 7f6678bff700 1 Processor -- start 2023-07-09T21:50:20.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.094+0000 7f6678bff700 1 -- start start 2023-07-09T21:50:20.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.095+0000 7f6678bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f66740b3ff0 0x7f66740b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.095+0000 7f6678bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66740d0b10 0x7f66740d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.095+0000 7f6678bff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66740b8e80 con 0x7f66740b25d0 2023-07-09T21:50:20.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.095+0000 7f6678bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66740d14a0 con 0x7f66740b3ff0 2023-07-09T21:50:20.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.095+0000 7f6678bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66740b1e30 con 0x7f66740d0b10 2023-07-09T21:50:20.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.096+0000 7f6672d9d700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f66740b25d0 0x7f66740b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45560/0 (socket says 172.21.15.53:45560) 2023-07-09T21:50:20.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.096+0000 7f6672d9d700 1 -- 172.21.15.53:0/1444158733 learned_addr learned my addr 172.21.15.53:0/1444158733 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:20.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.096+0000 7f667259c700 1 --2- 172.21.15.53:0/1444158733 >> v2:172.21.15.184:3300/0 conn(0x7f66740b3ff0 0x7f66740b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.096+0000 7f666bfff700 1 --2- 172.21.15.53:0/1444158733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66740d0b10 0x7f66740d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.096+0000 7f6671d9b700 1 -- 172.21.15.53:0/1444158733 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846560824 0 0) 0x7f666c001490 con 0x7f66740b25d0 2023-07-09T21:50:20.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.096+0000 7f6671d9b700 1 -- 172.21.15.53:0/1444158733 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66600035b0 con 0x7f66740b25d0 2023-07-09T21:50:20.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.096+0000 7f666bfff700 1 -- 172.21.15.53:0/1444158733 >> v2:172.21.15.184:3300/0 conn(0x7f66740b3ff0 msgr2=0x7f66740b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:20.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.096+0000 7f666bfff700 1 --2- 172.21.15.53:0/1444158733 >> v2:172.21.15.184:3300/0 conn(0x7f66740b3ff0 0x7f66740b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.096+0000 7f666bfff700 1 -- 172.21.15.53:0/1444158733 >> v1:172.21.15.53:6789/0 conn(0x7f66740b25d0 legacy=0x7f66740b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.096+0000 7f666bfff700 1 -- 172.21.15.53:0/1444158733 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66740afaa0 con 0x7f66740d0b10 2023-07-09T21:50:20.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.097+0000 7f666bfff700 1 --2- 172.21.15.53:0/1444158733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66740d0b10 0x7f66740d0f60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f665c009840 tx=0x7f665c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97e533e931d3e559 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:20.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.097+0000 7f6671d9b700 1 -- 172.21.15.53:0/1444158733 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c011830 con 0x7f66740d0b10 2023-07-09T21:50:20.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.097+0000 7f6671d9b700 1 -- 172.21.15.53:0/1444158733 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c011990 con 0x7f66740d0b10 2023-07-09T21:50:20.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.097+0000 7f6671d9b700 1 -- 172.21.15.53:0/1444158733 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c011d20 con 0x7f66740d0b10 2023-07-09T21:50:20.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.097+0000 7f6678bff700 1 -- 172.21.15.53:0/1444158733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66740d0b10 msgr2=0x7f66740d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.097+0000 7f6678bff700 1 --2- 172.21.15.53:0/1444158733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66740d0b10 0x7f66740d0f60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f665c009840 tx=0x7f665c009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:20.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.097+0000 7f6678bff700 1 -- 172.21.15.53:0/1444158733 shutdown_connections 2023-07-09T21:50:20.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.097+0000 7f6678bff700 1 --2- 172.21.15.53:0/1444158733 >> v2:172.21.15.184:3300/0 conn(0x7f66740b3ff0 0x7f66740b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.097+0000 7f6678bff700 1 --2- 172.21.15.53:0/1444158733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66740d0b10 0x7f66740d0f60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.098+0000 7f6678bff700 1 -- 172.21.15.53:0/1444158733 >> 172.21.15.53:0/1444158733 conn(0x7f667409c1b0 msgr2=0x7f66740d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:20.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.098+0000 7f6678bff700 1 -- 172.21.15.53:0/1444158733 shutdown_connections 2023-07-09T21:50:20.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.098+0000 7f6678bff700 1 -- 172.21.15.53:0/1444158733 wait complete. 2023-07-09T21:50:20.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.099+0000 7f6678bff700 1 Processor -- start 2023-07-09T21:50:20.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.099+0000 7f6678bff700 1 -- start start 2023-07-09T21:50:20.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.100+0000 7f6678bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740b25d0 0x7f667415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.100+0000 7f6678bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740b3ff0 0x7f667415e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.100+0000 7f6678bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66740d0b10 0x7f66740cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.100+0000 7f6678bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667415fe60 con 0x7f66740b25d0 2023-07-09T21:50:20.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.100+0000 7f6678bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667415cdb0 con 0x7f66740b3ff0 2023-07-09T21:50:20.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.100+0000 7f6678bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667415d090 con 0x7f66740d0b10 2023-07-09T21:50:20.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.100+0000 7f667259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740b25d0 0x7f667415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f667259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740b25d0 0x7f667415bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46214/0 (socket says 172.21.15.53:46214) 2023-07-09T21:50:20.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f667259c700 1 -- 172.21.15.53:0/511155491 learned_addr learned my addr 172.21.15.53:0/511155491 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:20.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f6672d9d700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66740d0b10 0x7f66740cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f666bfff700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740b3ff0 0x7f667415e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f667259c700 1 -- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66740d0b10 msgr2=0x7f66740cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f667259c700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66740d0b10 0x7f66740cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f667259c700 1 -- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740b3ff0 msgr2=0x7f667415e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f667259c700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740b3ff0 0x7f667415e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f667259c700 1 -- 172.21.15.53:0/511155491 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c0094a0 con 0x7f66740b25d0 2023-07-09T21:50:20.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f6672d9d700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66740d0b10 0x7f66740cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:20.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f667259c700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740b25d0 0x7f667415bbd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f666400e9b0 tx=0x7f666400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:20.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f666affd700 1 -- 172.21.15.53:0/511155491 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664009710 con 0x7f66740b25d0 2023-07-09T21:50:20.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f666affd700 1 -- 172.21.15.53:0/511155491 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666400c850 con 0x7f66740b25d0 2023-07-09T21:50:20.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f666affd700 1 -- 172.21.15.53:0/511155491 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666400cbc0 con 0x7f66740b25d0 2023-07-09T21:50:20.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.101+0000 7f6678bff700 1 -- 172.21.15.53:0/511155491 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667415d370 con 0x7f66740b25d0 2023-07-09T21:50:20.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.102+0000 7f6678bff700 1 -- 172.21.15.53:0/511155491 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667415d930 con 0x7f66740b25d0 2023-07-09T21:50:20.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.103+0000 7f6678bff700 1 -- 172.21.15.53:0/511155491 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667415df80 con 0x7f66740b25d0 2023-07-09T21:50:20.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.104+0000 7f666affd700 1 -- 172.21.15.53:0/511155491 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f666400cd20 con 0x7f66740b25d0 2023-07-09T21:50:20.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.104+0000 7f666affd700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f665406ace0 0x7f665406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.105+0000 7f666affd700 1 -- 172.21.15.53:0/511155491 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6664089240 con 0x7f66740b25d0 2023-07-09T21:50:20.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.105+0000 7f666bfff700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f665406ace0 0x7f665406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.106+0000 7f666bfff700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f665406ace0 0x7f665406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f665c000c00 tx=0x7f665c01c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:20.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.109+0000 7f666affd700 1 -- 172.21.15.53:0/511155491 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f66640580d0 con 0x7f66740b25d0 2023-07-09T21:50:20.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.316+0000 7f6678bff700 1 -- 172.21.15.53:0/511155491 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6674074350 con 0x7f66740b25d0 2023-07-09T21:50:20.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.316+0000 7f666affd700 1 -- 172.21.15.53:0/511155491 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6664057c60 con 0x7f66740b25d0 2023-07-09T21:50:20.319 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:50:20.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.319+0000 7f6678bff700 1 -- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f665406ace0 msgr2=0x7f665406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.319+0000 7f6678bff700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f665406ace0 0x7f665406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f665c000c00 tx=0x7f665c01c040 comp rx=0 tx=0).stop 2023-07-09T21:50:20.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.319+0000 7f6678bff700 1 -- 172.21.15.53:0/511155491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740b25d0 msgr2=0x7f667415bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.319+0000 7f6678bff700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740b25d0 0x7f667415bbd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f666400e9b0 tx=0x7f666400ed70 comp rx=0 tx=0).stop 2023-07-09T21:50:20.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.319+0000 7f6678bff700 1 -- 172.21.15.53:0/511155491 shutdown_connections 2023-07-09T21:50:20.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.319+0000 7f6678bff700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f665406ace0 0x7f665406d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.319+0000 7f6678bff700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66740d0b10 0x7f66740cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.319+0000 7f6678bff700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740b25d0 0x7f667415bbd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.319+0000 7f6678bff700 1 --2- 172.21.15.53:0/511155491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740b3ff0 0x7f667415e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.319+0000 7f6678bff700 1 -- 172.21.15.53:0/511155491 >> 172.21.15.53:0/511155491 conn(0x7f667409c1b0 msgr2=0x7f66740d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:20.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.319+0000 7f6678bff700 1 -- 172.21.15.53:0/511155491 shutdown_connections 2023-07-09T21:50:20.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.319+0000 7f6678bff700 1 -- 172.21.15.53:0/511155491 wait complete. 2023-07-09T21:50:20.339 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:50:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.541+0000 7f4d73bff700 1 Processor -- start 2023-07-09T21:50:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.541+0000 7f4d73bff700 1 -- start start 2023-07-09T21:50:20.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.542+0000 7f4d73bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4d6c0b3ff0 0x7f4d6c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.542+0000 7f4d73bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4d6c0d0b10 0x7f4d6c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.542+0000 7f4d73bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c0b25d0 0x7f4d6c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.542+0000 7f4d73bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6c0d14d0 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.542+0000 7f4d73bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6c0b8e80 con 0x7f4d6c0b3ff0 2023-07-09T21:50:20.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.542+0000 7f4d73bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0afaa0 con 0x7f4d6c0b25d0 2023-07-09T21:50:20.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.543+0000 7f4d7119a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4d6c0d0b10 0x7f4d6c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.543+0000 7f4d7119a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4d6c0d0b10 0x7f4d6c0d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46216/0 (socket says 172.21.15.53:46216) 2023-07-09T21:50:20.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.543+0000 7f4d7119a700 1 -- 172.21.15.53:0/1612791576 learned_addr learned my addr 172.21.15.53:0/1612791576 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:20.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.543+0000 7f4d7199b700 1 --2- 172.21.15.53:0/1612791576 >> v2:172.21.15.184:3300/0 conn(0x7f4d6c0b3ff0 0x7f4d6c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.543+0000 7f4d7219c700 1 --2- 172.21.15.53:0/1612791576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c0b25d0 0x7f4d6c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.543+0000 7f4d7119a700 1 -- 172.21.15.53:0/1612791576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c0b25d0 msgr2=0x7f4d6c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:20.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.543+0000 7f4d7119a700 1 --2- 172.21.15.53:0/1612791576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c0b25d0 0x7f4d6c0b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.543+0000 7f4d7119a700 1 -- 172.21.15.53:0/1612791576 >> v2:172.21.15.184:3300/0 conn(0x7f4d6c0b3ff0 msgr2=0x7f4d6c0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.543+0000 7f4d7119a700 1 --2- 172.21.15.53:0/1612791576 >> v2:172.21.15.184:3300/0 conn(0x7f4d6c0b3ff0 0x7f4d6c0b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.543+0000 7f4d7119a700 1 -- 172.21.15.53:0/1612791576 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c0afd80 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.543+0000 7f4d7199b700 1 --2- 172.21.15.53:0/1612791576 >> v2:172.21.15.184:3300/0 conn(0x7f4d6c0b3ff0 0x7f4d6c0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.543+0000 7f4d7119a700 1 --2- 172.21.15.53:0/1612791576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d6c0d0b10 0x7f4d6c0d0f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0b5b00 tx=0x7f4d5c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb098a52128d5275 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.544+0000 7f4d70999700 1 -- 172.21.15.53:0/1612791576 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00b870 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.544+0000 7f4d70999700 1 -- 172.21.15.53:0/1612791576 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c00b9d0 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.544+0000 7f4d70999700 1 -- 172.21.15.53:0/1612791576 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00bd60 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.544+0000 7f4d73bff700 1 -- 172.21.15.53:0/1612791576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d6c0d0b10 msgr2=0x7f4d6c0d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.544+0000 7f4d73bff700 1 --2- 172.21.15.53:0/1612791576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d6c0d0b10 0x7f4d6c0d0f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0b5b00 tx=0x7f4d5c009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.544+0000 7f4d73bff700 1 -- 172.21.15.53:0/1612791576 shutdown_connections 2023-07-09T21:50:20.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.544+0000 7f4d73bff700 1 --2- 172.21.15.53:0/1612791576 >> v2:172.21.15.184:3300/0 conn(0x7f4d6c0b3ff0 0x7f4d6c0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.544+0000 7f4d73bff700 1 --2- 172.21.15.53:0/1612791576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c0b25d0 0x7f4d6c0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.544+0000 7f4d73bff700 1 --2- 172.21.15.53:0/1612791576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d6c0d0b10 0x7f4d6c0d0f90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.544+0000 7f4d73bff700 1 -- 172.21.15.53:0/1612791576 >> 172.21.15.53:0/1612791576 conn(0x7f4d6c09c1b0 msgr2=0x7f4d6c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:20.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.544+0000 7f4d73bff700 1 -- 172.21.15.53:0/1612791576 shutdown_connections 2023-07-09T21:50:20.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.544+0000 7f4d73bff700 1 -- 172.21.15.53:0/1612791576 wait complete. 2023-07-09T21:50:20.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.546+0000 7f4d73bff700 1 Processor -- start 2023-07-09T21:50:20.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.546+0000 7f4d73bff700 1 -- start start 2023-07-09T21:50:20.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.547+0000 7f4d73bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d6c0b25d0 0x7f4d6c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.547+0000 7f4d73bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c0b3ff0 0x7f4d6c0d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.547+0000 7f4d73bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d6c0d0b10 0x7f4d6c15f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.547+0000 7f4d73bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0cd610 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.547+0000 7f4d73bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0cd8f0 con 0x7f4d6c0b25d0 2023-07-09T21:50:20.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.547+0000 7f4d73bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0cdbd0 con 0x7f4d6c0b3ff0 2023-07-09T21:50:20.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d7219c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d6c0d0b10 0x7f4d6c15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d7219c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d6c0d0b10 0x7f4d6c15f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46230/0 (socket says 172.21.15.53:46230) 2023-07-09T21:50:20.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d7219c700 1 -- 172.21.15.53:0/1896836845 learned_addr learned my addr 172.21.15.53:0/1896836845 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:20.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d7199b700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d6c0b25d0 0x7f4d6c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d7119a700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c0b3ff0 0x7f4d6c0d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d7219c700 1 -- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c0b3ff0 msgr2=0x7f4d6c0d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d7219c700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c0b3ff0 0x7f4d6c0d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d7219c700 1 -- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d6c0b25d0 msgr2=0x7f4d6c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d7219c700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d6c0b25d0 0x7f4d6c15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d7219c700 1 -- 172.21.15.53:0/1896836845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c009550 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d7219c700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d6c0d0b10 0x7f4d6c15f200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d64007e60 tx=0x7f4d6400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:20.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d627fc700 1 -- 172.21.15.53:0/1896836845 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6400ed30 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d627fc700 1 -- 172.21.15.53:0/1896836845 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64014420 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d627fc700 1 -- 172.21.15.53:0/1896836845 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d640147d0 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.548+0000 7f4d73bff700 1 -- 172.21.15.53:0/1896836845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c0cb1d0 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.549+0000 7f4d73bff700 1 -- 172.21.15.53:0/1896836845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c15a920 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.550+0000 7f4d73bff700 1 -- 172.21.15.53:0/1896836845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c0cb6f0 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.551+0000 7f4d627fc700 1 -- 172.21.15.53:0/1896836845 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d64014930 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.552+0000 7f4d627fc700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4d5006ace0 0x7f4d5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.552+0000 7f4d627fc700 1 -- 172.21.15.53:0/1896836845 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4d640897b0 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.552+0000 7f4d7199b700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4d5006ace0 0x7f4d5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.553+0000 7f4d7199b700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4d5006ace0 0x7f4d5006d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d68006f10 tx=0x7f4d68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:20.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.556+0000 7f4d627fc700 1 -- 172.21.15.53:0/1896836845 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4d6c0cb6f0 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.765+0000 7f4d73bff700 1 -- 172.21.15.53:0/1896836845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4d6c0cb6f0 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.765+0000 7f4d627fc700 1 -- 172.21.15.53:0/1896836845 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4d6c0cb6f0 con 0x7f4d6c0d0b10 2023-07-09T21:50:20.768 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:50:20.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.767+0000 7f4d73bff700 1 -- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4d5006ace0 msgr2=0x7f4d5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.767+0000 7f4d73bff700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4d5006ace0 0x7f4d5006d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d68006f10 tx=0x7f4d68008040 comp rx=0 tx=0).stop 2023-07-09T21:50:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.767+0000 7f4d73bff700 1 -- 172.21.15.53:0/1896836845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d6c0d0b10 msgr2=0x7f4d6c15f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.767+0000 7f4d73bff700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d6c0d0b10 0x7f4d6c15f200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d64007e60 tx=0x7f4d6400e3c0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.767+0000 7f4d73bff700 1 -- 172.21.15.53:0/1896836845 shutdown_connections 2023-07-09T21:50:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.767+0000 7f4d73bff700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4d5006ace0 0x7f4d5006d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.767+0000 7f4d73bff700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d6c0d0b10 0x7f4d6c15f200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.767+0000 7f4d73bff700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d6c0b25d0 0x7f4d6c15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.767+0000 7f4d73bff700 1 --2- 172.21.15.53:0/1896836845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c0b3ff0 0x7f4d6c0d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.767+0000 7f4d73bff700 1 -- 172.21.15.53:0/1896836845 >> 172.21.15.53:0/1896836845 conn(0x7f4d6c09c1b0 msgr2=0x7f4d6c06a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.767+0000 7f4d73bff700 1 -- 172.21.15.53:0/1896836845 shutdown_connections 2023-07-09T21:50:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.767+0000 7f4d73bff700 1 -- 172.21.15.53:0/1896836845 wait complete. 2023-07-09T21:50:20.788 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T21:50:20.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.987+0000 7fda54fff700 1 Processor -- start 2023-07-09T21:50:20.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.987+0000 7fda54fff700 1 -- start start 2023-07-09T21:50:20.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.988+0000 7fda54fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda500b1e00 0x7fda500b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.988+0000 7fda54fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda500b2350 0x7fda500d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.988+0000 7fda54fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fda500d1050 0x7fda500afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.988+0000 7fda54fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda500d14a0 con 0x7fda500b1e00 2023-07-09T21:50:20.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.988+0000 7fda54fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda500d2ce0 con 0x7fda500d1050 2023-07-09T21:50:20.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.988+0000 7fda54fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda500b3350 con 0x7fda500b2350 2023-07-09T21:50:20.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.989+0000 7fda4e59c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda500b1e00 0x7fda500b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.989+0000 7fda4e59c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda500b1e00 0x7fda500b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46232/0 (socket says 172.21.15.53:46232) 2023-07-09T21:50:20.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.989+0000 7fda4e59c700 1 -- 172.21.15.53:0/3535243851 learned_addr learned my addr 172.21.15.53:0/3535243851 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:20.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.989+0000 7fda4ed9d700 1 --2- 172.21.15.53:0/3535243851 >> v2:172.21.15.184:3300/0 conn(0x7fda500d1050 0x7fda500afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.989+0000 7fda47fff700 1 --2- 172.21.15.53:0/3535243851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda500b2350 0x7fda500d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.989+0000 7fda4e59c700 1 -- 172.21.15.53:0/3535243851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda500b2350 msgr2=0x7fda500d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:20.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.989+0000 7fda4e59c700 1 --2- 172.21.15.53:0/3535243851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda500b2350 0x7fda500d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.989+0000 7fda4e59c700 1 -- 172.21.15.53:0/3535243851 >> v2:172.21.15.184:3300/0 conn(0x7fda500d1050 msgr2=0x7fda500afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:20.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.989+0000 7fda4e59c700 1 --2- 172.21.15.53:0/3535243851 >> v2:172.21.15.184:3300/0 conn(0x7fda500d1050 0x7fda500afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.989+0000 7fda4e59c700 1 -- 172.21.15.53:0/3535243851 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda500b3630 con 0x7fda500b1e00 2023-07-09T21:50:20.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.990+0000 7fda4e59c700 1 --2- 172.21.15.53:0/3535243851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda500b1e00 0x7fda500b43f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fda500b3280 tx=0x7fda40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e974c772bdd50033 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:20.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.990+0000 7fda4dd9b700 1 -- 172.21.15.53:0/3535243851 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40005e30 con 0x7fda500b1e00 2023-07-09T21:50:20.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.990+0000 7fda4dd9b700 1 -- 172.21.15.53:0/3535243851 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda40004030 con 0x7fda500b1e00 2023-07-09T21:50:20.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.990+0000 7fda4dd9b700 1 -- 172.21.15.53:0/3535243851 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda400043e0 con 0x7fda500b1e00 2023-07-09T21:50:20.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.990+0000 7fda54fff700 1 -- 172.21.15.53:0/3535243851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda500b1e00 msgr2=0x7fda500b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.990+0000 7fda54fff700 1 --2- 172.21.15.53:0/3535243851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda500b1e00 0x7fda500b43f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fda500b3280 tx=0x7fda40009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.990+0000 7fda54fff700 1 -- 172.21.15.53:0/3535243851 shutdown_connections 2023-07-09T21:50:20.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.990+0000 7fda54fff700 1 --2- 172.21.15.53:0/3535243851 >> v2:172.21.15.184:3300/0 conn(0x7fda500d1050 0x7fda500afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.990+0000 7fda54fff700 1 --2- 172.21.15.53:0/3535243851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda500b1e00 0x7fda500b43f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.990+0000 7fda54fff700 1 --2- 172.21.15.53:0/3535243851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda500b2350 0x7fda500d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.990+0000 7fda54fff700 1 -- 172.21.15.53:0/3535243851 >> 172.21.15.53:0/3535243851 conn(0x7fda5009c1d0 msgr2=0x7fda500d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:20.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.991+0000 7fda54fff700 1 -- 172.21.15.53:0/3535243851 shutdown_connections 2023-07-09T21:50:20.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.991+0000 7fda54fff700 1 -- 172.21.15.53:0/3535243851 wait complete. 2023-07-09T21:50:20.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.993+0000 7fda54fff700 1 Processor -- start 2023-07-09T21:50:20.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.993+0000 7fda54fff700 1 -- start start 2023-07-09T21:50:20.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.994+0000 7fda54fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda500b1e00 0x7fda501584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.994+0000 7fda54fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda500b2350 0x7fda500c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.994+0000 7fda54fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda500d1050 0x7fda5015f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.994+0000 7fda54fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5015fd10 con 0x7fda500d1050 2023-07-09T21:50:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.994+0000 7fda54fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda501589e0 con 0x7fda500b2350 2023-07-09T21:50:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.994+0000 7fda54fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda500c76b0 con 0x7fda500b1e00 2023-07-09T21:50:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.995+0000 7fda4ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda500d1050 0x7fda5015f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.995+0000 7fda4ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda500d1050 0x7fda5015f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46238/0 (socket says 172.21.15.53:46238) 2023-07-09T21:50:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.995+0000 7fda4ed9d700 1 -- 172.21.15.53:0/1634678510 learned_addr learned my addr 172.21.15.53:0/1634678510 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.995+0000 7fda4e59c700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda500b1e00 0x7fda501584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.995+0000 7fda47fff700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda500b2350 0x7fda500c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.995+0000 7fda4ed9d700 1 -- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda500b1e00 msgr2=0x7fda501584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.995+0000 7fda4ed9d700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda500b1e00 0x7fda501584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.995+0000 7fda4ed9d700 1 -- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda500b2350 msgr2=0x7fda500c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.995+0000 7fda4ed9d700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda500b2350 0x7fda500c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.995+0000 7fda4ed9d700 1 -- 172.21.15.53:0/1634678510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda40009500 con 0x7fda500d1050 2023-07-09T21:50:21.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.995+0000 7fda47fff700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda500b2350 0x7fda500c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:21.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.995+0000 7fda4ed9d700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda500d1050 0x7fda5015f3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda4800efc0 tx=0x7fda4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:21.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.996+0000 7fda46ffd700 1 -- 172.21.15.53:0/1634678510 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48009ba0 con 0x7fda500d1050 2023-07-09T21:50:21.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.996+0000 7fda46ffd700 1 -- 172.21.15.53:0/1634678510 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4800f040 con 0x7fda500d1050 2023-07-09T21:50:21.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.996+0000 7fda46ffd700 1 -- 172.21.15.53:0/1634678510 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48014480 con 0x7fda500d1050 2023-07-09T21:50:21.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.996+0000 7fda54fff700 1 -- 172.21.15.53:0/1634678510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5015cf80 con 0x7fda500d1050 2023-07-09T21:50:21.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.996+0000 7fda54fff700 1 -- 172.21.15.53:0/1634678510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5015d540 con 0x7fda500d1050 2023-07-09T21:50:21.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.997+0000 7fda54fff700 1 -- 172.21.15.53:0/1634678510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5004e280 con 0x7fda500d1050 2023-07-09T21:50:21.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.998+0000 7fda46ffd700 1 -- 172.21.15.53:0/1634678510 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda480145e0 con 0x7fda500d1050 2023-07-09T21:50:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.998+0000 7fda46ffd700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fda3006acb0 0x7fda3006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.999+0000 7fda46ffd700 1 -- 172.21.15.53:0/1634678510 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fda48089e00 con 0x7fda500d1050 2023-07-09T21:50:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.999+0000 7fda4e59c700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fda3006acb0 0x7fda3006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:20.999+0000 7fda4e59c700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fda3006acb0 0x7fda3006d160 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda40009c10 tx=0x7fda40008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:21.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.003+0000 7fda46ffd700 1 -- 172.21.15.53:0/1634678510 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fda48055160 con 0x7fda500d1050 2023-07-09T21:50:21.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.215+0000 7fda54fff700 1 -- 172.21.15.53:0/1634678510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fda5008c5a0 con 0x7fda500d1050 2023-07-09T21:50:21.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.216+0000 7fda46ffd700 1 -- 172.21.15.53:0/1634678510 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+126 (secure 0 0 0) 0x7fda48018090 con 0x7fda500d1050 2023-07-09T21:50:21.218 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:21.218 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-07-09T21:50:21.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:50:21.219 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-07-09T21:50:21.219 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-07-09T21:50:21.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:50:21.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:50:21.219 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-07-09T21:50:21.219 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-07-09T21:50:21.220 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:50:21.220 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-07-09T21:50:21.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.218+0000 7fda54fff700 1 -- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fda3006acb0 msgr2=0x7fda3006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:21.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.218+0000 7fda54fff700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fda3006acb0 0x7fda3006d160 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda40009c10 tx=0x7fda40008070 comp rx=0 tx=0).stop 2023-07-09T21:50:21.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.218+0000 7fda54fff700 1 -- 172.21.15.53:0/1634678510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda500d1050 msgr2=0x7fda5015f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:21.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.218+0000 7fda54fff700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda500d1050 0x7fda5015f3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda4800efc0 tx=0x7fda4800c3a0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.218+0000 7fda54fff700 1 -- 172.21.15.53:0/1634678510 shutdown_connections 2023-07-09T21:50:21.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.218+0000 7fda54fff700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fda3006acb0 0x7fda3006d160 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.218+0000 7fda54fff700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda500d1050 0x7fda5015f3c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.218+0000 7fda54fff700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda500b1e00 0x7fda501584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.218+0000 7fda54fff700 1 --2- 172.21.15.53:0/1634678510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda500b2350 0x7fda500c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.218+0000 7fda54fff700 1 -- 172.21.15.53:0/1634678510 >> 172.21.15.53:0/1634678510 conn(0x7fda5009c1d0 msgr2=0x7fda500b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:21.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.218+0000 7fda54fff700 1 -- 172.21.15.53:0/1634678510 shutdown_connections 2023-07-09T21:50:21.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.218+0000 7fda54fff700 1 -- 172.21.15.53:0/1634678510 wait complete. 2023-07-09T21:50:21.238 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T21:50:21.239 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T21:50:21.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.440+0000 7f653efff700 1 Processor -- start 2023-07-09T21:50:21.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.440+0000 7f653efff700 1 -- start start 2023-07-09T21:50:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.441+0000 7f653efff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f65380d28a0 0x7f653815c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.441+0000 7f653efff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65380d0a30 0x7f65380d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.442+0000 7f653efff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65380d2c70 con 0x7f6538160350 2023-07-09T21:50:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.442+0000 7f653efff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65380d1410 con 0x7f65380d0a30 2023-07-09T21:50:21.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.442+0000 7f653efff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65380d3de0 con 0x7f65380d28a0 2023-07-09T21:50:21.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.442+0000 7f6537fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65380d0a30 0x7f65380d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:21.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.442+0000 7f6537fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65380d0a30 0x7f65380d0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46240/0 (socket says 172.21.15.53:46240) 2023-07-09T21:50:21.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.442+0000 7f6537fff700 1 -- 172.21.15.53:0/1436487617 learned_addr learned my addr 172.21.15.53:0/1436487617 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:21.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.442+0000 7f653cd9b700 1 --2- 172.21.15.53:0/1436487617 >> v2:172.21.15.184:3300/0 conn(0x7f65380d28a0 0x7f653815c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:21.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.442+0000 7f6537fff700 1 -- 172.21.15.53:0/1436487617 >> v2:172.21.15.184:3300/0 conn(0x7f65380d28a0 msgr2=0x7f653815c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:21.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.442+0000 7f6537fff700 1 --2- 172.21.15.53:0/1436487617 >> v2:172.21.15.184:3300/0 conn(0x7f65380d28a0 0x7f653815c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.442+0000 7f6537fff700 1 -- 172.21.15.53:0/1436487617 >> v1:172.21.15.184:6789/0 conn(0x7f6538160350 legacy=0x7f65381607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:21.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.442+0000 7f6537fff700 1 -- 172.21.15.53:0/1436487617 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65380d0190 con 0x7f65380d0a30 2023-07-09T21:50:21.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.443+0000 7f6537fff700 1 --2- 172.21.15.53:0/1436487617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65380d0a30 0x7f65380d0ed0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6538072060 tx=0x7f6524009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31e175bacaa5e76 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:21.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.443+0000 7f65377fe700 1 -- 172.21.15.53:0/1436487617 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652400b870 con 0x7f65380d0a30 2023-07-09T21:50:21.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.443+0000 7f65377fe700 1 -- 172.21.15.53:0/1436487617 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652400b9d0 con 0x7f65380d0a30 2023-07-09T21:50:21.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.443+0000 7f65377fe700 1 -- 172.21.15.53:0/1436487617 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652400bd60 con 0x7f65380d0a30 2023-07-09T21:50:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.443+0000 7f653efff700 1 -- 172.21.15.53:0/1436487617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65380d0a30 msgr2=0x7f65380d0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.443+0000 7f653efff700 1 --2- 172.21.15.53:0/1436487617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65380d0a30 0x7f65380d0ed0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6538072060 tx=0x7f6524009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.443+0000 7f653efff700 1 -- 172.21.15.53:0/1436487617 shutdown_connections 2023-07-09T21:50:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.443+0000 7f653efff700 1 --2- 172.21.15.53:0/1436487617 >> v2:172.21.15.184:3300/0 conn(0x7f65380d28a0 0x7f653815c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.443+0000 7f653efff700 1 --2- 172.21.15.53:0/1436487617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65380d0a30 0x7f65380d0ed0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.443+0000 7f653efff700 1 -- 172.21.15.53:0/1436487617 >> 172.21.15.53:0/1436487617 conn(0x7f653809c1b0 msgr2=0x7f65380d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.444+0000 7f653efff700 1 -- 172.21.15.53:0/1436487617 shutdown_connections 2023-07-09T21:50:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.444+0000 7f653efff700 1 -- 172.21.15.53:0/1436487617 wait complete. 2023-07-09T21:50:21.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.445+0000 7f653efff700 1 Processor -- start 2023-07-09T21:50:21.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.445+0000 7f653efff700 1 -- start start 2023-07-09T21:50:21.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.446+0000 7f653efff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65380d0a30 0x7f6538159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.446+0000 7f653efff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65380d28a0 0x7f653815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.446+0000 7f653efff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6538160350 0x7f65380c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.446+0000 7f653efff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6538158ca0 con 0x7f65380d28a0 2023-07-09T21:50:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.446+0000 7f653efff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653815a460 con 0x7f6538160350 2023-07-09T21:50:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.446+0000 7f653efff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6538158e80 con 0x7f65380d0a30 2023-07-09T21:50:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.447+0000 7f6537fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65380d28a0 0x7f653815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.447+0000 7f6537fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65380d28a0 0x7f653815ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46244/0 (socket says 172.21.15.53:46244) 2023-07-09T21:50:21.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.447+0000 7f6537fff700 1 -- 172.21.15.53:0/2922299940 learned_addr learned my addr 172.21.15.53:0/2922299940 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:21.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.447+0000 7f653cd9b700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65380d0a30 0x7f6538159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:21.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.447+0000 7f6537fff700 1 -- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65380d0a30 msgr2=0x7f6538159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:21.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.447+0000 7f6537fff700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65380d0a30 0x7f6538159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.447+0000 7f653d59c700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6538160350 0x7f65380c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:21.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.447+0000 7f6537fff700 1 -- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6538160350 msgr2=0x7f65380c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:21.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.447+0000 7f6537fff700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6538160350 0x7f65380c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.447+0000 7f6537fff700 1 -- 172.21.15.53:0/2922299940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6524009550 con 0x7f65380d28a0 2023-07-09T21:50:21.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.447+0000 7f653d59c700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6538160350 0x7f65380c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:21.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.447+0000 7f6537fff700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65380d28a0 0x7f653815ab00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6524000c00 tx=0x7f6524004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:21.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.447+0000 7f65357fa700 1 -- 172.21.15.53:0/2922299940 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6524004520 con 0x7f65380d28a0 2023-07-09T21:50:21.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.448+0000 7f65357fa700 1 -- 172.21.15.53:0/2922299940 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652401e070 con 0x7f65380d28a0 2023-07-09T21:50:21.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.448+0000 7f65357fa700 1 -- 172.21.15.53:0/2922299940 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65240038a0 con 0x7f65380d28a0 2023-07-09T21:50:21.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.448+0000 7f653efff700 1 -- 172.21.15.53:0/2922299940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6538159160 con 0x7f65380d28a0 2023-07-09T21:50:21.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.448+0000 7f653efff700 1 -- 172.21.15.53:0/2922299940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6538159720 con 0x7f65380d28a0 2023-07-09T21:50:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.449+0000 7f653efff700 1 -- 172.21.15.53:0/2922299940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6538074350 con 0x7f65380d28a0 2023-07-09T21:50:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.450+0000 7f65357fa700 1 -- 172.21.15.53:0/2922299940 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6524003a00 con 0x7f65380d28a0 2023-07-09T21:50:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.451+0000 7f65357fa700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f651c06ace0 0x7f651c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.451+0000 7f65357fa700 1 -- 172.21.15.53:0/2922299940 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6524020070 con 0x7f65380d28a0 2023-07-09T21:50:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.451+0000 7f653cd9b700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f651c06ace0 0x7f651c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.452+0000 7f653cd9b700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f651c06ace0 0x7f651c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f652c009950 tx=0x7f652c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.455+0000 7f65357fa700 1 -- 172.21.15.53:0/2922299940 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6524055b90 con 0x7f65380d28a0 2023-07-09T21:50:21.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.662+0000 7f653efff700 1 -- 172.21.15.53:0/2922299940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f653806cee0 con 0x7f65380d28a0 2023-07-09T21:50:21.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.747+0000 7f65357fa700 1 -- 172.21.15.53:0/2922299940 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v22) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6524003cb0 con 0x7f65380d28a0 2023-07-09T21:50:21.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.751+0000 7f653efff700 1 -- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f651c06ace0 msgr2=0x7f651c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:21.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.751+0000 7f653efff700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f651c06ace0 0x7f651c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f652c009950 tx=0x7f652c008040 comp rx=0 tx=0).stop 2023-07-09T21:50:21.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.751+0000 7f653efff700 1 -- 172.21.15.53:0/2922299940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65380d28a0 msgr2=0x7f653815ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:21.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.751+0000 7f653efff700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65380d28a0 0x7f653815ab00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6524000c00 tx=0x7f6524004750 comp rx=0 tx=0).stop 2023-07-09T21:50:21.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.751+0000 7f653efff700 1 -- 172.21.15.53:0/2922299940 shutdown_connections 2023-07-09T21:50:21.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.751+0000 7f653efff700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f651c06ace0 0x7f651c06d190 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f652c009950 tx=0x7f652c008040 comp rx=0 tx=0).stop 2023-07-09T21:50:21.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.751+0000 7f653efff700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6538160350 0x7f65380c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.751+0000 7f653efff700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65380d0a30 0x7f6538159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.751+0000 7f653efff700 1 --2- 172.21.15.53:0/2922299940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65380d28a0 0x7f653815ab00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.751+0000 7f653efff700 1 -- 172.21.15.53:0/2922299940 >> 172.21.15.53:0/2922299940 conn(0x7f653809c1b0 msgr2=0x7f653806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:21.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.752+0000 7f653efff700 1 -- 172.21.15.53:0/2922299940 shutdown_connections 2023-07-09T21:50:21.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.752+0000 7f653efff700 1 -- 172.21.15.53:0/2922299940 wait complete. 2023-07-09T21:50:21.757 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-07-09T21:50:21.774 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T21:50:21.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.978+0000 7fab0bdff700 1 Processor -- start 2023-07-09T21:50:21.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.979+0000 7fab0bdff700 1 -- start start 2023-07-09T21:50:21.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.980+0000 7fab0bdff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fab040b3ff0 0x7fab040b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:21.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.980+0000 7fab0bdff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab040d0f90 0x7fab040b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:21.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.980+0000 7fab0bdff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab040b8e80 con 0x7fab040d0b10 2023-07-09T21:50:21.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.980+0000 7fab0bdff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab040b1e30 con 0x7fab040d0f90 2023-07-09T21:50:21.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.980+0000 7fab0bdff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab040afaa0 con 0x7fab040b3ff0 2023-07-09T21:50:21.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.980+0000 7fab0a39c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab040d0f90 0x7fab040b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:21.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.980+0000 7fab0a39c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab040d0f90 0x7fab040b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46252/0 (socket says 172.21.15.53:46252) 2023-07-09T21:50:21.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.980+0000 7fab0a39c700 1 -- 172.21.15.53:0/2851332633 learned_addr learned my addr 172.21.15.53:0/2851332633 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:21.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.980+0000 7fab09b9b700 1 --2- 172.21.15.53:0/2851332633 >> v2:172.21.15.184:3300/0 conn(0x7fab040b3ff0 0x7fab040b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:21.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.980+0000 7fab0a39c700 1 -- 172.21.15.53:0/2851332633 >> v2:172.21.15.184:3300/0 conn(0x7fab040b3ff0 msgr2=0x7fab040b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:21.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.980+0000 7fab0a39c700 1 --2- 172.21.15.53:0/2851332633 >> v2:172.21.15.184:3300/0 conn(0x7fab040b3ff0 0x7fab040b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.981+0000 7fab0a39c700 1 -- 172.21.15.53:0/2851332633 >> v1:172.21.15.184:6789/0 conn(0x7fab040d0b10 legacy=0x7fab040b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:21.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.981+0000 7fab0a39c700 1 -- 172.21.15.53:0/2851332633 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab040afd80 con 0x7fab040d0f90 2023-07-09T21:50:21.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.981+0000 7fab0a39c700 1 --2- 172.21.15.53:0/2851332633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab040d0f90 0x7fab040b2ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fab040b5b00 tx=0x7faafc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c09f2c1b219d07e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:21.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.981+0000 7fab08b99700 1 -- 172.21.15.53:0/2851332633 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc00e070 con 0x7fab040d0f90 2023-07-09T21:50:21.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.981+0000 7fab08b99700 1 -- 172.21.15.53:0/2851332633 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc00b9c0 con 0x7fab040d0f90 2023-07-09T21:50:21.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.981+0000 7fab08b99700 1 -- 172.21.15.53:0/2851332633 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc00bd70 con 0x7fab040d0f90 2023-07-09T21:50:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.982+0000 7fab0bdff700 1 -- 172.21.15.53:0/2851332633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab040d0f90 msgr2=0x7fab040b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.982+0000 7fab0bdff700 1 --2- 172.21.15.53:0/2851332633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab040d0f90 0x7fab040b2ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fab040b5b00 tx=0x7faafc00b330 comp rx=0 tx=0).stop 2023-07-09T21:50:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.982+0000 7fab0bdff700 1 -- 172.21.15.53:0/2851332633 shutdown_connections 2023-07-09T21:50:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.982+0000 7fab0bdff700 1 --2- 172.21.15.53:0/2851332633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab040d0f90 0x7fab040b2ce0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.982+0000 7fab0bdff700 1 --2- 172.21.15.53:0/2851332633 >> v2:172.21.15.184:3300/0 conn(0x7fab040b3ff0 0x7fab040b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.982+0000 7fab0bdff700 1 -- 172.21.15.53:0/2851332633 >> 172.21.15.53:0/2851332633 conn(0x7fab0409c1b0 msgr2=0x7fab040d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.982+0000 7fab0bdff700 1 -- 172.21.15.53:0/2851332633 shutdown_connections 2023-07-09T21:50:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.982+0000 7fab0bdff700 1 -- 172.21.15.53:0/2851332633 wait complete. 2023-07-09T21:50:21.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.983+0000 7fab0bdff700 1 Processor -- start 2023-07-09T21:50:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.984+0000 7fab0bdff700 1 -- start start 2023-07-09T21:50:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.984+0000 7fab0bdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab040b3ff0 0x7fab04157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.984+0000 7fab0bdff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab040d0b10 0x7fab040caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:21.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.984+0000 7fab0bdff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab040d0f90 0x7fab040cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:21.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.984+0000 7fab0bdff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0415e3c0 con 0x7fab040d0b10 2023-07-09T21:50:21.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.984+0000 7fab0bdff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0415e6a0 con 0x7fab040d0f90 2023-07-09T21:50:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.984+0000 7fab0bdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0415e980 con 0x7fab040b3ff0 2023-07-09T21:50:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.985+0000 7fab0939a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab040d0b10 0x7fab040caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.985+0000 7fab0939a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab040d0b10 0x7fab040caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46264/0 (socket says 172.21.15.53:46264) 2023-07-09T21:50:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.985+0000 7fab0939a700 1 -- 172.21.15.53:0/1189577480 learned_addr learned my addr 172.21.15.53:0/1189577480 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:21.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.985+0000 7fab0a39c700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab040d0f90 0x7fab040cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:21.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.985+0000 7fab09b9b700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab040b3ff0 0x7fab04157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:21.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.985+0000 7fab0939a700 1 -- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab040b3ff0 msgr2=0x7fab04157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:21.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.985+0000 7fab0939a700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab040b3ff0 0x7fab04157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.985+0000 7fab0939a700 1 -- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab040d0f90 msgr2=0x7fab040cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:21.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.985+0000 7fab0939a700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab040d0f90 0x7fab040cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:21.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.985+0000 7fab0939a700 1 -- 172.21.15.53:0/1189577480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc009b30 con 0x7fab040d0b10 2023-07-09T21:50:21.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.985+0000 7fab09b9b700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab040b3ff0 0x7fab04157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:21.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.985+0000 7fab0939a700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab040d0b10 0x7fab040caec0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faaf400c4e0 tx=0x7faaf400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:21.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.986+0000 7faafa7fc700 1 -- 172.21.15.53:0/1189577480 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf40052d0 con 0x7fab040d0b10 2023-07-09T21:50:21.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.986+0000 7faafa7fc700 1 -- 172.21.15.53:0/1189577480 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf4005430 con 0x7fab040d0b10 2023-07-09T21:50:21.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.986+0000 7faafa7fc700 1 -- 172.21.15.53:0/1189577480 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf40038c0 con 0x7fab040d0b10 2023-07-09T21:50:21.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.986+0000 7fab0bdff700 1 -- 172.21.15.53:0/1189577480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0415ec60 con 0x7fab040d0b10 2023-07-09T21:50:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.986+0000 7fab0bdff700 1 -- 172.21.15.53:0/1189577480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0415df50 con 0x7fab040d0b10 2023-07-09T21:50:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.987+0000 7fab0bdff700 1 -- 172.21.15.53:0/1189577480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0415f180 con 0x7fab040d0b10 2023-07-09T21:50:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.988+0000 7faafa7fc700 1 -- 172.21.15.53:0/1189577480 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faaf4003a20 con 0x7fab040d0b10 2023-07-09T21:50:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.989+0000 7faafa7fc700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7faae806ace0 0x7faae806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.989+0000 7faafa7fc700 1 -- 172.21.15.53:0/1189577480 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5580+0+0 (secure 0 0 0) 0x7faaf4088590 con 0x7fab040d0b10 2023-07-09T21:50:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.990+0000 7fab09b9b700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7faae806ace0 0x7faae806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.990+0000 7fab09b9b700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7faae806ace0 0x7faae806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fab000099f0 tx=0x7fab00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:22.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:21.994+0000 7faafa7fc700 1 -- 172.21.15.53:0/1189577480 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab0415f180 con 0x7fab040d0b10 2023-07-09T21:50:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.202+0000 7fab0bdff700 1 -- 172.21.15.53:0/1189577480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fab040b8e80 con 0x7fab040d0b10 2023-07-09T21:50:22.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.754+0000 7faafa7fc700 1 -- 172.21.15.53:0/1189577480 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v23) v1 ==== 170+0+0 (secure 0 0 0) 0x7fab040b8e80 con 0x7fab040d0b10 2023-07-09T21:50:22.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.760+0000 7fab0bdff700 1 -- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7faae806ace0 msgr2=0x7faae806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:22.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.760+0000 7fab0bdff700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7faae806ace0 0x7faae806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fab000099f0 tx=0x7fab00008040 comp rx=0 tx=0).stop 2023-07-09T21:50:22.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.760+0000 7fab0bdff700 1 -- 172.21.15.53:0/1189577480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab040d0b10 msgr2=0x7fab040caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:22.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.760+0000 7fab0bdff700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab040d0b10 0x7fab040caec0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faaf400c4e0 tx=0x7faaf400c7f0 comp rx=0 tx=0).stop 2023-07-09T21:50:22.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.760+0000 7fab0bdff700 1 -- 172.21.15.53:0/1189577480 shutdown_connections 2023-07-09T21:50:22.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.760+0000 7fab0bdff700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7faae806ace0 0x7faae806d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:22.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.760+0000 7fab0bdff700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab040d0f90 0x7fab040cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:22.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.760+0000 7fab0bdff700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab040b3ff0 0x7fab04157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:22.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.760+0000 7fab0bdff700 1 --2- 172.21.15.53:0/1189577480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab040d0b10 0x7fab040caec0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faaf400c4e0 tx=0x7faaf400c7f0 comp rx=0 tx=0).stop 2023-07-09T21:50:22.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.760+0000 7fab0bdff700 1 -- 172.21.15.53:0/1189577480 >> 172.21.15.53:0/1189577480 conn(0x7fab0409c1b0 msgr2=0x7fab0406b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:22.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.773+0000 7fab0bdff700 1 -- 172.21.15.53:0/1189577480 shutdown_connections 2023-07-09T21:50:22.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:22.775+0000 7fab0bdff700 1 -- 172.21.15.53:0/1189577480 wait complete. 2023-07-09T21:50:22.779 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-07-09T21:50:22.798 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T21:50:23.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.000+0000 7fa8317ff700 1 Processor -- start 2023-07-09T21:50:23.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.000+0000 7fa8317ff700 1 -- start start 2023-07-09T21:50:23.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.001+0000 7fa8317ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa82c0b43c0 0x7fa82c0b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:23.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.001+0000 7fa8317ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82c0b8e80 con 0x7fa82c0b3ff0 2023-07-09T21:50:23.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.001+0000 7fa8317ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82c0afaa0 con 0x7fa82c0d1220 2023-07-09T21:50:23.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.001+0000 7fa8317ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82c0afd80 con 0x7fa82c0b43c0 2023-07-09T21:50:23.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.002+0000 7fa82affd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa82c0b3ff0 0x7fa82c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37622/0 (socket says 172.21.15.53:37622) 2023-07-09T21:50:23.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.002+0000 7fa82affd700 1 -- 172.21.15.53:0/3332569308 learned_addr learned my addr 172.21.15.53:0/3332569308 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:23.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.002+0000 7fa82b7fe700 1 --2- 172.21.15.53:0/3332569308 >> v2:172.21.15.184:3300/0 conn(0x7fa82c0b43c0 0x7fa82c0b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:23.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.002+0000 7fa829ffb700 1 -- 172.21.15.53:0/3332569308 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058495803 0 0) 0x7fa81c001110 con 0x7fa82c0b3ff0 2023-07-09T21:50:23.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.002+0000 7fa829ffb700 1 -- 172.21.15.53:0/3332569308 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8140035b0 con 0x7fa82c0b3ff0 2023-07-09T21:50:23.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.002+0000 7fa82b7fe700 1 -- 172.21.15.53:0/3332569308 >> v1:172.21.15.184:6789/0 conn(0x7fa82c0d1220 legacy=0x7fa82c0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:23.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.002+0000 7fa82b7fe700 1 -- 172.21.15.53:0/3332569308 >> v1:172.21.15.53:6789/0 conn(0x7fa82c0b3ff0 legacy=0x7fa82c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:23.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.002+0000 7fa829ffb700 1 -- 172.21.15.53:0/3332569308 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1167824634 0 0) 0x7fa8140035b0 con 0x7fa82c0b3ff0 2023-07-09T21:50:23.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.002+0000 7fa82b7fe700 1 -- 172.21.15.53:0/3332569308 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c0b0060 con 0x7fa82c0b43c0 2023-07-09T21:50:23.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.003+0000 7fa82b7fe700 1 --2- 172.21.15.53:0/3332569308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa82c0b43c0 0x7fa82c0b1530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa824009d90 tx=0x7fa82400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=743a46de6b1e1748 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:23.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.003+0000 7fa829ffb700 1 -- 172.21.15.53:0/3332569308 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82400e070 con 0x7fa82c0b43c0 2023-07-09T21:50:23.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.003+0000 7fa829ffb700 1 -- 172.21.15.53:0/3332569308 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa824003a20 con 0x7fa82c0b43c0 2023-07-09T21:50:23.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.003+0000 7fa829ffb700 1 -- 172.21.15.53:0/3332569308 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c001800 con 0x7fa82c0b43c0 2023-07-09T21:50:23.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.003+0000 7fa8317ff700 1 -- 172.21.15.53:0/3332569308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa82c0b43c0 msgr2=0x7fa82c0b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:23.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.003+0000 7fa8317ff700 1 --2- 172.21.15.53:0/3332569308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa82c0b43c0 0x7fa82c0b1530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa824009d90 tx=0x7fa82400b330 comp rx=0 tx=0).stop 2023-07-09T21:50:23.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.003+0000 7fa8317ff700 1 -- 172.21.15.53:0/3332569308 shutdown_connections 2023-07-09T21:50:23.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.003+0000 7fa8317ff700 1 --2- 172.21.15.53:0/3332569308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa82c0b43c0 0x7fa82c0b1530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:23.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.003+0000 7fa8317ff700 1 -- 172.21.15.53:0/3332569308 >> 172.21.15.53:0/3332569308 conn(0x7fa82c09c1b0 msgr2=0x7fa82c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:23.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.004+0000 7fa8317ff700 1 -- 172.21.15.53:0/3332569308 shutdown_connections 2023-07-09T21:50:23.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.004+0000 7fa8317ff700 1 -- 172.21.15.53:0/3332569308 wait complete. 2023-07-09T21:50:23.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.005+0000 7fa8317ff700 1 Processor -- start 2023-07-09T21:50:23.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.005+0000 7fa8317ff700 1 -- start start 2023-07-09T21:50:23.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.006+0000 7fa8317ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa82c0b3ff0 0x7fa82c15edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:23.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.006+0000 7fa8317ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa82c0b43c0 0x7fa82c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:23.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.006+0000 7fa8317ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa82c0d1220 0x7fa82c1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:23.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.006+0000 7fa8317ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c1588c0 con 0x7fa82c0b43c0 2023-07-09T21:50:23.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.006+0000 7fa8317ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c15fcd0 con 0x7fa82c0d1220 2023-07-09T21:50:23.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.006+0000 7fa8317ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c0cf210 con 0x7fa82c0b3ff0 2023-07-09T21:50:23.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.007+0000 7fa82a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa82c0b43c0 0x7fa82c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:23.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.007+0000 7fa82a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa82c0b43c0 0x7fa82c0cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40266/0 (socket says 172.21.15.53:40266) 2023-07-09T21:50:23.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.007+0000 7fa82a7fc700 1 -- 172.21.15.53:0/3572932501 learned_addr learned my addr 172.21.15.53:0/3572932501 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:23.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.007+0000 7fa82b7fe700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa82c0d1220 0x7fa82c1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:23.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.007+0000 7fa82a7fc700 1 -- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa82c0b3ff0 msgr2=0x7fa82c15edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:23.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.007+0000 7fa82affd700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa82c0b3ff0 0x7fa82c15edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:23.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.007+0000 7fa82a7fc700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa82c0b3ff0 0x7fa82c15edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:23.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.007+0000 7fa82a7fc700 1 -- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa82c0d1220 msgr2=0x7fa82c1544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:23.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.007+0000 7fa82a7fc700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa82c0d1220 0x7fa82c1544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:23.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.007+0000 7fa82a7fc700 1 -- 172.21.15.53:0/3572932501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa824009a70 con 0x7fa82c0b43c0 2023-07-09T21:50:23.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.007+0000 7fa82b7fe700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa82c0d1220 0x7fa82c1544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:23.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.007+0000 7fa82affd700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa82c0b3ff0 0x7fa82c15edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:23.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.007+0000 7fa82a7fc700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa82c0b43c0 0x7fa82c0cbac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa82000c480 tx=0x7fa82000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:23.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.008+0000 7fa8137fe700 1 -- 172.21.15.53:0/3572932501 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8200052d0 con 0x7fa82c0b43c0 2023-07-09T21:50:23.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.008+0000 7fa8137fe700 1 -- 172.21.15.53:0/3572932501 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa820005430 con 0x7fa82c0b43c0 2023-07-09T21:50:23.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.008+0000 7fa8137fe700 1 -- 172.21.15.53:0/3572932501 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8200038c0 con 0x7fa82c0b43c0 2023-07-09T21:50:23.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.008+0000 7fa8317ff700 1 -- 172.21.15.53:0/3572932501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c15f430 con 0x7fa82c0b43c0 2023-07-09T21:50:23.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.008+0000 7fa8317ff700 1 -- 172.21.15.53:0/3572932501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c15f9f0 con 0x7fa82c0b43c0 2023-07-09T21:50:23.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.009+0000 7fa8317ff700 1 -- 172.21.15.53:0/3572932501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82c158a00 con 0x7fa82c0b43c0 2023-07-09T21:50:23.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.010+0000 7fa8137fe700 1 -- 172.21.15.53:0/3572932501 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa820003a20 con 0x7fa82c0b43c0 2023-07-09T21:50:23.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.011+0000 7fa8137fe700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa81806ace0 0x7fa81806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:23.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.011+0000 7fa8137fe700 1 -- 172.21.15.53:0/3572932501 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fa820088880 con 0x7fa82c0b43c0 2023-07-09T21:50:23.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.011+0000 7fa82affd700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa81806ace0 0x7fa81806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:23.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.012+0000 7fa82affd700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa81806ace0 0x7fa81806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0cb040 tx=0x7fa81c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:23.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.016+0000 7fa8137fe700 1 -- 172.21.15.53:0/3572932501 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa82c158a00 con 0x7fa82c0b43c0 2023-07-09T21:50:23.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.270+0000 7fa8317ff700 1 -- 172.21.15.53:0/3572932501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa82c158a00 con 0x7fa82c0b43c0 2023-07-09T21:50:23.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.787+0000 7fa8137fe700 1 -- 172.21.15.53:0/3572932501 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa82c158a00 con 0x7fa82c0b43c0 2023-07-09T21:50:23.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.794+0000 7fa8317ff700 1 -- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa81806ace0 msgr2=0x7fa81806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:23.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.794+0000 7fa8317ff700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa81806ace0 0x7fa81806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0cb040 tx=0x7fa81c009040 comp rx=0 tx=0).stop 2023-07-09T21:50:23.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.794+0000 7fa8317ff700 1 -- 172.21.15.53:0/3572932501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa82c0b43c0 msgr2=0x7fa82c0cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:23.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.794+0000 7fa8317ff700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa82c0b43c0 0x7fa82c0cbac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa82000c480 tx=0x7fa82000c840 comp rx=0 tx=0).stop 2023-07-09T21:50:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.794+0000 7fa8317ff700 1 -- 172.21.15.53:0/3572932501 shutdown_connections 2023-07-09T21:50:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.794+0000 7fa8317ff700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa81806ace0 0x7fa81806d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.794+0000 7fa8317ff700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa82c0d1220 0x7fa82c1544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.794+0000 7fa8317ff700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa82c0b3ff0 0x7fa82c15edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.794+0000 7fa8317ff700 1 --2- 172.21.15.53:0/3572932501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa82c0b43c0 0x7fa82c0cbac0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.794+0000 7fa8317ff700 1 -- 172.21.15.53:0/3572932501 >> 172.21.15.53:0/3572932501 conn(0x7fa82c09c1b0 msgr2=0x7fa82c15c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:23.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.798+0000 7fa8317ff700 1 -- 172.21.15.53:0/3572932501 shutdown_connections 2023-07-09T21:50:23.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:23.798+0000 7fa8317ff700 1 -- 172.21.15.53:0/3572932501 wait complete. 2023-07-09T21:50:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 3 and data pool 4 2023-07-09T21:50:23.824 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:50:24.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.021+0000 7f2a4dfff700 1 Processor -- start 2023-07-09T21:50:24.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.021+0000 7f2a4dfff700 1 -- start start 2023-07-09T21:50:24.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a4dfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a480b1e00 0x7f2a480b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a4dfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2a480b2350 0x7f2a480d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a4dfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a480d2ce0 con 0x7f2a480d1050 2023-07-09T21:50:24.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a4dfff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a480d14d0 con 0x7f2a480b1e00 2023-07-09T21:50:24.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a4dfff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a480b3350 con 0x7f2a480b2350 2023-07-09T21:50:24.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a477fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a480b1e00 0x7f2a480b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a477fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a480b1e00 0x7f2a480b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40278/0 (socket says 172.21.15.53:40278) 2023-07-09T21:50:24.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a477fe700 1 -- 172.21.15.53:0/391099644 learned_addr learned my addr 172.21.15.53:0/391099644 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:24.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a46ffd700 1 --2- 172.21.15.53:0/391099644 >> v2:172.21.15.184:3300/0 conn(0x7f2a480b2350 0x7f2a480d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a477fe700 1 -- 172.21.15.53:0/391099644 >> v2:172.21.15.184:3300/0 conn(0x7f2a480b2350 msgr2=0x7f2a480d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:24.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a477fe700 1 --2- 172.21.15.53:0/391099644 >> v2:172.21.15.184:3300/0 conn(0x7f2a480b2350 0x7f2a480d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a477fe700 1 -- 172.21.15.53:0/391099644 >> v1:172.21.15.184:6789/0 conn(0x7f2a480d1050 legacy=0x7f2a480afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a477fe700 1 -- 172.21.15.53:0/391099644 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a480b3630 con 0x7f2a480b1e00 2023-07-09T21:50:24.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.023+0000 7f2a46ffd700 1 --2- 172.21.15.53:0/391099644 >> v2:172.21.15.184:3300/0 conn(0x7f2a480b2350 0x7f2a480d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:24.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.024+0000 7f2a477fe700 1 --2- 172.21.15.53:0/391099644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a480b1e00 0x7f2a480b43f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a48072140 tx=0x7f2a38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f74026574c510f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:24.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.024+0000 7f2a467fc700 1 -- 172.21.15.53:0/391099644 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38005e30 con 0x7f2a480b1e00 2023-07-09T21:50:24.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.024+0000 7f2a467fc700 1 -- 172.21.15.53:0/391099644 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a38004030 con 0x7f2a480b1e00 2023-07-09T21:50:24.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.024+0000 7f2a467fc700 1 -- 172.21.15.53:0/391099644 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a380043e0 con 0x7f2a480b1e00 2023-07-09T21:50:24.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.024+0000 7f2a4dfff700 1 -- 172.21.15.53:0/391099644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a480b1e00 msgr2=0x7f2a480b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.024+0000 7f2a4dfff700 1 --2- 172.21.15.53:0/391099644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a480b1e00 0x7f2a480b43f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a48072140 tx=0x7f2a38009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.024+0000 7f2a4dfff700 1 -- 172.21.15.53:0/391099644 shutdown_connections 2023-07-09T21:50:24.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.024+0000 7f2a4dfff700 1 --2- 172.21.15.53:0/391099644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a480b1e00 0x7f2a480b43f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.024+0000 7f2a4dfff700 1 --2- 172.21.15.53:0/391099644 >> v2:172.21.15.184:3300/0 conn(0x7f2a480b2350 0x7f2a480d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.024+0000 7f2a4dfff700 1 -- 172.21.15.53:0/391099644 >> 172.21.15.53:0/391099644 conn(0x7f2a4809c1d0 msgr2=0x7f2a480d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:24.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.025+0000 7f2a4dfff700 1 -- 172.21.15.53:0/391099644 shutdown_connections 2023-07-09T21:50:24.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.025+0000 7f2a4dfff700 1 -- 172.21.15.53:0/391099644 wait complete. 2023-07-09T21:50:24.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.026+0000 7f2a4dfff700 1 Processor -- start 2023-07-09T21:50:24.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.026+0000 7f2a4dfff700 1 -- start start 2023-07-09T21:50:24.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.027+0000 7f2a4dfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a480b1e00 0x7f2a480c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.027+0000 7f2a4dfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a480b2350 0x7f2a4815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.027+0000 7f2a4dfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a480d1050 0x7f2a480b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.027+0000 7f2a4dfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480c89e0 con 0x7f2a480b1e00 2023-07-09T21:50:24.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.027+0000 7f2a4dfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4815bc20 con 0x7f2a480d1050 2023-07-09T21:50:24.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.027+0000 7f2a4dfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480c7b30 con 0x7f2a480b2350 2023-07-09T21:50:24.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.028+0000 7f2a477fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a480b1e00 0x7f2a480c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.028+0000 7f2a477fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a480b1e00 0x7f2a480c9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40288/0 (socket says 172.21.15.53:40288) 2023-07-09T21:50:24.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.028+0000 7f2a477fe700 1 -- 172.21.15.53:0/2344746623 learned_addr learned my addr 172.21.15.53:0/2344746623 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:24.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.028+0000 7f2a47fff700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a480d1050 0x7f2a480b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.028+0000 7f2a46ffd700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a480b2350 0x7f2a4815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.028+0000 7f2a477fe700 1 -- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a480b2350 msgr2=0x7f2a4815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.028+0000 7f2a477fe700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a480b2350 0x7f2a4815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.028+0000 7f2a477fe700 1 -- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a480d1050 msgr2=0x7f2a480b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.028+0000 7f2a477fe700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a480d1050 0x7f2a480b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.028+0000 7f2a477fe700 1 -- 172.21.15.53:0/2344746623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a38009500 con 0x7f2a480b1e00 2023-07-09T21:50:24.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.028+0000 7f2a46ffd700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a480b2350 0x7f2a4815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:24.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.028+0000 7f2a477fe700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a480b1e00 0x7f2a480c9510 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009130 tx=0x7f2a38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:24.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.028+0000 7f2a2ffff700 1 -- 172.21.15.53:0/2344746623 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38003da0 con 0x7f2a480b1e00 2023-07-09T21:50:24.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.029+0000 7f2a2ffff700 1 -- 172.21.15.53:0/2344746623 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3801d430 con 0x7f2a480b1e00 2023-07-09T21:50:24.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.029+0000 7f2a4dfff700 1 -- 172.21.15.53:0/2344746623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a480c7dd0 con 0x7f2a480b1e00 2023-07-09T21:50:24.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.029+0000 7f2a2ffff700 1 -- 172.21.15.53:0/2344746623 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3801d7e0 con 0x7f2a480b1e00 2023-07-09T21:50:24.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.029+0000 7f2a4dfff700 1 -- 172.21.15.53:0/2344746623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a480c8390 con 0x7f2a480b1e00 2023-07-09T21:50:24.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.030+0000 7f2a4dfff700 1 -- 172.21.15.53:0/2344746623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a480b3eb0 con 0x7f2a480b1e00 2023-07-09T21:50:24.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.031+0000 7f2a2ffff700 1 -- 172.21.15.53:0/2344746623 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a3801d940 con 0x7f2a480b1e00 2023-07-09T21:50:24.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.032+0000 7f2a2ffff700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2a3406ace0 0x7f2a3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.032+0000 7f2a2ffff700 1 -- 172.21.15.53:0/2344746623 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a3808a930 con 0x7f2a480b1e00 2023-07-09T21:50:24.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.032+0000 7f2a46ffd700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2a3406ace0 0x7f2a3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.032+0000 7f2a46ffd700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2a3406ace0 0x7f2a3406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2a4814dbc0 tx=0x7f2a3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:24.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.036+0000 7f2a2ffff700 1 -- 172.21.15.53:0/2344746623 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2a480b3eb0 con 0x7f2a480b1e00 2023-07-09T21:50:24.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.248+0000 7f2a4dfff700 1 -- 172.21.15.53:0/2344746623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a480b3eb0 con 0x7f2a480b1e00 2023-07-09T21:50:24.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.249+0000 7f2a2ffff700 1 -- 172.21.15.53:0/2344746623 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18268 (secure 0 0 0) 0x7f2a480b3eb0 con 0x7f2a480b1e00 2023-07-09T21:50:24.252 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:24.252 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":24,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:23.272350+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:50:24.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.251+0000 7f2a4dfff700 1 -- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2a3406ace0 msgr2=0x7f2a3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.251+0000 7f2a4dfff700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2a3406ace0 0x7f2a3406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2a4814dbc0 tx=0x7f2a3c008040 comp rx=0 tx=0).stop 2023-07-09T21:50:24.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.251+0000 7f2a4dfff700 1 -- 172.21.15.53:0/2344746623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a480b1e00 msgr2=0x7f2a480c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.251+0000 7f2a4dfff700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a480b1e00 0x7f2a480c9510 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009130 tx=0x7f2a38004750 comp rx=0 tx=0).stop 2023-07-09T21:50:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.251+0000 7f2a4dfff700 1 -- 172.21.15.53:0/2344746623 shutdown_connections 2023-07-09T21:50:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.251+0000 7f2a4dfff700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2a3406ace0 0x7f2a3406d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.251+0000 7f2a4dfff700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a480d1050 0x7f2a480b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.251+0000 7f2a4dfff700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a480b1e00 0x7f2a480c9510 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.251+0000 7f2a4dfff700 1 --2- 172.21.15.53:0/2344746623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a480b2350 0x7f2a4815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.251+0000 7f2a4dfff700 1 -- 172.21.15.53:0/2344746623 >> 172.21.15.53:0/2344746623 conn(0x7f2a4809c1d0 msgr2=0x7f2a48158530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:24.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.251+0000 7f2a4dfff700 1 -- 172.21.15.53:0/2344746623 shutdown_connections 2023-07-09T21:50:24.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.252+0000 7f2a4dfff700 1 -- 172.21.15.53:0/2344746623 wait complete. 2023-07-09T21:50:24.272 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:50:24.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.470+0000 7fe4bcdff700 1 Processor -- start 2023-07-09T21:50:24.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.470+0000 7fe4bcdff700 1 -- start start 2023-07-09T21:50:24.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.471+0000 7fe4bcdff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe4b80b1e00 0x7fe4b80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.471+0000 7fe4bcdff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b80d2ce0 con 0x7fe4b80d1220 2023-07-09T21:50:24.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.471+0000 7fe4bcdff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b80b3350 con 0x7fe4b80b2350 2023-07-09T21:50:24.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.471+0000 7fe4bcdff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b80b3630 con 0x7fe4b80b1e00 2023-07-09T21:50:24.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.471+0000 7fe4b659c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe4b80b1e00 0x7fe4b80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.471+0000 7fe4b6d9d700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe4b80d1220 0x7fe4b80afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37626/0 (socket says 172.21.15.53:37626) 2023-07-09T21:50:24.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.471+0000 7fe4b6d9d700 1 -- 172.21.15.53:0/3699881526 learned_addr learned my addr 172.21.15.53:0/3699881526 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:24.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.472+0000 7fe4b659c700 1 -- 172.21.15.53:0/3699881526 >> v1:172.21.15.184:6789/0 conn(0x7fe4b80b2350 legacy=0x7fe4b80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.472+0000 7fe4b659c700 1 -- 172.21.15.53:0/3699881526 >> v1:172.21.15.53:6789/0 conn(0x7fe4b80d1220 legacy=0x7fe4b80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.472+0000 7fe4b659c700 1 -- 172.21.15.53:0/3699881526 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b80b3910 con 0x7fe4b80b1e00 2023-07-09T21:50:24.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.472+0000 7fe4b5d9b700 1 -- 172.21.15.53:0/3699881526 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836594824 0 0) 0x7fe4b80d2ce0 con 0x7fe4b80d1220 2023-07-09T21:50:24.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.472+0000 7fe4b659c700 1 --2- 172.21.15.53:0/3699881526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b80b1e00 0x7fe4b80b43f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009820 tx=0x7fe4a8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99892e6114657412 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:24.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.472+0000 7fe4b5d9b700 1 -- 172.21.15.53:0/3699881526 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8005e30 con 0x7fe4b80b1e00 2023-07-09T21:50:24.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.472+0000 7fe4b5d9b700 1 -- 172.21.15.53:0/3699881526 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a8006030 con 0x7fe4b80b1e00 2023-07-09T21:50:24.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.472+0000 7fe4b5d9b700 1 -- 172.21.15.53:0/3699881526 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a80063e0 con 0x7fe4b80b1e00 2023-07-09T21:50:24.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.473+0000 7fe4bcdff700 1 -- 172.21.15.53:0/3699881526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b80b1e00 msgr2=0x7fe4b80b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.473+0000 7fe4bcdff700 1 --2- 172.21.15.53:0/3699881526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b80b1e00 0x7fe4b80b43f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009820 tx=0x7fe4a8009b30 comp rx=0 tx=0).stop 2023-07-09T21:50:24.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.473+0000 7fe4bcdff700 1 -- 172.21.15.53:0/3699881526 shutdown_connections 2023-07-09T21:50:24.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.473+0000 7fe4bcdff700 1 --2- 172.21.15.53:0/3699881526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b80b1e00 0x7fe4b80b43f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.473+0000 7fe4bcdff700 1 -- 172.21.15.53:0/3699881526 >> 172.21.15.53:0/3699881526 conn(0x7fe4b809c1d0 msgr2=0x7fe4b80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:24.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.473+0000 7fe4bcdff700 1 -- 172.21.15.53:0/3699881526 shutdown_connections 2023-07-09T21:50:24.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.473+0000 7fe4bcdff700 1 -- 172.21.15.53:0/3699881526 wait complete. 2023-07-09T21:50:24.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.475+0000 7fe4bcdff700 1 Processor -- start 2023-07-09T21:50:24.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.475+0000 7fe4bcdff700 1 -- start start 2023-07-09T21:50:24.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4bcdff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80b1e00 0x7fe4b815f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4bcdff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b80b2350 0x7fe4b80cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4bcdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4b80d1220 0x7fe4b80ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4bcdff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80cffa0 con 0x7fe4b80b2350 2023-07-09T21:50:24.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4bcdff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80c6c10 con 0x7fe4b80b1e00 2023-07-09T21:50:24.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4bcdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80c6ef0 con 0x7fe4b80d1220 2023-07-09T21:50:24.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4affff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b80b2350 0x7fe4b80cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4affff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b80b2350 0x7fe4b80cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40298/0 (socket says 172.21.15.53:40298) 2023-07-09T21:50:24.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4affff700 1 -- 172.21.15.53:0/2582566790 learned_addr learned my addr 172.21.15.53:0/2582566790 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:24.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4b659c700 1 --2- 172.21.15.53:0/2582566790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80b1e00 0x7fe4b815f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4affff700 1 -- 172.21.15.53:0/2582566790 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4b80d1220 msgr2=0x7fe4b80ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4affff700 1 --2- 172.21.15.53:0/2582566790 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4b80d1220 0x7fe4b80ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4affff700 1 -- 172.21.15.53:0/2582566790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80b1e00 msgr2=0x7fe4b815f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4affff700 1 --2- 172.21.15.53:0/2582566790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80b1e00 0x7fe4b815f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4affff700 1 -- 172.21.15.53:0/2582566790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a8009430 con 0x7fe4b80b2350 2023-07-09T21:50:24.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.476+0000 7fe4affff700 1 --2- 172.21.15.53:0/2582566790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b80b2350 0x7fe4b80cf4e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c4e0 tx=0x7fe4a000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:24.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.477+0000 7fe4aeffd700 1 -- 172.21.15.53:0/2582566790 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00052d0 con 0x7fe4b80b2350 2023-07-09T21:50:24.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.477+0000 7fe4aeffd700 1 -- 172.21.15.53:0/2582566790 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a0005430 con 0x7fe4b80b2350 2023-07-09T21:50:24.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.477+0000 7fe4aeffd700 1 -- 172.21.15.53:0/2582566790 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00038c0 con 0x7fe4b80b2350 2023-07-09T21:50:24.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.477+0000 7fe4bcdff700 1 -- 172.21.15.53:0/2582566790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b80c71d0 con 0x7fe4b80b2350 2023-07-09T21:50:24.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.477+0000 7fe4bcdff700 1 -- 172.21.15.53:0/2582566790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b80ce850 con 0x7fe4b80b2350 2023-07-09T21:50:24.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.478+0000 7fe4bcdff700 1 -- 172.21.15.53:0/2582566790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b80c76f0 con 0x7fe4b80b2350 2023-07-09T21:50:24.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.479+0000 7fe4aeffd700 1 -- 172.21.15.53:0/2582566790 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4a0003a20 con 0x7fe4b80b2350 2023-07-09T21:50:24.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.480+0000 7fe4aeffd700 1 --2- 172.21.15.53:0/2582566790 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe49806ace0 0x7fe49806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.480+0000 7fe4aeffd700 1 -- 172.21.15.53:0/2582566790 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4a0088a40 con 0x7fe4b80b2350 2023-07-09T21:50:24.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.480+0000 7fe4b659c700 1 --2- 172.21.15.53:0/2582566790 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe49806ace0 0x7fe49806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.481+0000 7fe4b659c700 1 --2- 172.21.15.53:0/2582566790 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe49806ace0 0x7fe49806d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009b70 tx=0x7fe4a8008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:24.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.485+0000 7fe4aeffd700 1 -- 172.21.15.53:0/2582566790 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe4b80c76f0 con 0x7fe4b80b2350 2023-07-09T21:50:24.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.698+0000 7fe4bcdff700 1 -- 172.21.15.53:0/2582566790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4b80c76f0 con 0x7fe4b80b2350 2023-07-09T21:50:24.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.699+0000 7fe4aeffd700 1 -- 172.21.15.53:0/2582566790 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18268 (secure 0 0 0) 0x7fe4b80c76f0 con 0x7fe4b80b2350 2023-07-09T21:50:24.701 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:24.702 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":24,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:23.272350+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:50:24.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.702+0000 7fe4bcdff700 1 -- 172.21.15.53:0/2582566790 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe49806ace0 msgr2=0x7fe49806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.702+0000 7fe4bcdff700 1 --2- 172.21.15.53:0/2582566790 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe49806ace0 0x7fe49806d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009b70 tx=0x7fe4a8008070 comp rx=0 tx=0).stop 2023-07-09T21:50:24.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.702+0000 7fe4bcdff700 1 -- 172.21.15.53:0/2582566790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b80b2350 msgr2=0x7fe4b80cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.702+0000 7fe4bcdff700 1 --2- 172.21.15.53:0/2582566790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b80b2350 0x7fe4b80cf4e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c4e0 tx=0x7fe4a000c8a0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.702+0000 7fe4bcdff700 1 -- 172.21.15.53:0/2582566790 shutdown_connections 2023-07-09T21:50:24.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.702+0000 7fe4bcdff700 1 --2- 172.21.15.53:0/2582566790 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe49806ace0 0x7fe49806d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.702+0000 7fe4bcdff700 1 --2- 172.21.15.53:0/2582566790 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4b80d1220 0x7fe4b80ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.702+0000 7fe4bcdff700 1 --2- 172.21.15.53:0/2582566790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80b1e00 0x7fe4b815f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.702+0000 7fe4bcdff700 1 --2- 172.21.15.53:0/2582566790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b80b2350 0x7fe4b80cf4e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.702+0000 7fe4bcdff700 1 -- 172.21.15.53:0/2582566790 >> 172.21.15.53:0/2582566790 conn(0x7fe4b809c1d0 msgr2=0x7fe4b80afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:24.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.702+0000 7fe4bcdff700 1 -- 172.21.15.53:0/2582566790 shutdown_connections 2023-07-09T21:50:24.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.702+0000 7fe4bcdff700 1 -- 172.21.15.53:0/2582566790 wait complete. 2023-07-09T21:50:24.722 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T21:50:24.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.927+0000 7f1b6d3ff700 1 Processor -- start 2023-07-09T21:50:24.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.927+0000 7f1b6d3ff700 1 -- start start 2023-07-09T21:50:24.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.928+0000 7f1b6d3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b680d1220 0x7f1b680b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.928+0000 7f1b6d3ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b680b8e80 con 0x7f1b680b0e20 2023-07-09T21:50:24.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.928+0000 7f1b6d3ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b680afaa0 con 0x7f1b680b3ff0 2023-07-09T21:50:24.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.928+0000 7f1b6d3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b680afd80 con 0x7f1b680d1220 2023-07-09T21:50:24.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.929+0000 7f1b677fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1b680b0e20 0x7f1b680b1280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37630/0 (socket says 172.21.15.53:37630) 2023-07-09T21:50:24.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.929+0000 7f1b677fe700 1 -- 172.21.15.53:0/3858247182 learned_addr learned my addr 172.21.15.53:0/3858247182 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:24.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.929+0000 7f1b667fc700 1 --2- 172.21.15.53:0/3858247182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b680d1220 0x7f1b680b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.929+0000 7f1b65ffb700 1 -- 172.21.15.53:0/3858247182 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240072988 0 0) 0x7f1b60001490 con 0x7f1b680b0e20 2023-07-09T21:50:24.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.929+0000 7f1b65ffb700 1 -- 172.21.15.53:0/3858247182 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b500035b0 con 0x7f1b680b0e20 2023-07-09T21:50:24.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.929+0000 7f1b65ffb700 1 -- 172.21.15.53:0/3858247182 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82506245 0 0) 0x7f1b680afaa0 con 0x7f1b680b3ff0 2023-07-09T21:50:24.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.929+0000 7f1b65ffb700 1 -- 172.21.15.53:0/3858247182 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b60001490 con 0x7f1b680b3ff0 2023-07-09T21:50:24.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.929+0000 7f1b667fc700 1 -- 172.21.15.53:0/3858247182 >> v1:172.21.15.184:6789/0 conn(0x7f1b680b3ff0 legacy=0x7f1b680d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.929+0000 7f1b667fc700 1 -- 172.21.15.53:0/3858247182 >> v1:172.21.15.53:6789/0 conn(0x7f1b680b0e20 legacy=0x7f1b680b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.929+0000 7f1b65ffb700 1 -- 172.21.15.53:0/3858247182 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1362808610 0 0) 0x7f1b500035b0 con 0x7f1b680b0e20 2023-07-09T21:50:24.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.929+0000 7f1b667fc700 1 -- 172.21.15.53:0/3858247182 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b680b0060 con 0x7f1b680d1220 2023-07-09T21:50:24.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.930+0000 7f1b667fc700 1 --2- 172.21.15.53:0/3858247182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b680d1220 0x7f1b680b43c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009870 tx=0x7f1b5c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f5d4a738e12ac6c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:24.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.930+0000 7f1b65ffb700 1 -- 172.21.15.53:0/3858247182 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60001b80 con 0x7f1b680d1220 2023-07-09T21:50:24.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.930+0000 7f1b65ffb700 1 -- 172.21.15.53:0/3858247182 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c004030 con 0x7f1b680d1220 2023-07-09T21:50:24.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.930+0000 7f1b65ffb700 1 -- 172.21.15.53:0/3858247182 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0043c0 con 0x7f1b680d1220 2023-07-09T21:50:24.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.930+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/3858247182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b680d1220 msgr2=0x7f1b680b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.930+0000 7f1b6d3ff700 1 --2- 172.21.15.53:0/3858247182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b680d1220 0x7f1b680b43c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009870 tx=0x7f1b5c009b80 comp rx=0 tx=0).stop 2023-07-09T21:50:24.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.930+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/3858247182 shutdown_connections 2023-07-09T21:50:24.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.930+0000 7f1b6d3ff700 1 --2- 172.21.15.53:0/3858247182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b680d1220 0x7f1b680b43c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.930+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/3858247182 >> 172.21.15.53:0/3858247182 conn(0x7f1b6809c1b0 msgr2=0x7f1b680d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:24.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.931+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/3858247182 shutdown_connections 2023-07-09T21:50:24.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.931+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/3858247182 wait complete. 2023-07-09T21:50:24.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.932+0000 7f1b6d3ff700 1 Processor -- start 2023-07-09T21:50:24.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.932+0000 7f1b6d3ff700 1 -- start start 2023-07-09T21:50:24.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.933+0000 7f1b6d3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b680b0e20 0x7f1b681f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.933+0000 7f1b6d3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b680b3ff0 0x7f1b6815b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.933+0000 7f1b6d3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b680d1220 0x7f1b6815bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.933+0000 7f1b6d3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6815e170 con 0x7f1b680d1220 2023-07-09T21:50:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.933+0000 7f1b6d3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b680ce460 con 0x7f1b680b3ff0 2023-07-09T21:50:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.933+0000 7f1b6d3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6815d840 con 0x7f1b680b0e20 2023-07-09T21:50:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.934+0000 7f1b677fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b680d1220 0x7f1b6815bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.934+0000 7f1b66ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b680b0e20 0x7f1b681f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.934+0000 7f1b677fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b680d1220 0x7f1b6815bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40300/0 (socket says 172.21.15.53:40300) 2023-07-09T21:50:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.934+0000 7f1b667fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b680b3ff0 0x7f1b6815b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.934+0000 7f1b677fe700 1 -- 172.21.15.53:0/4238067249 learned_addr learned my addr 172.21.15.53:0/4238067249 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:24.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.934+0000 7f1b677fe700 1 -- 172.21.15.53:0/4238067249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b680b0e20 msgr2=0x7f1b681f2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.934+0000 7f1b677fe700 1 --2- 172.21.15.53:0/4238067249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b680b0e20 0x7f1b681f2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.934+0000 7f1b677fe700 1 -- 172.21.15.53:0/4238067249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b680b3ff0 msgr2=0x7f1b6815b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:24.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.934+0000 7f1b677fe700 1 --2- 172.21.15.53:0/4238067249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b680b3ff0 0x7f1b6815b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:24.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.934+0000 7f1b677fe700 1 -- 172.21.15.53:0/4238067249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c0094a0 con 0x7f1b680d1220 2023-07-09T21:50:24.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.934+0000 7f1b677fe700 1 --2- 172.21.15.53:0/4238067249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b680d1220 0x7f1b6815bc30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1b60001b60 tx=0x7f1b6000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:24.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.935+0000 7f1b4f7fe700 1 -- 172.21.15.53:0/4238067249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6000acf0 con 0x7f1b680d1220 2023-07-09T21:50:24.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.935+0000 7f1b4f7fe700 1 -- 172.21.15.53:0/4238067249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6000ae50 con 0x7f1b680d1220 2023-07-09T21:50:24.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.935+0000 7f1b4f7fe700 1 -- 172.21.15.53:0/4238067249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60007310 con 0x7f1b680d1220 2023-07-09T21:50:24.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.935+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/4238067249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6815db20 con 0x7f1b680d1220 2023-07-09T21:50:24.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.935+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/4238067249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6815e600 con 0x7f1b680d1220 2023-07-09T21:50:24.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.936+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/4238067249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6815e7f0 con 0x7f1b680d1220 2023-07-09T21:50:24.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.937+0000 7f1b4f7fe700 1 -- 172.21.15.53:0/4238067249 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b60007470 con 0x7f1b680d1220 2023-07-09T21:50:24.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.938+0000 7f1b4f7fe700 1 --2- 172.21.15.53:0/4238067249 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1b5406ad10 0x7f1b5406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:24.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.938+0000 7f1b4f7fe700 1 -- 172.21.15.53:0/4238067249 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b60089060 con 0x7f1b680d1220 2023-07-09T21:50:24.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.939+0000 7f1b66ffd700 1 --2- 172.21.15.53:0/4238067249 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1b5406ad10 0x7f1b5406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:24.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.939+0000 7f1b66ffd700 1 --2- 172.21.15.53:0/4238067249 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1b5406ad10 0x7f1b5406d1c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1b580011e0 tx=0x7f1b58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:24.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:24.942+0000 7f1b4f7fe700 1 -- 172.21.15.53:0/4238067249 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1b600bb310 con 0x7f1b680d1220 2023-07-09T21:50:25.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.194+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/4238067249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1b680b8e80 con 0x7f1b680d1220 2023-07-09T21:50:25.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.796+0000 7f1b4f7fe700 1 -- 172.21.15.53:0/4238067249 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1b680b8e80 con 0x7f1b680d1220 2023-07-09T21:50:25.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.799+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/4238067249 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1b5406ad10 msgr2=0x7f1b5406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:25.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.799+0000 7f1b6d3ff700 1 --2- 172.21.15.53:0/4238067249 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1b5406ad10 0x7f1b5406d1c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1b580011e0 tx=0x7f1b58009040 comp rx=0 tx=0).stop 2023-07-09T21:50:25.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.799+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/4238067249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b680d1220 msgr2=0x7f1b6815bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:25.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.799+0000 7f1b6d3ff700 1 --2- 172.21.15.53:0/4238067249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b680d1220 0x7f1b6815bc30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1b60001b60 tx=0x7f1b6000a340 comp rx=0 tx=0).stop 2023-07-09T21:50:25.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.800+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/4238067249 shutdown_connections 2023-07-09T21:50:25.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.800+0000 7f1b6d3ff700 1 --2- 172.21.15.53:0/4238067249 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1b5406ad10 0x7f1b5406d1c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:25.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.800+0000 7f1b6d3ff700 1 --2- 172.21.15.53:0/4238067249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b680d1220 0x7f1b6815bc30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:25.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.800+0000 7f1b6d3ff700 1 --2- 172.21.15.53:0/4238067249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b680b0e20 0x7f1b681f2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:25.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.800+0000 7f1b6d3ff700 1 --2- 172.21.15.53:0/4238067249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b680b3ff0 0x7f1b6815b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:25.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.800+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/4238067249 >> 172.21.15.53:0/4238067249 conn(0x7f1b6809c1b0 msgr2=0x7f1b680b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:25.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.800+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/4238067249 shutdown_connections 2023-07-09T21:50:25.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:25.800+0000 7f1b6d3ff700 1 -- 172.21.15.53:0/4238067249 wait complete. 2023-07-09T21:50:25.823 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T21:50:25.823 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T21:50:26.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.028+0000 7f2996bff700 1 Processor -- start 2023-07-09T21:50:26.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.029+0000 7f2996bff700 1 -- start start 2023-07-09T21:50:26.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.030+0000 7f2996bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29900b3ff0 0x7f29900b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:26.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.030+0000 7f2996bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900d0b10 0x7f29900d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:26.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.030+0000 7f2996bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29900b8e80 con 0x7f29900b25d0 2023-07-09T21:50:26.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.030+0000 7f2996bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29900d14a0 con 0x7f29900b3ff0 2023-07-09T21:50:26.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.030+0000 7f2996bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29900b1e30 con 0x7f29900d0b10 2023-07-09T21:50:26.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.030+0000 7f299499b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29900b3ff0 0x7f29900b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:26.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.030+0000 7f299499b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29900b3ff0 0x7f29900b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40306/0 (socket says 172.21.15.53:40306) 2023-07-09T21:50:26.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.030+0000 7f299499b700 1 -- 172.21.15.53:0/3578814323 learned_addr learned my addr 172.21.15.53:0/3578814323 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:26.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.030+0000 7f298ffff700 1 --2- 172.21.15.53:0/3578814323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900d0b10 0x7f29900d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:26.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.030+0000 7f299499b700 1 -- 172.21.15.53:0/3578814323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900d0b10 msgr2=0x7f29900d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:26.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.031+0000 7f299499b700 1 --2- 172.21.15.53:0/3578814323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900d0b10 0x7f29900d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:26.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.031+0000 7f299499b700 1 -- 172.21.15.53:0/3578814323 >> v1:172.21.15.184:6789/0 conn(0x7f29900b25d0 legacy=0x7f29900b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:26.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.031+0000 7f299499b700 1 -- 172.21.15.53:0/3578814323 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29900afaa0 con 0x7f29900b3ff0 2023-07-09T21:50:26.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.031+0000 7f299499b700 1 --2- 172.21.15.53:0/3578814323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29900b3ff0 0x7f29900b43c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f29840098f0 tx=0x7f2984009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5f2e13c81aae42 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:26.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.031+0000 7f298f7fe700 1 -- 172.21.15.53:0/3578814323 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400b8a0 con 0x7f29900b3ff0 2023-07-09T21:50:26.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.031+0000 7f298f7fe700 1 -- 172.21.15.53:0/3578814323 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298400ba00 con 0x7f29900b3ff0 2023-07-09T21:50:26.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.031+0000 7f298f7fe700 1 -- 172.21.15.53:0/3578814323 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400bd90 con 0x7f29900b3ff0 2023-07-09T21:50:26.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.032+0000 7f2996bff700 1 -- 172.21.15.53:0/3578814323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29900b3ff0 msgr2=0x7f29900b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:26.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.032+0000 7f2996bff700 1 --2- 172.21.15.53:0/3578814323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29900b3ff0 0x7f29900b43c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f29840098f0 tx=0x7f2984009c00 comp rx=0 tx=0).stop 2023-07-09T21:50:26.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.032+0000 7f2996bff700 1 -- 172.21.15.53:0/3578814323 shutdown_connections 2023-07-09T21:50:26.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.032+0000 7f2996bff700 1 --2- 172.21.15.53:0/3578814323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29900b3ff0 0x7f29900b43c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:26.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.032+0000 7f2996bff700 1 --2- 172.21.15.53:0/3578814323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900d0b10 0x7f29900d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:26.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.032+0000 7f2996bff700 1 -- 172.21.15.53:0/3578814323 >> 172.21.15.53:0/3578814323 conn(0x7f299009c1b0 msgr2=0x7f29900d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:26.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.032+0000 7f2996bff700 1 -- 172.21.15.53:0/3578814323 shutdown_connections 2023-07-09T21:50:26.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.032+0000 7f2996bff700 1 -- 172.21.15.53:0/3578814323 wait complete. 2023-07-09T21:50:26.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.033+0000 7f2996bff700 1 Processor -- start 2023-07-09T21:50:26.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.034+0000 7f2996bff700 1 -- start start 2023-07-09T21:50:26.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.034+0000 7f2996bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29900b25d0 0x7f299015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:26.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f2996bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29900b3ff0 0x7f29900ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:26.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f2996bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900d0b10 0x7f29901f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:26.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f2996bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29901f2bc0 con 0x7f29900b3ff0 2023-07-09T21:50:26.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f2996bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29900cda60 con 0x7f29900b25d0 2023-07-09T21:50:26.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f2996bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29901f2600 con 0x7f29900d0b10 2023-07-09T21:50:26.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f298ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29900b3ff0 0x7f29900ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:26.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f298ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29900b3ff0 0x7f29900ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40316/0 (socket says 172.21.15.53:40316) 2023-07-09T21:50:26.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f298ffff700 1 -- 172.21.15.53:0/108579985 learned_addr learned my addr 172.21.15.53:0/108579985 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:26.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f299519c700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900d0b10 0x7f29901f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:26.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f299499b700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29900b25d0 0x7f299015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:26.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f298ffff700 1 -- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900d0b10 msgr2=0x7f29901f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:26.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f298ffff700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900d0b10 0x7f29901f1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:26.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f298ffff700 1 -- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29900b25d0 msgr2=0x7f299015b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:26.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f298ffff700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29900b25d0 0x7f299015b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:26.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f298ffff700 1 -- 172.21.15.53:0/108579985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2984009550 con 0x7f29900b3ff0 2023-07-09T21:50:26.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.035+0000 7f298ffff700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29900b3ff0 0x7f29900ca010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f297c00d800 tx=0x7f297c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:26.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.036+0000 7f298d7fa700 1 -- 172.21.15.53:0/108579985 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c0125f0 con 0x7f29900b3ff0 2023-07-09T21:50:26.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.036+0000 7f298d7fa700 1 -- 172.21.15.53:0/108579985 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c012750 con 0x7f29900b3ff0 2023-07-09T21:50:26.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.036+0000 7f298d7fa700 1 -- 172.21.15.53:0/108579985 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c012b00 con 0x7f29900b3ff0 2023-07-09T21:50:26.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.036+0000 7f2996bff700 1 -- 172.21.15.53:0/108579985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29901f28e0 con 0x7f29900b3ff0 2023-07-09T21:50:26.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.036+0000 7f2996bff700 1 -- 172.21.15.53:0/108579985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29900ca550 con 0x7f29900b3ff0 2023-07-09T21:50:26.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.037+0000 7f2996bff700 1 -- 172.21.15.53:0/108579985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29900cd550 con 0x7f29900b3ff0 2023-07-09T21:50:26.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.038+0000 7f298d7fa700 1 -- 172.21.15.53:0/108579985 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f297c012c60 con 0x7f29900b3ff0 2023-07-09T21:50:26.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.039+0000 7f298d7fa700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f297406ace0 0x7f297406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:26.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.039+0000 7f298d7fa700 1 -- 172.21.15.53:0/108579985 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f297c089530 con 0x7f29900b3ff0 2023-07-09T21:50:26.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.039+0000 7f299499b700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f297406ace0 0x7f297406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:26.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.040+0000 7f299499b700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f297406ace0 0x7f297406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2984009c40 tx=0x7f2984008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:26.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.043+0000 7f298d7fa700 1 -- 172.21.15.53:0/108579985 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f29900cd550 con 0x7f29900b3ff0 2023-07-09T21:50:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.295+0000 7f2996bff700 1 -- 172.21.15.53:0/108579985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f29900cd520 con 0x7f29900b3ff0 2023-07-09T21:50:26.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.799+0000 7f298d7fa700 1 -- 172.21.15.53:0/108579985 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f297c054540 con 0x7f29900b3ff0 2023-07-09T21:50:26.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.802+0000 7f2996bff700 1 -- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f297406ace0 msgr2=0x7f297406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:26.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.802+0000 7f2996bff700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f297406ace0 0x7f297406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2984009c40 tx=0x7f2984008030 comp rx=0 tx=0).stop 2023-07-09T21:50:26.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.802+0000 7f2996bff700 1 -- 172.21.15.53:0/108579985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29900b3ff0 msgr2=0x7f29900ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:26.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.802+0000 7f2996bff700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29900b3ff0 0x7f29900ca010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f297c00d800 tx=0x7f297c00db10 comp rx=0 tx=0).stop 2023-07-09T21:50:26.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.802+0000 7f2996bff700 1 -- 172.21.15.53:0/108579985 shutdown_connections 2023-07-09T21:50:26.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.802+0000 7f2996bff700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f297406ace0 0x7f297406d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:26.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.802+0000 7f2996bff700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900d0b10 0x7f29901f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:26.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.802+0000 7f2996bff700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29900b25d0 0x7f299015b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:26.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.802+0000 7f2996bff700 1 --2- 172.21.15.53:0/108579985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29900b3ff0 0x7f29900ca010 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:26.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.802+0000 7f2996bff700 1 -- 172.21.15.53:0/108579985 >> 172.21.15.53:0/108579985 conn(0x7f299009c1b0 msgr2=0x7f299006b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:26.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.803+0000 7f2996bff700 1 -- 172.21.15.53:0/108579985 shutdown_connections 2023-07-09T21:50:26.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:26.803+0000 7f2996bff700 1 -- 172.21.15.53:0/108579985 wait complete. 2023-07-09T21:50:26.829 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T21:50:26.830 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:50:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.032+0000 7f80641ff700 1 Processor -- start 2023-07-09T21:50:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.032+0000 7f80641ff700 1 -- start start 2023-07-09T21:50:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.033+0000 7f80641ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f805c0b2350 0x7f805c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.033+0000 7f80641ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805c0d2ce0 con 0x7f805c0d1220 2023-07-09T21:50:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.033+0000 7f80641ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805c0b3350 con 0x7f805c0b1e00 2023-07-09T21:50:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.033+0000 7f80641ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0b3630 con 0x7f805c0b2350 2023-07-09T21:50:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f806179a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f805c0d1220 0x7f805c0afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37632/0 (socket says 172.21.15.53:37632) 2023-07-09T21:50:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f806179a700 1 -- 172.21.15.53:0/1757879125 learned_addr learned my addr 172.21.15.53:0/1757879125 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f806279c700 1 --2- 172.21.15.53:0/1757879125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f805c0b2350 0x7f805c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795008273 0 0) 0x7f805c0d2ce0 con 0x7f805c0d1220 2023-07-09T21:50:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80480035b0 con 0x7f805c0d1220 2023-07-09T21:50:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322407660 0 0) 0x7f805c0b3350 con 0x7f805c0b1e00 2023-07-09T21:50:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f805c0d2ce0 con 0x7f805c0b1e00 2023-07-09T21:50:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3900202738 0 0) 0x7f80480035b0 con 0x7f805c0d1220 2023-07-09T21:50:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f805c0b2350 msgr2=0x7f805c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f8060f99700 1 --2- 172.21.15.53:0/1757879125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f805c0b2350 0x7f805c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 >> v1:172.21.15.184:6789/0 conn(0x7f805c0b1e00 legacy=0x7f805c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805c0b3910 con 0x7f805c0d1220 2023-07-09T21:50:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f804c0015f0 con 0x7f805c0d1220 2023-07-09T21:50:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 >> v1:172.21.15.53:6789/0 conn(0x7f805c0d1220 legacy=0x7f805c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.034+0000 7f8060f99700 1 --2- 172.21.15.53:0/1757879125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f805c0b2350 0x7f8048003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f8060f99700 1 --2- 172.21.15.53:0/1757879125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8048004170 0x7f8048004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f8060f99700 1 --2- 172.21.15.53:0/1757879125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8048004d90 0x7f8048005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0b3630 con 0x7f8048004d90 2023-07-09T21:50:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804800bc50 con 0x7f8048004170 2023-07-09T21:50:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804800be10 con 0x7f805c0b2350 2023-07-09T21:50:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f806279c700 1 --2- 172.21.15.53:0/1757879125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8048004d90 0x7f8048005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f8061f9b700 1 --2- 172.21.15.53:0/1757879125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f805c0b2350 0x7f8048003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f806179a700 1 --2- 172.21.15.53:0/1757879125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8048004170 0x7f8048004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f806279c700 1 -- 172.21.15.53:0/1757879125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f805c0b2350 msgr2=0x7f8048003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f806279c700 1 --2- 172.21.15.53:0/1757879125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f805c0b2350 0x7f8048003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f806279c700 1 -- 172.21.15.53:0/1757879125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8048004170 msgr2=0x7f8048004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f806279c700 1 --2- 172.21.15.53:0/1757879125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8048004170 0x7f8048004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f806279c700 1 -- 172.21.15.53:0/1757879125 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80480035b0 con 0x7f8048004d90 2023-07-09T21:50:27.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f806179a700 1 --2- 172.21.15.53:0/1757879125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8048004170 0x7f8048004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:27.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.035+0000 7f806279c700 1 --2- 172.21.15.53:0/1757879125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8048004d90 0x7f8048005200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8054009f90 tx=0x7f8048005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e65b74ad632bd83 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:27.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.036+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805400ec30 con 0x7f8048004d90 2023-07-09T21:50:27.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.036+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805400f040 con 0x7f8048004d90 2023-07-09T21:50:27.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.036+0000 7f8060f99700 1 -- 172.21.15.53:0/1757879125 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054014480 con 0x7f8048004d90 2023-07-09T21:50:27.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.036+0000 7f80641ff700 1 -- 172.21.15.53:0/1757879125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8048004d90 msgr2=0x7f8048005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.036+0000 7f80641ff700 1 --2- 172.21.15.53:0/1757879125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8048004d90 0x7f8048005200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8054009f90 tx=0x7f8048005880 comp rx=0 tx=0).stop 2023-07-09T21:50:27.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.036+0000 7f806279c700 1 -- 172.21.15.53:0/1757879125 reap_dead start 2023-07-09T21:50:27.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.036+0000 7f80641ff700 1 -- 172.21.15.53:0/1757879125 shutdown_connections 2023-07-09T21:50:27.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.036+0000 7f80641ff700 1 -- 172.21.15.53:0/1757879125 >> 172.21.15.53:0/1757879125 conn(0x7f805c09c1d0 msgr2=0x7f805c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:27.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.036+0000 7f80641ff700 1 -- 172.21.15.53:0/1757879125 shutdown_connections 2023-07-09T21:50:27.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.036+0000 7f80641ff700 1 -- 172.21.15.53:0/1757879125 wait complete. 2023-07-09T21:50:27.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.038+0000 7f80641ff700 1 Processor -- start 2023-07-09T21:50:27.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.038+0000 7f80641ff700 1 -- start start 2023-07-09T21:50:27.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.039+0000 7f80641ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8048004d90 0x7f805c0cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.039+0000 7f80641ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f805c155a40 0x7f805c0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.039+0000 7f80641ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805c0c9150 0x7f805c1453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.039+0000 7f80641ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c1434c0 con 0x7f805c0c9150 2023-07-09T21:50:27.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.039+0000 7f80641ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c143760 con 0x7f805c155a40 2023-07-09T21:50:27.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.039+0000 7f80641ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805c143a40 con 0x7f8048004d90 2023-07-09T21:50:27.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.039+0000 7f806279c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805c0c9150 0x7f805c1453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.039+0000 7f806279c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805c0c9150 0x7f805c1453b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40334/0 (socket says 172.21.15.53:40334) 2023-07-09T21:50:27.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.039+0000 7f806279c700 1 -- 172.21.15.53:0/2393021450 learned_addr learned my addr 172.21.15.53:0/2393021450 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:27.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.040+0000 7f806279c700 1 -- 172.21.15.53:0/2393021450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8048004d90 msgr2=0x7f805c0cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.040+0000 7f806279c700 1 --2- 172.21.15.53:0/2393021450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8048004d90 0x7f805c0cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.040+0000 7f806279c700 1 -- 172.21.15.53:0/2393021450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f805c155a40 msgr2=0x7f805c0caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.040+0000 7f806279c700 1 --2- 172.21.15.53:0/2393021450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f805c155a40 0x7f805c0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.040+0000 7f806279c700 1 -- 172.21.15.53:0/2393021450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805c143d20 con 0x7f805c0c9150 2023-07-09T21:50:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.040+0000 7f806279c700 1 --2- 172.21.15.53:0/2393021450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805c0c9150 0x7f805c1453b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8054017040 tx=0x7f8054009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.040+0000 7f80527fc700 1 -- 172.21.15.53:0/2393021450 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054009410 con 0x7f805c0c9150 2023-07-09T21:50:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.040+0000 7f80527fc700 1 -- 172.21.15.53:0/2393021450 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8054021070 con 0x7f805c0c9150 2023-07-09T21:50:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.040+0000 7f80527fc700 1 -- 172.21.15.53:0/2393021450 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054014d70 con 0x7f805c0c9150 2023-07-09T21:50:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.040+0000 7f80641ff700 1 -- 172.21.15.53:0/2393021450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805c144000 con 0x7f805c0c9150 2023-07-09T21:50:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.040+0000 7f80641ff700 1 -- 172.21.15.53:0/2393021450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805c0cb460 con 0x7f805c0c9150 2023-07-09T21:50:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.041+0000 7f80641ff700 1 -- 172.21.15.53:0/2393021450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805c04e280 con 0x7f805c0c9150 2023-07-09T21:50:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.042+0000 7f80527fc700 1 -- 172.21.15.53:0/2393021450 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8054003a20 con 0x7f805c0c9150 2023-07-09T21:50:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.043+0000 7f80527fc700 1 --2- 172.21.15.53:0/2393021450 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f804006ace0 0x7f804006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.043+0000 7f80527fc700 1 -- 172.21.15.53:0/2393021450 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f805408a5e0 con 0x7f805c0c9150 2023-07-09T21:50:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.044+0000 7f8061f9b700 1 --2- 172.21.15.53:0/2393021450 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f804006ace0 0x7f804006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.044+0000 7f8061f9b700 1 --2- 172.21.15.53:0/2393021450 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f804006ace0 0x7f804006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8058001130 tx=0x7f8058009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.047+0000 7f80527fc700 1 -- 172.21.15.53:0/2393021450 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8054055680 con 0x7f805c0c9150 2023-07-09T21:50:27.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.297+0000 7f80641ff700 1 -- 172.21.15.53:0/2393021450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f805c08c5a0 con 0x7f805c0c9150 2023-07-09T21:50:27.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.298+0000 7f80527fc700 1 -- 172.21.15.53:0/2393021450 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7f8054058ca0 con 0x7f805c0c9150 2023-07-09T21:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3421374491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3421374491},{"type":"v1","addr":"172.21.15.53:6835","nonce":3421374491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1569539203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":1569539203},{"type":"v1","addr":"172.21.15.184:6837","nonce":1569539203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3569510065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3569510065},{"type":"v1","addr":"172.21.15.53:6834","nonce":3569510065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:50:23.272725+0000","modified":"2023-07-09T21:50:26.798670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/3002520227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3002520227},{"type":"v1","addr":"172.21.15.184:6836","nonce":3002520227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:50:27.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.300+0000 7f80641ff700 1 -- 172.21.15.53:0/2393021450 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f804006ace0 msgr2=0x7f804006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.300+0000 7f80641ff700 1 --2- 172.21.15.53:0/2393021450 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f804006ace0 0x7f804006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8058001130 tx=0x7f8058009040 comp rx=0 tx=0).stop 2023-07-09T21:50:27.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.300+0000 7f80641ff700 1 -- 172.21.15.53:0/2393021450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805c0c9150 msgr2=0x7f805c1453b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.300+0000 7f80641ff700 1 --2- 172.21.15.53:0/2393021450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805c0c9150 0x7f805c1453b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8054017040 tx=0x7f8054009750 comp rx=0 tx=0).stop 2023-07-09T21:50:27.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.300+0000 7f80641ff700 1 -- 172.21.15.53:0/2393021450 shutdown_connections 2023-07-09T21:50:27.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.300+0000 7f80641ff700 1 --2- 172.21.15.53:0/2393021450 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f804006ace0 0x7f804006d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.300+0000 7f80641ff700 1 --2- 172.21.15.53:0/2393021450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805c0c9150 0x7f805c1453b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.300+0000 7f80641ff700 1 --2- 172.21.15.53:0/2393021450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8048004d90 0x7f805c0cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.300+0000 7f80641ff700 1 --2- 172.21.15.53:0/2393021450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f805c155a40 0x7f805c0caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.300+0000 7f80641ff700 1 -- 172.21.15.53:0/2393021450 >> 172.21.15.53:0/2393021450 conn(0x7f805c09c1d0 msgr2=0x7f805c0b8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:27.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.300+0000 7f80641ff700 1 -- 172.21.15.53:0/2393021450 shutdown_connections 2023-07-09T21:50:27.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.300+0000 7f80641ff700 1 -- 172.21.15.53:0/2393021450 wait complete. 2023-07-09T21:50:27.304 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 8 2023-07-09T21:50:27.321 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:50:27.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.518+0000 7f92ce9ff700 1 Processor -- start 2023-07-09T21:50:27.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.518+0000 7f92ce9ff700 1 -- start start 2023-07-09T21:50:27.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.520+0000 7f92ce9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f92c80b1e00 0x7f92c80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.520+0000 7f92ce9ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c80d2ce0 con 0x7f92c80b2350 2023-07-09T21:50:27.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.520+0000 7f92ce9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c80b3350 con 0x7f92c80d1220 2023-07-09T21:50:27.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.520+0000 7f92ce9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c80b3630 con 0x7f92c80b1e00 2023-07-09T21:50:27.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.520+0000 7f92c77fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f92c80b2350 0x7f92c80d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37638/0 (socket says 172.21.15.53:37638) 2023-07-09T21:50:27.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.520+0000 7f92c77fe700 1 -- 172.21.15.53:0/3613859492 learned_addr learned my addr 172.21.15.53:0/3613859492 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:27.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.520+0000 7f92c7fff700 1 --2- 172.21.15.53:0/3613859492 >> v2:172.21.15.184:3300/0 conn(0x7f92c80b1e00 0x7f92c80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.520+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059918304 0 0) 0x7f92c80d2ce0 con 0x7f92c80b2350 2023-07-09T21:50:27.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.520+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92b00035b0 con 0x7f92c80b2350 2023-07-09T21:50:27.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 390615294 0 0) 0x7f92b00035b0 con 0x7f92c80b2350 2023-07-09T21:50:27.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 >> v2:172.21.15.184:3300/0 conn(0x7f92c80b1e00 msgr2=0x7f92c80b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:27.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c6ffd700 1 --2- 172.21.15.53:0/3613859492 >> v2:172.21.15.184:3300/0 conn(0x7f92c80b1e00 0x7f92c80b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 >> v1:172.21.15.184:6789/0 conn(0x7f92c80d1220 legacy=0x7f92c80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c80b3910 con 0x7f92c80b2350 2023-07-09T21:50:27.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f92bc001670 con 0x7f92c80b2350 2023-07-09T21:50:27.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 >> v1:172.21.15.53:6789/0 conn(0x7f92c80b2350 legacy=0x7f92c80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c6ffd700 1 --2- 172.21.15.53:0/3613859492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b0003a00 0x7f92b0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c6ffd700 1 --2- 172.21.15.53:0/3613859492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92b0004850 0x7f92b0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c6ffd700 1 --2- 172.21.15.53:0/3613859492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92b0005200 0x7f92b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80b3630 con 0x7f92b0004850 2023-07-09T21:50:27.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b000c110 con 0x7f92b0003a00 2023-07-09T21:50:27.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b000c2d0 con 0x7f92b0005200 2023-07-09T21:50:27.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c77fe700 1 --2- 172.21.15.53:0/3613859492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92b0004850 0x7f92b0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92c7fff700 1 --2- 172.21.15.53:0/3613859492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b0003a00 0x7f92b0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.521+0000 7f92ccf9c700 1 --2- 172.21.15.53:0/3613859492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92b0005200 0x7f92b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.522+0000 7f92c7fff700 1 -- 172.21.15.53:0/3613859492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92b0005200 msgr2=0x7f92b000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:27.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.522+0000 7f92c7fff700 1 --2- 172.21.15.53:0/3613859492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92b0005200 0x7f92b000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.522+0000 7f92c7fff700 1 -- 172.21.15.53:0/3613859492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92b0004850 msgr2=0x7f92b0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:27.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.522+0000 7f92c7fff700 1 --2- 172.21.15.53:0/3613859492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92b0004850 0x7f92b0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.522+0000 7f92c7fff700 1 -- 172.21.15.53:0/3613859492 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00035b0 con 0x7f92b0003a00 2023-07-09T21:50:27.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.522+0000 7f92c77fe700 1 --2- 172.21.15.53:0/3613859492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92b0004850 0x7f92b0004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:50:27.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.522+0000 7f92ccf9c700 1 -- 172.21.15.53:0/3613859492 reap_dead start 2023-07-09T21:50:27.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.522+0000 7f92c7fff700 1 --2- 172.21.15.53:0/3613859492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b0003a00 0x7f92b0003e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009b40 tx=0x7f92b0005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bd2b4bf7d66ee1b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:27.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.522+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8005a20 con 0x7f92b0003a00 2023-07-09T21:50:27.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.522+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8005b80 con 0x7f92b0003a00 2023-07-09T21:50:27.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.522+0000 7f92c6ffd700 1 -- 172.21.15.53:0/3613859492 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800e6c0 con 0x7f92b0003a00 2023-07-09T21:50:27.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.523+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3613859492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b0003a00 msgr2=0x7f92b0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.523+0000 7f92ce9ff700 1 --2- 172.21.15.53:0/3613859492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b0003a00 0x7f92b0003e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009b40 tx=0x7f92b0005880 comp rx=0 tx=0).stop 2023-07-09T21:50:27.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.523+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3613859492 shutdown_connections 2023-07-09T21:50:27.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.523+0000 7f92ce9ff700 1 --2- 172.21.15.53:0/3613859492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b0003a00 0x7f92b0003e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.523+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3613859492 >> 172.21.15.53:0/3613859492 conn(0x7f92c809c1d0 msgr2=0x7f92c80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:27.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.523+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3613859492 shutdown_connections 2023-07-09T21:50:27.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.523+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3613859492 wait complete. 2023-07-09T21:50:27.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.525+0000 7f92ce9ff700 1 Processor -- start 2023-07-09T21:50:27.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.525+0000 7f92ce9ff700 1 -- start start 2023-07-09T21:50:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92ce9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92b0003a00 0x7f92c8157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92ce9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c80c8aa0 0x7f92c80cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92ce9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c80c8f10 0x7f92c80cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92ce9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80b6b20 con 0x7f92b0003a00 2023-07-09T21:50:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92ce9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80b5f10 con 0x7f92c80c8f10 2023-07-09T21:50:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92ce9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80b61f0 con 0x7f92c80c8aa0 2023-07-09T21:50:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92c7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92b0003a00 0x7f92c8157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92c7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92b0003a00 0x7f92c8157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40362/0 (socket says 172.21.15.53:40362) 2023-07-09T21:50:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92c7fff700 1 -- 172.21.15.53:0/3191502733 learned_addr learned my addr 172.21.15.53:0/3191502733 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92ccf9c700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c80c8f10 0x7f92c80cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92c77fe700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c80c8aa0 0x7f92c80cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92c7fff700 1 -- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c80c8aa0 msgr2=0x7f92c80cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92c7fff700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c80c8aa0 0x7f92c80cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92c7fff700 1 -- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c80c8f10 msgr2=0x7f92c80cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92c7fff700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c80c8f10 0x7f92c80cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.526+0000 7f92c7fff700 1 -- 172.21.15.53:0/3191502733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c80b64d0 con 0x7f92b0003a00 2023-07-09T21:50:27.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.527+0000 7f92c7fff700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92b0003a00 0x7f92c8157ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92b8000c00 tx=0x7f92b80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:27.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.527+0000 7f92c4ff9700 1 -- 172.21.15.53:0/3191502733 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8020070 con 0x7f92b0003a00 2023-07-09T21:50:27.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.527+0000 7f92c4ff9700 1 -- 172.21.15.53:0/3191502733 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8004050 con 0x7f92b0003a00 2023-07-09T21:50:27.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.527+0000 7f92c4ff9700 1 -- 172.21.15.53:0/3191502733 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80043e0 con 0x7f92b0003a00 2023-07-09T21:50:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.527+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3191502733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c80b67b0 con 0x7f92b0003a00 2023-07-09T21:50:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.527+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3191502733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c8154b10 con 0x7f92b0003a00 2023-07-09T21:50:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.528+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3191502733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c8155ae0 con 0x7f92b0003a00 2023-07-09T21:50:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.529+0000 7f92c4ff9700 1 -- 172.21.15.53:0/3191502733 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f92b80036a0 con 0x7f92b0003a00 2023-07-09T21:50:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.530+0000 7f92c4ff9700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f92b406ace0 0x7f92b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.530+0000 7f92c4ff9700 1 -- 172.21.15.53:0/3191502733 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f92b808a360 con 0x7f92b0003a00 2023-07-09T21:50:27.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.530+0000 7f92c77fe700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f92b406ace0 0x7f92b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.531+0000 7f92c77fe700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f92b406ace0 0x7f92b406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f92c80c7c30 tx=0x7f92bc004cc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:27.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.534+0000 7f92c4ff9700 1 -- 172.21.15.53:0/3191502733 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f92b8055400 con 0x7f92b0003a00 2023-07-09T21:50:27.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.748+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3191502733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92c80b6940 con 0x7f92b0003a00 2023-07-09T21:50:27.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.749+0000 7f92c4ff9700 1 -- 172.21.15.53:0/3191502733 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f92b8058a20 con 0x7f92b0003a00 2023-07-09T21:50:27.752 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:27.752 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:24.766288+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:50:27.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.751+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f92b406ace0 msgr2=0x7f92b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.751+0000 7f92ce9ff700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f92b406ace0 0x7f92b406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f92c80c7c30 tx=0x7f92bc004cc0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.752+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3191502733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92b0003a00 msgr2=0x7f92c8157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.752+0000 7f92ce9ff700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92b0003a00 0x7f92c8157ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92b8000c00 tx=0x7f92b80047c0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.752+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3191502733 shutdown_connections 2023-07-09T21:50:27.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.752+0000 7f92ce9ff700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f92b406ace0 0x7f92b406d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.752+0000 7f92ce9ff700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c80c8f10 0x7f92c80cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.752+0000 7f92ce9ff700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92b0003a00 0x7f92c8157ac0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.752+0000 7f92ce9ff700 1 --2- 172.21.15.53:0/3191502733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c80c8aa0 0x7f92c80cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.752+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3191502733 >> 172.21.15.53:0/3191502733 conn(0x7f92c809c1d0 msgr2=0x7f92c80d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:27.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.752+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3191502733 shutdown_connections 2023-07-09T21:50:27.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.752+0000 7f92ce9ff700 1 -- 172.21.15.53:0/3191502733 wait complete. 2023-07-09T21:50:27.772 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T21:50:27.773 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:50:27.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.972+0000 7fecf45ff700 1 Processor -- start 2023-07-09T21:50:27.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.972+0000 7fecf45ff700 1 -- start start 2023-07-09T21:50:27.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.972+0000 7fecf45ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fecec0d1220 0x7fecec0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.972+0000 7fecf45ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecec0b2350 0x7fecec0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.972+0000 7fecf45ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec0d2ce0 con 0x7fecec0b1e00 2023-07-09T21:50:27.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.972+0000 7fecf45ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecec0b3350 con 0x7fecec0d1220 2023-07-09T21:50:27.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.972+0000 7fecf45ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0b3630 con 0x7fecec0b2350 2023-07-09T21:50:27.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.973+0000 7fecf2b9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecec0b2350 0x7fecec0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.973+0000 7fecf1b9a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fecec0d1220 0x7fecec0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.973+0000 7fecf2b9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecec0b2350 0x7fecec0afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:53428/0 (socket says 172.21.15.53:53428) 2023-07-09T21:50:27.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.973+0000 7fecf2b9c700 1 -- 172.21.15.53:0/2537321434 learned_addr learned my addr 172.21.15.53:0/2537321434 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:27.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.973+0000 7fecf2b9c700 1 -- 172.21.15.53:0/2537321434 >> v2:172.21.15.184:3300/0 conn(0x7fecec0d1220 msgr2=0x7fecec0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:27.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.973+0000 7fecf2b9c700 1 --2- 172.21.15.53:0/2537321434 >> v2:172.21.15.184:3300/0 conn(0x7fecec0d1220 0x7fecec0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.973+0000 7fecf2b9c700 1 -- 172.21.15.53:0/2537321434 >> v1:172.21.15.184:6789/0 conn(0x7fecec0b1e00 legacy=0x7fecec0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.973+0000 7fecf2b9c700 1 -- 172.21.15.53:0/2537321434 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec0b3910 con 0x7fecec0b2350 2023-07-09T21:50:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.974+0000 7fecf2b9c700 1 --2- 172.21.15.53:0/2537321434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecec0b2350 0x7fecec0afac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fece4009e50 tx=0x7fece400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3116a280c5ddc05 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.974+0000 7fecf1399700 1 -- 172.21.15.53:0/2537321434 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400e070 con 0x7fecec0b2350 2023-07-09T21:50:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.974+0000 7fecf1399700 1 -- 172.21.15.53:0/2537321434 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece400b910 con 0x7fecec0b2350 2023-07-09T21:50:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.974+0000 7fecf1399700 1 -- 172.21.15.53:0/2537321434 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400bcc0 con 0x7fecec0b2350 2023-07-09T21:50:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.974+0000 7fecf45ff700 1 -- 172.21.15.53:0/2537321434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecec0b2350 msgr2=0x7fecec0afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.974+0000 7fecf45ff700 1 --2- 172.21.15.53:0/2537321434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecec0b2350 0x7fecec0afac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fece4009e50 tx=0x7fece400b330 comp rx=0 tx=0).stop 2023-07-09T21:50:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.974+0000 7fecf45ff700 1 -- 172.21.15.53:0/2537321434 shutdown_connections 2023-07-09T21:50:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.974+0000 7fecf45ff700 1 --2- 172.21.15.53:0/2537321434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecec0b2350 0x7fecec0afac0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.974+0000 7fecf45ff700 1 --2- 172.21.15.53:0/2537321434 >> v2:172.21.15.184:3300/0 conn(0x7fecec0d1220 0x7fecec0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.974+0000 7fecf45ff700 1 -- 172.21.15.53:0/2537321434 >> 172.21.15.53:0/2537321434 conn(0x7fecec09c1d0 msgr2=0x7fecec0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.975+0000 7fecf45ff700 1 -- 172.21.15.53:0/2537321434 shutdown_connections 2023-07-09T21:50:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.975+0000 7fecf45ff700 1 -- 172.21.15.53:0/2537321434 wait complete. 2023-07-09T21:50:27.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.976+0000 7fecf45ff700 1 Processor -- start 2023-07-09T21:50:27.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.977+0000 7fecf45ff700 1 -- start start 2023-07-09T21:50:27.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.977+0000 7fecf45ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecec0b1e00 0x7fecec152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.977+0000 7fecf45ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecec0b2350 0x7fecec0b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.977+0000 7fecf45ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecec0d1220 0x7fecec0b8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf45ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec152aa0 con 0x7fecec0b2350 2023-07-09T21:50:27.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf45ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0c77b0 con 0x7fecec0b1e00 2023-07-09T21:50:27.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf45ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0c6ba0 con 0x7fecec0d1220 2023-07-09T21:50:27.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf1b9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecec0b2350 0x7fecec0b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf1b9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecec0b2350 0x7fecec0b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40378/0 (socket says 172.21.15.53:40378) 2023-07-09T21:50:27.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf1b9a700 1 -- 172.21.15.53:0/726440447 learned_addr learned my addr 172.21.15.53:0/726440447 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf2b9c700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecec0d1220 0x7fecec0b8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf239b700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecec0b1e00 0x7fecec152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf1b9a700 1 -- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecec0d1220 msgr2=0x7fecec0b8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf1b9a700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecec0d1220 0x7fecec0b8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf1b9a700 1 -- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecec0b1e00 msgr2=0x7fecec152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf1b9a700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecec0b1e00 0x7fecec152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf1b9a700 1 -- 172.21.15.53:0/726440447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece4009b30 con 0x7fecec0b2350 2023-07-09T21:50:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf2b9c700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecec0d1220 0x7fecec0b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf239b700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecec0b1e00 0x7fecec152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.978+0000 7fecf1b9a700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecec0b2350 0x7fecec0b7f40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00e840 tx=0x7fecdc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.979+0000 7fece2ffd700 1 -- 172.21.15.53:0/726440447 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc009590 con 0x7fecec0b2350 2023-07-09T21:50:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.979+0000 7fece2ffd700 1 -- 172.21.15.53:0/726440447 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc013680 con 0x7fecec0b2350 2023-07-09T21:50:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.979+0000 7fecf45ff700 1 -- 172.21.15.53:0/726440447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecec0c6e80 con 0x7fecec0b2350 2023-07-09T21:50:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.979+0000 7fece2ffd700 1 -- 172.21.15.53:0/726440447 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc013a30 con 0x7fecec0b2350 2023-07-09T21:50:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.979+0000 7fecf45ff700 1 -- 172.21.15.53:0/726440447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecec0c7440 con 0x7fecec0b2350 2023-07-09T21:50:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.980+0000 7fecf45ff700 1 -- 172.21.15.53:0/726440447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecec0d3eb0 con 0x7fecec0b2350 2023-07-09T21:50:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.981+0000 7fece2ffd700 1 -- 172.21.15.53:0/726440447 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fecdc013b90 con 0x7fecec0b2350 2023-07-09T21:50:27.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.983+0000 7fece2ffd700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fecd006ace0 0x7fecd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:27.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.983+0000 7fece2ffd700 1 -- 172.21.15.53:0/726440447 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fecdc089440 con 0x7fecec0b2350 2023-07-09T21:50:27.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.983+0000 7fecf239b700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fecd006ace0 0x7fecd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:27.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.985+0000 7fecf239b700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fecd006ace0 0x7fecd006d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fece8000fb0 tx=0x7fece8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:27.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:27.988+0000 7fece2ffd700 1 -- 172.21.15.53:0/726440447 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fecdc0544e0 con 0x7fecec0b2350 2023-07-09T21:50:28.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.191+0000 7fecf45ff700 1 -- 172.21.15.53:0/726440447 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fecec0b3ed0 con 0x7fecd006ace0 2023-07-09T21:50:28.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.203+0000 7fece2ffd700 1 -- 172.21.15.53:0/726440447 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283407 (secure 0 0 0) 0x7fece80123d0 con 0x7fecd006ace0 2023-07-09T21:50:28.207 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:28.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.206+0000 7fecf45ff700 1 -- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fecd006ace0 msgr2=0x7fecd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:28.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.206+0000 7fecf45ff700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fecd006ace0 0x7fecd006d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fece8000fb0 tx=0x7fece8009040 comp rx=0 tx=0).stop 2023-07-09T21:50:28.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.206+0000 7fecf45ff700 1 -- 172.21.15.53:0/726440447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecec0b2350 msgr2=0x7fecec0b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:28.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.206+0000 7fecf45ff700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecec0b2350 0x7fecec0b7f40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00e840 tx=0x7fecdc00ec00 comp rx=0 tx=0).stop 2023-07-09T21:50:28.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.206+0000 7fecf45ff700 1 -- 172.21.15.53:0/726440447 shutdown_connections 2023-07-09T21:50:28.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.206+0000 7fecf45ff700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fecd006ace0 0x7fecd006d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.206+0000 7fecf45ff700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecec0d1220 0x7fecec0b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.206+0000 7fecf45ff700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecec0b1e00 0x7fecec152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.206+0000 7fecf45ff700 1 --2- 172.21.15.53:0/726440447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecec0b2350 0x7fecec0b7f40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.206+0000 7fecf45ff700 1 -- 172.21.15.53:0/726440447 >> 172.21.15.53:0/726440447 conn(0x7fecec09c1d0 msgr2=0x7fecec0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:28.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.206+0000 7fecf45ff700 1 -- 172.21.15.53:0/726440447 shutdown_connections 2023-07-09T21:50:28.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.206+0000 7fecf45ff700 1 -- 172.21.15.53:0/726440447 wait complete. 2023-07-09T21:50:28.211 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:50:28.226 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-09T21:50:26.851478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591932,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222636,"kb_used_data":2924,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754752084,"statfs":{"total":773094113280,"available":772866134016,"internally_reserved":0,"allocated":2994176,"data_stored":1813428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.104285"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.754655+0000","last_change":"2023-07-09T21:50:22.754655+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.754655+0000","last_undegraded":"2023-07-09T21:50:22.754655+0000","last_fullsized":"2023-07-09T21:50:22.754655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.756786+0000","last_change":"2023-07-09T21:50:22.756786+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.756786+0000","last_undegraded":"2023-07-09T21:50:22.756786+0000","last_fullsized":"2023-07-09T21:50:22.756786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801988+0000","last_change":"2023-07-09T21:50:23.792566+0000","last_active":"2023-07-09T21:50:23.801988+0000","last_peered":"2023-07-09T21:50:23.801988+0000","last_clean":"2023-07-09T21:50:23.801988+0000","last_became_active":"2023-07-09T21:50:23.792316+0000","last_became_peered":"2023-07-09T21:50:23.792316+0000","last_unstale":"2023-07-09T21:50:23.801988+0000","last_undegraded":"2023-07-09T21:50:23.801988+0000","last_fullsized":"2023-07-09T21:50:23.801988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762969+0000","last_change":"2023-07-09T21:50:22.762969+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762969+0000","last_undegraded":"2023-07-09T21:50:22.762969+0000","last_fullsized":"2023-07-09T21:50:22.762969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761501+0000","last_change":"2023-07-09T21:50:22.761501+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761501+0000","last_undegraded":"2023-07-09T21:50:22.761501+0000","last_fullsized":"2023-07-09T21:50:22.761501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802212+0000","last_change":"2023-07-09T21:50:23.798790+0000","last_active":"2023-07-09T21:50:23.802212+0000","last_peered":"2023-07-09T21:50:23.802212+0000","last_clean":"2023-07-09T21:50:23.802212+0000","last_became_active":"2023-07-09T21:50:23.798508+0000","last_became_peered":"2023-07-09T21:50:23.798508+0000","last_unstale":"2023-07-09T21:50:23.802212+0000","last_undegraded":"2023-07-09T21:50:23.802212+0000","last_fullsized":"2023-07-09T21:50:23.802212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:43.474786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.765773+0000","last_change":"2023-07-09T21:50:22.765773+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.765773+0000","last_undegraded":"2023-07-09T21:50:22.765773+0000","last_fullsized":"2023-07-09T21:50:22.765773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.756942+0000","last_change":"2023-07-09T21:50:22.756942+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.756942+0000","last_undegraded":"2023-07-09T21:50:22.756942+0000","last_fullsized":"2023-07-09T21:50:22.756942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.759981+0000","last_change":"2023-07-09T21:50:22.759981+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.759981+0000","last_undegraded":"2023-07-09T21:50:22.759981+0000","last_fullsized":"2023-07-09T21:50:22.759981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.755562+0000","last_change":"2023-07-09T21:50:22.755562+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.755562+0000","last_undegraded":"2023-07-09T21:50:22.755562+0000","last_fullsized":"2023-07-09T21:50:22.755562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801969+0000","last_change":"2023-07-09T21:50:23.787617+0000","last_active":"2023-07-09T21:50:23.801969+0000","last_peered":"2023-07-09T21:50:23.801969+0000","last_clean":"2023-07-09T21:50:23.801969+0000","last_became_active":"2023-07-09T21:50:23.787324+0000","last_became_peered":"2023-07-09T21:50:23.787324+0000","last_unstale":"2023-07-09T21:50:23.801969+0000","last_undegraded":"2023-07-09T21:50:23.801969+0000","last_fullsized":"2023-07-09T21:50:23.801969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:28.676168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.755444+0000","last_change":"2023-07-09T21:50:22.755444+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.755444+0000","last_undegraded":"2023-07-09T21:50:22.755444+0000","last_fullsized":"2023-07-09T21:50:22.755444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.755192+0000","last_change":"2023-07-09T21:50:22.755192+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.755192+0000","last_undegraded":"2023-07-09T21:50:22.755192+0000","last_fullsized":"2023-07-09T21:50:22.755192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.757837+0000","last_change":"2023-07-09T21:50:22.757837+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.757837+0000","last_undegraded":"2023-07-09T21:50:22.757837+0000","last_fullsized":"2023-07-09T21:50:22.757837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762272+0000","last_change":"2023-07-09T21:50:22.762272+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762272+0000","last_undegraded":"2023-07-09T21:50:22.762272+0000","last_fullsized":"2023-07-09T21:50:22.762272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801854+0000","last_change":"2023-07-09T21:50:23.792844+0000","last_active":"2023-07-09T21:50:23.801854+0000","last_peered":"2023-07-09T21:50:23.801854+0000","last_clean":"2023-07-09T21:50:23.801854+0000","last_became_active":"2023-07-09T21:50:23.792511+0000","last_became_peered":"2023-07-09T21:50:23.792511+0000","last_unstale":"2023-07-09T21:50:23.801854+0000","last_undegraded":"2023-07-09T21:50:23.801854+0000","last_fullsized":"2023-07-09T21:50:23.801854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:33.102940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.759469+0000","last_change":"2023-07-09T21:50:22.759469+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.759469+0000","last_undegraded":"2023-07-09T21:50:22.759469+0000","last_fullsized":"2023-07-09T21:50:22.759469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802103+0000","last_change":"2023-07-09T21:50:23.791210+0000","last_active":"2023-07-09T21:50:23.802103+0000","last_peered":"2023-07-09T21:50:23.802103+0000","last_clean":"2023-07-09T21:50:23.802103+0000","last_became_active":"2023-07-09T21:50:23.790958+0000","last_became_peered":"2023-07-09T21:50:23.790958+0000","last_unstale":"2023-07-09T21:50:23.802103+0000","last_undegraded":"2023-07-09T21:50:23.802103+0000","last_fullsized":"2023-07-09T21:50:23.802103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:23.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.755003+0000","last_change":"2023-07-09T21:50:22.755003+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.755003+0000","last_undegraded":"2023-07-09T21:50:22.755003+0000","last_fullsized":"2023-07-09T21:50:22.755003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801751+0000","last_change":"2023-07-09T21:50:23.788775+0000","last_active":"2023-07-09T21:50:23.801751+0000","last_peered":"2023-07-09T21:50:23.801751+0000","last_clean":"2023-07-09T21:50:23.801751+0000","last_became_active":"2023-07-09T21:50:23.788474+0000","last_became_peered":"2023-07-09T21:50:23.788474+0000","last_unstale":"2023-07-09T21:50:23.801751+0000","last_undegraded":"2023-07-09T21:50:23.801751+0000","last_fullsized":"2023-07-09T21:50:23.801751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:49.489636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761604+0000","last_change":"2023-07-09T21:50:22.761604+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761604+0000","last_undegraded":"2023-07-09T21:50:22.761604+0000","last_fullsized":"2023-07-09T21:50:22.761604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.758071+0000","last_change":"2023-07-09T21:50:22.758071+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.758071+0000","last_undegraded":"2023-07-09T21:50:22.758071+0000","last_fullsized":"2023-07-09T21:50:22.758071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762718+0000","last_change":"2023-07-09T21:50:22.762718+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762718+0000","last_undegraded":"2023-07-09T21:50:22.762718+0000","last_fullsized":"2023-07-09T21:50:22.762718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761637+0000","last_change":"2023-07-09T21:50:22.761637+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761637+0000","last_undegraded":"2023-07-09T21:50:22.761637+0000","last_fullsized":"2023-07-09T21:50:22.761637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790159+0000","last_change":"2023-07-09T21:50:23.785433+0000","last_active":"2023-07-09T21:50:23.790159+0000","last_peered":"2023-07-09T21:50:23.790159+0000","last_clean":"2023-07-09T21:50:23.790159+0000","last_became_active":"2023-07-09T21:50:23.785016+0000","last_became_peered":"2023-07-09T21:50:23.785016+0000","last_unstale":"2023-07-09T21:50:23.790159+0000","last_undegraded":"2023-07-09T21:50:23.790159+0000","last_fullsized":"2023-07-09T21:50:23.790159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:05:28.932158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790106+0000","last_change":"2023-07-09T21:50:23.781394+0000","last_active":"2023-07-09T21:50:23.790106+0000","last_peered":"2023-07-09T21:50:23.790106+0000","last_clean":"2023-07-09T21:50:23.790106+0000","last_became_active":"2023-07-09T21:50:23.781089+0000","last_became_peered":"2023-07-09T21:50:23.781089+0000","last_unstale":"2023-07-09T21:50:23.790106+0000","last_undegraded":"2023-07-09T21:50:23.790106+0000","last_fullsized":"2023-07-09T21:50:23.790106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:26:12.334998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.757413+0000","last_change":"2023-07-09T21:50:22.757413+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.757413+0000","last_undegraded":"2023-07-09T21:50:22.757413+0000","last_fullsized":"2023-07-09T21:50:22.757413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.812395+0000","last_change":"2023-07-09T21:50:22.774935+0000","last_active":"2023-07-09T21:50:23.812395+0000","last_peered":"2023-07-09T21:50:23.812395+0000","last_clean":"2023-07-09T21:50:23.812395+0000","last_became_active":"2023-07-09T21:50:22.774612+0000","last_became_peered":"2023-07-09T21:50:22.774612+0000","last_unstale":"2023-07-09T21:50:23.812395+0000","last_undegraded":"2023-07-09T21:50:23.812395+0000","last_fullsized":"2023-07-09T21:50:23.812395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:17:27.986566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.760621+0000","last_change":"2023-07-09T21:50:22.760621+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.760621+0000","last_undegraded":"2023-07-09T21:50:22.760621+0000","last_fullsized":"2023-07-09T21:50:22.760621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.777834+0000","last_change":"2023-07-09T21:50:22.772852+0000","last_active":"2023-07-09T21:50:23.777834+0000","last_peered":"2023-07-09T21:50:23.777834+0000","last_clean":"2023-07-09T21:50:23.777834+0000","last_became_active":"2023-07-09T21:50:22.772592+0000","last_became_peered":"2023-07-09T21:50:22.772592+0000","last_unstale":"2023-07-09T21:50:23.777834+0000","last_undegraded":"2023-07-09T21:50:23.777834+0000","last_fullsized":"2023-07-09T21:50:23.777834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:33:47.769844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761024+0000","last_change":"2023-07-09T21:50:22.761024+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761024+0000","last_undegraded":"2023-07-09T21:50:22.761024+0000","last_fullsized":"2023-07-09T21:50:22.761024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.774155+0000","last_change":"2023-07-09T21:50:22.771300+0000","last_active":"2023-07-09T21:50:22.774155+0000","last_peered":"2023-07-09T21:50:22.774155+0000","last_clean":"2023-07-09T21:50:22.774155+0000","last_became_active":"2023-07-09T21:50:22.770639+0000","last_became_peered":"2023-07-09T21:50:22.770639+0000","last_unstale":"2023-07-09T21:50:22.774155+0000","last_undegraded":"2023-07-09T21:50:22.774155+0000","last_fullsized":"2023-07-09T21:50:22.774155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:48.485365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762952+0000","last_change":"2023-07-09T21:50:22.762952+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762952+0000","last_undegraded":"2023-07-09T21:50:22.762952+0000","last_fullsized":"2023-07-09T21:50:22.762952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.782880+0000","last_change":"2023-07-09T21:50:22.781881+0000","last_active":"2023-07-09T21:50:22.782880+0000","last_peered":"2023-07-09T21:50:22.782880+0000","last_clean":"2023-07-09T21:50:22.782880+0000","last_became_active":"2023-07-09T21:50:22.781553+0000","last_became_peered":"2023-07-09T21:50:22.781553+0000","last_unstale":"2023-07-09T21:50:22.782880+0000","last_undegraded":"2023-07-09T21:50:22.782880+0000","last_fullsized":"2023-07-09T21:50:22.782880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:32.098668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.757174+0000","last_change":"2023-07-09T21:50:22.757174+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.757174+0000","last_undegraded":"2023-07-09T21:50:22.757174+0000","last_fullsized":"2023-07-09T21:50:22.757174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.781134+0000","last_change":"2023-07-09T21:50:22.775466+0000","last_active":"2023-07-09T21:50:22.781134+0000","last_peered":"2023-07-09T21:50:22.781134+0000","last_clean":"2023-07-09T21:50:22.781134+0000","last_became_active":"2023-07-09T21:50:22.775189+0000","last_became_peered":"2023-07-09T21:50:22.775189+0000","last_unstale":"2023-07-09T21:50:22.781134+0000","last_undegraded":"2023-07-09T21:50:22.781134+0000","last_fullsized":"2023-07-09T21:50:22.781134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:30:44.360848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.756722+0000","last_change":"2023-07-09T21:50:22.756722+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.756722+0000","last_undegraded":"2023-07-09T21:50:22.756722+0000","last_fullsized":"2023-07-09T21:50:22.756722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.779374+0000","last_change":"2023-07-09T21:50:22.776755+0000","last_active":"2023-07-09T21:50:22.779374+0000","last_peered":"2023-07-09T21:50:22.779374+0000","last_clean":"2023-07-09T21:50:22.779374+0000","last_became_active":"2023-07-09T21:50:22.776393+0000","last_became_peered":"2023-07-09T21:50:22.776393+0000","last_unstale":"2023-07-09T21:50:22.779374+0000","last_undegraded":"2023-07-09T21:50:22.779374+0000","last_fullsized":"2023-07-09T21:50:22.779374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:17:27.986566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.787655+0000","last_change":"2023-07-09T21:50:23.781306+0000","last_active":"2023-07-09T21:50:23.787655+0000","last_peered":"2023-07-09T21:50:23.787655+0000","last_clean":"2023-07-09T21:50:23.787655+0000","last_became_active":"2023-07-09T21:50:23.781040+0000","last_became_peered":"2023-07-09T21:50:23.781040+0000","last_unstale":"2023-07-09T21:50:23.787655+0000","last_undegraded":"2023-07-09T21:50:23.787655+0000","last_fullsized":"2023-07-09T21:50:23.787655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:24:58.710922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.818016+0000","last_change":"2023-07-09T21:50:22.778707+0000","last_active":"2023-07-09T21:50:23.818016+0000","last_peered":"2023-07-09T21:50:23.818016+0000","last_clean":"2023-07-09T21:50:23.818016+0000","last_became_active":"2023-07-09T21:50:22.778397+0000","last_became_peered":"2023-07-09T21:50:22.778397+0000","last_unstale":"2023-07-09T21:50:23.818016+0000","last_undegraded":"2023-07-09T21:50:23.818016+0000","last_fullsized":"2023-07-09T21:50:23.818016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:30:44.360848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801947+0000","last_change":"2023-07-09T21:50:23.793887+0000","last_active":"2023-07-09T21:50:23.801947+0000","last_peered":"2023-07-09T21:50:23.801947+0000","last_clean":"2023-07-09T21:50:23.801947+0000","last_became_active":"2023-07-09T21:50:23.793626+0000","last_became_peered":"2023-07-09T21:50:23.793626+0000","last_unstale":"2023-07-09T21:50:23.801947+0000","last_undegraded":"2023-07-09T21:50:23.801947+0000","last_fullsized":"2023-07-09T21:50:23.801947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:05.934271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.785652+0000","last_change":"2023-07-09T21:50:22.781947+0000","last_active":"2023-07-09T21:50:22.785652+0000","last_peered":"2023-07-09T21:50:22.785652+0000","last_clean":"2023-07-09T21:50:22.785652+0000","last_became_active":"2023-07-09T21:50:22.780676+0000","last_became_peered":"2023-07-09T21:50:22.780676+0000","last_unstale":"2023-07-09T21:50:22.785652+0000","last_undegraded":"2023-07-09T21:50:22.785652+0000","last_fullsized":"2023-07-09T21:50:22.785652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:41.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.758303+0000","last_change":"2023-07-09T21:50:22.758303+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.758303+0000","last_undegraded":"2023-07-09T21:50:22.758303+0000","last_fullsized":"2023-07-09T21:50:22.758303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.778439+0000","last_change":"2023-07-09T21:50:22.777294+0000","last_active":"2023-07-09T21:50:22.778439+0000","last_peered":"2023-07-09T21:50:22.778439+0000","last_clean":"2023-07-09T21:50:22.778439+0000","last_became_active":"2023-07-09T21:50:22.776308+0000","last_became_peered":"2023-07-09T21:50:22.776308+0000","last_unstale":"2023-07-09T21:50:22.778439+0000","last_undegraded":"2023-07-09T21:50:22.778439+0000","last_fullsized":"2023-07-09T21:50:22.778439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:29:15.348265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.756431+0000","last_change":"2023-07-09T21:50:22.756431+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.756431+0000","last_undegraded":"2023-07-09T21:50:22.756431+0000","last_fullsized":"2023-07-09T21:50:22.756431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.785609+0000","last_change":"2023-07-09T21:50:22.780710+0000","last_active":"2023-07-09T21:50:22.785609+0000","last_peered":"2023-07-09T21:50:22.785609+0000","last_clean":"2023-07-09T21:50:22.785609+0000","last_became_active":"2023-07-09T21:50:22.780392+0000","last_became_peered":"2023-07-09T21:50:22.780392+0000","last_unstale":"2023-07-09T21:50:22.785609+0000","last_undegraded":"2023-07-09T21:50:22.785609+0000","last_fullsized":"2023-07-09T21:50:22.785609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:23.785505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761522+0000","last_change":"2023-07-09T21:50:22.761522+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761522+0000","last_undegraded":"2023-07-09T21:50:22.761522+0000","last_fullsized":"2023-07-09T21:50:22.761522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.774543+0000","last_change":"2023-07-09T21:50:22.770920+0000","last_active":"2023-07-09T21:50:22.774543+0000","last_peered":"2023-07-09T21:50:22.774543+0000","last_clean":"2023-07-09T21:50:22.774543+0000","last_became_active":"2023-07-09T21:50:22.770566+0000","last_became_peered":"2023-07-09T21:50:22.770566+0000","last_unstale":"2023-07-09T21:50:22.774543+0000","last_undegraded":"2023-07-09T21:50:22.774543+0000","last_fullsized":"2023-07-09T21:50:22.774543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:29:15.348265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.758525+0000","last_change":"2023-07-09T21:50:22.758525+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.758525+0000","last_undegraded":"2023-07-09T21:50:22.758525+0000","last_fullsized":"2023-07-09T21:50:22.758525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.785627+0000","last_change":"2023-07-09T21:50:22.781469+0000","last_active":"2023-07-09T21:50:22.785627+0000","last_peered":"2023-07-09T21:50:22.785627+0000","last_clean":"2023-07-09T21:50:22.785627+0000","last_became_active":"2023-07-09T21:50:22.781215+0000","last_became_peered":"2023-07-09T21:50:22.781215+0000","last_unstale":"2023-07-09T21:50:22.785627+0000","last_undegraded":"2023-07-09T21:50:22.785627+0000","last_fullsized":"2023-07-09T21:50:22.785627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:34.301244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.755435+0000","last_change":"2023-07-09T21:50:22.755435+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.755435+0000","last_undegraded":"2023-07-09T21:50:22.755435+0000","last_fullsized":"2023-07-09T21:50:22.755435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.785619+0000","last_change":"2023-07-09T21:50:22.780841+0000","last_active":"2023-07-09T21:50:22.785619+0000","last_peered":"2023-07-09T21:50:22.785619+0000","last_clean":"2023-07-09T21:50:22.785619+0000","last_became_active":"2023-07-09T21:50:22.780287+0000","last_became_peered":"2023-07-09T21:50:22.780287+0000","last_unstale":"2023-07-09T21:50:22.785619+0000","last_undegraded":"2023-07-09T21:50:22.785619+0000","last_fullsized":"2023-07-09T21:50:22.785619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:49.689261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802245+0000","last_change":"2023-07-09T21:50:23.794825+0000","last_active":"2023-07-09T21:50:23.802245+0000","last_peered":"2023-07-09T21:50:23.802245+0000","last_clean":"2023-07-09T21:50:23.802245+0000","last_became_active":"2023-07-09T21:50:23.794372+0000","last_became_peered":"2023-07-09T21:50:23.794372+0000","last_unstale":"2023-07-09T21:50:23.802245+0000","last_undegraded":"2023-07-09T21:50:23.802245+0000","last_fullsized":"2023-07-09T21:50:23.802245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:07.185673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.785683+0000","last_change":"2023-07-09T21:50:22.782310+0000","last_active":"2023-07-09T21:50:22.785683+0000","last_peered":"2023-07-09T21:50:22.785683+0000","last_clean":"2023-07-09T21:50:22.785683+0000","last_became_active":"2023-07-09T21:50:22.782041+0000","last_became_peered":"2023-07-09T21:50:22.782041+0000","last_unstale":"2023-07-09T21:50:22.785683+0000","last_undegraded":"2023-07-09T21:50:22.785683+0000","last_fullsized":"2023-07-09T21:50:22.785683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:04.930000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762223+0000","last_change":"2023-07-09T21:50:22.762223+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762223+0000","last_undegraded":"2023-07-09T21:50:22.762223+0000","last_fullsized":"2023-07-09T21:50:22.762223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.780793+0000","last_change":"2023-07-09T21:50:22.769028+0000","last_active":"2023-07-09T21:50:22.780793+0000","last_peered":"2023-07-09T21:50:22.780793+0000","last_clean":"2023-07-09T21:50:22.780793+0000","last_became_active":"2023-07-09T21:50:22.768697+0000","last_became_peered":"2023-07-09T21:50:22.768697+0000","last_unstale":"2023-07-09T21:50:22.780793+0000","last_undegraded":"2023-07-09T21:50:22.780793+0000","last_fullsized":"2023-07-09T21:50:22.780793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:32.098668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.760133+0000","last_change":"2023-07-09T21:50:22.760133+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.760133+0000","last_undegraded":"2023-07-09T21:50:22.760133+0000","last_fullsized":"2023-07-09T21:50:22.760133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.773425+0000","last_change":"2023-07-09T21:50:22.769216+0000","last_active":"2023-07-09T21:50:22.773425+0000","last_peered":"2023-07-09T21:50:22.773425+0000","last_clean":"2023-07-09T21:50:22.773425+0000","last_became_active":"2023-07-09T21:50:22.768893+0000","last_became_peered":"2023-07-09T21:50:22.768893+0000","last_unstale":"2023-07-09T21:50:22.773425+0000","last_undegraded":"2023-07-09T21:50:22.773425+0000","last_fullsized":"2023-07-09T21:50:22.773425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:50.434981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801774+0000","last_change":"2023-07-09T21:50:23.790525+0000","last_active":"2023-07-09T21:50:23.801774+0000","last_peered":"2023-07-09T21:50:23.801774+0000","last_clean":"2023-07-09T21:50:23.801774+0000","last_became_active":"2023-07-09T21:50:23.790164+0000","last_became_peered":"2023-07-09T21:50:23.790164+0000","last_unstale":"2023-07-09T21:50:23.801774+0000","last_undegraded":"2023-07-09T21:50:23.801774+0000","last_fullsized":"2023-07-09T21:50:23.801774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:51.439253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.782211+0000","last_change":"2023-07-09T21:50:22.779742+0000","last_active":"2023-07-09T21:50:22.782211+0000","last_peered":"2023-07-09T21:50:22.782211+0000","last_clean":"2023-07-09T21:50:22.782211+0000","last_became_active":"2023-07-09T21:50:22.779462+0000","last_became_peered":"2023-07-09T21:50:22.779462+0000","last_unstale":"2023-07-09T21:50:22.782211+0000","last_undegraded":"2023-07-09T21:50:22.782211+0000","last_fullsized":"2023-07-09T21:50:22.782211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:50.434981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802010+0000","last_change":"2023-07-09T21:50:23.793928+0000","last_active":"2023-07-09T21:50:23.802010+0000","last_peered":"2023-07-09T21:50:23.802010+0000","last_clean":"2023-07-09T21:50:23.802010+0000","last_became_active":"2023-07-09T21:50:23.793620+0000","last_became_peered":"2023-07-09T21:50:23.793620+0000","last_unstale":"2023-07-09T21:50:23.802010+0000","last_undegraded":"2023-07-09T21:50:23.802010+0000","last_fullsized":"2023-07-09T21:50:23.802010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:50.693532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.781593+0000","last_change":"2023-07-09T21:50:22.772850+0000","last_active":"2023-07-09T21:50:23.781593+0000","last_peered":"2023-07-09T21:50:23.781593+0000","last_clean":"2023-07-09T21:50:23.781593+0000","last_became_active":"2023-07-09T21:50:22.772522+0000","last_became_peered":"2023-07-09T21:50:22.772522+0000","last_unstale":"2023-07-09T21:50:23.781593+0000","last_undegraded":"2023-07-09T21:50:23.781593+0000","last_fullsized":"2023-07-09T21:50:23.781593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:32:07.041518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802085+0000","last_change":"2023-07-09T21:50:23.787502+0000","last_active":"2023-07-09T21:50:23.802085+0000","last_peered":"2023-07-09T21:50:23.802085+0000","last_clean":"2023-07-09T21:50:23.802085+0000","last_became_active":"2023-07-09T21:50:23.786685+0000","last_became_peered":"2023-07-09T21:50:23.786685+0000","last_unstale":"2023-07-09T21:50:23.802085+0000","last_undegraded":"2023-07-09T21:50:23.802085+0000","last_fullsized":"2023-07-09T21:50:23.802085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:05.764849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.773470+0000","last_change":"2023-07-09T21:50:22.769583+0000","last_active":"2023-07-09T21:50:22.773470+0000","last_peered":"2023-07-09T21:50:22.773470+0000","last_clean":"2023-07-09T21:50:22.773470+0000","last_became_active":"2023-07-09T21:50:22.768169+0000","last_became_peered":"2023-07-09T21:50:22.768169+0000","last_unstale":"2023-07-09T21:50:22.773470+0000","last_undegraded":"2023-07-09T21:50:22.773470+0000","last_fullsized":"2023-07-09T21:50:22.773470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:29:15.348265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790139+0000","last_change":"2023-07-09T21:50:23.784726+0000","last_active":"2023-07-09T21:50:23.790139+0000","last_peered":"2023-07-09T21:50:23.790139+0000","last_clean":"2023-07-09T21:50:23.790139+0000","last_became_active":"2023-07-09T21:50:23.777193+0000","last_became_peered":"2023-07-09T21:50:23.777193+0000","last_unstale":"2023-07-09T21:50:23.790139+0000","last_undegraded":"2023-07-09T21:50:23.790139+0000","last_fullsized":"2023-07-09T21:50:23.790139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:34.646316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.779148+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:50:23.779148+0000","last_peered":"2023-07-09T21:50:23.779148+0000","last_clean":"2023-07-09T21:50:23.779148+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:50:23.779148+0000","last_undegraded":"2023-07-09T21:50:23.779148+0000","last_fullsized":"2023-07-09T21:50:23.779148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:35:50.473268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.781384+0000","last_change":"2023-07-09T21:50:22.772281+0000","last_active":"2023-07-09T21:50:22.781384+0000","last_peered":"2023-07-09T21:50:22.781384+0000","last_clean":"2023-07-09T21:50:22.781384+0000","last_became_active":"2023-07-09T21:50:22.769167+0000","last_became_peered":"2023-07-09T21:50:22.769167+0000","last_unstale":"2023-07-09T21:50:22.781384+0000","last_undegraded":"2023-07-09T21:50:22.781384+0000","last_fullsized":"2023-07-09T21:50:22.781384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:04.760578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.787677+0000","last_change":"2023-07-09T21:50:23.783723+0000","last_active":"2023-07-09T21:50:23.787677+0000","last_peered":"2023-07-09T21:50:23.787677+0000","last_clean":"2023-07-09T21:50:23.787677+0000","last_became_active":"2023-07-09T21:50:23.783453+0000","last_became_peered":"2023-07-09T21:50:23.783453+0000","last_unstale":"2023-07-09T21:50:23.787677+0000","last_undegraded":"2023-07-09T21:50:23.787677+0000","last_fullsized":"2023-07-09T21:50:23.787677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:42:06.075539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.759584+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:50:22.759584+0000","last_peered":"2023-07-09T21:50:22.759584+0000","last_clean":"2023-07-09T21:50:22.759584+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:50:22.759584+0000","last_undegraded":"2023-07-09T21:50:22.759584+0000","last_fullsized":"2023-07-09T21:50:22.759584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:37.252696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.779267+0000","last_change":"2023-07-09T21:50:22.778044+0000","last_active":"2023-07-09T21:50:23.779267+0000","last_peered":"2023-07-09T21:50:23.779267+0000","last_clean":"2023-07-09T21:50:23.779267+0000","last_became_active":"2023-07-09T21:50:22.777708+0000","last_became_peered":"2023-07-09T21:50:22.777708+0000","last_unstale":"2023-07-09T21:50:23.779267+0000","last_undegraded":"2023-07-09T21:50:23.779267+0000","last_fullsized":"2023-07-09T21:50:23.779267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:23.785505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.787438+0000","last_change":"2023-07-09T21:50:23.780850+0000","last_active":"2023-07-09T21:50:23.787438+0000","last_peered":"2023-07-09T21:50:23.787438+0000","last_clean":"2023-07-09T21:50:23.787438+0000","last_became_active":"2023-07-09T21:50:23.780529+0000","last_became_peered":"2023-07-09T21:50:23.780529+0000","last_unstale":"2023-07-09T21:50:23.787438+0000","last_undegraded":"2023-07-09T21:50:23.787438+0000","last_fullsized":"2023-07-09T21:50:23.787438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:10.298327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.754057+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:50:22.754057+0000","last_peered":"2023-07-09T21:50:22.754057+0000","last_clean":"2023-07-09T21:50:22.754057+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:50:22.754057+0000","last_undegraded":"2023-07-09T21:50:22.754057+0000","last_fullsized":"2023-07-09T21:50:22.754057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:29:10.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.777557+0000","last_change":"2023-07-09T21:50:22.774908+0000","last_active":"2023-07-09T21:50:23.777557+0000","last_peered":"2023-07-09T21:50:23.777557+0000","last_clean":"2023-07-09T21:50:23.777557+0000","last_became_active":"2023-07-09T21:50:22.774600+0000","last_became_peered":"2023-07-09T21:50:22.774600+0000","last_unstale":"2023-07-09T21:50:23.777557+0000","last_undegraded":"2023-07-09T21:50:23.777557+0000","last_fullsized":"2023-07-09T21:50:23.777557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:08:56.300464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790176+0000","last_change":"2023-07-09T21:50:23.786034+0000","last_active":"2023-07-09T21:50:23.790176+0000","last_peered":"2023-07-09T21:50:23.790176+0000","last_clean":"2023-07-09T21:50:23.790176+0000","last_became_active":"2023-07-09T21:50:23.785763+0000","last_became_peered":"2023-07-09T21:50:23.785763+0000","last_unstale":"2023-07-09T21:50:23.790176+0000","last_undegraded":"2023-07-09T21:50:23.790176+0000","last_fullsized":"2023-07-09T21:50:23.790176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:20:36.952568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.759619+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:50:22.759619+0000","last_peered":"2023-07-09T21:50:22.759619+0000","last_clean":"2023-07-09T21:50:22.759619+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:50:22.759619+0000","last_undegraded":"2023-07-09T21:50:22.759619+0000","last_fullsized":"2023-07-09T21:50:22.759619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:07:05.866039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.766215+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:50:22.766215+0000","last_peered":"2023-07-09T21:50:22.766215+0000","last_clean":"2023-07-09T21:50:22.766215+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:50:22.766215+0000","last_undegraded":"2023-07-09T21:50:22.766215+0000","last_fullsized":"2023-07-09T21:50:22.766215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:09.774473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.769879+0000","last_change":"2023-07-09T21:50:22.766454+0000","last_active":"2023-07-09T21:50:22.769879+0000","last_peered":"2023-07-09T21:50:22.769879+0000","last_clean":"2023-07-09T21:50:22.769879+0000","last_became_active":"2023-07-09T21:50:22.766057+0000","last_became_peered":"2023-07-09T21:50:22.766057+0000","last_unstale":"2023-07-09T21:50:22.769879+0000","last_undegraded":"2023-07-09T21:50:22.769879+0000","last_fullsized":"2023-07-09T21:50:22.769879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:32.098668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762431+0000","last_change":"2023-07-09T21:50:22.762431+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762431+0000","last_undegraded":"2023-07-09T21:50:22.762431+0000","last_fullsized":"2023-07-09T21:50:22.762431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.766371+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:50:22.766371+0000","last_peered":"2023-07-09T21:50:22.766371+0000","last_clean":"2023-07-09T21:50:22.766371+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:50:22.766371+0000","last_undegraded":"2023-07-09T21:50:22.766371+0000","last_fullsized":"2023-07-09T21:50:22.766371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:22.454077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.778478+0000","last_change":"2023-07-09T21:50:22.777350+0000","last_active":"2023-07-09T21:50:22.778478+0000","last_peered":"2023-07-09T21:50:22.778478+0000","last_clean":"2023-07-09T21:50:22.778478+0000","last_became_active":"2023-07-09T21:50:22.776974+0000","last_became_peered":"2023-07-09T21:50:22.776974+0000","last_unstale":"2023-07-09T21:50:22.778478+0000","last_undegraded":"2023-07-09T21:50:22.778478+0000","last_fullsized":"2023-07-09T21:50:22.778478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:04.760578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.757544+0000","last_change":"2023-07-09T21:50:22.757544+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.757544+0000","last_undegraded":"2023-07-09T21:50:22.757544+0000","last_fullsized":"2023-07-09T21:50:22.757544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.767821+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:50:22.767821+0000","last_peered":"2023-07-09T21:50:22.767821+0000","last_clean":"2023-07-09T21:50:22.767821+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:50:22.767821+0000","last_undegraded":"2023-07-09T21:50:22.767821+0000","last_fullsized":"2023-07-09T21:50:22.767821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:00.963583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.779375+0000","last_change":"2023-07-09T21:50:22.774621+0000","last_active":"2023-07-09T21:50:23.779375+0000","last_peered":"2023-07-09T21:50:23.779375+0000","last_clean":"2023-07-09T21:50:23.779375+0000","last_became_active":"2023-07-09T21:50:22.774322+0000","last_became_peered":"2023-07-09T21:50:22.774322+0000","last_unstale":"2023-07-09T21:50:23.779375+0000","last_undegraded":"2023-07-09T21:50:23.779375+0000","last_fullsized":"2023-07-09T21:50:23.779375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:49.341701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761021+0000","last_change":"2023-07-09T21:50:22.761021+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761021+0000","last_undegraded":"2023-07-09T21:50:22.761021+0000","last_fullsized":"2023-07-09T21:50:22.761021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.777873+0000","last_change":"2023-07-09T21:50:22.775713+0000","last_active":"2023-07-09T21:50:22.777873+0000","last_peered":"2023-07-09T21:50:22.777873+0000","last_clean":"2023-07-09T21:50:22.777873+0000","last_became_active":"2023-07-09T21:50:22.775420+0000","last_became_peered":"2023-07-09T21:50:22.775420+0000","last_unstale":"2023-07-09T21:50:22.777873+0000","last_undegraded":"2023-07-09T21:50:22.777873+0000","last_fullsized":"2023-07-09T21:50:22.777873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:42.243258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.778529+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:50:23.778529+0000","last_peered":"2023-07-09T21:50:23.778529+0000","last_clean":"2023-07-09T21:50:23.778529+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:50:23.778529+0000","last_undegraded":"2023-07-09T21:50:23.778529+0000","last_fullsized":"2023-07-09T21:50:23.778529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:28:48.759912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.756577+0000","last_change":"2023-07-09T21:50:22.756577+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.756577+0000","last_undegraded":"2023-07-09T21:50:22.756577+0000","last_fullsized":"2023-07-09T21:50:22.756577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.767000+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:50:22.767000+0000","last_peered":"2023-07-09T21:50:22.767000+0000","last_clean":"2023-07-09T21:50:22.767000+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:50:22.767000+0000","last_undegraded":"2023-07-09T21:50:22.767000+0000","last_fullsized":"2023-07-09T21:50:22.767000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:26.880849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.775151+0000","last_change":"2023-07-09T21:50:22.772687+0000","last_active":"2023-07-09T21:50:22.775151+0000","last_peered":"2023-07-09T21:50:22.775151+0000","last_clean":"2023-07-09T21:50:22.775151+0000","last_became_active":"2023-07-09T21:50:22.772342+0000","last_became_peered":"2023-07-09T21:50:22.772342+0000","last_unstale":"2023-07-09T21:50:22.775151+0000","last_undegraded":"2023-07-09T21:50:22.775151+0000","last_fullsized":"2023-07-09T21:50:22.775151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:42.243258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802227+0000","last_change":"2023-07-09T21:50:23.794661+0000","last_active":"2023-07-09T21:50:23.802227+0000","last_peered":"2023-07-09T21:50:23.802227+0000","last_clean":"2023-07-09T21:50:23.802227+0000","last_became_active":"2023-07-09T21:50:23.794107+0000","last_became_peered":"2023-07-09T21:50:23.794107+0000","last_unstale":"2023-07-09T21:50:23.802227+0000","last_undegraded":"2023-07-09T21:50:23.802227+0000","last_fullsized":"2023-07-09T21:50:23.802227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:35.305515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.780592+0000","last_change":"2023-07-09T21:50:22.779822+0000","last_active":"2023-07-09T21:50:22.780592+0000","last_peered":"2023-07-09T21:50:22.780592+0000","last_clean":"2023-07-09T21:50:22.780592+0000","last_became_active":"2023-07-09T21:50:22.779595+0000","last_became_peered":"2023-07-09T21:50:22.779595+0000","last_unstale":"2023-07-09T21:50:22.780592+0000","last_undegraded":"2023-07-09T21:50:22.780592+0000","last_fullsized":"2023-07-09T21:50:22.780592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:48.485365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.754562+0000","last_change":"2023-07-09T21:50:22.754562+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.754562+0000","last_undegraded":"2023-07-09T21:50:22.754562+0000","last_fullsized":"2023-07-09T21:50:22.754562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.781182+0000","last_change":"2023-07-09T21:50:22.772154+0000","last_active":"2023-07-09T21:50:22.781182+0000","last_peered":"2023-07-09T21:50:22.781182+0000","last_clean":"2023-07-09T21:50:22.781182+0000","last_became_active":"2023-07-09T21:50:22.771882+0000","last_became_peered":"2023-07-09T21:50:22.771882+0000","last_unstale":"2023-07-09T21:50:22.781182+0000","last_undegraded":"2023-07-09T21:50:22.781182+0000","last_fullsized":"2023-07-09T21:50:22.781182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:48.485365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801927+0000","last_change":"2023-07-09T21:50:23.793009+0000","last_active":"2023-07-09T21:50:23.801927+0000","last_peered":"2023-07-09T21:50:23.801927+0000","last_clean":"2023-07-09T21:50:23.801927+0000","last_became_active":"2023-07-09T21:50:23.791995+0000","last_became_peered":"2023-07-09T21:50:23.791995+0000","last_unstale":"2023-07-09T21:50:23.801927+0000","last_undegraded":"2023-07-09T21:50:23.801927+0000","last_fullsized":"2023-07-09T21:50:23.801927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:40.779031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.781405+0000","last_change":"2023-07-09T21:50:22.772972+0000","last_active":"2023-07-09T21:50:22.781405+0000","last_peered":"2023-07-09T21:50:22.781405+0000","last_clean":"2023-07-09T21:50:22.781405+0000","last_became_active":"2023-07-09T21:50:22.772647+0000","last_became_peered":"2023-07-09T21:50:22.772647+0000","last_unstale":"2023-07-09T21:50:22.781405+0000","last_undegraded":"2023-07-09T21:50:22.781405+0000","last_fullsized":"2023-07-09T21:50:22.781405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:42.243258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801973+0000","last_change":"2023-07-09T21:50:23.790945+0000","last_active":"2023-07-09T21:50:23.801973+0000","last_peered":"2023-07-09T21:50:23.801973+0000","last_clean":"2023-07-09T21:50:23.801973+0000","last_became_active":"2023-07-09T21:50:23.790660+0000","last_became_peered":"2023-07-09T21:50:23.790660+0000","last_unstale":"2023-07-09T21:50:23.801973+0000","last_undegraded":"2023-07-09T21:50:23.801973+0000","last_fullsized":"2023-07-09T21:50:23.801973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:43.247529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.774364+0000","last_change":"2023-07-09T21:50:22.770573+0000","last_active":"2023-07-09T21:50:22.774364+0000","last_peered":"2023-07-09T21:50:22.774364+0000","last_clean":"2023-07-09T21:50:22.774364+0000","last_became_active":"2023-07-09T21:50:22.770263+0000","last_became_peered":"2023-07-09T21:50:22.770263+0000","last_unstale":"2023-07-09T21:50:22.774364+0000","last_undegraded":"2023-07-09T21:50:22.774364+0000","last_fullsized":"2023-07-09T21:50:22.774364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:04.760578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.757889+0000","last_change":"2023-07-09T21:50:22.757889+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.757889+0000","last_undegraded":"2023-07-09T21:50:22.757889+0000","last_fullsized":"2023-07-09T21:50:22.757889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.777725+0000","last_change":"2023-07-09T21:50:22.776290+0000","last_active":"2023-07-09T21:50:22.777725+0000","last_peered":"2023-07-09T21:50:22.777725+0000","last_clean":"2023-07-09T21:50:22.777725+0000","last_became_active":"2023-07-09T21:50:22.775873+0000","last_became_peered":"2023-07-09T21:50:22.775873+0000","last_unstale":"2023-07-09T21:50:22.777725+0000","last_undegraded":"2023-07-09T21:50:22.777725+0000","last_fullsized":"2023-07-09T21:50:22.777725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:50.434981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.797500+0000","last_change":"2023-07-09T21:50:23.787350+0000","last_active":"2023-07-09T21:50:23.797500+0000","last_peered":"2023-07-09T21:50:23.797500+0000","last_clean":"2023-07-09T21:50:23.797500+0000","last_became_active":"2023-07-09T21:50:23.787079+0000","last_became_peered":"2023-07-09T21:50:23.787079+0000","last_unstale":"2023-07-09T21:50:23.797500+0000","last_undegraded":"2023-07-09T21:50:23.797500+0000","last_fullsized":"2023-07-09T21:50:23.797500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:07:12.088130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762011+0000","last_change":"2023-07-09T21:50:22.762011+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762011+0000","last_undegraded":"2023-07-09T21:50:22.762011+0000","last_fullsized":"2023-07-09T21:50:22.762011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762296+0000","last_change":"2023-07-09T21:50:22.762296+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762296+0000","last_undegraded":"2023-07-09T21:50:22.762296+0000","last_fullsized":"2023-07-09T21:50:22.762296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.797393+0000","last_change":"2023-07-09T21:50:23.787304+0000","last_active":"2023-07-09T21:50:23.797393+0000","last_peered":"2023-07-09T21:50:23.797393+0000","last_clean":"2023-07-09T21:50:23.797393+0000","last_became_active":"2023-07-09T21:50:23.787022+0000","last_became_peered":"2023-07-09T21:50:23.787022+0000","last_unstale":"2023-07-09T21:50:23.797393+0000","last_undegraded":"2023-07-09T21:50:23.797393+0000","last_fullsized":"2023-07-09T21:50:23.797393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:57:38.274013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761679+0000","last_change":"2023-07-09T21:50:22.761679+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761679+0000","last_undegraded":"2023-07-09T21:50:22.761679+0000","last_fullsized":"2023-07-09T21:50:22.761679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.783621+0000","last_change":"2023-07-09T21:50:23.780066+0000","last_active":"2023-07-09T21:50:23.783621+0000","last_peered":"2023-07-09T21:50:23.783621+0000","last_clean":"2023-07-09T21:50:23.783621+0000","last_became_active":"2023-07-09T21:50:23.779691+0000","last_became_peered":"2023-07-09T21:50:23.779691+0000","last_unstale":"2023-07-09T21:50:23.783621+0000","last_undegraded":"2023-07-09T21:50:23.783621+0000","last_fullsized":"2023-07-09T21:50:23.783621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:51:58.642076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":83224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":83224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":76604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":815104,"data_stored":666972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":815104,"data_stored":666972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":76604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":83224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":76604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:50:28.235 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:50:28.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.464+0000 7fb31dfff700 1 Processor -- start 2023-07-09T21:50:28.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.464+0000 7fb31dfff700 1 -- start start 2023-07-09T21:50:28.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.466+0000 7fb31dfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3180b1e00 0x7fb3180b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:28.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.466+0000 7fb31dfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb3180b2350 0x7fb3180d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:28.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.466+0000 7fb31dfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3180d14a0 con 0x7fb3180d1050 2023-07-09T21:50:28.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.466+0000 7fb31dfff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3180d2ce0 con 0x7fb3180b2350 2023-07-09T21:50:28.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.466+0000 7fb31dfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180b3350 con 0x7fb3180b1e00 2023-07-09T21:50:28.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.466+0000 7fb30ffff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb3180b2350 0x7fb3180d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:28.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.466+0000 7fb3177fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3180b1e00 0x7fb3180b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:28.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.466+0000 7fb317fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb3180d1050 0x7fb3180afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:53052/0 (socket says 172.21.15.53:53052) 2023-07-09T21:50:28.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb317fff700 1 -- 172.21.15.53:0/1758059693 learned_addr learned my addr 172.21.15.53:0/1758059693 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:28.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb30ffff700 1 -- 172.21.15.53:0/1758059693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3180b1e00 msgr2=0x7fb3180b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:28.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb30ffff700 1 --2- 172.21.15.53:0/1758059693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3180b1e00 0x7fb3180b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb30ffff700 1 -- 172.21.15.53:0/1758059693 >> v1:172.21.15.184:6789/0 conn(0x7fb3180d1050 legacy=0x7fb3180afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:28.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb30ffff700 1 -- 172.21.15.53:0/1758059693 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3180b3630 con 0x7fb3180b2350 2023-07-09T21:50:28.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb30ffff700 1 --2- 172.21.15.53:0/1758059693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3180b2350 0x7fb3180d0b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb300009840 tx=0x7fb300009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4cf7738cdfd1613 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:28.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb316ffd700 1 -- 172.21.15.53:0/1758059693 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300011830 con 0x7fb3180b2350 2023-07-09T21:50:28.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb316ffd700 1 -- 172.21.15.53:0/1758059693 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb300011990 con 0x7fb3180b2350 2023-07-09T21:50:28.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb316ffd700 1 -- 172.21.15.53:0/1758059693 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300011d20 con 0x7fb3180b2350 2023-07-09T21:50:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb31dfff700 1 -- 172.21.15.53:0/1758059693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3180b2350 msgr2=0x7fb3180d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb31dfff700 1 --2- 172.21.15.53:0/1758059693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3180b2350 0x7fb3180d0b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb300009840 tx=0x7fb300009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb31dfff700 1 -- 172.21.15.53:0/1758059693 shutdown_connections 2023-07-09T21:50:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb31dfff700 1 --2- 172.21.15.53:0/1758059693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3180b1e00 0x7fb3180b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb31dfff700 1 --2- 172.21.15.53:0/1758059693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3180b2350 0x7fb3180d0b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb31dfff700 1 -- 172.21.15.53:0/1758059693 >> 172.21.15.53:0/1758059693 conn(0x7fb31809c1d0 msgr2=0x7fb3180d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb31dfff700 1 -- 172.21.15.53:0/1758059693 shutdown_connections 2023-07-09T21:50:28.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.467+0000 7fb31dfff700 1 -- 172.21.15.53:0/1758059693 wait complete. 2023-07-09T21:50:28.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.469+0000 7fb31dfff700 1 Processor -- start 2023-07-09T21:50:28.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.469+0000 7fb31dfff700 1 -- start start 2023-07-09T21:50:28.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.470+0000 7fb31dfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3180b1e00 0x7fb3180b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:28.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.470+0000 7fb31dfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3180b2350 0x7fb3180c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:28.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.470+0000 7fb31dfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3180d1050 0x7fb3180b8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:28.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.470+0000 7fb31dfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180c8810 con 0x7fb3180b2350 2023-07-09T21:50:28.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.470+0000 7fb31dfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31814cc20 con 0x7fb3180b1e00 2023-07-09T21:50:28.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.470+0000 7fb31dfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180b7bd0 con 0x7fb3180d1050 2023-07-09T21:50:28.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.470+0000 7fb30ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3180b2350 0x7fb3180c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:28.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.470+0000 7fb30ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3180b2350 0x7fb3180c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40380/0 (socket says 172.21.15.53:40380) 2023-07-09T21:50:28.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.470+0000 7fb30ffff700 1 -- 172.21.15.53:0/550089879 learned_addr learned my addr 172.21.15.53:0/550089879 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:28.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.471+0000 7fb3177fe700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3180b1e00 0x7fb3180b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:28.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.471+0000 7fb317fff700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3180d1050 0x7fb3180b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:28.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.471+0000 7fb30ffff700 1 -- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3180d1050 msgr2=0x7fb3180b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:28.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.471+0000 7fb30ffff700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3180d1050 0x7fb3180b8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.471+0000 7fb30ffff700 1 -- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3180b1e00 msgr2=0x7fb3180b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:28.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.471+0000 7fb30ffff700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3180b1e00 0x7fb3180b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.471+0000 7fb30ffff700 1 -- 172.21.15.53:0/550089879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3000094a0 con 0x7fb3180b2350 2023-07-09T21:50:28.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.471+0000 7fb30ffff700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3180b2350 0x7fb3180c82d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb300009fd0 tx=0x7fb300004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:28.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.471+0000 7fb314ff9700 1 -- 172.21.15.53:0/550089879 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3000036a0 con 0x7fb3180b2350 2023-07-09T21:50:28.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.471+0000 7fb314ff9700 1 -- 172.21.15.53:0/550089879 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30001e070 con 0x7fb3180b2350 2023-07-09T21:50:28.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.471+0000 7fb314ff9700 1 -- 172.21.15.53:0/550089879 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300003a60 con 0x7fb3180b2350 2023-07-09T21:50:28.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.471+0000 7fb31dfff700 1 -- 172.21.15.53:0/550089879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3180b64f0 con 0x7fb3180b2350 2023-07-09T21:50:28.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.472+0000 7fb31dfff700 1 -- 172.21.15.53:0/550089879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3180b5ea0 con 0x7fb3180b2350 2023-07-09T21:50:28.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.472+0000 7fb31dfff700 1 -- 172.21.15.53:0/550089879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3180b6680 con 0x7fb3180b2350 2023-07-09T21:50:28.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.474+0000 7fb314ff9700 1 -- 172.21.15.53:0/550089879 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb300003bc0 con 0x7fb3180b2350 2023-07-09T21:50:28.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.475+0000 7fb314ff9700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb2f806ad10 0x7fb2f806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:28.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.475+0000 7fb314ff9700 1 -- 172.21.15.53:0/550089879 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb30008a370 con 0x7fb3180b2350 2023-07-09T21:50:28.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.476+0000 7fb3177fe700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb2f806ad10 0x7fb2f806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:28.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.476+0000 7fb3177fe700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb2f806ad10 0x7fb2f806d1c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb308009b20 tx=0x7fb3080091c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:28.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.480+0000 7fb314ff9700 1 -- 172.21.15.53:0/550089879 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb300055540 con 0x7fb3180b2350 2023-07-09T21:50:28.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.686+0000 7fb31dfff700 1 -- 172.21.15.53:0/550089879 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3180b3bf0 con 0x7fb2f806ad10 2023-07-09T21:50:28.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.695+0000 7fb314ff9700 1 -- 172.21.15.53:0/550089879 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283407 (secure 0 0 0) 0x7fb308005a20 con 0x7fb2f806ad10 2023-07-09T21:50:28.699 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:28.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.699+0000 7fb31dfff700 1 -- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb2f806ad10 msgr2=0x7fb2f806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:28.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.699+0000 7fb31dfff700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb2f806ad10 0x7fb2f806d1c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb308009b20 tx=0x7fb3080091c0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.699+0000 7fb31dfff700 1 -- 172.21.15.53:0/550089879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3180b2350 msgr2=0x7fb3180c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:28.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.699+0000 7fb31dfff700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3180b2350 0x7fb3180c82d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb300009fd0 tx=0x7fb300004750 comp rx=0 tx=0).stop 2023-07-09T21:50:28.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.699+0000 7fb31dfff700 1 -- 172.21.15.53:0/550089879 shutdown_connections 2023-07-09T21:50:28.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.699+0000 7fb31dfff700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb2f806ad10 0x7fb2f806d1c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.699+0000 7fb31dfff700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3180d1050 0x7fb3180b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.699+0000 7fb31dfff700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3180b1e00 0x7fb3180b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.699+0000 7fb31dfff700 1 --2- 172.21.15.53:0/550089879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3180b2350 0x7fb3180c82d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.699+0000 7fb31dfff700 1 -- 172.21.15.53:0/550089879 >> 172.21.15.53:0/550089879 conn(0x7fb31809c1d0 msgr2=0x7fb3181554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:28.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.699+0000 7fb31dfff700 1 -- 172.21.15.53:0/550089879 shutdown_connections 2023-07-09T21:50:28.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.699+0000 7fb31dfff700 1 -- 172.21.15.53:0/550089879 wait complete. 2023-07-09T21:50:28.703 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:50:28.718 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-09T21:50:26.851478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591932,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222636,"kb_used_data":2924,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754752084,"statfs":{"total":773094113280,"available":772866134016,"internally_reserved":0,"allocated":2994176,"data_stored":1813428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.104285"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.754655+0000","last_change":"2023-07-09T21:50:22.754655+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.754655+0000","last_undegraded":"2023-07-09T21:50:22.754655+0000","last_fullsized":"2023-07-09T21:50:22.754655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.756786+0000","last_change":"2023-07-09T21:50:22.756786+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.756786+0000","last_undegraded":"2023-07-09T21:50:22.756786+0000","last_fullsized":"2023-07-09T21:50:22.756786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801988+0000","last_change":"2023-07-09T21:50:23.792566+0000","last_active":"2023-07-09T21:50:23.801988+0000","last_peered":"2023-07-09T21:50:23.801988+0000","last_clean":"2023-07-09T21:50:23.801988+0000","last_became_active":"2023-07-09T21:50:23.792316+0000","last_became_peered":"2023-07-09T21:50:23.792316+0000","last_unstale":"2023-07-09T21:50:23.801988+0000","last_undegraded":"2023-07-09T21:50:23.801988+0000","last_fullsized":"2023-07-09T21:50:23.801988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762969+0000","last_change":"2023-07-09T21:50:22.762969+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762969+0000","last_undegraded":"2023-07-09T21:50:22.762969+0000","last_fullsized":"2023-07-09T21:50:22.762969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761501+0000","last_change":"2023-07-09T21:50:22.761501+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761501+0000","last_undegraded":"2023-07-09T21:50:22.761501+0000","last_fullsized":"2023-07-09T21:50:22.761501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802212+0000","last_change":"2023-07-09T21:50:23.798790+0000","last_active":"2023-07-09T21:50:23.802212+0000","last_peered":"2023-07-09T21:50:23.802212+0000","last_clean":"2023-07-09T21:50:23.802212+0000","last_became_active":"2023-07-09T21:50:23.798508+0000","last_became_peered":"2023-07-09T21:50:23.798508+0000","last_unstale":"2023-07-09T21:50:23.802212+0000","last_undegraded":"2023-07-09T21:50:23.802212+0000","last_fullsized":"2023-07-09T21:50:23.802212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:43.474786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.765773+0000","last_change":"2023-07-09T21:50:22.765773+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.765773+0000","last_undegraded":"2023-07-09T21:50:22.765773+0000","last_fullsized":"2023-07-09T21:50:22.765773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.756942+0000","last_change":"2023-07-09T21:50:22.756942+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.756942+0000","last_undegraded":"2023-07-09T21:50:22.756942+0000","last_fullsized":"2023-07-09T21:50:22.756942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.759981+0000","last_change":"2023-07-09T21:50:22.759981+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.759981+0000","last_undegraded":"2023-07-09T21:50:22.759981+0000","last_fullsized":"2023-07-09T21:50:22.759981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.755562+0000","last_change":"2023-07-09T21:50:22.755562+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.755562+0000","last_undegraded":"2023-07-09T21:50:22.755562+0000","last_fullsized":"2023-07-09T21:50:22.755562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801969+0000","last_change":"2023-07-09T21:50:23.787617+0000","last_active":"2023-07-09T21:50:23.801969+0000","last_peered":"2023-07-09T21:50:23.801969+0000","last_clean":"2023-07-09T21:50:23.801969+0000","last_became_active":"2023-07-09T21:50:23.787324+0000","last_became_peered":"2023-07-09T21:50:23.787324+0000","last_unstale":"2023-07-09T21:50:23.801969+0000","last_undegraded":"2023-07-09T21:50:23.801969+0000","last_fullsized":"2023-07-09T21:50:23.801969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:28.676168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.755444+0000","last_change":"2023-07-09T21:50:22.755444+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.755444+0000","last_undegraded":"2023-07-09T21:50:22.755444+0000","last_fullsized":"2023-07-09T21:50:22.755444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.755192+0000","last_change":"2023-07-09T21:50:22.755192+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.755192+0000","last_undegraded":"2023-07-09T21:50:22.755192+0000","last_fullsized":"2023-07-09T21:50:22.755192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.757837+0000","last_change":"2023-07-09T21:50:22.757837+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.757837+0000","last_undegraded":"2023-07-09T21:50:22.757837+0000","last_fullsized":"2023-07-09T21:50:22.757837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762272+0000","last_change":"2023-07-09T21:50:22.762272+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762272+0000","last_undegraded":"2023-07-09T21:50:22.762272+0000","last_fullsized":"2023-07-09T21:50:22.762272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801854+0000","last_change":"2023-07-09T21:50:23.792844+0000","last_active":"2023-07-09T21:50:23.801854+0000","last_peered":"2023-07-09T21:50:23.801854+0000","last_clean":"2023-07-09T21:50:23.801854+0000","last_became_active":"2023-07-09T21:50:23.792511+0000","last_became_peered":"2023-07-09T21:50:23.792511+0000","last_unstale":"2023-07-09T21:50:23.801854+0000","last_undegraded":"2023-07-09T21:50:23.801854+0000","last_fullsized":"2023-07-09T21:50:23.801854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:33.102940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.759469+0000","last_change":"2023-07-09T21:50:22.759469+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.759469+0000","last_undegraded":"2023-07-09T21:50:22.759469+0000","last_fullsized":"2023-07-09T21:50:22.759469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802103+0000","last_change":"2023-07-09T21:50:23.791210+0000","last_active":"2023-07-09T21:50:23.802103+0000","last_peered":"2023-07-09T21:50:23.802103+0000","last_clean":"2023-07-09T21:50:23.802103+0000","last_became_active":"2023-07-09T21:50:23.790958+0000","last_became_peered":"2023-07-09T21:50:23.790958+0000","last_unstale":"2023-07-09T21:50:23.802103+0000","last_undegraded":"2023-07-09T21:50:23.802103+0000","last_fullsized":"2023-07-09T21:50:23.802103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:23.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.755003+0000","last_change":"2023-07-09T21:50:22.755003+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.755003+0000","last_undegraded":"2023-07-09T21:50:22.755003+0000","last_fullsized":"2023-07-09T21:50:22.755003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801751+0000","last_change":"2023-07-09T21:50:23.788775+0000","last_active":"2023-07-09T21:50:23.801751+0000","last_peered":"2023-07-09T21:50:23.801751+0000","last_clean":"2023-07-09T21:50:23.801751+0000","last_became_active":"2023-07-09T21:50:23.788474+0000","last_became_peered":"2023-07-09T21:50:23.788474+0000","last_unstale":"2023-07-09T21:50:23.801751+0000","last_undegraded":"2023-07-09T21:50:23.801751+0000","last_fullsized":"2023-07-09T21:50:23.801751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:49.489636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761604+0000","last_change":"2023-07-09T21:50:22.761604+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761604+0000","last_undegraded":"2023-07-09T21:50:22.761604+0000","last_fullsized":"2023-07-09T21:50:22.761604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.758071+0000","last_change":"2023-07-09T21:50:22.758071+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.758071+0000","last_undegraded":"2023-07-09T21:50:22.758071+0000","last_fullsized":"2023-07-09T21:50:22.758071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762718+0000","last_change":"2023-07-09T21:50:22.762718+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762718+0000","last_undegraded":"2023-07-09T21:50:22.762718+0000","last_fullsized":"2023-07-09T21:50:22.762718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761637+0000","last_change":"2023-07-09T21:50:22.761637+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761637+0000","last_undegraded":"2023-07-09T21:50:22.761637+0000","last_fullsized":"2023-07-09T21:50:22.761637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790159+0000","last_change":"2023-07-09T21:50:23.785433+0000","last_active":"2023-07-09T21:50:23.790159+0000","last_peered":"2023-07-09T21:50:23.790159+0000","last_clean":"2023-07-09T21:50:23.790159+0000","last_became_active":"2023-07-09T21:50:23.785016+0000","last_became_peered":"2023-07-09T21:50:23.785016+0000","last_unstale":"2023-07-09T21:50:23.790159+0000","last_undegraded":"2023-07-09T21:50:23.790159+0000","last_fullsized":"2023-07-09T21:50:23.790159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:05:28.932158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790106+0000","last_change":"2023-07-09T21:50:23.781394+0000","last_active":"2023-07-09T21:50:23.790106+0000","last_peered":"2023-07-09T21:50:23.790106+0000","last_clean":"2023-07-09T21:50:23.790106+0000","last_became_active":"2023-07-09T21:50:23.781089+0000","last_became_peered":"2023-07-09T21:50:23.781089+0000","last_unstale":"2023-07-09T21:50:23.790106+0000","last_undegraded":"2023-07-09T21:50:23.790106+0000","last_fullsized":"2023-07-09T21:50:23.790106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:26:12.334998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.757413+0000","last_change":"2023-07-09T21:50:22.757413+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.757413+0000","last_undegraded":"2023-07-09T21:50:22.757413+0000","last_fullsized":"2023-07-09T21:50:22.757413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.812395+0000","last_change":"2023-07-09T21:50:22.774935+0000","last_active":"2023-07-09T21:50:23.812395+0000","last_peered":"2023-07-09T21:50:23.812395+0000","last_clean":"2023-07-09T21:50:23.812395+0000","last_became_active":"2023-07-09T21:50:22.774612+0000","last_became_peered":"2023-07-09T21:50:22.774612+0000","last_unstale":"2023-07-09T21:50:23.812395+0000","last_undegraded":"2023-07-09T21:50:23.812395+0000","last_fullsized":"2023-07-09T21:50:23.812395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:17:27.986566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.760621+0000","last_change":"2023-07-09T21:50:22.760621+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.760621+0000","last_undegraded":"2023-07-09T21:50:22.760621+0000","last_fullsized":"2023-07-09T21:50:22.760621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.777834+0000","last_change":"2023-07-09T21:50:22.772852+0000","last_active":"2023-07-09T21:50:23.777834+0000","last_peered":"2023-07-09T21:50:23.777834+0000","last_clean":"2023-07-09T21:50:23.777834+0000","last_became_active":"2023-07-09T21:50:22.772592+0000","last_became_peered":"2023-07-09T21:50:22.772592+0000","last_unstale":"2023-07-09T21:50:23.777834+0000","last_undegraded":"2023-07-09T21:50:23.777834+0000","last_fullsized":"2023-07-09T21:50:23.777834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:33:47.769844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761024+0000","last_change":"2023-07-09T21:50:22.761024+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761024+0000","last_undegraded":"2023-07-09T21:50:22.761024+0000","last_fullsized":"2023-07-09T21:50:22.761024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.774155+0000","last_change":"2023-07-09T21:50:22.771300+0000","last_active":"2023-07-09T21:50:22.774155+0000","last_peered":"2023-07-09T21:50:22.774155+0000","last_clean":"2023-07-09T21:50:22.774155+0000","last_became_active":"2023-07-09T21:50:22.770639+0000","last_became_peered":"2023-07-09T21:50:22.770639+0000","last_unstale":"2023-07-09T21:50:22.774155+0000","last_undegraded":"2023-07-09T21:50:22.774155+0000","last_fullsized":"2023-07-09T21:50:22.774155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:48.485365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762952+0000","last_change":"2023-07-09T21:50:22.762952+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762952+0000","last_undegraded":"2023-07-09T21:50:22.762952+0000","last_fullsized":"2023-07-09T21:50:22.762952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.782880+0000","last_change":"2023-07-09T21:50:22.781881+0000","last_active":"2023-07-09T21:50:22.782880+0000","last_peered":"2023-07-09T21:50:22.782880+0000","last_clean":"2023-07-09T21:50:22.782880+0000","last_became_active":"2023-07-09T21:50:22.781553+0000","last_became_peered":"2023-07-09T21:50:22.781553+0000","last_unstale":"2023-07-09T21:50:22.782880+0000","last_undegraded":"2023-07-09T21:50:22.782880+0000","last_fullsized":"2023-07-09T21:50:22.782880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:32.098668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.757174+0000","last_change":"2023-07-09T21:50:22.757174+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.757174+0000","last_undegraded":"2023-07-09T21:50:22.757174+0000","last_fullsized":"2023-07-09T21:50:22.757174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.781134+0000","last_change":"2023-07-09T21:50:22.775466+0000","last_active":"2023-07-09T21:50:22.781134+0000","last_peered":"2023-07-09T21:50:22.781134+0000","last_clean":"2023-07-09T21:50:22.781134+0000","last_became_active":"2023-07-09T21:50:22.775189+0000","last_became_peered":"2023-07-09T21:50:22.775189+0000","last_unstale":"2023-07-09T21:50:22.781134+0000","last_undegraded":"2023-07-09T21:50:22.781134+0000","last_fullsized":"2023-07-09T21:50:22.781134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:30:44.360848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.756722+0000","last_change":"2023-07-09T21:50:22.756722+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.756722+0000","last_undegraded":"2023-07-09T21:50:22.756722+0000","last_fullsized":"2023-07-09T21:50:22.756722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.779374+0000","last_change":"2023-07-09T21:50:22.776755+0000","last_active":"2023-07-09T21:50:22.779374+0000","last_peered":"2023-07-09T21:50:22.779374+0000","last_clean":"2023-07-09T21:50:22.779374+0000","last_became_active":"2023-07-09T21:50:22.776393+0000","last_became_peered":"2023-07-09T21:50:22.776393+0000","last_unstale":"2023-07-09T21:50:22.779374+0000","last_undegraded":"2023-07-09T21:50:22.779374+0000","last_fullsized":"2023-07-09T21:50:22.779374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:17:27.986566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.787655+0000","last_change":"2023-07-09T21:50:23.781306+0000","last_active":"2023-07-09T21:50:23.787655+0000","last_peered":"2023-07-09T21:50:23.787655+0000","last_clean":"2023-07-09T21:50:23.787655+0000","last_became_active":"2023-07-09T21:50:23.781040+0000","last_became_peered":"2023-07-09T21:50:23.781040+0000","last_unstale":"2023-07-09T21:50:23.787655+0000","last_undegraded":"2023-07-09T21:50:23.787655+0000","last_fullsized":"2023-07-09T21:50:23.787655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:24:58.710922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.818016+0000","last_change":"2023-07-09T21:50:22.778707+0000","last_active":"2023-07-09T21:50:23.818016+0000","last_peered":"2023-07-09T21:50:23.818016+0000","last_clean":"2023-07-09T21:50:23.818016+0000","last_became_active":"2023-07-09T21:50:22.778397+0000","last_became_peered":"2023-07-09T21:50:22.778397+0000","last_unstale":"2023-07-09T21:50:23.818016+0000","last_undegraded":"2023-07-09T21:50:23.818016+0000","last_fullsized":"2023-07-09T21:50:23.818016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:30:44.360848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801947+0000","last_change":"2023-07-09T21:50:23.793887+0000","last_active":"2023-07-09T21:50:23.801947+0000","last_peered":"2023-07-09T21:50:23.801947+0000","last_clean":"2023-07-09T21:50:23.801947+0000","last_became_active":"2023-07-09T21:50:23.793626+0000","last_became_peered":"2023-07-09T21:50:23.793626+0000","last_unstale":"2023-07-09T21:50:23.801947+0000","last_undegraded":"2023-07-09T21:50:23.801947+0000","last_fullsized":"2023-07-09T21:50:23.801947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:05.934271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.785652+0000","last_change":"2023-07-09T21:50:22.781947+0000","last_active":"2023-07-09T21:50:22.785652+0000","last_peered":"2023-07-09T21:50:22.785652+0000","last_clean":"2023-07-09T21:50:22.785652+0000","last_became_active":"2023-07-09T21:50:22.780676+0000","last_became_peered":"2023-07-09T21:50:22.780676+0000","last_unstale":"2023-07-09T21:50:22.785652+0000","last_undegraded":"2023-07-09T21:50:22.785652+0000","last_fullsized":"2023-07-09T21:50:22.785652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:41.170273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.758303+0000","last_change":"2023-07-09T21:50:22.758303+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.758303+0000","last_undegraded":"2023-07-09T21:50:22.758303+0000","last_fullsized":"2023-07-09T21:50:22.758303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.778439+0000","last_change":"2023-07-09T21:50:22.777294+0000","last_active":"2023-07-09T21:50:22.778439+0000","last_peered":"2023-07-09T21:50:22.778439+0000","last_clean":"2023-07-09T21:50:22.778439+0000","last_became_active":"2023-07-09T21:50:22.776308+0000","last_became_peered":"2023-07-09T21:50:22.776308+0000","last_unstale":"2023-07-09T21:50:22.778439+0000","last_undegraded":"2023-07-09T21:50:22.778439+0000","last_fullsized":"2023-07-09T21:50:22.778439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:29:15.348265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.756431+0000","last_change":"2023-07-09T21:50:22.756431+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.756431+0000","last_undegraded":"2023-07-09T21:50:22.756431+0000","last_fullsized":"2023-07-09T21:50:22.756431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.785609+0000","last_change":"2023-07-09T21:50:22.780710+0000","last_active":"2023-07-09T21:50:22.785609+0000","last_peered":"2023-07-09T21:50:22.785609+0000","last_clean":"2023-07-09T21:50:22.785609+0000","last_became_active":"2023-07-09T21:50:22.780392+0000","last_became_peered":"2023-07-09T21:50:22.780392+0000","last_unstale":"2023-07-09T21:50:22.785609+0000","last_undegraded":"2023-07-09T21:50:22.785609+0000","last_fullsized":"2023-07-09T21:50:22.785609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:23.785505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761522+0000","last_change":"2023-07-09T21:50:22.761522+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761522+0000","last_undegraded":"2023-07-09T21:50:22.761522+0000","last_fullsized":"2023-07-09T21:50:22.761522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.774543+0000","last_change":"2023-07-09T21:50:22.770920+0000","last_active":"2023-07-09T21:50:22.774543+0000","last_peered":"2023-07-09T21:50:22.774543+0000","last_clean":"2023-07-09T21:50:22.774543+0000","last_became_active":"2023-07-09T21:50:22.770566+0000","last_became_peered":"2023-07-09T21:50:22.770566+0000","last_unstale":"2023-07-09T21:50:22.774543+0000","last_undegraded":"2023-07-09T21:50:22.774543+0000","last_fullsized":"2023-07-09T21:50:22.774543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:29:15.348265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.758525+0000","last_change":"2023-07-09T21:50:22.758525+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.758525+0000","last_undegraded":"2023-07-09T21:50:22.758525+0000","last_fullsized":"2023-07-09T21:50:22.758525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.785627+0000","last_change":"2023-07-09T21:50:22.781469+0000","last_active":"2023-07-09T21:50:22.785627+0000","last_peered":"2023-07-09T21:50:22.785627+0000","last_clean":"2023-07-09T21:50:22.785627+0000","last_became_active":"2023-07-09T21:50:22.781215+0000","last_became_peered":"2023-07-09T21:50:22.781215+0000","last_unstale":"2023-07-09T21:50:22.785627+0000","last_undegraded":"2023-07-09T21:50:22.785627+0000","last_fullsized":"2023-07-09T21:50:22.785627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:34.301244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.755435+0000","last_change":"2023-07-09T21:50:22.755435+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.755435+0000","last_undegraded":"2023-07-09T21:50:22.755435+0000","last_fullsized":"2023-07-09T21:50:22.755435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.785619+0000","last_change":"2023-07-09T21:50:22.780841+0000","last_active":"2023-07-09T21:50:22.785619+0000","last_peered":"2023-07-09T21:50:22.785619+0000","last_clean":"2023-07-09T21:50:22.785619+0000","last_became_active":"2023-07-09T21:50:22.780287+0000","last_became_peered":"2023-07-09T21:50:22.780287+0000","last_unstale":"2023-07-09T21:50:22.785619+0000","last_undegraded":"2023-07-09T21:50:22.785619+0000","last_fullsized":"2023-07-09T21:50:22.785619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:49.689261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802245+0000","last_change":"2023-07-09T21:50:23.794825+0000","last_active":"2023-07-09T21:50:23.802245+0000","last_peered":"2023-07-09T21:50:23.802245+0000","last_clean":"2023-07-09T21:50:23.802245+0000","last_became_active":"2023-07-09T21:50:23.794372+0000","last_became_peered":"2023-07-09T21:50:23.794372+0000","last_unstale":"2023-07-09T21:50:23.802245+0000","last_undegraded":"2023-07-09T21:50:23.802245+0000","last_fullsized":"2023-07-09T21:50:23.802245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:07.185673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.785683+0000","last_change":"2023-07-09T21:50:22.782310+0000","last_active":"2023-07-09T21:50:22.785683+0000","last_peered":"2023-07-09T21:50:22.785683+0000","last_clean":"2023-07-09T21:50:22.785683+0000","last_became_active":"2023-07-09T21:50:22.782041+0000","last_became_peered":"2023-07-09T21:50:22.782041+0000","last_unstale":"2023-07-09T21:50:22.785683+0000","last_undegraded":"2023-07-09T21:50:22.785683+0000","last_fullsized":"2023-07-09T21:50:22.785683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:04.930000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762223+0000","last_change":"2023-07-09T21:50:22.762223+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762223+0000","last_undegraded":"2023-07-09T21:50:22.762223+0000","last_fullsized":"2023-07-09T21:50:22.762223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.780793+0000","last_change":"2023-07-09T21:50:22.769028+0000","last_active":"2023-07-09T21:50:22.780793+0000","last_peered":"2023-07-09T21:50:22.780793+0000","last_clean":"2023-07-09T21:50:22.780793+0000","last_became_active":"2023-07-09T21:50:22.768697+0000","last_became_peered":"2023-07-09T21:50:22.768697+0000","last_unstale":"2023-07-09T21:50:22.780793+0000","last_undegraded":"2023-07-09T21:50:22.780793+0000","last_fullsized":"2023-07-09T21:50:22.780793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:32.098668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.760133+0000","last_change":"2023-07-09T21:50:22.760133+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.760133+0000","last_undegraded":"2023-07-09T21:50:22.760133+0000","last_fullsized":"2023-07-09T21:50:22.760133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.773425+0000","last_change":"2023-07-09T21:50:22.769216+0000","last_active":"2023-07-09T21:50:22.773425+0000","last_peered":"2023-07-09T21:50:22.773425+0000","last_clean":"2023-07-09T21:50:22.773425+0000","last_became_active":"2023-07-09T21:50:22.768893+0000","last_became_peered":"2023-07-09T21:50:22.768893+0000","last_unstale":"2023-07-09T21:50:22.773425+0000","last_undegraded":"2023-07-09T21:50:22.773425+0000","last_fullsized":"2023-07-09T21:50:22.773425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:50.434981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801774+0000","last_change":"2023-07-09T21:50:23.790525+0000","last_active":"2023-07-09T21:50:23.801774+0000","last_peered":"2023-07-09T21:50:23.801774+0000","last_clean":"2023-07-09T21:50:23.801774+0000","last_became_active":"2023-07-09T21:50:23.790164+0000","last_became_peered":"2023-07-09T21:50:23.790164+0000","last_unstale":"2023-07-09T21:50:23.801774+0000","last_undegraded":"2023-07-09T21:50:23.801774+0000","last_fullsized":"2023-07-09T21:50:23.801774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:51.439253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.782211+0000","last_change":"2023-07-09T21:50:22.779742+0000","last_active":"2023-07-09T21:50:22.782211+0000","last_peered":"2023-07-09T21:50:22.782211+0000","last_clean":"2023-07-09T21:50:22.782211+0000","last_became_active":"2023-07-09T21:50:22.779462+0000","last_became_peered":"2023-07-09T21:50:22.779462+0000","last_unstale":"2023-07-09T21:50:22.782211+0000","last_undegraded":"2023-07-09T21:50:22.782211+0000","last_fullsized":"2023-07-09T21:50:22.782211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:50.434981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802010+0000","last_change":"2023-07-09T21:50:23.793928+0000","last_active":"2023-07-09T21:50:23.802010+0000","last_peered":"2023-07-09T21:50:23.802010+0000","last_clean":"2023-07-09T21:50:23.802010+0000","last_became_active":"2023-07-09T21:50:23.793620+0000","last_became_peered":"2023-07-09T21:50:23.793620+0000","last_unstale":"2023-07-09T21:50:23.802010+0000","last_undegraded":"2023-07-09T21:50:23.802010+0000","last_fullsized":"2023-07-09T21:50:23.802010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:50.693532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.781593+0000","last_change":"2023-07-09T21:50:22.772850+0000","last_active":"2023-07-09T21:50:23.781593+0000","last_peered":"2023-07-09T21:50:23.781593+0000","last_clean":"2023-07-09T21:50:23.781593+0000","last_became_active":"2023-07-09T21:50:22.772522+0000","last_became_peered":"2023-07-09T21:50:22.772522+0000","last_unstale":"2023-07-09T21:50:23.781593+0000","last_undegraded":"2023-07-09T21:50:23.781593+0000","last_fullsized":"2023-07-09T21:50:23.781593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:32:07.041518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802085+0000","last_change":"2023-07-09T21:50:23.787502+0000","last_active":"2023-07-09T21:50:23.802085+0000","last_peered":"2023-07-09T21:50:23.802085+0000","last_clean":"2023-07-09T21:50:23.802085+0000","last_became_active":"2023-07-09T21:50:23.786685+0000","last_became_peered":"2023-07-09T21:50:23.786685+0000","last_unstale":"2023-07-09T21:50:23.802085+0000","last_undegraded":"2023-07-09T21:50:23.802085+0000","last_fullsized":"2023-07-09T21:50:23.802085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:05.764849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.773470+0000","last_change":"2023-07-09T21:50:22.769583+0000","last_active":"2023-07-09T21:50:22.773470+0000","last_peered":"2023-07-09T21:50:22.773470+0000","last_clean":"2023-07-09T21:50:22.773470+0000","last_became_active":"2023-07-09T21:50:22.768169+0000","last_became_peered":"2023-07-09T21:50:22.768169+0000","last_unstale":"2023-07-09T21:50:22.773470+0000","last_undegraded":"2023-07-09T21:50:22.773470+0000","last_fullsized":"2023-07-09T21:50:22.773470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:29:15.348265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790139+0000","last_change":"2023-07-09T21:50:23.784726+0000","last_active":"2023-07-09T21:50:23.790139+0000","last_peered":"2023-07-09T21:50:23.790139+0000","last_clean":"2023-07-09T21:50:23.790139+0000","last_became_active":"2023-07-09T21:50:23.777193+0000","last_became_peered":"2023-07-09T21:50:23.777193+0000","last_unstale":"2023-07-09T21:50:23.790139+0000","last_undegraded":"2023-07-09T21:50:23.790139+0000","last_fullsized":"2023-07-09T21:50:23.790139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:34.646316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.779148+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:50:23.779148+0000","last_peered":"2023-07-09T21:50:23.779148+0000","last_clean":"2023-07-09T21:50:23.779148+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:50:23.779148+0000","last_undegraded":"2023-07-09T21:50:23.779148+0000","last_fullsized":"2023-07-09T21:50:23.779148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:35:50.473268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.781384+0000","last_change":"2023-07-09T21:50:22.772281+0000","last_active":"2023-07-09T21:50:22.781384+0000","last_peered":"2023-07-09T21:50:22.781384+0000","last_clean":"2023-07-09T21:50:22.781384+0000","last_became_active":"2023-07-09T21:50:22.769167+0000","last_became_peered":"2023-07-09T21:50:22.769167+0000","last_unstale":"2023-07-09T21:50:22.781384+0000","last_undegraded":"2023-07-09T21:50:22.781384+0000","last_fullsized":"2023-07-09T21:50:22.781384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:04.760578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.787677+0000","last_change":"2023-07-09T21:50:23.783723+0000","last_active":"2023-07-09T21:50:23.787677+0000","last_peered":"2023-07-09T21:50:23.787677+0000","last_clean":"2023-07-09T21:50:23.787677+0000","last_became_active":"2023-07-09T21:50:23.783453+0000","last_became_peered":"2023-07-09T21:50:23.783453+0000","last_unstale":"2023-07-09T21:50:23.787677+0000","last_undegraded":"2023-07-09T21:50:23.787677+0000","last_fullsized":"2023-07-09T21:50:23.787677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:42:06.075539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.759584+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:50:22.759584+0000","last_peered":"2023-07-09T21:50:22.759584+0000","last_clean":"2023-07-09T21:50:22.759584+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:50:22.759584+0000","last_undegraded":"2023-07-09T21:50:22.759584+0000","last_fullsized":"2023-07-09T21:50:22.759584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:37.252696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.779267+0000","last_change":"2023-07-09T21:50:22.778044+0000","last_active":"2023-07-09T21:50:23.779267+0000","last_peered":"2023-07-09T21:50:23.779267+0000","last_clean":"2023-07-09T21:50:23.779267+0000","last_became_active":"2023-07-09T21:50:22.777708+0000","last_became_peered":"2023-07-09T21:50:22.777708+0000","last_unstale":"2023-07-09T21:50:23.779267+0000","last_undegraded":"2023-07-09T21:50:23.779267+0000","last_fullsized":"2023-07-09T21:50:23.779267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:23.785505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.787438+0000","last_change":"2023-07-09T21:50:23.780850+0000","last_active":"2023-07-09T21:50:23.787438+0000","last_peered":"2023-07-09T21:50:23.787438+0000","last_clean":"2023-07-09T21:50:23.787438+0000","last_became_active":"2023-07-09T21:50:23.780529+0000","last_became_peered":"2023-07-09T21:50:23.780529+0000","last_unstale":"2023-07-09T21:50:23.787438+0000","last_undegraded":"2023-07-09T21:50:23.787438+0000","last_fullsized":"2023-07-09T21:50:23.787438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:10.298327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.754057+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:50:22.754057+0000","last_peered":"2023-07-09T21:50:22.754057+0000","last_clean":"2023-07-09T21:50:22.754057+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:50:22.754057+0000","last_undegraded":"2023-07-09T21:50:22.754057+0000","last_fullsized":"2023-07-09T21:50:22.754057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:29:10.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.777557+0000","last_change":"2023-07-09T21:50:22.774908+0000","last_active":"2023-07-09T21:50:23.777557+0000","last_peered":"2023-07-09T21:50:23.777557+0000","last_clean":"2023-07-09T21:50:23.777557+0000","last_became_active":"2023-07-09T21:50:22.774600+0000","last_became_peered":"2023-07-09T21:50:22.774600+0000","last_unstale":"2023-07-09T21:50:23.777557+0000","last_undegraded":"2023-07-09T21:50:23.777557+0000","last_fullsized":"2023-07-09T21:50:23.777557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:08:56.300464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790176+0000","last_change":"2023-07-09T21:50:23.786034+0000","last_active":"2023-07-09T21:50:23.790176+0000","last_peered":"2023-07-09T21:50:23.790176+0000","last_clean":"2023-07-09T21:50:23.790176+0000","last_became_active":"2023-07-09T21:50:23.785763+0000","last_became_peered":"2023-07-09T21:50:23.785763+0000","last_unstale":"2023-07-09T21:50:23.790176+0000","last_undegraded":"2023-07-09T21:50:23.790176+0000","last_fullsized":"2023-07-09T21:50:23.790176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:20:36.952568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.759619+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:50:22.759619+0000","last_peered":"2023-07-09T21:50:22.759619+0000","last_clean":"2023-07-09T21:50:22.759619+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:50:22.759619+0000","last_undegraded":"2023-07-09T21:50:22.759619+0000","last_fullsized":"2023-07-09T21:50:22.759619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:07:05.866039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.766215+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:50:22.766215+0000","last_peered":"2023-07-09T21:50:22.766215+0000","last_clean":"2023-07-09T21:50:22.766215+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:50:22.766215+0000","last_undegraded":"2023-07-09T21:50:22.766215+0000","last_fullsized":"2023-07-09T21:50:22.766215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:09.774473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.769879+0000","last_change":"2023-07-09T21:50:22.766454+0000","last_active":"2023-07-09T21:50:22.769879+0000","last_peered":"2023-07-09T21:50:22.769879+0000","last_clean":"2023-07-09T21:50:22.769879+0000","last_became_active":"2023-07-09T21:50:22.766057+0000","last_became_peered":"2023-07-09T21:50:22.766057+0000","last_unstale":"2023-07-09T21:50:22.769879+0000","last_undegraded":"2023-07-09T21:50:22.769879+0000","last_fullsized":"2023-07-09T21:50:22.769879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:32.098668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762431+0000","last_change":"2023-07-09T21:50:22.762431+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762431+0000","last_undegraded":"2023-07-09T21:50:22.762431+0000","last_fullsized":"2023-07-09T21:50:22.762431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.766371+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:50:22.766371+0000","last_peered":"2023-07-09T21:50:22.766371+0000","last_clean":"2023-07-09T21:50:22.766371+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:50:22.766371+0000","last_undegraded":"2023-07-09T21:50:22.766371+0000","last_fullsized":"2023-07-09T21:50:22.766371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:22.454077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.778478+0000","last_change":"2023-07-09T21:50:22.777350+0000","last_active":"2023-07-09T21:50:22.778478+0000","last_peered":"2023-07-09T21:50:22.778478+0000","last_clean":"2023-07-09T21:50:22.778478+0000","last_became_active":"2023-07-09T21:50:22.776974+0000","last_became_peered":"2023-07-09T21:50:22.776974+0000","last_unstale":"2023-07-09T21:50:22.778478+0000","last_undegraded":"2023-07-09T21:50:22.778478+0000","last_fullsized":"2023-07-09T21:50:22.778478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:04.760578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.757544+0000","last_change":"2023-07-09T21:50:22.757544+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.757544+0000","last_undegraded":"2023-07-09T21:50:22.757544+0000","last_fullsized":"2023-07-09T21:50:22.757544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.767821+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:50:22.767821+0000","last_peered":"2023-07-09T21:50:22.767821+0000","last_clean":"2023-07-09T21:50:22.767821+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:50:22.767821+0000","last_undegraded":"2023-07-09T21:50:22.767821+0000","last_fullsized":"2023-07-09T21:50:22.767821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:00.963583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.779375+0000","last_change":"2023-07-09T21:50:22.774621+0000","last_active":"2023-07-09T21:50:23.779375+0000","last_peered":"2023-07-09T21:50:23.779375+0000","last_clean":"2023-07-09T21:50:23.779375+0000","last_became_active":"2023-07-09T21:50:22.774322+0000","last_became_peered":"2023-07-09T21:50:22.774322+0000","last_unstale":"2023-07-09T21:50:23.779375+0000","last_undegraded":"2023-07-09T21:50:23.779375+0000","last_fullsized":"2023-07-09T21:50:23.779375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:49.341701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761021+0000","last_change":"2023-07-09T21:50:22.761021+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761021+0000","last_undegraded":"2023-07-09T21:50:22.761021+0000","last_fullsized":"2023-07-09T21:50:22.761021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.777873+0000","last_change":"2023-07-09T21:50:22.775713+0000","last_active":"2023-07-09T21:50:22.777873+0000","last_peered":"2023-07-09T21:50:22.777873+0000","last_clean":"2023-07-09T21:50:22.777873+0000","last_became_active":"2023-07-09T21:50:22.775420+0000","last_became_peered":"2023-07-09T21:50:22.775420+0000","last_unstale":"2023-07-09T21:50:22.777873+0000","last_undegraded":"2023-07-09T21:50:22.777873+0000","last_fullsized":"2023-07-09T21:50:22.777873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:42.243258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.778529+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:50:23.778529+0000","last_peered":"2023-07-09T21:50:23.778529+0000","last_clean":"2023-07-09T21:50:23.778529+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:50:23.778529+0000","last_undegraded":"2023-07-09T21:50:23.778529+0000","last_fullsized":"2023-07-09T21:50:23.778529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:28:48.759912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.756577+0000","last_change":"2023-07-09T21:50:22.756577+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.756577+0000","last_undegraded":"2023-07-09T21:50:22.756577+0000","last_fullsized":"2023-07-09T21:50:22.756577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.767000+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:50:22.767000+0000","last_peered":"2023-07-09T21:50:22.767000+0000","last_clean":"2023-07-09T21:50:22.767000+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:50:22.767000+0000","last_undegraded":"2023-07-09T21:50:22.767000+0000","last_fullsized":"2023-07-09T21:50:22.767000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:26.880849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.775151+0000","last_change":"2023-07-09T21:50:22.772687+0000","last_active":"2023-07-09T21:50:22.775151+0000","last_peered":"2023-07-09T21:50:22.775151+0000","last_clean":"2023-07-09T21:50:22.775151+0000","last_became_active":"2023-07-09T21:50:22.772342+0000","last_became_peered":"2023-07-09T21:50:22.772342+0000","last_unstale":"2023-07-09T21:50:22.775151+0000","last_undegraded":"2023-07-09T21:50:22.775151+0000","last_fullsized":"2023-07-09T21:50:22.775151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:42.243258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802227+0000","last_change":"2023-07-09T21:50:23.794661+0000","last_active":"2023-07-09T21:50:23.802227+0000","last_peered":"2023-07-09T21:50:23.802227+0000","last_clean":"2023-07-09T21:50:23.802227+0000","last_became_active":"2023-07-09T21:50:23.794107+0000","last_became_peered":"2023-07-09T21:50:23.794107+0000","last_unstale":"2023-07-09T21:50:23.802227+0000","last_undegraded":"2023-07-09T21:50:23.802227+0000","last_fullsized":"2023-07-09T21:50:23.802227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:35.305515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.780592+0000","last_change":"2023-07-09T21:50:22.779822+0000","last_active":"2023-07-09T21:50:22.780592+0000","last_peered":"2023-07-09T21:50:22.780592+0000","last_clean":"2023-07-09T21:50:22.780592+0000","last_became_active":"2023-07-09T21:50:22.779595+0000","last_became_peered":"2023-07-09T21:50:22.779595+0000","last_unstale":"2023-07-09T21:50:22.780592+0000","last_undegraded":"2023-07-09T21:50:22.780592+0000","last_fullsized":"2023-07-09T21:50:22.780592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:48.485365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.754562+0000","last_change":"2023-07-09T21:50:22.754562+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.754562+0000","last_undegraded":"2023-07-09T21:50:22.754562+0000","last_fullsized":"2023-07-09T21:50:22.754562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.781182+0000","last_change":"2023-07-09T21:50:22.772154+0000","last_active":"2023-07-09T21:50:22.781182+0000","last_peered":"2023-07-09T21:50:22.781182+0000","last_clean":"2023-07-09T21:50:22.781182+0000","last_became_active":"2023-07-09T21:50:22.771882+0000","last_became_peered":"2023-07-09T21:50:22.771882+0000","last_unstale":"2023-07-09T21:50:22.781182+0000","last_undegraded":"2023-07-09T21:50:22.781182+0000","last_fullsized":"2023-07-09T21:50:22.781182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:48.485365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801927+0000","last_change":"2023-07-09T21:50:23.793009+0000","last_active":"2023-07-09T21:50:23.801927+0000","last_peered":"2023-07-09T21:50:23.801927+0000","last_clean":"2023-07-09T21:50:23.801927+0000","last_became_active":"2023-07-09T21:50:23.791995+0000","last_became_peered":"2023-07-09T21:50:23.791995+0000","last_unstale":"2023-07-09T21:50:23.801927+0000","last_undegraded":"2023-07-09T21:50:23.801927+0000","last_fullsized":"2023-07-09T21:50:23.801927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:40.779031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.781405+0000","last_change":"2023-07-09T21:50:22.772972+0000","last_active":"2023-07-09T21:50:22.781405+0000","last_peered":"2023-07-09T21:50:22.781405+0000","last_clean":"2023-07-09T21:50:22.781405+0000","last_became_active":"2023-07-09T21:50:22.772647+0000","last_became_peered":"2023-07-09T21:50:22.772647+0000","last_unstale":"2023-07-09T21:50:22.781405+0000","last_undegraded":"2023-07-09T21:50:22.781405+0000","last_fullsized":"2023-07-09T21:50:22.781405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:42.243258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801973+0000","last_change":"2023-07-09T21:50:23.790945+0000","last_active":"2023-07-09T21:50:23.801973+0000","last_peered":"2023-07-09T21:50:23.801973+0000","last_clean":"2023-07-09T21:50:23.801973+0000","last_became_active":"2023-07-09T21:50:23.790660+0000","last_became_peered":"2023-07-09T21:50:23.790660+0000","last_unstale":"2023-07-09T21:50:23.801973+0000","last_undegraded":"2023-07-09T21:50:23.801973+0000","last_fullsized":"2023-07-09T21:50:23.801973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:43.247529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.774364+0000","last_change":"2023-07-09T21:50:22.770573+0000","last_active":"2023-07-09T21:50:22.774364+0000","last_peered":"2023-07-09T21:50:22.774364+0000","last_clean":"2023-07-09T21:50:22.774364+0000","last_became_active":"2023-07-09T21:50:22.770263+0000","last_became_peered":"2023-07-09T21:50:22.770263+0000","last_unstale":"2023-07-09T21:50:22.774364+0000","last_undegraded":"2023-07-09T21:50:22.774364+0000","last_fullsized":"2023-07-09T21:50:22.774364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:04.760578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.757889+0000","last_change":"2023-07-09T21:50:22.757889+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.757889+0000","last_undegraded":"2023-07-09T21:50:22.757889+0000","last_fullsized":"2023-07-09T21:50:22.757889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:50:22.777725+0000","last_change":"2023-07-09T21:50:22.776290+0000","last_active":"2023-07-09T21:50:22.777725+0000","last_peered":"2023-07-09T21:50:22.777725+0000","last_clean":"2023-07-09T21:50:22.777725+0000","last_became_active":"2023-07-09T21:50:22.775873+0000","last_became_peered":"2023-07-09T21:50:22.775873+0000","last_unstale":"2023-07-09T21:50:22.777725+0000","last_undegraded":"2023-07-09T21:50:22.777725+0000","last_fullsized":"2023-07-09T21:50:22.777725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:50.434981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.797500+0000","last_change":"2023-07-09T21:50:23.787350+0000","last_active":"2023-07-09T21:50:23.797500+0000","last_peered":"2023-07-09T21:50:23.797500+0000","last_clean":"2023-07-09T21:50:23.797500+0000","last_became_active":"2023-07-09T21:50:23.787079+0000","last_became_peered":"2023-07-09T21:50:23.787079+0000","last_unstale":"2023-07-09T21:50:23.797500+0000","last_undegraded":"2023-07-09T21:50:23.797500+0000","last_fullsized":"2023-07-09T21:50:23.797500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:07:12.088130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762011+0000","last_change":"2023-07-09T21:50:22.762011+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762011+0000","last_undegraded":"2023-07-09T21:50:22.762011+0000","last_fullsized":"2023-07-09T21:50:22.762011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.762296+0000","last_change":"2023-07-09T21:50:22.762296+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.762296+0000","last_undegraded":"2023-07-09T21:50:22.762296+0000","last_fullsized":"2023-07-09T21:50:22.762296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.797393+0000","last_change":"2023-07-09T21:50:23.787304+0000","last_active":"2023-07-09T21:50:23.797393+0000","last_peered":"2023-07-09T21:50:23.797393+0000","last_clean":"2023-07-09T21:50:23.797393+0000","last_became_active":"2023-07-09T21:50:23.787022+0000","last_became_peered":"2023-07-09T21:50:23.787022+0000","last_unstale":"2023-07-09T21:50:23.797393+0000","last_undegraded":"2023-07-09T21:50:23.797393+0000","last_fullsized":"2023-07-09T21:50:23.797393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:57:38.274013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-09T21:50:22.761679+0000","last_change":"2023-07-09T21:50:22.761679+0000","last_active":"2023-07-09T21:50:22.746844+0000","last_peered":"2023-07-09T21:50:22.746844+0000","last_clean":"2023-07-09T21:50:22.746844+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:50:22.761679+0000","last_undegraded":"2023-07-09T21:50:22.761679+0000","last_fullsized":"2023-07-09T21:50:22.761679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.783621+0000","last_change":"2023-07-09T21:50:23.780066+0000","last_active":"2023-07-09T21:50:23.783621+0000","last_peered":"2023-07-09T21:50:23.783621+0000","last_clean":"2023-07-09T21:50:23.783621+0000","last_became_active":"2023-07-09T21:50:23.779691+0000","last_became_peered":"2023-07-09T21:50:23.779691+0000","last_unstale":"2023-07-09T21:50:23.783621+0000","last_undegraded":"2023-07-09T21:50:23.783621+0000","last_fullsized":"2023-07-09T21:50:23.783621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:51:58.642076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":83224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":83224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":76604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":815104,"data_stored":666972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":815104,"data_stored":666972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":76604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":83224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":76604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:50:28.724 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:50:28.747 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-07-09T21:50:28.746+0000 7f0a16df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:50:28.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.958+0000 7f56d13ff700 1 Processor -- start 2023-07-09T21:50:28.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.958+0000 7f56d13ff700 1 -- start start 2023-07-09T21:50:28.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.959+0000 7f56d13ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f56cc0b1e00 0x7f56cc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:28.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.959+0000 7f56d13ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56cc0b2350 0x7f56cc0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:28.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.959+0000 7f56d13ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc0d14a0 con 0x7f56cc0d1050 2023-07-09T21:50:28.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.959+0000 7f56d13ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc0d2ce0 con 0x7f56cc0b1e00 2023-07-09T21:50:28.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.959+0000 7f56d13ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0b3350 con 0x7f56cc0b2350 2023-07-09T21:50:28.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.959+0000 7f56ca7fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56cc0b2350 0x7f56cc0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:28.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.959+0000 7f56caffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f56cc0b1e00 0x7f56cc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:28.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.959+0000 7f56cb7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f56cc0d1050 0x7f56cc0afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:53064/0 (socket says 172.21.15.53:53064) 2023-07-09T21:50:28.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.959+0000 7f56cb7fe700 1 -- 172.21.15.53:0/844009197 learned_addr learned my addr 172.21.15.53:0/844009197 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:28.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.960+0000 7f56c9ffb700 1 -- 172.21.15.53:0/844009197 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004977458 0 0) 0x7f56c4001490 con 0x7f56cc0d1050 2023-07-09T21:50:28.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.960+0000 7f56c9ffb700 1 -- 172.21.15.53:0/844009197 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b40035b0 con 0x7f56cc0d1050 2023-07-09T21:50:28.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.960+0000 7f56caffd700 1 -- 172.21.15.53:0/844009197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56cc0b2350 msgr2=0x7f56cc0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:28.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.960+0000 7f56caffd700 1 --2- 172.21.15.53:0/844009197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56cc0b2350 0x7f56cc0d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.960+0000 7f56caffd700 1 -- 172.21.15.53:0/844009197 >> v1:172.21.15.184:6789/0 conn(0x7f56cc0d1050 legacy=0x7f56cc0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:28.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.960+0000 7f56caffd700 1 -- 172.21.15.53:0/844009197 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0b3630 con 0x7f56cc0b1e00 2023-07-09T21:50:28.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.960+0000 7f56ca7fc700 1 --2- 172.21.15.53:0/844009197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56cc0b2350 0x7f56cc0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:50:28.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.960+0000 7f56caffd700 1 --2- 172.21.15.53:0/844009197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56cc0b1e00 0x7f56cc0b43f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009820 tx=0x7f56bc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61375faceff89953 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:28.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.961+0000 7f56c9ffb700 1 -- 172.21.15.53:0/844009197 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc005e30 con 0x7f56cc0b1e00 2023-07-09T21:50:28.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.961+0000 7f56c9ffb700 1 -- 172.21.15.53:0/844009197 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc006030 con 0x7f56cc0b1e00 2023-07-09T21:50:28.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.961+0000 7f56c9ffb700 1 -- 172.21.15.53:0/844009197 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0063a0 con 0x7f56cc0b1e00 2023-07-09T21:50:28.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.961+0000 7f56d13ff700 1 -- 172.21.15.53:0/844009197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56cc0b1e00 msgr2=0x7f56cc0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:28.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.961+0000 7f56d13ff700 1 --2- 172.21.15.53:0/844009197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56cc0b1e00 0x7f56cc0b43f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009820 tx=0x7f56bc009b30 comp rx=0 tx=0).stop 2023-07-09T21:50:28.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.961+0000 7f56d13ff700 1 -- 172.21.15.53:0/844009197 shutdown_connections 2023-07-09T21:50:28.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.961+0000 7f56d13ff700 1 --2- 172.21.15.53:0/844009197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56cc0b1e00 0x7f56cc0b43f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.961+0000 7f56d13ff700 1 --2- 172.21.15.53:0/844009197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56cc0b2350 0x7f56cc0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.961+0000 7f56d13ff700 1 -- 172.21.15.53:0/844009197 >> 172.21.15.53:0/844009197 conn(0x7f56cc09c1d0 msgr2=0x7f56cc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:28.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.961+0000 7f56d13ff700 1 -- 172.21.15.53:0/844009197 shutdown_connections 2023-07-09T21:50:28.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.961+0000 7f56d13ff700 1 -- 172.21.15.53:0/844009197 wait complete. 2023-07-09T21:50:28.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.963+0000 7f56d13ff700 1 Processor -- start 2023-07-09T21:50:28.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.963+0000 7f56d13ff700 1 -- start start 2023-07-09T21:50:28.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.964+0000 7f56d13ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56cc0b1e00 0x7f56cc145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:28.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.964+0000 7f56d13ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56cc0b2350 0x7f56cc1536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:28.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.964+0000 7f56d13ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56cc0d1050 0x7f56cc0c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:28.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.964+0000 7f56d13ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc145fb0 con 0x7f56cc0d1050 2023-07-09T21:50:28.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.964+0000 7f56d13ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc153c20 con 0x7f56cc0b1e00 2023-07-09T21:50:28.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.964+0000 7f56d13ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0c8d30 con 0x7f56cc0b2350 2023-07-09T21:50:28.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.964+0000 7f56cb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56cc0d1050 0x7f56cc0c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:28.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.964+0000 7f56cb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56cc0d1050 0x7f56cc0c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40388/0 (socket says 172.21.15.53:40388) 2023-07-09T21:50:28.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.964+0000 7f56cb7fe700 1 -- 172.21.15.53:0/3095056872 learned_addr learned my addr 172.21.15.53:0/3095056872 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:28.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.965+0000 7f56caffd700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56cc0b1e00 0x7f56cc145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:28.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.965+0000 7f56ca7fc700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56cc0b2350 0x7f56cc1536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:28.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.965+0000 7f56cb7fe700 1 -- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56cc0b2350 msgr2=0x7f56cc1536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:28.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.965+0000 7f56cb7fe700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56cc0b2350 0x7f56cc1536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.965+0000 7f56cb7fe700 1 -- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56cc0b1e00 msgr2=0x7f56cc145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:28.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.965+0000 7f56cb7fe700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56cc0b1e00 0x7f56cc145a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:28.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.965+0000 7f56cb7fe700 1 -- 172.21.15.53:0/3095056872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c00094a0 con 0x7f56cc0d1050 2023-07-09T21:50:28.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.965+0000 7f56caffd700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56cc0b1e00 0x7f56cc145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:28.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.965+0000 7f56cb7fe700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56cc0d1050 0x7f56cc0c6a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f56c400cb40 tx=0x7f56c400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:28.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.965+0000 7f56b37fe700 1 -- 172.21.15.53:0/3095056872 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c400aaa0 con 0x7f56cc0d1050 2023-07-09T21:50:28.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.965+0000 7f56b37fe700 1 -- 172.21.15.53:0/3095056872 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c400ac00 con 0x7f56cc0d1050 2023-07-09T21:50:28.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.965+0000 7f56d13ff700 1 -- 172.21.15.53:0/3095056872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56bc009430 con 0x7f56cc0d1050 2023-07-09T21:50:28.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.965+0000 7f56b37fe700 1 -- 172.21.15.53:0/3095056872 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4012400 con 0x7f56cc0d1050 2023-07-09T21:50:28.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.966+0000 7f56d13ff700 1 -- 172.21.15.53:0/3095056872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc0c92f0 con 0x7f56cc0d1050 2023-07-09T21:50:28.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.967+0000 7f56d13ff700 1 -- 172.21.15.53:0/3095056872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc04e280 con 0x7f56cc0d1050 2023-07-09T21:50:28.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.968+0000 7f56b37fe700 1 -- 172.21.15.53:0/3095056872 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56c401b3b0 con 0x7f56cc0d1050 2023-07-09T21:50:28.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.968+0000 7f56b37fe700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f56b806ace0 0x7f56b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:28.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.969+0000 7f56b37fe700 1 -- 172.21.15.53:0/3095056872 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f56c40890b0 con 0x7f56cc0d1050 2023-07-09T21:50:28.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.969+0000 7f56caffd700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f56b806ace0 0x7f56b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:28.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.969+0000 7f56caffd700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f56b806ace0 0x7f56b806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56bc013040 tx=0x7f56bc008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:28.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:28.973+0000 7f56b37fe700 1 -- 172.21.15.53:0/3095056872 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f56c4057be0 con 0x7f56cc0d1050 2023-07-09T21:50:29.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.175+0000 7f56d13ff700 1 -- 172.21.15.53:0/3095056872 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56cc0b3910 con 0x7f56b806ace0 2023-07-09T21:50:29.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.185+0000 7f56b37fe700 1 -- 172.21.15.53:0/3095056872 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286793 (secure 0 0 0) 0x7f56bc005cb0 con 0x7f56b806ace0 2023-07-09T21:50:29.189 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:29.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.188+0000 7f56d13ff700 1 -- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f56b806ace0 msgr2=0x7f56b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:29.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.188+0000 7f56d13ff700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f56b806ace0 0x7f56b806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56bc013040 tx=0x7f56bc008070 comp rx=0 tx=0).stop 2023-07-09T21:50:29.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.188+0000 7f56d13ff700 1 -- 172.21.15.53:0/3095056872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56cc0d1050 msgr2=0x7f56cc0c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:29.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.188+0000 7f56d13ff700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56cc0d1050 0x7f56cc0c6a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f56c400cb40 tx=0x7f56c400ce50 comp rx=0 tx=0).stop 2023-07-09T21:50:29.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.189+0000 7f56d13ff700 1 -- 172.21.15.53:0/3095056872 shutdown_connections 2023-07-09T21:50:29.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.189+0000 7f56d13ff700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f56b806ace0 0x7f56b806d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.189+0000 7f56d13ff700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56cc0d1050 0x7f56cc0c6a70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.189+0000 7f56d13ff700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56cc0b1e00 0x7f56cc145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.189+0000 7f56d13ff700 1 --2- 172.21.15.53:0/3095056872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56cc0b2350 0x7f56cc1536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.189+0000 7f56d13ff700 1 -- 172.21.15.53:0/3095056872 >> 172.21.15.53:0/3095056872 conn(0x7f56cc09c1d0 msgr2=0x7f56cc0b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:29.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.189+0000 7f56d13ff700 1 -- 172.21.15.53:0/3095056872 shutdown_connections 2023-07-09T21:50:29.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.189+0000 7f56d13ff700 1 -- 172.21.15.53:0/3095056872 wait complete. 2023-07-09T21:50:29.193 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:50:29.208 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-09T21:50:28.851931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222884,"kb_used_data":3172,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751836,"statfs":{"total":773094113280,"available":772865880064,"internally_reserved":0,"allocated":3248128,"data_stored":1932318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.101385"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401409+0000","last_change":"2023-07-09T21:50:23.789471+0000","last_active":"2023-07-09T21:50:25.401409+0000","last_peered":"2023-07-09T21:50:25.401409+0000","last_clean":"2023-07-09T21:50:25.401409+0000","last_became_active":"2023-07-09T21:50:23.789178+0000","last_became_peered":"2023-07-09T21:50:23.789178+0000","last_unstale":"2023-07-09T21:50:25.401409+0000","last_undegraded":"2023-07-09T21:50:25.401409+0000","last_fullsized":"2023-07-09T21:50:25.401409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:24.789777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771695+0000","last_change":"2023-07-09T21:50:23.789721+0000","last_active":"2023-07-09T21:50:24.771695+0000","last_peered":"2023-07-09T21:50:24.771695+0000","last_clean":"2023-07-09T21:50:24.771695+0000","last_became_active":"2023-07-09T21:50:23.789478+0000","last_became_peered":"2023-07-09T21:50:23.789478+0000","last_unstale":"2023-07-09T21:50:24.771695+0000","last_undegraded":"2023-07-09T21:50:24.771695+0000","last_fullsized":"2023-07-09T21:50:24.771695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801988+0000","last_change":"2023-07-09T21:50:23.792566+0000","last_active":"2023-07-09T21:50:23.801988+0000","last_peered":"2023-07-09T21:50:23.801988+0000","last_clean":"2023-07-09T21:50:23.801988+0000","last_became_active":"2023-07-09T21:50:23.792316+0000","last_became_peered":"2023-07-09T21:50:23.792316+0000","last_unstale":"2023-07-09T21:50:23.801988+0000","last_undegraded":"2023-07-09T21:50:23.801988+0000","last_fullsized":"2023-07-09T21:50:23.801988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401848+0000","last_change":"2023-07-09T21:50:23.790737+0000","last_active":"2023-07-09T21:50:25.401848+0000","last_peered":"2023-07-09T21:50:25.401848+0000","last_clean":"2023-07-09T21:50:25.401848+0000","last_became_active":"2023-07-09T21:50:23.790455+0000","last_became_peered":"2023-07-09T21:50:23.790455+0000","last_unstale":"2023-07-09T21:50:25.401848+0000","last_undegraded":"2023-07-09T21:50:25.401848+0000","last_fullsized":"2023-07-09T21:50:25.401848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:33:28.169248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771850+0000","last_change":"2023-07-09T21:50:23.799889+0000","last_active":"2023-07-09T21:50:24.771850+0000","last_peered":"2023-07-09T21:50:24.771850+0000","last_clean":"2023-07-09T21:50:24.771850+0000","last_became_active":"2023-07-09T21:50:23.798717+0000","last_became_peered":"2023-07-09T21:50:23.798717+0000","last_unstale":"2023-07-09T21:50:24.771850+0000","last_undegraded":"2023-07-09T21:50:24.771850+0000","last_fullsized":"2023-07-09T21:50:24.771850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:25.755232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802212+0000","last_change":"2023-07-09T21:50:23.798790+0000","last_active":"2023-07-09T21:50:23.802212+0000","last_peered":"2023-07-09T21:50:23.802212+0000","last_clean":"2023-07-09T21:50:23.802212+0000","last_became_active":"2023-07-09T21:50:23.798508+0000","last_became_peered":"2023-07-09T21:50:23.798508+0000","last_unstale":"2023-07-09T21:50:23.802212+0000","last_undegraded":"2023-07-09T21:50:23.802212+0000","last_fullsized":"2023-07-09T21:50:23.802212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:43.474786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094158+0000","last_change":"2023-07-09T21:50:23.791148+0000","last_active":"2023-07-09T21:50:25.094158+0000","last_peered":"2023-07-09T21:50:25.094158+0000","last_clean":"2023-07-09T21:50:25.094158+0000","last_became_active":"2023-07-09T21:50:23.790530+0000","last_became_peered":"2023-07-09T21:50:23.790530+0000","last_unstale":"2023-07-09T21:50:25.094158+0000","last_undegraded":"2023-07-09T21:50:25.094158+0000","last_fullsized":"2023-07-09T21:50:25.094158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771365+0000","last_change":"2023-07-09T21:50:23.786451+0000","last_active":"2023-07-09T21:50:24.771365+0000","last_peered":"2023-07-09T21:50:24.771365+0000","last_clean":"2023-07-09T21:50:24.771365+0000","last_became_active":"2023-07-09T21:50:23.786150+0000","last_became_peered":"2023-07-09T21:50:23.786150+0000","last_unstale":"2023-07-09T21:50:24.771365+0000","last_undegraded":"2023-07-09T21:50:24.771365+0000","last_fullsized":"2023-07-09T21:50:24.771365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773128+0000","last_change":"2023-07-09T21:50:23.799651+0000","last_active":"2023-07-09T21:50:24.773128+0000","last_peered":"2023-07-09T21:50:24.773128+0000","last_clean":"2023-07-09T21:50:24.773128+0000","last_became_active":"2023-07-09T21:50:23.799306+0000","last_became_peered":"2023-07-09T21:50:23.799306+0000","last_unstale":"2023-07-09T21:50:24.773128+0000","last_undegraded":"2023-07-09T21:50:24.773128+0000","last_fullsized":"2023-07-09T21:50:24.773128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:06.841347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772154+0000","last_change":"2023-07-09T21:50:23.807058+0000","last_active":"2023-07-09T21:50:24.772154+0000","last_peered":"2023-07-09T21:50:24.772154+0000","last_clean":"2023-07-09T21:50:24.772154+0000","last_became_active":"2023-07-09T21:50:23.805775+0000","last_became_peered":"2023-07-09T21:50:23.805775+0000","last_unstale":"2023-07-09T21:50:24.772154+0000","last_undegraded":"2023-07-09T21:50:24.772154+0000","last_fullsized":"2023-07-09T21:50:24.772154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:16.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801969+0000","last_change":"2023-07-09T21:50:23.787617+0000","last_active":"2023-07-09T21:50:23.801969+0000","last_peered":"2023-07-09T21:50:23.801969+0000","last_clean":"2023-07-09T21:50:23.801969+0000","last_became_active":"2023-07-09T21:50:23.787324+0000","last_became_peered":"2023-07-09T21:50:23.787324+0000","last_unstale":"2023-07-09T21:50:23.801969+0000","last_undegraded":"2023-07-09T21:50:23.801969+0000","last_fullsized":"2023-07-09T21:50:23.801969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:28.676168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401442+0000","last_change":"2023-07-09T21:50:23.786780+0000","last_active":"2023-07-09T21:50:25.401442+0000","last_peered":"2023-07-09T21:50:25.401442+0000","last_clean":"2023-07-09T21:50:25.401442+0000","last_became_active":"2023-07-09T21:50:23.786285+0000","last_became_peered":"2023-07-09T21:50:23.786285+0000","last_unstale":"2023-07-09T21:50:25.401442+0000","last_undegraded":"2023-07-09T21:50:25.401442+0000","last_fullsized":"2023-07-09T21:50:25.401442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:17:28.990837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401348+0000","last_change":"2023-07-09T21:50:23.779777+0000","last_active":"2023-07-09T21:50:25.401348+0000","last_peered":"2023-07-09T21:50:25.401348+0000","last_clean":"2023-07-09T21:50:25.401348+0000","last_became_active":"2023-07-09T21:50:23.779402+0000","last_became_peered":"2023-07-09T21:50:23.779402+0000","last_unstale":"2023-07-09T21:50:25.401348+0000","last_undegraded":"2023-07-09T21:50:25.401348+0000","last_fullsized":"2023-07-09T21:50:25.401348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:28.676168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771883+0000","last_change":"2023-07-09T21:50:23.785342+0000","last_active":"2023-07-09T21:50:24.771883+0000","last_peered":"2023-07-09T21:50:24.771883+0000","last_clean":"2023-07-09T21:50:24.771883+0000","last_became_active":"2023-07-09T21:50:23.785042+0000","last_became_peered":"2023-07-09T21:50:23.785042+0000","last_unstale":"2023-07-09T21:50:24.771883+0000","last_undegraded":"2023-07-09T21:50:24.771883+0000","last_fullsized":"2023-07-09T21:50:24.771883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:33.584119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094514+0000","last_change":"2023-07-09T21:50:23.791304+0000","last_active":"2023-07-09T21:50:25.094514+0000","last_peered":"2023-07-09T21:50:25.094514+0000","last_clean":"2023-07-09T21:50:25.094514+0000","last_became_active":"2023-07-09T21:50:23.790881+0000","last_became_peered":"2023-07-09T21:50:23.790881+0000","last_unstale":"2023-07-09T21:50:25.094514+0000","last_undegraded":"2023-07-09T21:50:25.094514+0000","last_fullsized":"2023-07-09T21:50:25.094514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:53:11.882162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801854+0000","last_change":"2023-07-09T21:50:23.792844+0000","last_active":"2023-07-09T21:50:23.801854+0000","last_peered":"2023-07-09T21:50:23.801854+0000","last_clean":"2023-07-09T21:50:23.801854+0000","last_became_active":"2023-07-09T21:50:23.792511+0000","last_became_peered":"2023-07-09T21:50:23.792511+0000","last_unstale":"2023-07-09T21:50:23.801854+0000","last_undegraded":"2023-07-09T21:50:23.801854+0000","last_fullsized":"2023-07-09T21:50:23.801854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:33.102940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773086+0000","last_change":"2023-07-09T21:50:23.801511+0000","last_active":"2023-07-09T21:50:24.773086+0000","last_peered":"2023-07-09T21:50:24.773086+0000","last_clean":"2023-07-09T21:50:24.773086+0000","last_became_active":"2023-07-09T21:50:23.799945+0000","last_became_peered":"2023-07-09T21:50:23.799945+0000","last_unstale":"2023-07-09T21:50:24.773086+0000","last_undegraded":"2023-07-09T21:50:24.773086+0000","last_fullsized":"2023-07-09T21:50:24.773086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:30.584499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802103+0000","last_change":"2023-07-09T21:50:23.791210+0000","last_active":"2023-07-09T21:50:23.802103+0000","last_peered":"2023-07-09T21:50:23.802103+0000","last_clean":"2023-07-09T21:50:23.802103+0000","last_became_active":"2023-07-09T21:50:23.790958+0000","last_became_peered":"2023-07-09T21:50:23.790958+0000","last_unstale":"2023-07-09T21:50:23.802103+0000","last_undegraded":"2023-07-09T21:50:23.802103+0000","last_fullsized":"2023-07-09T21:50:23.802103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:23.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401359+0000","last_change":"2023-07-09T21:50:23.781367+0000","last_active":"2023-07-09T21:50:25.401359+0000","last_peered":"2023-07-09T21:50:25.401359+0000","last_clean":"2023-07-09T21:50:25.401359+0000","last_became_active":"2023-07-09T21:50:23.781111+0000","last_became_peered":"2023-07-09T21:50:23.781111+0000","last_unstale":"2023-07-09T21:50:25.401359+0000","last_undegraded":"2023-07-09T21:50:25.401359+0000","last_fullsized":"2023-07-09T21:50:25.401359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:23.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801751+0000","last_change":"2023-07-09T21:50:23.788775+0000","last_active":"2023-07-09T21:50:23.801751+0000","last_peered":"2023-07-09T21:50:23.801751+0000","last_clean":"2023-07-09T21:50:23.801751+0000","last_became_active":"2023-07-09T21:50:23.788474+0000","last_became_peered":"2023-07-09T21:50:23.788474+0000","last_unstale":"2023-07-09T21:50:23.801751+0000","last_undegraded":"2023-07-09T21:50:23.801751+0000","last_fullsized":"2023-07-09T21:50:23.801751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:49.489636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094336+0000","last_change":"2023-07-09T21:50:23.782607+0000","last_active":"2023-07-09T21:50:25.094336+0000","last_peered":"2023-07-09T21:50:25.094336+0000","last_clean":"2023-07-09T21:50:25.094336+0000","last_became_active":"2023-07-09T21:50:23.782315+0000","last_became_peered":"2023-07-09T21:50:23.782315+0000","last_unstale":"2023-07-09T21:50:25.094336+0000","last_undegraded":"2023-07-09T21:50:25.094336+0000","last_fullsized":"2023-07-09T21:50:25.094336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:36.220738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771811+0000","last_change":"2023-07-09T21:50:23.796236+0000","last_active":"2023-07-09T21:50:24.771811+0000","last_peered":"2023-07-09T21:50:24.771811+0000","last_clean":"2023-07-09T21:50:24.771811+0000","last_became_active":"2023-07-09T21:50:23.795910+0000","last_became_peered":"2023-07-09T21:50:23.795910+0000","last_unstale":"2023-07-09T21:50:24.771811+0000","last_undegraded":"2023-07-09T21:50:24.771811+0000","last_fullsized":"2023-07-09T21:50:24.771811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770483+0000","last_change":"2023-07-09T21:50:23.795797+0000","last_active":"2023-07-09T21:50:24.770483+0000","last_peered":"2023-07-09T21:50:24.770483+0000","last_clean":"2023-07-09T21:50:24.770483+0000","last_became_active":"2023-07-09T21:50:23.795569+0000","last_became_peered":"2023-07-09T21:50:23.795569+0000","last_unstale":"2023-07-09T21:50:24.770483+0000","last_undegraded":"2023-07-09T21:50:24.770483+0000","last_fullsized":"2023-07-09T21:50:24.770483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094493+0000","last_change":"2023-07-09T21:50:23.782770+0000","last_active":"2023-07-09T21:50:25.094493+0000","last_peered":"2023-07-09T21:50:25.094493+0000","last_clean":"2023-07-09T21:50:25.094493+0000","last_became_active":"2023-07-09T21:50:23.782509+0000","last_became_peered":"2023-07-09T21:50:23.782509+0000","last_unstale":"2023-07-09T21:50:25.094493+0000","last_undegraded":"2023-07-09T21:50:25.094493+0000","last_fullsized":"2023-07-09T21:50:25.094493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:48:23.282646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790159+0000","last_change":"2023-07-09T21:50:23.785433+0000","last_active":"2023-07-09T21:50:23.790159+0000","last_peered":"2023-07-09T21:50:23.790159+0000","last_clean":"2023-07-09T21:50:23.790159+0000","last_became_active":"2023-07-09T21:50:23.785016+0000","last_became_peered":"2023-07-09T21:50:23.785016+0000","last_unstale":"2023-07-09T21:50:23.790159+0000","last_undegraded":"2023-07-09T21:50:23.790159+0000","last_fullsized":"2023-07-09T21:50:23.790159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:05:28.932158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790106+0000","last_change":"2023-07-09T21:50:23.781394+0000","last_active":"2023-07-09T21:50:23.790106+0000","last_peered":"2023-07-09T21:50:23.790106+0000","last_clean":"2023-07-09T21:50:23.790106+0000","last_became_active":"2023-07-09T21:50:23.781089+0000","last_became_peered":"2023-07-09T21:50:23.781089+0000","last_unstale":"2023-07-09T21:50:23.790106+0000","last_undegraded":"2023-07-09T21:50:23.790106+0000","last_fullsized":"2023-07-09T21:50:23.790106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:26:12.334998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771627+0000","last_change":"2023-07-09T21:50:23.783556+0000","last_active":"2023-07-09T21:50:24.771627+0000","last_peered":"2023-07-09T21:50:24.771627+0000","last_clean":"2023-07-09T21:50:24.771627+0000","last_became_active":"2023-07-09T21:50:23.783277+0000","last_became_peered":"2023-07-09T21:50:23.783277+0000","last_unstale":"2023-07-09T21:50:24.771627+0000","last_undegraded":"2023-07-09T21:50:24.771627+0000","last_fullsized":"2023-07-09T21:50:24.771627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.148959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.812395+0000","last_change":"2023-07-09T21:50:22.774935+0000","last_active":"2023-07-09T21:50:23.812395+0000","last_peered":"2023-07-09T21:50:23.812395+0000","last_clean":"2023-07-09T21:50:23.812395+0000","last_became_active":"2023-07-09T21:50:22.774612+0000","last_became_peered":"2023-07-09T21:50:22.774612+0000","last_unstale":"2023-07-09T21:50:23.812395+0000","last_undegraded":"2023-07-09T21:50:23.812395+0000","last_fullsized":"2023-07-09T21:50:23.812395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:17:27.986566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770699+0000","last_change":"2023-07-09T21:50:23.777644+0000","last_active":"2023-07-09T21:50:24.770699+0000","last_peered":"2023-07-09T21:50:24.770699+0000","last_clean":"2023-07-09T21:50:24.770699+0000","last_became_active":"2023-07-09T21:50:23.777372+0000","last_became_peered":"2023-07-09T21:50:23.777372+0000","last_unstale":"2023-07-09T21:50:24.770699+0000","last_undegraded":"2023-07-09T21:50:24.770699+0000","last_fullsized":"2023-07-09T21:50:24.770699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:06.551761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.777834+0000","last_change":"2023-07-09T21:50:22.772852+0000","last_active":"2023-07-09T21:50:23.777834+0000","last_peered":"2023-07-09T21:50:23.777834+0000","last_clean":"2023-07-09T21:50:23.777834+0000","last_became_active":"2023-07-09T21:50:22.772592+0000","last_became_peered":"2023-07-09T21:50:22.772592+0000","last_unstale":"2023-07-09T21:50:23.777834+0000","last_undegraded":"2023-07-09T21:50:23.777834+0000","last_fullsized":"2023-07-09T21:50:23.777834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:33:47.769844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773185+0000","last_change":"2023-07-09T21:50:23.802442+0000","last_active":"2023-07-09T21:50:24.773185+0000","last_peered":"2023-07-09T21:50:24.773185+0000","last_clean":"2023-07-09T21:50:24.773185+0000","last_became_active":"2023-07-09T21:50:23.801644+0000","last_became_peered":"2023-07-09T21:50:23.801644+0000","last_unstale":"2023-07-09T21:50:24.773185+0000","last_undegraded":"2023-07-09T21:50:24.773185+0000","last_fullsized":"2023-07-09T21:50:24.773185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:13.602484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770485+0000","last_change":"2023-07-09T21:50:22.771300+0000","last_active":"2023-07-09T21:50:24.770485+0000","last_peered":"2023-07-09T21:50:24.770485+0000","last_clean":"2023-07-09T21:50:24.770485+0000","last_became_active":"2023-07-09T21:50:22.770639+0000","last_became_peered":"2023-07-09T21:50:22.770639+0000","last_unstale":"2023-07-09T21:50:24.770485+0000","last_undegraded":"2023-07-09T21:50:24.770485+0000","last_fullsized":"2023-07-09T21:50:24.770485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:29.580228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401889+0000","last_change":"2023-07-09T21:50:23.783801+0000","last_active":"2023-07-09T21:50:25.401889+0000","last_peered":"2023-07-09T21:50:25.401889+0000","last_clean":"2023-07-09T21:50:25.401889+0000","last_became_active":"2023-07-09T21:50:23.783545+0000","last_became_peered":"2023-07-09T21:50:23.783545+0000","last_unstale":"2023-07-09T21:50:25.401889+0000","last_undegraded":"2023-07-09T21:50:25.401889+0000","last_fullsized":"2023-07-09T21:50:25.401889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:44:36.986572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773224+0000","last_change":"2023-07-09T21:50:22.781881+0000","last_active":"2023-07-09T21:50:24.773224+0000","last_peered":"2023-07-09T21:50:24.773224+0000","last_clean":"2023-07-09T21:50:24.773224+0000","last_became_active":"2023-07-09T21:50:22.781553+0000","last_became_peered":"2023-07-09T21:50:22.781553+0000","last_unstale":"2023-07-09T21:50:24.773224+0000","last_undegraded":"2023-07-09T21:50:24.773224+0000","last_fullsized":"2023-07-09T21:50:24.773224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:32.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770398+0000","last_change":"2023-07-09T21:50:23.782080+0000","last_active":"2023-07-09T21:50:24.770398+0000","last_peered":"2023-07-09T21:50:24.770398+0000","last_clean":"2023-07-09T21:50:24.770398+0000","last_became_active":"2023-07-09T21:50:23.781769+0000","last_became_peered":"2023-07-09T21:50:23.781769+0000","last_unstale":"2023-07-09T21:50:24.770398+0000","last_undegraded":"2023-07-09T21:50:24.770398+0000","last_fullsized":"2023-07-09T21:50:24.770398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.148959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771796+0000","last_change":"2023-07-09T21:50:22.775466+0000","last_active":"2023-07-09T21:50:24.771796+0000","last_peered":"2023-07-09T21:50:24.771796+0000","last_clean":"2023-07-09T21:50:24.771796+0000","last_became_active":"2023-07-09T21:50:22.775189+0000","last_became_peered":"2023-07-09T21:50:22.775189+0000","last_unstale":"2023-07-09T21:50:24.771796+0000","last_undegraded":"2023-07-09T21:50:24.771796+0000","last_fullsized":"2023-07-09T21:50:24.771796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:29.580228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771009+0000","last_change":"2023-07-09T21:50:23.776973+0000","last_active":"2023-07-09T21:50:24.771009+0000","last_peered":"2023-07-09T21:50:24.771009+0000","last_clean":"2023-07-09T21:50:24.771009+0000","last_became_active":"2023-07-09T21:50:23.776468+0000","last_became_peered":"2023-07-09T21:50:23.776468+0000","last_unstale":"2023-07-09T21:50:24.771009+0000","last_undegraded":"2023-07-09T21:50:24.771009+0000","last_fullsized":"2023-07-09T21:50:24.771009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:54.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094368+0000","last_change":"2023-07-09T21:50:22.776755+0000","last_active":"2023-07-09T21:50:25.094368+0000","last_peered":"2023-07-09T21:50:25.094368+0000","last_clean":"2023-07-09T21:50:25.094368+0000","last_became_active":"2023-07-09T21:50:22.776393+0000","last_became_peered":"2023-07-09T21:50:22.776393+0000","last_unstale":"2023-07-09T21:50:25.094368+0000","last_undegraded":"2023-07-09T21:50:25.094368+0000","last_fullsized":"2023-07-09T21:50:25.094368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:15.389440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.787655+0000","last_change":"2023-07-09T21:50:23.781306+0000","last_active":"2023-07-09T21:50:23.787655+0000","last_peered":"2023-07-09T21:50:23.787655+0000","last_clean":"2023-07-09T21:50:23.787655+0000","last_became_active":"2023-07-09T21:50:23.781040+0000","last_became_peered":"2023-07-09T21:50:23.781040+0000","last_unstale":"2023-07-09T21:50:23.787655+0000","last_undegraded":"2023-07-09T21:50:23.787655+0000","last_fullsized":"2023-07-09T21:50:23.787655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:24:58.710922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.818016+0000","last_change":"2023-07-09T21:50:22.778707+0000","last_active":"2023-07-09T21:50:23.818016+0000","last_peered":"2023-07-09T21:50:23.818016+0000","last_clean":"2023-07-09T21:50:23.818016+0000","last_became_active":"2023-07-09T21:50:22.778397+0000","last_became_peered":"2023-07-09T21:50:22.778397+0000","last_unstale":"2023-07-09T21:50:23.818016+0000","last_undegraded":"2023-07-09T21:50:23.818016+0000","last_fullsized":"2023-07-09T21:50:23.818016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:30:44.360848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801947+0000","last_change":"2023-07-09T21:50:23.793887+0000","last_active":"2023-07-09T21:50:23.801947+0000","last_peered":"2023-07-09T21:50:23.801947+0000","last_clean":"2023-07-09T21:50:23.801947+0000","last_became_active":"2023-07-09T21:50:23.793626+0000","last_became_peered":"2023-07-09T21:50:23.793626+0000","last_unstale":"2023-07-09T21:50:23.801947+0000","last_undegraded":"2023-07-09T21:50:23.801947+0000","last_fullsized":"2023-07-09T21:50:23.801947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:05.934271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094228+0000","last_change":"2023-07-09T21:50:22.781947+0000","last_active":"2023-07-09T21:50:25.094228+0000","last_peered":"2023-07-09T21:50:25.094228+0000","last_clean":"2023-07-09T21:50:25.094228+0000","last_became_active":"2023-07-09T21:50:22.780676+0000","last_became_peered":"2023-07-09T21:50:22.780676+0000","last_unstale":"2023-07-09T21:50:25.094228+0000","last_undegraded":"2023-07-09T21:50:25.094228+0000","last_fullsized":"2023-07-09T21:50:25.094228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:47:53.248634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770793+0000","last_change":"2023-07-09T21:50:23.788674+0000","last_active":"2023-07-09T21:50:24.770793+0000","last_peered":"2023-07-09T21:50:24.770793+0000","last_clean":"2023-07-09T21:50:24.770793+0000","last_became_active":"2023-07-09T21:50:23.788306+0000","last_became_peered":"2023-07-09T21:50:23.788306+0000","last_unstale":"2023-07-09T21:50:24.770793+0000","last_undegraded":"2023-07-09T21:50:24.770793+0000","last_fullsized":"2023-07-09T21:50:24.770793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771654+0000","last_change":"2023-07-09T21:50:22.777294+0000","last_active":"2023-07-09T21:50:24.771654+0000","last_peered":"2023-07-09T21:50:24.771654+0000","last_clean":"2023-07-09T21:50:24.771654+0000","last_became_active":"2023-07-09T21:50:22.776308+0000","last_became_peered":"2023-07-09T21:50:22.776308+0000","last_unstale":"2023-07-09T21:50:24.771654+0000","last_undegraded":"2023-07-09T21:50:24.771654+0000","last_fullsized":"2023-07-09T21:50:24.771654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:10.488382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771772+0000","last_change":"2023-07-09T21:50:23.782217+0000","last_active":"2023-07-09T21:50:24.771772+0000","last_peered":"2023-07-09T21:50:24.771772+0000","last_clean":"2023-07-09T21:50:24.771772+0000","last_became_active":"2023-07-09T21:50:23.781948+0000","last_became_peered":"2023-07-09T21:50:23.781948+0000","last_unstale":"2023-07-09T21:50:24.771772+0000","last_undegraded":"2023-07-09T21:50:24.771772+0000","last_fullsized":"2023-07-09T21:50:24.771772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094393+0000","last_change":"2023-07-09T21:50:22.780710+0000","last_active":"2023-07-09T21:50:25.094393+0000","last_peered":"2023-07-09T21:50:25.094393+0000","last_clean":"2023-07-09T21:50:25.094393+0000","last_became_active":"2023-07-09T21:50:22.780392+0000","last_became_peered":"2023-07-09T21:50:22.780392+0000","last_unstale":"2023-07-09T21:50:25.094393+0000","last_undegraded":"2023-07-09T21:50:25.094393+0000","last_fullsized":"2023-07-09T21:50:25.094393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:08.834959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773173+0000","last_change":"2023-07-09T21:50:23.803234+0000","last_active":"2023-07-09T21:50:24.773173+0000","last_peered":"2023-07-09T21:50:24.773173+0000","last_clean":"2023-07-09T21:50:24.773173+0000","last_became_active":"2023-07-09T21:50:23.802407+0000","last_became_peered":"2023-07-09T21:50:23.802407+0000","last_unstale":"2023-07-09T21:50:24.773173+0000","last_undegraded":"2023-07-09T21:50:24.773173+0000","last_fullsized":"2023-07-09T21:50:24.773173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:06.551761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401477+0000","last_change":"2023-07-09T21:50:22.770920+0000","last_active":"2023-07-09T21:50:25.401477+0000","last_peered":"2023-07-09T21:50:25.401477+0000","last_clean":"2023-07-09T21:50:25.401477+0000","last_became_active":"2023-07-09T21:50:22.770566+0000","last_became_peered":"2023-07-09T21:50:22.770566+0000","last_unstale":"2023-07-09T21:50:25.401477+0000","last_undegraded":"2023-07-09T21:50:25.401477+0000","last_fullsized":"2023-07-09T21:50:25.401477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:06.181402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771083+0000","last_change":"2023-07-09T21:50:23.786089+0000","last_active":"2023-07-09T21:50:24.771083+0000","last_peered":"2023-07-09T21:50:24.771083+0000","last_clean":"2023-07-09T21:50:24.771083+0000","last_became_active":"2023-07-09T21:50:23.785827+0000","last_became_peered":"2023-07-09T21:50:23.785827+0000","last_unstale":"2023-07-09T21:50:24.771083+0000","last_undegraded":"2023-07-09T21:50:24.771083+0000","last_fullsized":"2023-07-09T21:50:24.771083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:16.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094687+0000","last_change":"2023-07-09T21:50:22.781469+0000","last_active":"2023-07-09T21:50:25.094687+0000","last_peered":"2023-07-09T21:50:25.094687+0000","last_clean":"2023-07-09T21:50:25.094687+0000","last_became_active":"2023-07-09T21:50:22.781215+0000","last_became_peered":"2023-07-09T21:50:22.781215+0000","last_unstale":"2023-07-09T21:50:25.094687+0000","last_undegraded":"2023-07-09T21:50:25.094687+0000","last_fullsized":"2023-07-09T21:50:25.094687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:41:06.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771366+0000","last_change":"2023-07-09T21:50:23.781500+0000","last_active":"2023-07-09T21:50:24.771366+0000","last_peered":"2023-07-09T21:50:24.771366+0000","last_clean":"2023-07-09T21:50:24.771366+0000","last_became_active":"2023-07-09T21:50:23.781247+0000","last_became_peered":"2023-07-09T21:50:23.781247+0000","last_unstale":"2023-07-09T21:50:24.771366+0000","last_undegraded":"2023-07-09T21:50:24.771366+0000","last_fullsized":"2023-07-09T21:50:24.771366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:25.755232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094343+0000","last_change":"2023-07-09T21:50:22.780841+0000","last_active":"2023-07-09T21:50:25.094343+0000","last_peered":"2023-07-09T21:50:25.094343+0000","last_clean":"2023-07-09T21:50:25.094343+0000","last_became_active":"2023-07-09T21:50:22.780287+0000","last_became_peered":"2023-07-09T21:50:22.780287+0000","last_unstale":"2023-07-09T21:50:25.094343+0000","last_undegraded":"2023-07-09T21:50:25.094343+0000","last_fullsized":"2023-07-09T21:50:25.094343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:53.307790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802245+0000","last_change":"2023-07-09T21:50:23.794825+0000","last_active":"2023-07-09T21:50:23.802245+0000","last_peered":"2023-07-09T21:50:23.802245+0000","last_clean":"2023-07-09T21:50:23.802245+0000","last_became_active":"2023-07-09T21:50:23.794372+0000","last_became_peered":"2023-07-09T21:50:23.794372+0000","last_unstale":"2023-07-09T21:50:23.802245+0000","last_undegraded":"2023-07-09T21:50:23.802245+0000","last_fullsized":"2023-07-09T21:50:23.802245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:07.185673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094667+0000","last_change":"2023-07-09T21:50:22.782310+0000","last_active":"2023-07-09T21:50:25.094667+0000","last_peered":"2023-07-09T21:50:25.094667+0000","last_clean":"2023-07-09T21:50:25.094667+0000","last_became_active":"2023-07-09T21:50:22.782041+0000","last_became_peered":"2023-07-09T21:50:22.782041+0000","last_unstale":"2023-07-09T21:50:25.094667+0000","last_undegraded":"2023-07-09T21:50:25.094667+0000","last_fullsized":"2023-07-09T21:50:25.094667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:11:23.436562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401729+0000","last_change":"2023-07-09T21:50:23.789564+0000","last_active":"2023-07-09T21:50:25.401729+0000","last_peered":"2023-07-09T21:50:25.401729+0000","last_clean":"2023-07-09T21:50:25.401729+0000","last_became_active":"2023-07-09T21:50:23.789320+0000","last_became_peered":"2023-07-09T21:50:23.789320+0000","last_unstale":"2023-07-09T21:50:25.401729+0000","last_undegraded":"2023-07-09T21:50:25.401729+0000","last_fullsized":"2023-07-09T21:50:25.401729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:05.934271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771882+0000","last_change":"2023-07-09T21:50:22.769028+0000","last_active":"2023-07-09T21:50:24.771882+0000","last_peered":"2023-07-09T21:50:24.771882+0000","last_clean":"2023-07-09T21:50:24.771882+0000","last_became_active":"2023-07-09T21:50:22.768697+0000","last_became_peered":"2023-07-09T21:50:22.768697+0000","last_unstale":"2023-07-09T21:50:24.771882+0000","last_undegraded":"2023-07-09T21:50:24.771882+0000","last_fullsized":"2023-07-09T21:50:24.771882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:12.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773064+0000","last_change":"2023-07-09T21:50:23.792126+0000","last_active":"2023-07-09T21:50:24.773064+0000","last_peered":"2023-07-09T21:50:24.773064+0000","last_clean":"2023-07-09T21:50:24.773064+0000","last_became_active":"2023-07-09T21:50:23.790182+0000","last_became_peered":"2023-07-09T21:50:23.790182+0000","last_unstale":"2023-07-09T21:50:24.773064+0000","last_undegraded":"2023-07-09T21:50:24.773064+0000","last_fullsized":"2023-07-09T21:50:24.773064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770745+0000","last_change":"2023-07-09T21:50:22.769216+0000","last_active":"2023-07-09T21:50:24.770745+0000","last_peered":"2023-07-09T21:50:24.770745+0000","last_clean":"2023-07-09T21:50:24.770745+0000","last_became_active":"2023-07-09T21:50:22.768893+0000","last_became_peered":"2023-07-09T21:50:22.768893+0000","last_unstale":"2023-07-09T21:50:24.770745+0000","last_undegraded":"2023-07-09T21:50:24.770745+0000","last_fullsized":"2023-07-09T21:50:24.770745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:32.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801774+0000","last_change":"2023-07-09T21:50:23.790525+0000","last_active":"2023-07-09T21:50:23.801774+0000","last_peered":"2023-07-09T21:50:23.801774+0000","last_clean":"2023-07-09T21:50:23.801774+0000","last_became_active":"2023-07-09T21:50:23.790164+0000","last_became_peered":"2023-07-09T21:50:23.790164+0000","last_unstale":"2023-07-09T21:50:23.801774+0000","last_undegraded":"2023-07-09T21:50:23.801774+0000","last_fullsized":"2023-07-09T21:50:23.801774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:51.439253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401701+0000","last_change":"2023-07-09T21:50:22.779742+0000","last_active":"2023-07-09T21:50:25.401701+0000","last_peered":"2023-07-09T21:50:25.401701+0000","last_clean":"2023-07-09T21:50:25.401701+0000","last_became_active":"2023-07-09T21:50:22.779462+0000","last_became_peered":"2023-07-09T21:50:22.779462+0000","last_unstale":"2023-07-09T21:50:25.401701+0000","last_undegraded":"2023-07-09T21:50:25.401701+0000","last_fullsized":"2023-07-09T21:50:25.401701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:34.301244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802010+0000","last_change":"2023-07-09T21:50:23.793928+0000","last_active":"2023-07-09T21:50:23.802010+0000","last_peered":"2023-07-09T21:50:23.802010+0000","last_clean":"2023-07-09T21:50:23.802010+0000","last_became_active":"2023-07-09T21:50:23.793620+0000","last_became_peered":"2023-07-09T21:50:23.793620+0000","last_unstale":"2023-07-09T21:50:23.802010+0000","last_undegraded":"2023-07-09T21:50:23.802010+0000","last_fullsized":"2023-07-09T21:50:23.802010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:50.693532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.781593+0000","last_change":"2023-07-09T21:50:22.772850+0000","last_active":"2023-07-09T21:50:23.781593+0000","last_peered":"2023-07-09T21:50:23.781593+0000","last_clean":"2023-07-09T21:50:23.781593+0000","last_became_active":"2023-07-09T21:50:22.772522+0000","last_became_peered":"2023-07-09T21:50:22.772522+0000","last_unstale":"2023-07-09T21:50:23.781593+0000","last_undegraded":"2023-07-09T21:50:23.781593+0000","last_fullsized":"2023-07-09T21:50:23.781593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:32:07.041518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802085+0000","last_change":"2023-07-09T21:50:23.787502+0000","last_active":"2023-07-09T21:50:23.802085+0000","last_peered":"2023-07-09T21:50:23.802085+0000","last_clean":"2023-07-09T21:50:23.802085+0000","last_became_active":"2023-07-09T21:50:23.786685+0000","last_became_peered":"2023-07-09T21:50:23.786685+0000","last_unstale":"2023-07-09T21:50:23.802085+0000","last_undegraded":"2023-07-09T21:50:23.802085+0000","last_fullsized":"2023-07-09T21:50:23.802085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:05.764849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770315+0000","last_change":"2023-07-09T21:50:22.769583+0000","last_active":"2023-07-09T21:50:24.770315+0000","last_peered":"2023-07-09T21:50:24.770315+0000","last_clean":"2023-07-09T21:50:24.770315+0000","last_became_active":"2023-07-09T21:50:22.768169+0000","last_became_peered":"2023-07-09T21:50:22.768169+0000","last_unstale":"2023-07-09T21:50:24.770315+0000","last_undegraded":"2023-07-09T21:50:24.770315+0000","last_fullsized":"2023-07-09T21:50:24.770315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:24.750960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790139+0000","last_change":"2023-07-09T21:50:23.784726+0000","last_active":"2023-07-09T21:50:23.790139+0000","last_peered":"2023-07-09T21:50:23.790139+0000","last_clean":"2023-07-09T21:50:23.790139+0000","last_became_active":"2023-07-09T21:50:23.777193+0000","last_became_peered":"2023-07-09T21:50:23.777193+0000","last_unstale":"2023-07-09T21:50:23.790139+0000","last_undegraded":"2023-07-09T21:50:23.790139+0000","last_fullsized":"2023-07-09T21:50:23.790139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:34.646316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.779148+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:50:23.779148+0000","last_peered":"2023-07-09T21:50:23.779148+0000","last_clean":"2023-07-09T21:50:23.779148+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:50:23.779148+0000","last_undegraded":"2023-07-09T21:50:23.779148+0000","last_fullsized":"2023-07-09T21:50:23.779148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:35:50.473268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771985+0000","last_change":"2023-07-09T21:50:22.772281+0000","last_active":"2023-07-09T21:50:24.771985+0000","last_peered":"2023-07-09T21:50:24.771985+0000","last_clean":"2023-07-09T21:50:24.771985+0000","last_became_active":"2023-07-09T21:50:22.769167+0000","last_became_peered":"2023-07-09T21:50:22.769167+0000","last_unstale":"2023-07-09T21:50:24.771985+0000","last_undegraded":"2023-07-09T21:50:24.771985+0000","last_fullsized":"2023-07-09T21:50:24.771985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:05.547490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.787677+0000","last_change":"2023-07-09T21:50:23.783723+0000","last_active":"2023-07-09T21:50:23.787677+0000","last_peered":"2023-07-09T21:50:23.787677+0000","last_clean":"2023-07-09T21:50:23.787677+0000","last_became_active":"2023-07-09T21:50:23.783453+0000","last_became_peered":"2023-07-09T21:50:23.783453+0000","last_unstale":"2023-07-09T21:50:23.787677+0000","last_undegraded":"2023-07-09T21:50:23.787677+0000","last_fullsized":"2023-07-09T21:50:23.787677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:42:06.075539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771999+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:50:24.771999+0000","last_peered":"2023-07-09T21:50:24.771999+0000","last_clean":"2023-07-09T21:50:24.771999+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:50:24.771999+0000","last_undegraded":"2023-07-09T21:50:24.771999+0000","last_fullsized":"2023-07-09T21:50:24.771999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:48.089970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.779267+0000","last_change":"2023-07-09T21:50:22.778044+0000","last_active":"2023-07-09T21:50:23.779267+0000","last_peered":"2023-07-09T21:50:23.779267+0000","last_clean":"2023-07-09T21:50:23.779267+0000","last_became_active":"2023-07-09T21:50:22.777708+0000","last_became_peered":"2023-07-09T21:50:22.777708+0000","last_unstale":"2023-07-09T21:50:23.779267+0000","last_undegraded":"2023-07-09T21:50:23.779267+0000","last_fullsized":"2023-07-09T21:50:23.779267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:23.785505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.787438+0000","last_change":"2023-07-09T21:50:23.780850+0000","last_active":"2023-07-09T21:50:23.787438+0000","last_peered":"2023-07-09T21:50:23.787438+0000","last_clean":"2023-07-09T21:50:23.787438+0000","last_became_active":"2023-07-09T21:50:23.780529+0000","last_became_peered":"2023-07-09T21:50:23.780529+0000","last_unstale":"2023-07-09T21:50:23.787438+0000","last_undegraded":"2023-07-09T21:50:23.787438+0000","last_fullsized":"2023-07-09T21:50:23.787438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:10.298327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401178+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:50:25.401178+0000","last_peered":"2023-07-09T21:50:25.401178+0000","last_clean":"2023-07-09T21:50:25.401178+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:50:25.401178+0000","last_undegraded":"2023-07-09T21:50:25.401178+0000","last_fullsized":"2023-07-09T21:50:25.401178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:57:32.051923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.777557+0000","last_change":"2023-07-09T21:50:22.774908+0000","last_active":"2023-07-09T21:50:23.777557+0000","last_peered":"2023-07-09T21:50:23.777557+0000","last_clean":"2023-07-09T21:50:23.777557+0000","last_became_active":"2023-07-09T21:50:22.774600+0000","last_became_peered":"2023-07-09T21:50:22.774600+0000","last_unstale":"2023-07-09T21:50:23.777557+0000","last_undegraded":"2023-07-09T21:50:23.777557+0000","last_fullsized":"2023-07-09T21:50:23.777557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:08:56.300464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790176+0000","last_change":"2023-07-09T21:50:23.786034+0000","last_active":"2023-07-09T21:50:23.790176+0000","last_peered":"2023-07-09T21:50:23.790176+0000","last_clean":"2023-07-09T21:50:23.790176+0000","last_became_active":"2023-07-09T21:50:23.785763+0000","last_became_peered":"2023-07-09T21:50:23.785763+0000","last_unstale":"2023-07-09T21:50:23.790176+0000","last_undegraded":"2023-07-09T21:50:23.790176+0000","last_fullsized":"2023-07-09T21:50:23.790176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:20:36.952568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771488+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:50:24.771488+0000","last_peered":"2023-07-09T21:50:24.771488+0000","last_clean":"2023-07-09T21:50:24.771488+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:50:24.771488+0000","last_undegraded":"2023-07-09T21:50:24.771488+0000","last_fullsized":"2023-07-09T21:50:24.771488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:00.619257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094325+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:50:25.094325+0000","last_peered":"2023-07-09T21:50:25.094325+0000","last_clean":"2023-07-09T21:50:25.094325+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:50:25.094325+0000","last_undegraded":"2023-07-09T21:50:25.094325+0000","last_fullsized":"2023-07-09T21:50:25.094325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:21:03.421360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770620+0000","last_change":"2023-07-09T21:50:22.766454+0000","last_active":"2023-07-09T21:50:24.770620+0000","last_peered":"2023-07-09T21:50:24.770620+0000","last_clean":"2023-07-09T21:50:24.770620+0000","last_became_active":"2023-07-09T21:50:22.766057+0000","last_became_peered":"2023-07-09T21:50:22.766057+0000","last_unstale":"2023-07-09T21:50:24.770620+0000","last_undegraded":"2023-07-09T21:50:24.770620+0000","last_fullsized":"2023-07-09T21:50:24.770620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:05.837076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401812+0000","last_change":"2023-07-09T21:50:23.795134+0000","last_active":"2023-07-09T21:50:25.401812+0000","last_peered":"2023-07-09T21:50:25.401812+0000","last_clean":"2023-07-09T21:50:25.401812+0000","last_became_active":"2023-07-09T21:50:23.794914+0000","last_became_peered":"2023-07-09T21:50:23.794914+0000","last_unstale":"2023-07-09T21:50:25.401812+0000","last_undegraded":"2023-07-09T21:50:25.401812+0000","last_fullsized":"2023-07-09T21:50:25.401812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:50.693532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094581+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:50:25.094581+0000","last_peered":"2023-07-09T21:50:25.094581+0000","last_clean":"2023-07-09T21:50:25.094581+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:50:25.094581+0000","last_undegraded":"2023-07-09T21:50:25.094581+0000","last_fullsized":"2023-07-09T21:50:25.094581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:13.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771706+0000","last_change":"2023-07-09T21:50:22.777350+0000","last_active":"2023-07-09T21:50:24.771706+0000","last_peered":"2023-07-09T21:50:24.771706+0000","last_clean":"2023-07-09T21:50:24.771706+0000","last_became_active":"2023-07-09T21:50:22.776974+0000","last_became_peered":"2023-07-09T21:50:22.776974+0000","last_unstale":"2023-07-09T21:50:24.771706+0000","last_undegraded":"2023-07-09T21:50:24.771706+0000","last_fullsized":"2023-07-09T21:50:24.771706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:32.888530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773336+0000","last_change":"2023-07-09T21:50:23.801310+0000","last_active":"2023-07-09T21:50:24.773336+0000","last_peered":"2023-07-09T21:50:24.773336+0000","last_clean":"2023-07-09T21:50:24.773336+0000","last_became_active":"2023-07-09T21:50:23.798687+0000","last_became_peered":"2023-07-09T21:50:23.798687+0000","last_unstale":"2023-07-09T21:50:24.773336+0000","last_undegraded":"2023-07-09T21:50:24.773336+0000","last_fullsized":"2023-07-09T21:50:24.773336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:54.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094422+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:50:25.094422+0000","last_peered":"2023-07-09T21:50:25.094422+0000","last_clean":"2023-07-09T21:50:25.094422+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:50:25.094422+0000","last_undegraded":"2023-07-09T21:50:25.094422+0000","last_fullsized":"2023-07-09T21:50:25.094422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:19:53.960138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.779375+0000","last_change":"2023-07-09T21:50:22.774621+0000","last_active":"2023-07-09T21:50:23.779375+0000","last_peered":"2023-07-09T21:50:23.779375+0000","last_clean":"2023-07-09T21:50:23.779375+0000","last_became_active":"2023-07-09T21:50:22.774322+0000","last_became_peered":"2023-07-09T21:50:22.774322+0000","last_unstale":"2023-07-09T21:50:23.779375+0000","last_undegraded":"2023-07-09T21:50:23.779375+0000","last_fullsized":"2023-07-09T21:50:23.779375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:49.341701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772919+0000","last_change":"2023-07-09T21:50:23.793311+0000","last_active":"2023-07-09T21:50:24.772919+0000","last_peered":"2023-07-09T21:50:24.772919+0000","last_clean":"2023-07-09T21:50:24.772919+0000","last_became_active":"2023-07-09T21:50:23.792913+0000","last_became_peered":"2023-07-09T21:50:23.792913+0000","last_unstale":"2023-07-09T21:50:24.772919+0000","last_undegraded":"2023-07-09T21:50:24.772919+0000","last_fullsized":"2023-07-09T21:50:24.772919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:36.978787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771232+0000","last_change":"2023-07-09T21:50:22.775713+0000","last_active":"2023-07-09T21:50:24.771232+0000","last_peered":"2023-07-09T21:50:24.771232+0000","last_clean":"2023-07-09T21:50:24.771232+0000","last_became_active":"2023-07-09T21:50:22.775420+0000","last_became_peered":"2023-07-09T21:50:22.775420+0000","last_unstale":"2023-07-09T21:50:24.771232+0000","last_undegraded":"2023-07-09T21:50:24.771232+0000","last_fullsized":"2023-07-09T21:50:24.771232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:47:53.248634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.778529+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:50:23.778529+0000","last_peered":"2023-07-09T21:50:23.778529+0000","last_clean":"2023-07-09T21:50:23.778529+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:50:23.778529+0000","last_undegraded":"2023-07-09T21:50:23.778529+0000","last_fullsized":"2023-07-09T21:50:23.778529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:28:48.759912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770239+0000","last_change":"2023-07-09T21:50:23.787661+0000","last_active":"2023-07-09T21:50:24.770239+0000","last_peered":"2023-07-09T21:50:24.770239+0000","last_clean":"2023-07-09T21:50:24.770239+0000","last_became_active":"2023-07-09T21:50:23.787366+0000","last_became_peered":"2023-07-09T21:50:23.787366+0000","last_unstale":"2023-07-09T21:50:24.770239+0000","last_undegraded":"2023-07-09T21:50:24.770239+0000","last_fullsized":"2023-07-09T21:50:24.770239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:33.892801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401827+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:50:25.401827+0000","last_peered":"2023-07-09T21:50:25.401827+0000","last_clean":"2023-07-09T21:50:25.401827+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:50:25.401827+0000","last_undegraded":"2023-07-09T21:50:25.401827+0000","last_fullsized":"2023-07-09T21:50:25.401827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:32:01.823699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773325+0000","last_change":"2023-07-09T21:50:22.772687+0000","last_active":"2023-07-09T21:50:24.773325+0000","last_peered":"2023-07-09T21:50:24.773325+0000","last_clean":"2023-07-09T21:50:24.773325+0000","last_became_active":"2023-07-09T21:50:22.772342+0000","last_became_peered":"2023-07-09T21:50:22.772342+0000","last_unstale":"2023-07-09T21:50:24.773325+0000","last_undegraded":"2023-07-09T21:50:24.773325+0000","last_fullsized":"2023-07-09T21:50:24.773325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802227+0000","last_change":"2023-07-09T21:50:23.794661+0000","last_active":"2023-07-09T21:50:23.802227+0000","last_peered":"2023-07-09T21:50:23.802227+0000","last_clean":"2023-07-09T21:50:23.802227+0000","last_became_active":"2023-07-09T21:50:23.794107+0000","last_became_peered":"2023-07-09T21:50:23.794107+0000","last_unstale":"2023-07-09T21:50:23.802227+0000","last_undegraded":"2023-07-09T21:50:23.802227+0000","last_fullsized":"2023-07-09T21:50:23.802227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:35.305515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772952+0000","last_change":"2023-07-09T21:50:22.779822+0000","last_active":"2023-07-09T21:50:24.772952+0000","last_peered":"2023-07-09T21:50:24.772952+0000","last_clean":"2023-07-09T21:50:24.772952+0000","last_became_active":"2023-07-09T21:50:22.779595+0000","last_became_peered":"2023-07-09T21:50:22.779595+0000","last_unstale":"2023-07-09T21:50:24.772952+0000","last_undegraded":"2023-07-09T21:50:24.772952+0000","last_fullsized":"2023-07-09T21:50:24.772952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:37.144688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401494+0000","last_change":"2023-07-09T21:50:23.786609+0000","last_active":"2023-07-09T21:50:25.401494+0000","last_peered":"2023-07-09T21:50:25.401494+0000","last_clean":"2023-07-09T21:50:25.401494+0000","last_became_active":"2023-07-09T21:50:23.785938+0000","last_became_peered":"2023-07-09T21:50:23.785938+0000","last_unstale":"2023-07-09T21:50:25.401494+0000","last_undegraded":"2023-07-09T21:50:25.401494+0000","last_fullsized":"2023-07-09T21:50:25.401494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771497+0000","last_change":"2023-07-09T21:50:22.772154+0000","last_active":"2023-07-09T21:50:24.771497+0000","last_peered":"2023-07-09T21:50:24.771497+0000","last_clean":"2023-07-09T21:50:24.771497+0000","last_became_active":"2023-07-09T21:50:22.771882+0000","last_became_peered":"2023-07-09T21:50:22.771882+0000","last_unstale":"2023-07-09T21:50:24.771497+0000","last_undegraded":"2023-07-09T21:50:24.771497+0000","last_fullsized":"2023-07-09T21:50:24.771497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:35.974516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801927+0000","last_change":"2023-07-09T21:50:23.793009+0000","last_active":"2023-07-09T21:50:23.801927+0000","last_peered":"2023-07-09T21:50:23.801927+0000","last_clean":"2023-07-09T21:50:23.801927+0000","last_became_active":"2023-07-09T21:50:23.791995+0000","last_became_peered":"2023-07-09T21:50:23.791995+0000","last_unstale":"2023-07-09T21:50:23.801927+0000","last_undegraded":"2023-07-09T21:50:23.801927+0000","last_fullsized":"2023-07-09T21:50:23.801927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:40.779031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772036+0000","last_change":"2023-07-09T21:50:22.772972+0000","last_active":"2023-07-09T21:50:24.772036+0000","last_peered":"2023-07-09T21:50:24.772036+0000","last_clean":"2023-07-09T21:50:24.772036+0000","last_became_active":"2023-07-09T21:50:22.772647+0000","last_became_peered":"2023-07-09T21:50:22.772647+0000","last_unstale":"2023-07-09T21:50:24.772036+0000","last_undegraded":"2023-07-09T21:50:24.772036+0000","last_fullsized":"2023-07-09T21:50:24.772036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801973+0000","last_change":"2023-07-09T21:50:23.790945+0000","last_active":"2023-07-09T21:50:23.801973+0000","last_peered":"2023-07-09T21:50:23.801973+0000","last_clean":"2023-07-09T21:50:23.801973+0000","last_became_active":"2023-07-09T21:50:23.790660+0000","last_became_peered":"2023-07-09T21:50:23.790660+0000","last_unstale":"2023-07-09T21:50:23.801973+0000","last_undegraded":"2023-07-09T21:50:23.801973+0000","last_fullsized":"2023-07-09T21:50:23.801973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:43.247529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770852+0000","last_change":"2023-07-09T21:50:22.770573+0000","last_active":"2023-07-09T21:50:24.770852+0000","last_peered":"2023-07-09T21:50:24.770852+0000","last_clean":"2023-07-09T21:50:24.770852+0000","last_became_active":"2023-07-09T21:50:22.770263+0000","last_became_peered":"2023-07-09T21:50:22.770263+0000","last_unstale":"2023-07-09T21:50:24.770852+0000","last_undegraded":"2023-07-09T21:50:24.770852+0000","last_fullsized":"2023-07-09T21:50:24.770852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770370+0000","last_change":"2023-07-09T21:50:23.791092+0000","last_active":"2023-07-09T21:50:24.770370+0000","last_peered":"2023-07-09T21:50:24.770370+0000","last_clean":"2023-07-09T21:50:24.770370+0000","last_became_active":"2023-07-09T21:50:23.789631+0000","last_became_peered":"2023-07-09T21:50:23.789631+0000","last_unstale":"2023-07-09T21:50:24.770370+0000","last_undegraded":"2023-07-09T21:50:24.770370+0000","last_fullsized":"2023-07-09T21:50:24.770370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:36.978787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773272+0000","last_change":"2023-07-09T21:50:22.776290+0000","last_active":"2023-07-09T21:50:24.773272+0000","last_peered":"2023-07-09T21:50:24.773272+0000","last_clean":"2023-07-09T21:50:24.773272+0000","last_became_active":"2023-07-09T21:50:22.775873+0000","last_became_peered":"2023-07-09T21:50:22.775873+0000","last_unstale":"2023-07-09T21:50:24.773272+0000","last_undegraded":"2023-07-09T21:50:24.773272+0000","last_fullsized":"2023-07-09T21:50:24.773272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:26.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.797500+0000","last_change":"2023-07-09T21:50:23.787350+0000","last_active":"2023-07-09T21:50:23.797500+0000","last_peered":"2023-07-09T21:50:23.797500+0000","last_clean":"2023-07-09T21:50:23.797500+0000","last_became_active":"2023-07-09T21:50:23.787079+0000","last_became_peered":"2023-07-09T21:50:23.787079+0000","last_unstale":"2023-07-09T21:50:23.797500+0000","last_undegraded":"2023-07-09T21:50:23.797500+0000","last_fullsized":"2023-07-09T21:50:23.797500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:07:12.088130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401659+0000","last_change":"2023-07-09T21:50:23.783603+0000","last_active":"2023-07-09T21:50:25.401659+0000","last_peered":"2023-07-09T21:50:25.401659+0000","last_clean":"2023-07-09T21:50:25.401659+0000","last_became_active":"2023-07-09T21:50:23.781930+0000","last_became_peered":"2023-07-09T21:50:23.781930+0000","last_unstale":"2023-07-09T21:50:25.401659+0000","last_undegraded":"2023-07-09T21:50:25.401659+0000","last_fullsized":"2023-07-09T21:50:25.401659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770323+0000","last_change":"2023-07-09T21:50:23.788879+0000","last_active":"2023-07-09T21:50:24.770323+0000","last_peered":"2023-07-09T21:50:24.770323+0000","last_clean":"2023-07-09T21:50:24.770323+0000","last_became_active":"2023-07-09T21:50:23.788458+0000","last_became_peered":"2023-07-09T21:50:23.788458+0000","last_unstale":"2023-07-09T21:50:24.770323+0000","last_undegraded":"2023-07-09T21:50:24.770323+0000","last_fullsized":"2023-07-09T21:50:24.770323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.797393+0000","last_change":"2023-07-09T21:50:23.787304+0000","last_active":"2023-07-09T21:50:23.797393+0000","last_peered":"2023-07-09T21:50:23.797393+0000","last_clean":"2023-07-09T21:50:23.797393+0000","last_became_active":"2023-07-09T21:50:23.787022+0000","last_became_peered":"2023-07-09T21:50:23.787022+0000","last_unstale":"2023-07-09T21:50:23.797393+0000","last_undegraded":"2023-07-09T21:50:23.797393+0000","last_fullsized":"2023-07-09T21:50:23.797393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:57:38.274013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770719+0000","last_change":"2023-07-09T21:50:23.785978+0000","last_active":"2023-07-09T21:50:24.770719+0000","last_peered":"2023-07-09T21:50:24.770719+0000","last_clean":"2023-07-09T21:50:24.770719+0000","last_became_active":"2023-07-09T21:50:23.785694+0000","last_became_peered":"2023-07-09T21:50:23.785694+0000","last_unstale":"2023-07-09T21:50:24.770719+0000","last_undegraded":"2023-07-09T21:50:24.770719+0000","last_fullsized":"2023-07-09T21:50:24.770719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:13.602484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.783621+0000","last_change":"2023-07-09T21:50:23.780066+0000","last_active":"2023-07-09T21:50:23.783621+0000","last_peered":"2023-07-09T21:50:23.783621+0000","last_clean":"2023-07-09T21:50:23.783621+0000","last_became_active":"2023-07-09T21:50:23.779691+0000","last_became_peered":"2023-07-09T21:50:23.779691+0000","last_unstale":"2023-07-09T21:50:23.783621+0000","last_undegraded":"2023-07-09T21:50:23.783621+0000","last_fullsized":"2023-07-09T21:50:23.783621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:51:58.642076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":83224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":83224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":97005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":856064,"data_stored":687955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":880640,"data_stored":689153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":97095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":97657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":97005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:50:29.219 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-09T21:50:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.445+0000 7fd3e0bff700 1 Processor -- start 2023-07-09T21:50:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.445+0000 7fd3e0bff700 1 -- start start 2023-07-09T21:50:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.446+0000 7fd3e0bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3dc0d1220 0x7fd3dc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:29.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.446+0000 7fd3e0bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3dc0b2350 0x7fd3dc0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:29.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.446+0000 7fd3e0bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3dc0d2ce0 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.446+0000 7fd3e0bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3dc0b3350 con 0x7fd3dc0b2350 2023-07-09T21:50:29.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.446+0000 7fd3e0bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc0b3630 con 0x7fd3dc0d1220 2023-07-09T21:50:29.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.447+0000 7fd3dad9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3dc0b2350 0x7fd3dc0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:29.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.447+0000 7fd3dad9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3dc0b2350 0x7fd3dc0afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40404/0 (socket says 172.21.15.53:40404) 2023-07-09T21:50:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.447+0000 7fd3dad9d700 1 -- 172.21.15.53:0/3805423731 learned_addr learned my addr 172.21.15.53:0/3805423731 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.447+0000 7fd3d9d9b700 1 --2- 172.21.15.53:0/3805423731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3dc0d1220 0x7fd3dc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.447+0000 7fd3dad9d700 1 -- 172.21.15.53:0/3805423731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3dc0d1220 msgr2=0x7fd3dc0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.447+0000 7fd3dad9d700 1 --2- 172.21.15.53:0/3805423731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3dc0d1220 0x7fd3dc0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.447+0000 7fd3dad9d700 1 -- 172.21.15.53:0/3805423731 >> v1:172.21.15.184:6789/0 conn(0x7fd3dc0b1e00 legacy=0x7fd3dc0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.447+0000 7fd3dad9d700 1 -- 172.21.15.53:0/3805423731 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc0b3910 con 0x7fd3dc0b2350 2023-07-09T21:50:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.447+0000 7fd3dad9d700 1 --2- 172.21.15.53:0/3805423731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3dc0b2350 0x7fd3dc0afac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009e50 tx=0x7fd3d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83b70b46bde5ff7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.447+0000 7fd3d959a700 1 -- 172.21.15.53:0/3805423731 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d400e070 con 0x7fd3dc0b2350 2023-07-09T21:50:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.448+0000 7fd3d959a700 1 -- 172.21.15.53:0/3805423731 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d400b910 con 0x7fd3dc0b2350 2023-07-09T21:50:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.448+0000 7fd3d959a700 1 -- 172.21.15.53:0/3805423731 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d400bcc0 con 0x7fd3dc0b2350 2023-07-09T21:50:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.448+0000 7fd3e0bff700 1 -- 172.21.15.53:0/3805423731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3dc0b2350 msgr2=0x7fd3dc0afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.448+0000 7fd3e0bff700 1 --2- 172.21.15.53:0/3805423731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3dc0b2350 0x7fd3dc0afac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009e50 tx=0x7fd3d400b330 comp rx=0 tx=0).stop 2023-07-09T21:50:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.448+0000 7fd3e0bff700 1 -- 172.21.15.53:0/3805423731 shutdown_connections 2023-07-09T21:50:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.448+0000 7fd3e0bff700 1 --2- 172.21.15.53:0/3805423731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3dc0b2350 0x7fd3dc0afac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.448+0000 7fd3e0bff700 1 --2- 172.21.15.53:0/3805423731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3dc0d1220 0x7fd3dc0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.448+0000 7fd3e0bff700 1 -- 172.21.15.53:0/3805423731 >> 172.21.15.53:0/3805423731 conn(0x7fd3dc09c1d0 msgr2=0x7fd3dc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.448+0000 7fd3e0bff700 1 -- 172.21.15.53:0/3805423731 shutdown_connections 2023-07-09T21:50:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.448+0000 7fd3e0bff700 1 -- 172.21.15.53:0/3805423731 wait complete. 2023-07-09T21:50:29.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.450+0000 7fd3e0bff700 1 Processor -- start 2023-07-09T21:50:29.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.450+0000 7fd3e0bff700 1 -- start start 2023-07-09T21:50:29.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.451+0000 7fd3e0bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3dc0b1e00 0x7fd3dc1556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:29.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.451+0000 7fd3e0bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3dc0b2350 0x7fd3dc0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:29.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.451+0000 7fd3e0bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3dc0d1220 0x7fd3dc0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:29.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.451+0000 7fd3e0bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc0cb710 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.451+0000 7fd3e0bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc0cb9f0 con 0x7fd3dc0b2350 2023-07-09T21:50:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.451+0000 7fd3e0bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc0cbcd0 con 0x7fd3dc0d1220 2023-07-09T21:50:29.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.451+0000 7fd3da59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3dc0b1e00 0x7fd3dc1556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:29.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3da59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3dc0b1e00 0x7fd3dc1556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40416/0 (socket says 172.21.15.53:40416) 2023-07-09T21:50:29.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3da59c700 1 -- 172.21.15.53:0/84228422 learned_addr learned my addr 172.21.15.53:0/84228422 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:29.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3d9d9b700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3dc0b2350 0x7fd3dc0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:29.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3dad9d700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3dc0d1220 0x7fd3dc0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:29.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3da59c700 1 -- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3dc0d1220 msgr2=0x7fd3dc0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:29.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3da59c700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3dc0d1220 0x7fd3dc0c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3da59c700 1 -- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3dc0b2350 msgr2=0x7fd3dc0cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:29.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3da59c700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3dc0b2350 0x7fd3dc0cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3da59c700 1 -- 172.21.15.53:0/84228422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d4009b30 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3da59c700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3dc0b1e00 0x7fd3dc1556b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00c4d0 tx=0x7fd3cc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:29.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3caffd700 1 -- 172.21.15.53:0/84228422 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc0052d0 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3caffd700 1 -- 172.21.15.53:0/84228422 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc005430 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3caffd700 1 -- 172.21.15.53:0/84228422 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc0038f0 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.452+0000 7fd3e0bff700 1 -- 172.21.15.53:0/84228422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3dc0cbfb0 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.453+0000 7fd3e0bff700 1 -- 172.21.15.53:0/84228422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3dc155bf0 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.454+0000 7fd3e0bff700 1 -- 172.21.15.53:0/84228422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3dc0cc4d0 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.455+0000 7fd3caffd700 1 -- 172.21.15.53:0/84228422 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd3cc003a50 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.456+0000 7fd3caffd700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd3bc06ace0 0x7fd3bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:29.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.456+0000 7fd3caffd700 1 -- 172.21.15.53:0/84228422 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd3cc088a30 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.456+0000 7fd3d9d9b700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd3bc06ace0 0x7fd3bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:29.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.457+0000 7fd3d9d9b700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd3bc06ace0 0x7fd3bc06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0cc6d0 tx=0x7fd3d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:29.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.460+0000 7fd3caffd700 1 -- 172.21.15.53:0/84228422 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd3cc053a40 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.753+0000 7fd3e0bff700 1 -- 172.21.15.53:0/84228422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd3dc04e280 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.753+0000 7fd3caffd700 1 -- 172.21.15.53:0/84228422 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1093 (secure 0 0 0) 0x7fd3cc057060 con 0x7fd3dc0b1e00 2023-07-09T21:50:29.755 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:29.755 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":34,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":25,"num_osds":8,"num_up_osds":8,"osd_up_since":1688939408,"num_in_osds":8,"osd_in_since":1688939399,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":65},{"state_name":"creating+peering","count":40}],"num_pgs":105,"num_pools":4,"num_objects":6,"data_bytes":591932,"bytes_used":227979264,"bytes_avail":772866134016,"bytes_total":773094113280,"inactive_pgs_ratio":0.380952388048172,"write_bytes_sec":601,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4306}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-07-09T21:49:55.751164+0000","services":{}},"progress_events":{}} 2023-07-09T21:50:29.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.756+0000 7fd3e0bff700 1 -- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd3bc06ace0 msgr2=0x7fd3bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:29.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.756+0000 7fd3e0bff700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd3bc06ace0 0x7fd3bc06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0cc6d0 tx=0x7fd3d0008040 comp rx=0 tx=0).stop 2023-07-09T21:50:29.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.756+0000 7fd3e0bff700 1 -- 172.21.15.53:0/84228422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3dc0b1e00 msgr2=0x7fd3dc1556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:29.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.756+0000 7fd3e0bff700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3dc0b1e00 0x7fd3dc1556b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00c4d0 tx=0x7fd3cc00c890 comp rx=0 tx=0).stop 2023-07-09T21:50:29.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.756+0000 7fd3e0bff700 1 -- 172.21.15.53:0/84228422 shutdown_connections 2023-07-09T21:50:29.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.756+0000 7fd3e0bff700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd3bc06ace0 0x7fd3bc06d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.756+0000 7fd3e0bff700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3dc0d1220 0x7fd3dc0c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.756+0000 7fd3e0bff700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3dc0b1e00 0x7fd3dc1556b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.756+0000 7fd3e0bff700 1 --2- 172.21.15.53:0/84228422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3dc0b2350 0x7fd3dc0cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.756+0000 7fd3e0bff700 1 -- 172.21.15.53:0/84228422 >> 172.21.15.53:0/84228422 conn(0x7fd3dc09c1d0 msgr2=0x7fd3dc0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:29.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.756+0000 7fd3e0bff700 1 -- 172.21.15.53:0/84228422 shutdown_connections 2023-07-09T21:50:29.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.756+0000 7fd3e0bff700 1 -- 172.21.15.53:0/84228422 wait complete. 2023-07-09T21:50:29.775 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-09T21:50:29.776 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:50:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.974+0000 7f4df61ff700 1 Processor -- start 2023-07-09T21:50:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.975+0000 7f4df61ff700 1 -- start start 2023-07-09T21:50:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.976+0000 7f4df61ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4df00b1e00 0x7f4df00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.976+0000 7f4df61ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4df00b2350 0x7f4df00d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.976+0000 7f4df61ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df00d2ce0 con 0x7f4df00d1050 2023-07-09T21:50:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.976+0000 7f4df61ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df00d14d0 con 0x7f4df00b2350 2023-07-09T21:50:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.976+0000 7f4df61ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df00b3350 con 0x7f4df00b1e00 2023-07-09T21:50:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.976+0000 7f4deeffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4df00b2350 0x7f4df00d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.976+0000 7f4deffff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4df00d1050 0x7f4df00afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37646/0 (socket says 172.21.15.53:37646) 2023-07-09T21:50:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.976+0000 7f4deffff700 1 -- 172.21.15.53:0/2529163139 learned_addr learned my addr 172.21.15.53:0/2529163139 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.976+0000 7f4def7fe700 1 --2- 172.21.15.53:0/2529163139 >> v2:172.21.15.184:3300/0 conn(0x7f4df00b1e00 0x7f4df00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.976+0000 7f4deeffd700 1 -- 172.21.15.53:0/2529163139 >> v2:172.21.15.184:3300/0 conn(0x7f4df00b1e00 msgr2=0x7f4df00b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:29.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.976+0000 7f4deeffd700 1 --2- 172.21.15.53:0/2529163139 >> v2:172.21.15.184:3300/0 conn(0x7f4df00b1e00 0x7f4df00b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.976+0000 7f4deeffd700 1 -- 172.21.15.53:0/2529163139 >> v1:172.21.15.53:6789/0 conn(0x7f4df00d1050 legacy=0x7f4df00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:29.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.977+0000 7f4deeffd700 1 -- 172.21.15.53:0/2529163139 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df00b3630 con 0x7f4df00b2350 2023-07-09T21:50:29.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.977+0000 7f4dee7fc700 1 -- 172.21.15.53:0/2529163139 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038447472 0 0) 0x7f4df00d2ce0 con 0x7f4df00d1050 2023-07-09T21:50:29.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.977+0000 7f4deeffd700 1 --2- 172.21.15.53:0/2529163139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4df00b2350 0x7f4df00d0b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4df008d170 tx=0x7f4de4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26012b05955baf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:29.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.977+0000 7f4dee7fc700 1 -- 172.21.15.53:0/2529163139 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4011830 con 0x7f4df00b2350 2023-07-09T21:50:29.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.977+0000 7f4dee7fc700 1 -- 172.21.15.53:0/2529163139 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de4011990 con 0x7f4df00b2350 2023-07-09T21:50:29.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.977+0000 7f4dee7fc700 1 -- 172.21.15.53:0/2529163139 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4011d20 con 0x7f4df00b2350 2023-07-09T21:50:29.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.978+0000 7f4df61ff700 1 -- 172.21.15.53:0/2529163139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4df00b2350 msgr2=0x7f4df00d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:29.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.978+0000 7f4df61ff700 1 --2- 172.21.15.53:0/2529163139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4df00b2350 0x7f4df00d0b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4df008d170 tx=0x7f4de4009b20 comp rx=0 tx=0).stop 2023-07-09T21:50:29.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.978+0000 7f4df61ff700 1 -- 172.21.15.53:0/2529163139 shutdown_connections 2023-07-09T21:50:29.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.978+0000 7f4df61ff700 1 --2- 172.21.15.53:0/2529163139 >> v2:172.21.15.184:3300/0 conn(0x7f4df00b1e00 0x7f4df00b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.978+0000 7f4df61ff700 1 --2- 172.21.15.53:0/2529163139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4df00b2350 0x7f4df00d0b10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.978+0000 7f4df61ff700 1 -- 172.21.15.53:0/2529163139 >> 172.21.15.53:0/2529163139 conn(0x7f4df009c1d0 msgr2=0x7f4df00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:29.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.978+0000 7f4df61ff700 1 -- 172.21.15.53:0/2529163139 shutdown_connections 2023-07-09T21:50:29.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.978+0000 7f4df61ff700 1 -- 172.21.15.53:0/2529163139 wait complete. 2023-07-09T21:50:29.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.979+0000 7f4df61ff700 1 Processor -- start 2023-07-09T21:50:29.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.980+0000 7f4df61ff700 1 -- start start 2023-07-09T21:50:29.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.980+0000 7f4df61ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4df00b1e00 0x7f4df00cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:29.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.980+0000 7f4df61ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4df00b2350 0x7f4df01f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.980+0000 7f4df61ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4df00d1050 0x7f4df00cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.980+0000 7f4df61ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01f1c40 con 0x7f4df00d1050 2023-07-09T21:50:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.980+0000 7f4df61ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00cbfb0 con 0x7f4df00b1e00 2023-07-09T21:50:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.980+0000 7f4df61ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00cdc40 con 0x7f4df00b2350 2023-07-09T21:50:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.981+0000 7f4deffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4df00d1050 0x7f4df00cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.981+0000 7f4def7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4df00b1e00 0x7f4df00cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.981+0000 7f4deffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4df00d1050 0x7f4df00cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40432/0 (socket says 172.21.15.53:40432) 2023-07-09T21:50:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.981+0000 7f4deffff700 1 -- 172.21.15.53:0/4186352084 learned_addr learned my addr 172.21.15.53:0/4186352084 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.981+0000 7f4deeffd700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4df00b2350 0x7f4df01f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.981+0000 7f4deffff700 1 -- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4df00b2350 msgr2=0x7f4df01f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.981+0000 7f4deffff700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4df00b2350 0x7f4df01f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.981+0000 7f4deffff700 1 -- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4df00b1e00 msgr2=0x7f4df00cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.981+0000 7f4deffff700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4df00b1e00 0x7f4df00cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.981+0000 7f4deffff700 1 -- 172.21.15.53:0/4186352084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de40094a0 con 0x7f4df00d1050 2023-07-09T21:50:29.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.981+0000 7f4def7fe700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4df00b1e00 0x7f4df00cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:50:29.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.981+0000 7f4deffff700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4df00d1050 0x7f4df00cba70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4de800cba0 tx=0x7f4de800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:29.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.982+0000 7f4dd7fff700 1 -- 172.21.15.53:0/4186352084 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de800aaa0 con 0x7f4df00d1050 2023-07-09T21:50:29.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.982+0000 7f4dd7fff700 1 -- 172.21.15.53:0/4186352084 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de800ac20 con 0x7f4df00d1050 2023-07-09T21:50:29.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.982+0000 7f4dd7fff700 1 -- 172.21.15.53:0/4186352084 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de80070d0 con 0x7f4df00d1050 2023-07-09T21:50:29.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.982+0000 7f4df61ff700 1 -- 172.21.15.53:0/4186352084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df00cc1f0 con 0x7f4df00d1050 2023-07-09T21:50:29.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.982+0000 7f4df61ff700 1 -- 172.21.15.53:0/4186352084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df00cd5f0 con 0x7f4df00d1050 2023-07-09T21:50:29.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.983+0000 7f4df61ff700 1 -- 172.21.15.53:0/4186352084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df004e280 con 0x7f4df00d1050 2023-07-09T21:50:29.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.984+0000 7f4dd7fff700 1 -- 172.21.15.53:0/4186352084 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4de8007230 con 0x7f4df00d1050 2023-07-09T21:50:29.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.985+0000 7f4dd7fff700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ddc06ace0 0x7f4ddc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:29.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.985+0000 7f4dd7fff700 1 -- 172.21.15.53:0/4186352084 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4de8088fe0 con 0x7f4df00d1050 2023-07-09T21:50:29.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.985+0000 7f4def7fe700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ddc06ace0 0x7f4ddc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:29.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.986+0000 7f4def7fe700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ddc06ace0 0x7f4ddc06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009f10 tx=0x7f4de00091c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:29.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:29.989+0000 7f4dd7fff700 1 -- 172.21.15.53:0/4186352084 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4de8054030 con 0x7f4df00d1050 2023-07-09T21:50:30.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.191+0000 7f4df61ff700 1 -- 172.21.15.53:0/4186352084 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4df00b3bf0 con 0x7f4ddc06ace0 2023-07-09T21:50:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.200+0000 7f4dd7fff700 1 -- 172.21.15.53:0/4186352084 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286793 (secure 0 0 0) 0x7f4de0011ba0 con 0x7f4ddc06ace0 2023-07-09T21:50:30.205 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:30.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.204+0000 7f4df61ff700 1 -- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ddc06ace0 msgr2=0x7f4ddc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.204+0000 7f4df61ff700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ddc06ace0 0x7f4ddc06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009f10 tx=0x7f4de00091c0 comp rx=0 tx=0).stop 2023-07-09T21:50:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.204+0000 7f4df61ff700 1 -- 172.21.15.53:0/4186352084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4df00d1050 msgr2=0x7f4df00cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.204+0000 7f4df61ff700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4df00d1050 0x7f4df00cba70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4de800cba0 tx=0x7f4de800ceb0 comp rx=0 tx=0).stop 2023-07-09T21:50:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.205+0000 7f4df61ff700 1 -- 172.21.15.53:0/4186352084 shutdown_connections 2023-07-09T21:50:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.205+0000 7f4df61ff700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ddc06ace0 0x7f4ddc06d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:30.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.205+0000 7f4df61ff700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4df00d1050 0x7f4df00cba70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:30.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.205+0000 7f4df61ff700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4df00b1e00 0x7f4df00cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:30.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.205+0000 7f4df61ff700 1 --2- 172.21.15.53:0/4186352084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4df00b2350 0x7f4df01f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:30.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.205+0000 7f4df61ff700 1 -- 172.21.15.53:0/4186352084 >> 172.21.15.53:0/4186352084 conn(0x7f4df009c1d0 msgr2=0x7f4df00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:30.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.205+0000 7f4df61ff700 1 -- 172.21.15.53:0/4186352084 shutdown_connections 2023-07-09T21:50:30.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:30.205+0000 7f4df61ff700 1 -- 172.21.15.53:0/4186352084 wait complete. 2023-07-09T21:50:30.209 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:50:30.224 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-09T21:50:28.851931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222884,"kb_used_data":3172,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751836,"statfs":{"total":773094113280,"available":772865880064,"internally_reserved":0,"allocated":3248128,"data_stored":1932318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.101385"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401409+0000","last_change":"2023-07-09T21:50:23.789471+0000","last_active":"2023-07-09T21:50:25.401409+0000","last_peered":"2023-07-09T21:50:25.401409+0000","last_clean":"2023-07-09T21:50:25.401409+0000","last_became_active":"2023-07-09T21:50:23.789178+0000","last_became_peered":"2023-07-09T21:50:23.789178+0000","last_unstale":"2023-07-09T21:50:25.401409+0000","last_undegraded":"2023-07-09T21:50:25.401409+0000","last_fullsized":"2023-07-09T21:50:25.401409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:24.789777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771695+0000","last_change":"2023-07-09T21:50:23.789721+0000","last_active":"2023-07-09T21:50:24.771695+0000","last_peered":"2023-07-09T21:50:24.771695+0000","last_clean":"2023-07-09T21:50:24.771695+0000","last_became_active":"2023-07-09T21:50:23.789478+0000","last_became_peered":"2023-07-09T21:50:23.789478+0000","last_unstale":"2023-07-09T21:50:24.771695+0000","last_undegraded":"2023-07-09T21:50:24.771695+0000","last_fullsized":"2023-07-09T21:50:24.771695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801988+0000","last_change":"2023-07-09T21:50:23.792566+0000","last_active":"2023-07-09T21:50:23.801988+0000","last_peered":"2023-07-09T21:50:23.801988+0000","last_clean":"2023-07-09T21:50:23.801988+0000","last_became_active":"2023-07-09T21:50:23.792316+0000","last_became_peered":"2023-07-09T21:50:23.792316+0000","last_unstale":"2023-07-09T21:50:23.801988+0000","last_undegraded":"2023-07-09T21:50:23.801988+0000","last_fullsized":"2023-07-09T21:50:23.801988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401848+0000","last_change":"2023-07-09T21:50:23.790737+0000","last_active":"2023-07-09T21:50:25.401848+0000","last_peered":"2023-07-09T21:50:25.401848+0000","last_clean":"2023-07-09T21:50:25.401848+0000","last_became_active":"2023-07-09T21:50:23.790455+0000","last_became_peered":"2023-07-09T21:50:23.790455+0000","last_unstale":"2023-07-09T21:50:25.401848+0000","last_undegraded":"2023-07-09T21:50:25.401848+0000","last_fullsized":"2023-07-09T21:50:25.401848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:33:28.169248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771850+0000","last_change":"2023-07-09T21:50:23.799889+0000","last_active":"2023-07-09T21:50:24.771850+0000","last_peered":"2023-07-09T21:50:24.771850+0000","last_clean":"2023-07-09T21:50:24.771850+0000","last_became_active":"2023-07-09T21:50:23.798717+0000","last_became_peered":"2023-07-09T21:50:23.798717+0000","last_unstale":"2023-07-09T21:50:24.771850+0000","last_undegraded":"2023-07-09T21:50:24.771850+0000","last_fullsized":"2023-07-09T21:50:24.771850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:25.755232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802212+0000","last_change":"2023-07-09T21:50:23.798790+0000","last_active":"2023-07-09T21:50:23.802212+0000","last_peered":"2023-07-09T21:50:23.802212+0000","last_clean":"2023-07-09T21:50:23.802212+0000","last_became_active":"2023-07-09T21:50:23.798508+0000","last_became_peered":"2023-07-09T21:50:23.798508+0000","last_unstale":"2023-07-09T21:50:23.802212+0000","last_undegraded":"2023-07-09T21:50:23.802212+0000","last_fullsized":"2023-07-09T21:50:23.802212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:43.474786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094158+0000","last_change":"2023-07-09T21:50:23.791148+0000","last_active":"2023-07-09T21:50:25.094158+0000","last_peered":"2023-07-09T21:50:25.094158+0000","last_clean":"2023-07-09T21:50:25.094158+0000","last_became_active":"2023-07-09T21:50:23.790530+0000","last_became_peered":"2023-07-09T21:50:23.790530+0000","last_unstale":"2023-07-09T21:50:25.094158+0000","last_undegraded":"2023-07-09T21:50:25.094158+0000","last_fullsized":"2023-07-09T21:50:25.094158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771365+0000","last_change":"2023-07-09T21:50:23.786451+0000","last_active":"2023-07-09T21:50:24.771365+0000","last_peered":"2023-07-09T21:50:24.771365+0000","last_clean":"2023-07-09T21:50:24.771365+0000","last_became_active":"2023-07-09T21:50:23.786150+0000","last_became_peered":"2023-07-09T21:50:23.786150+0000","last_unstale":"2023-07-09T21:50:24.771365+0000","last_undegraded":"2023-07-09T21:50:24.771365+0000","last_fullsized":"2023-07-09T21:50:24.771365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773128+0000","last_change":"2023-07-09T21:50:23.799651+0000","last_active":"2023-07-09T21:50:24.773128+0000","last_peered":"2023-07-09T21:50:24.773128+0000","last_clean":"2023-07-09T21:50:24.773128+0000","last_became_active":"2023-07-09T21:50:23.799306+0000","last_became_peered":"2023-07-09T21:50:23.799306+0000","last_unstale":"2023-07-09T21:50:24.773128+0000","last_undegraded":"2023-07-09T21:50:24.773128+0000","last_fullsized":"2023-07-09T21:50:24.773128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:06.841347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772154+0000","last_change":"2023-07-09T21:50:23.807058+0000","last_active":"2023-07-09T21:50:24.772154+0000","last_peered":"2023-07-09T21:50:24.772154+0000","last_clean":"2023-07-09T21:50:24.772154+0000","last_became_active":"2023-07-09T21:50:23.805775+0000","last_became_peered":"2023-07-09T21:50:23.805775+0000","last_unstale":"2023-07-09T21:50:24.772154+0000","last_undegraded":"2023-07-09T21:50:24.772154+0000","last_fullsized":"2023-07-09T21:50:24.772154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:16.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801969+0000","last_change":"2023-07-09T21:50:23.787617+0000","last_active":"2023-07-09T21:50:23.801969+0000","last_peered":"2023-07-09T21:50:23.801969+0000","last_clean":"2023-07-09T21:50:23.801969+0000","last_became_active":"2023-07-09T21:50:23.787324+0000","last_became_peered":"2023-07-09T21:50:23.787324+0000","last_unstale":"2023-07-09T21:50:23.801969+0000","last_undegraded":"2023-07-09T21:50:23.801969+0000","last_fullsized":"2023-07-09T21:50:23.801969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:28.676168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401442+0000","last_change":"2023-07-09T21:50:23.786780+0000","last_active":"2023-07-09T21:50:25.401442+0000","last_peered":"2023-07-09T21:50:25.401442+0000","last_clean":"2023-07-09T21:50:25.401442+0000","last_became_active":"2023-07-09T21:50:23.786285+0000","last_became_peered":"2023-07-09T21:50:23.786285+0000","last_unstale":"2023-07-09T21:50:25.401442+0000","last_undegraded":"2023-07-09T21:50:25.401442+0000","last_fullsized":"2023-07-09T21:50:25.401442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:17:28.990837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401348+0000","last_change":"2023-07-09T21:50:23.779777+0000","last_active":"2023-07-09T21:50:25.401348+0000","last_peered":"2023-07-09T21:50:25.401348+0000","last_clean":"2023-07-09T21:50:25.401348+0000","last_became_active":"2023-07-09T21:50:23.779402+0000","last_became_peered":"2023-07-09T21:50:23.779402+0000","last_unstale":"2023-07-09T21:50:25.401348+0000","last_undegraded":"2023-07-09T21:50:25.401348+0000","last_fullsized":"2023-07-09T21:50:25.401348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:28.676168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771883+0000","last_change":"2023-07-09T21:50:23.785342+0000","last_active":"2023-07-09T21:50:24.771883+0000","last_peered":"2023-07-09T21:50:24.771883+0000","last_clean":"2023-07-09T21:50:24.771883+0000","last_became_active":"2023-07-09T21:50:23.785042+0000","last_became_peered":"2023-07-09T21:50:23.785042+0000","last_unstale":"2023-07-09T21:50:24.771883+0000","last_undegraded":"2023-07-09T21:50:24.771883+0000","last_fullsized":"2023-07-09T21:50:24.771883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:33.584119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094514+0000","last_change":"2023-07-09T21:50:23.791304+0000","last_active":"2023-07-09T21:50:25.094514+0000","last_peered":"2023-07-09T21:50:25.094514+0000","last_clean":"2023-07-09T21:50:25.094514+0000","last_became_active":"2023-07-09T21:50:23.790881+0000","last_became_peered":"2023-07-09T21:50:23.790881+0000","last_unstale":"2023-07-09T21:50:25.094514+0000","last_undegraded":"2023-07-09T21:50:25.094514+0000","last_fullsized":"2023-07-09T21:50:25.094514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:53:11.882162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801854+0000","last_change":"2023-07-09T21:50:23.792844+0000","last_active":"2023-07-09T21:50:23.801854+0000","last_peered":"2023-07-09T21:50:23.801854+0000","last_clean":"2023-07-09T21:50:23.801854+0000","last_became_active":"2023-07-09T21:50:23.792511+0000","last_became_peered":"2023-07-09T21:50:23.792511+0000","last_unstale":"2023-07-09T21:50:23.801854+0000","last_undegraded":"2023-07-09T21:50:23.801854+0000","last_fullsized":"2023-07-09T21:50:23.801854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:33.102940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773086+0000","last_change":"2023-07-09T21:50:23.801511+0000","last_active":"2023-07-09T21:50:24.773086+0000","last_peered":"2023-07-09T21:50:24.773086+0000","last_clean":"2023-07-09T21:50:24.773086+0000","last_became_active":"2023-07-09T21:50:23.799945+0000","last_became_peered":"2023-07-09T21:50:23.799945+0000","last_unstale":"2023-07-09T21:50:24.773086+0000","last_undegraded":"2023-07-09T21:50:24.773086+0000","last_fullsized":"2023-07-09T21:50:24.773086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:30.584499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802103+0000","last_change":"2023-07-09T21:50:23.791210+0000","last_active":"2023-07-09T21:50:23.802103+0000","last_peered":"2023-07-09T21:50:23.802103+0000","last_clean":"2023-07-09T21:50:23.802103+0000","last_became_active":"2023-07-09T21:50:23.790958+0000","last_became_peered":"2023-07-09T21:50:23.790958+0000","last_unstale":"2023-07-09T21:50:23.802103+0000","last_undegraded":"2023-07-09T21:50:23.802103+0000","last_fullsized":"2023-07-09T21:50:23.802103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:23.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401359+0000","last_change":"2023-07-09T21:50:23.781367+0000","last_active":"2023-07-09T21:50:25.401359+0000","last_peered":"2023-07-09T21:50:25.401359+0000","last_clean":"2023-07-09T21:50:25.401359+0000","last_became_active":"2023-07-09T21:50:23.781111+0000","last_became_peered":"2023-07-09T21:50:23.781111+0000","last_unstale":"2023-07-09T21:50:25.401359+0000","last_undegraded":"2023-07-09T21:50:25.401359+0000","last_fullsized":"2023-07-09T21:50:25.401359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:23.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801751+0000","last_change":"2023-07-09T21:50:23.788775+0000","last_active":"2023-07-09T21:50:23.801751+0000","last_peered":"2023-07-09T21:50:23.801751+0000","last_clean":"2023-07-09T21:50:23.801751+0000","last_became_active":"2023-07-09T21:50:23.788474+0000","last_became_peered":"2023-07-09T21:50:23.788474+0000","last_unstale":"2023-07-09T21:50:23.801751+0000","last_undegraded":"2023-07-09T21:50:23.801751+0000","last_fullsized":"2023-07-09T21:50:23.801751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:49.489636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094336+0000","last_change":"2023-07-09T21:50:23.782607+0000","last_active":"2023-07-09T21:50:25.094336+0000","last_peered":"2023-07-09T21:50:25.094336+0000","last_clean":"2023-07-09T21:50:25.094336+0000","last_became_active":"2023-07-09T21:50:23.782315+0000","last_became_peered":"2023-07-09T21:50:23.782315+0000","last_unstale":"2023-07-09T21:50:25.094336+0000","last_undegraded":"2023-07-09T21:50:25.094336+0000","last_fullsized":"2023-07-09T21:50:25.094336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:36.220738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771811+0000","last_change":"2023-07-09T21:50:23.796236+0000","last_active":"2023-07-09T21:50:24.771811+0000","last_peered":"2023-07-09T21:50:24.771811+0000","last_clean":"2023-07-09T21:50:24.771811+0000","last_became_active":"2023-07-09T21:50:23.795910+0000","last_became_peered":"2023-07-09T21:50:23.795910+0000","last_unstale":"2023-07-09T21:50:24.771811+0000","last_undegraded":"2023-07-09T21:50:24.771811+0000","last_fullsized":"2023-07-09T21:50:24.771811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770483+0000","last_change":"2023-07-09T21:50:23.795797+0000","last_active":"2023-07-09T21:50:24.770483+0000","last_peered":"2023-07-09T21:50:24.770483+0000","last_clean":"2023-07-09T21:50:24.770483+0000","last_became_active":"2023-07-09T21:50:23.795569+0000","last_became_peered":"2023-07-09T21:50:23.795569+0000","last_unstale":"2023-07-09T21:50:24.770483+0000","last_undegraded":"2023-07-09T21:50:24.770483+0000","last_fullsized":"2023-07-09T21:50:24.770483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094493+0000","last_change":"2023-07-09T21:50:23.782770+0000","last_active":"2023-07-09T21:50:25.094493+0000","last_peered":"2023-07-09T21:50:25.094493+0000","last_clean":"2023-07-09T21:50:25.094493+0000","last_became_active":"2023-07-09T21:50:23.782509+0000","last_became_peered":"2023-07-09T21:50:23.782509+0000","last_unstale":"2023-07-09T21:50:25.094493+0000","last_undegraded":"2023-07-09T21:50:25.094493+0000","last_fullsized":"2023-07-09T21:50:25.094493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:48:23.282646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790159+0000","last_change":"2023-07-09T21:50:23.785433+0000","last_active":"2023-07-09T21:50:23.790159+0000","last_peered":"2023-07-09T21:50:23.790159+0000","last_clean":"2023-07-09T21:50:23.790159+0000","last_became_active":"2023-07-09T21:50:23.785016+0000","last_became_peered":"2023-07-09T21:50:23.785016+0000","last_unstale":"2023-07-09T21:50:23.790159+0000","last_undegraded":"2023-07-09T21:50:23.790159+0000","last_fullsized":"2023-07-09T21:50:23.790159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:05:28.932158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790106+0000","last_change":"2023-07-09T21:50:23.781394+0000","last_active":"2023-07-09T21:50:23.790106+0000","last_peered":"2023-07-09T21:50:23.790106+0000","last_clean":"2023-07-09T21:50:23.790106+0000","last_became_active":"2023-07-09T21:50:23.781089+0000","last_became_peered":"2023-07-09T21:50:23.781089+0000","last_unstale":"2023-07-09T21:50:23.790106+0000","last_undegraded":"2023-07-09T21:50:23.790106+0000","last_fullsized":"2023-07-09T21:50:23.790106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:26:12.334998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771627+0000","last_change":"2023-07-09T21:50:23.783556+0000","last_active":"2023-07-09T21:50:24.771627+0000","last_peered":"2023-07-09T21:50:24.771627+0000","last_clean":"2023-07-09T21:50:24.771627+0000","last_became_active":"2023-07-09T21:50:23.783277+0000","last_became_peered":"2023-07-09T21:50:23.783277+0000","last_unstale":"2023-07-09T21:50:24.771627+0000","last_undegraded":"2023-07-09T21:50:24.771627+0000","last_fullsized":"2023-07-09T21:50:24.771627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.148959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.812395+0000","last_change":"2023-07-09T21:50:22.774935+0000","last_active":"2023-07-09T21:50:23.812395+0000","last_peered":"2023-07-09T21:50:23.812395+0000","last_clean":"2023-07-09T21:50:23.812395+0000","last_became_active":"2023-07-09T21:50:22.774612+0000","last_became_peered":"2023-07-09T21:50:22.774612+0000","last_unstale":"2023-07-09T21:50:23.812395+0000","last_undegraded":"2023-07-09T21:50:23.812395+0000","last_fullsized":"2023-07-09T21:50:23.812395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:17:27.986566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770699+0000","last_change":"2023-07-09T21:50:23.777644+0000","last_active":"2023-07-09T21:50:24.770699+0000","last_peered":"2023-07-09T21:50:24.770699+0000","last_clean":"2023-07-09T21:50:24.770699+0000","last_became_active":"2023-07-09T21:50:23.777372+0000","last_became_peered":"2023-07-09T21:50:23.777372+0000","last_unstale":"2023-07-09T21:50:24.770699+0000","last_undegraded":"2023-07-09T21:50:24.770699+0000","last_fullsized":"2023-07-09T21:50:24.770699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:06.551761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.777834+0000","last_change":"2023-07-09T21:50:22.772852+0000","last_active":"2023-07-09T21:50:23.777834+0000","last_peered":"2023-07-09T21:50:23.777834+0000","last_clean":"2023-07-09T21:50:23.777834+0000","last_became_active":"2023-07-09T21:50:22.772592+0000","last_became_peered":"2023-07-09T21:50:22.772592+0000","last_unstale":"2023-07-09T21:50:23.777834+0000","last_undegraded":"2023-07-09T21:50:23.777834+0000","last_fullsized":"2023-07-09T21:50:23.777834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:33:47.769844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773185+0000","last_change":"2023-07-09T21:50:23.802442+0000","last_active":"2023-07-09T21:50:24.773185+0000","last_peered":"2023-07-09T21:50:24.773185+0000","last_clean":"2023-07-09T21:50:24.773185+0000","last_became_active":"2023-07-09T21:50:23.801644+0000","last_became_peered":"2023-07-09T21:50:23.801644+0000","last_unstale":"2023-07-09T21:50:24.773185+0000","last_undegraded":"2023-07-09T21:50:24.773185+0000","last_fullsized":"2023-07-09T21:50:24.773185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:13.602484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770485+0000","last_change":"2023-07-09T21:50:22.771300+0000","last_active":"2023-07-09T21:50:24.770485+0000","last_peered":"2023-07-09T21:50:24.770485+0000","last_clean":"2023-07-09T21:50:24.770485+0000","last_became_active":"2023-07-09T21:50:22.770639+0000","last_became_peered":"2023-07-09T21:50:22.770639+0000","last_unstale":"2023-07-09T21:50:24.770485+0000","last_undegraded":"2023-07-09T21:50:24.770485+0000","last_fullsized":"2023-07-09T21:50:24.770485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:29.580228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401889+0000","last_change":"2023-07-09T21:50:23.783801+0000","last_active":"2023-07-09T21:50:25.401889+0000","last_peered":"2023-07-09T21:50:25.401889+0000","last_clean":"2023-07-09T21:50:25.401889+0000","last_became_active":"2023-07-09T21:50:23.783545+0000","last_became_peered":"2023-07-09T21:50:23.783545+0000","last_unstale":"2023-07-09T21:50:25.401889+0000","last_undegraded":"2023-07-09T21:50:25.401889+0000","last_fullsized":"2023-07-09T21:50:25.401889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:44:36.986572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773224+0000","last_change":"2023-07-09T21:50:22.781881+0000","last_active":"2023-07-09T21:50:24.773224+0000","last_peered":"2023-07-09T21:50:24.773224+0000","last_clean":"2023-07-09T21:50:24.773224+0000","last_became_active":"2023-07-09T21:50:22.781553+0000","last_became_peered":"2023-07-09T21:50:22.781553+0000","last_unstale":"2023-07-09T21:50:24.773224+0000","last_undegraded":"2023-07-09T21:50:24.773224+0000","last_fullsized":"2023-07-09T21:50:24.773224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:32.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770398+0000","last_change":"2023-07-09T21:50:23.782080+0000","last_active":"2023-07-09T21:50:24.770398+0000","last_peered":"2023-07-09T21:50:24.770398+0000","last_clean":"2023-07-09T21:50:24.770398+0000","last_became_active":"2023-07-09T21:50:23.781769+0000","last_became_peered":"2023-07-09T21:50:23.781769+0000","last_unstale":"2023-07-09T21:50:24.770398+0000","last_undegraded":"2023-07-09T21:50:24.770398+0000","last_fullsized":"2023-07-09T21:50:24.770398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.148959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771796+0000","last_change":"2023-07-09T21:50:22.775466+0000","last_active":"2023-07-09T21:50:24.771796+0000","last_peered":"2023-07-09T21:50:24.771796+0000","last_clean":"2023-07-09T21:50:24.771796+0000","last_became_active":"2023-07-09T21:50:22.775189+0000","last_became_peered":"2023-07-09T21:50:22.775189+0000","last_unstale":"2023-07-09T21:50:24.771796+0000","last_undegraded":"2023-07-09T21:50:24.771796+0000","last_fullsized":"2023-07-09T21:50:24.771796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:29.580228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771009+0000","last_change":"2023-07-09T21:50:23.776973+0000","last_active":"2023-07-09T21:50:24.771009+0000","last_peered":"2023-07-09T21:50:24.771009+0000","last_clean":"2023-07-09T21:50:24.771009+0000","last_became_active":"2023-07-09T21:50:23.776468+0000","last_became_peered":"2023-07-09T21:50:23.776468+0000","last_unstale":"2023-07-09T21:50:24.771009+0000","last_undegraded":"2023-07-09T21:50:24.771009+0000","last_fullsized":"2023-07-09T21:50:24.771009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:54.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094368+0000","last_change":"2023-07-09T21:50:22.776755+0000","last_active":"2023-07-09T21:50:25.094368+0000","last_peered":"2023-07-09T21:50:25.094368+0000","last_clean":"2023-07-09T21:50:25.094368+0000","last_became_active":"2023-07-09T21:50:22.776393+0000","last_became_peered":"2023-07-09T21:50:22.776393+0000","last_unstale":"2023-07-09T21:50:25.094368+0000","last_undegraded":"2023-07-09T21:50:25.094368+0000","last_fullsized":"2023-07-09T21:50:25.094368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:15.389440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.787655+0000","last_change":"2023-07-09T21:50:23.781306+0000","last_active":"2023-07-09T21:50:23.787655+0000","last_peered":"2023-07-09T21:50:23.787655+0000","last_clean":"2023-07-09T21:50:23.787655+0000","last_became_active":"2023-07-09T21:50:23.781040+0000","last_became_peered":"2023-07-09T21:50:23.781040+0000","last_unstale":"2023-07-09T21:50:23.787655+0000","last_undegraded":"2023-07-09T21:50:23.787655+0000","last_fullsized":"2023-07-09T21:50:23.787655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:24:58.710922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.818016+0000","last_change":"2023-07-09T21:50:22.778707+0000","last_active":"2023-07-09T21:50:23.818016+0000","last_peered":"2023-07-09T21:50:23.818016+0000","last_clean":"2023-07-09T21:50:23.818016+0000","last_became_active":"2023-07-09T21:50:22.778397+0000","last_became_peered":"2023-07-09T21:50:22.778397+0000","last_unstale":"2023-07-09T21:50:23.818016+0000","last_undegraded":"2023-07-09T21:50:23.818016+0000","last_fullsized":"2023-07-09T21:50:23.818016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:30:44.360848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801947+0000","last_change":"2023-07-09T21:50:23.793887+0000","last_active":"2023-07-09T21:50:23.801947+0000","last_peered":"2023-07-09T21:50:23.801947+0000","last_clean":"2023-07-09T21:50:23.801947+0000","last_became_active":"2023-07-09T21:50:23.793626+0000","last_became_peered":"2023-07-09T21:50:23.793626+0000","last_unstale":"2023-07-09T21:50:23.801947+0000","last_undegraded":"2023-07-09T21:50:23.801947+0000","last_fullsized":"2023-07-09T21:50:23.801947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:05.934271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094228+0000","last_change":"2023-07-09T21:50:22.781947+0000","last_active":"2023-07-09T21:50:25.094228+0000","last_peered":"2023-07-09T21:50:25.094228+0000","last_clean":"2023-07-09T21:50:25.094228+0000","last_became_active":"2023-07-09T21:50:22.780676+0000","last_became_peered":"2023-07-09T21:50:22.780676+0000","last_unstale":"2023-07-09T21:50:25.094228+0000","last_undegraded":"2023-07-09T21:50:25.094228+0000","last_fullsized":"2023-07-09T21:50:25.094228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:47:53.248634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770793+0000","last_change":"2023-07-09T21:50:23.788674+0000","last_active":"2023-07-09T21:50:24.770793+0000","last_peered":"2023-07-09T21:50:24.770793+0000","last_clean":"2023-07-09T21:50:24.770793+0000","last_became_active":"2023-07-09T21:50:23.788306+0000","last_became_peered":"2023-07-09T21:50:23.788306+0000","last_unstale":"2023-07-09T21:50:24.770793+0000","last_undegraded":"2023-07-09T21:50:24.770793+0000","last_fullsized":"2023-07-09T21:50:24.770793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771654+0000","last_change":"2023-07-09T21:50:22.777294+0000","last_active":"2023-07-09T21:50:24.771654+0000","last_peered":"2023-07-09T21:50:24.771654+0000","last_clean":"2023-07-09T21:50:24.771654+0000","last_became_active":"2023-07-09T21:50:22.776308+0000","last_became_peered":"2023-07-09T21:50:22.776308+0000","last_unstale":"2023-07-09T21:50:24.771654+0000","last_undegraded":"2023-07-09T21:50:24.771654+0000","last_fullsized":"2023-07-09T21:50:24.771654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:10.488382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771772+0000","last_change":"2023-07-09T21:50:23.782217+0000","last_active":"2023-07-09T21:50:24.771772+0000","last_peered":"2023-07-09T21:50:24.771772+0000","last_clean":"2023-07-09T21:50:24.771772+0000","last_became_active":"2023-07-09T21:50:23.781948+0000","last_became_peered":"2023-07-09T21:50:23.781948+0000","last_unstale":"2023-07-09T21:50:24.771772+0000","last_undegraded":"2023-07-09T21:50:24.771772+0000","last_fullsized":"2023-07-09T21:50:24.771772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094393+0000","last_change":"2023-07-09T21:50:22.780710+0000","last_active":"2023-07-09T21:50:25.094393+0000","last_peered":"2023-07-09T21:50:25.094393+0000","last_clean":"2023-07-09T21:50:25.094393+0000","last_became_active":"2023-07-09T21:50:22.780392+0000","last_became_peered":"2023-07-09T21:50:22.780392+0000","last_unstale":"2023-07-09T21:50:25.094393+0000","last_undegraded":"2023-07-09T21:50:25.094393+0000","last_fullsized":"2023-07-09T21:50:25.094393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:08.834959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773173+0000","last_change":"2023-07-09T21:50:23.803234+0000","last_active":"2023-07-09T21:50:24.773173+0000","last_peered":"2023-07-09T21:50:24.773173+0000","last_clean":"2023-07-09T21:50:24.773173+0000","last_became_active":"2023-07-09T21:50:23.802407+0000","last_became_peered":"2023-07-09T21:50:23.802407+0000","last_unstale":"2023-07-09T21:50:24.773173+0000","last_undegraded":"2023-07-09T21:50:24.773173+0000","last_fullsized":"2023-07-09T21:50:24.773173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:06.551761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401477+0000","last_change":"2023-07-09T21:50:22.770920+0000","last_active":"2023-07-09T21:50:25.401477+0000","last_peered":"2023-07-09T21:50:25.401477+0000","last_clean":"2023-07-09T21:50:25.401477+0000","last_became_active":"2023-07-09T21:50:22.770566+0000","last_became_peered":"2023-07-09T21:50:22.770566+0000","last_unstale":"2023-07-09T21:50:25.401477+0000","last_undegraded":"2023-07-09T21:50:25.401477+0000","last_fullsized":"2023-07-09T21:50:25.401477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:06.181402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771083+0000","last_change":"2023-07-09T21:50:23.786089+0000","last_active":"2023-07-09T21:50:24.771083+0000","last_peered":"2023-07-09T21:50:24.771083+0000","last_clean":"2023-07-09T21:50:24.771083+0000","last_became_active":"2023-07-09T21:50:23.785827+0000","last_became_peered":"2023-07-09T21:50:23.785827+0000","last_unstale":"2023-07-09T21:50:24.771083+0000","last_undegraded":"2023-07-09T21:50:24.771083+0000","last_fullsized":"2023-07-09T21:50:24.771083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:16.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094687+0000","last_change":"2023-07-09T21:50:22.781469+0000","last_active":"2023-07-09T21:50:25.094687+0000","last_peered":"2023-07-09T21:50:25.094687+0000","last_clean":"2023-07-09T21:50:25.094687+0000","last_became_active":"2023-07-09T21:50:22.781215+0000","last_became_peered":"2023-07-09T21:50:22.781215+0000","last_unstale":"2023-07-09T21:50:25.094687+0000","last_undegraded":"2023-07-09T21:50:25.094687+0000","last_fullsized":"2023-07-09T21:50:25.094687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:41:06.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771366+0000","last_change":"2023-07-09T21:50:23.781500+0000","last_active":"2023-07-09T21:50:24.771366+0000","last_peered":"2023-07-09T21:50:24.771366+0000","last_clean":"2023-07-09T21:50:24.771366+0000","last_became_active":"2023-07-09T21:50:23.781247+0000","last_became_peered":"2023-07-09T21:50:23.781247+0000","last_unstale":"2023-07-09T21:50:24.771366+0000","last_undegraded":"2023-07-09T21:50:24.771366+0000","last_fullsized":"2023-07-09T21:50:24.771366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:25.755232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094343+0000","last_change":"2023-07-09T21:50:22.780841+0000","last_active":"2023-07-09T21:50:25.094343+0000","last_peered":"2023-07-09T21:50:25.094343+0000","last_clean":"2023-07-09T21:50:25.094343+0000","last_became_active":"2023-07-09T21:50:22.780287+0000","last_became_peered":"2023-07-09T21:50:22.780287+0000","last_unstale":"2023-07-09T21:50:25.094343+0000","last_undegraded":"2023-07-09T21:50:25.094343+0000","last_fullsized":"2023-07-09T21:50:25.094343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:53.307790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802245+0000","last_change":"2023-07-09T21:50:23.794825+0000","last_active":"2023-07-09T21:50:23.802245+0000","last_peered":"2023-07-09T21:50:23.802245+0000","last_clean":"2023-07-09T21:50:23.802245+0000","last_became_active":"2023-07-09T21:50:23.794372+0000","last_became_peered":"2023-07-09T21:50:23.794372+0000","last_unstale":"2023-07-09T21:50:23.802245+0000","last_undegraded":"2023-07-09T21:50:23.802245+0000","last_fullsized":"2023-07-09T21:50:23.802245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:07.185673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094667+0000","last_change":"2023-07-09T21:50:22.782310+0000","last_active":"2023-07-09T21:50:25.094667+0000","last_peered":"2023-07-09T21:50:25.094667+0000","last_clean":"2023-07-09T21:50:25.094667+0000","last_became_active":"2023-07-09T21:50:22.782041+0000","last_became_peered":"2023-07-09T21:50:22.782041+0000","last_unstale":"2023-07-09T21:50:25.094667+0000","last_undegraded":"2023-07-09T21:50:25.094667+0000","last_fullsized":"2023-07-09T21:50:25.094667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:11:23.436562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401729+0000","last_change":"2023-07-09T21:50:23.789564+0000","last_active":"2023-07-09T21:50:25.401729+0000","last_peered":"2023-07-09T21:50:25.401729+0000","last_clean":"2023-07-09T21:50:25.401729+0000","last_became_active":"2023-07-09T21:50:23.789320+0000","last_became_peered":"2023-07-09T21:50:23.789320+0000","last_unstale":"2023-07-09T21:50:25.401729+0000","last_undegraded":"2023-07-09T21:50:25.401729+0000","last_fullsized":"2023-07-09T21:50:25.401729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:05.934271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771882+0000","last_change":"2023-07-09T21:50:22.769028+0000","last_active":"2023-07-09T21:50:24.771882+0000","last_peered":"2023-07-09T21:50:24.771882+0000","last_clean":"2023-07-09T21:50:24.771882+0000","last_became_active":"2023-07-09T21:50:22.768697+0000","last_became_peered":"2023-07-09T21:50:22.768697+0000","last_unstale":"2023-07-09T21:50:24.771882+0000","last_undegraded":"2023-07-09T21:50:24.771882+0000","last_fullsized":"2023-07-09T21:50:24.771882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:12.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773064+0000","last_change":"2023-07-09T21:50:23.792126+0000","last_active":"2023-07-09T21:50:24.773064+0000","last_peered":"2023-07-09T21:50:24.773064+0000","last_clean":"2023-07-09T21:50:24.773064+0000","last_became_active":"2023-07-09T21:50:23.790182+0000","last_became_peered":"2023-07-09T21:50:23.790182+0000","last_unstale":"2023-07-09T21:50:24.773064+0000","last_undegraded":"2023-07-09T21:50:24.773064+0000","last_fullsized":"2023-07-09T21:50:24.773064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770745+0000","last_change":"2023-07-09T21:50:22.769216+0000","last_active":"2023-07-09T21:50:24.770745+0000","last_peered":"2023-07-09T21:50:24.770745+0000","last_clean":"2023-07-09T21:50:24.770745+0000","last_became_active":"2023-07-09T21:50:22.768893+0000","last_became_peered":"2023-07-09T21:50:22.768893+0000","last_unstale":"2023-07-09T21:50:24.770745+0000","last_undegraded":"2023-07-09T21:50:24.770745+0000","last_fullsized":"2023-07-09T21:50:24.770745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:32.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801774+0000","last_change":"2023-07-09T21:50:23.790525+0000","last_active":"2023-07-09T21:50:23.801774+0000","last_peered":"2023-07-09T21:50:23.801774+0000","last_clean":"2023-07-09T21:50:23.801774+0000","last_became_active":"2023-07-09T21:50:23.790164+0000","last_became_peered":"2023-07-09T21:50:23.790164+0000","last_unstale":"2023-07-09T21:50:23.801774+0000","last_undegraded":"2023-07-09T21:50:23.801774+0000","last_fullsized":"2023-07-09T21:50:23.801774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:51.439253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401701+0000","last_change":"2023-07-09T21:50:22.779742+0000","last_active":"2023-07-09T21:50:25.401701+0000","last_peered":"2023-07-09T21:50:25.401701+0000","last_clean":"2023-07-09T21:50:25.401701+0000","last_became_active":"2023-07-09T21:50:22.779462+0000","last_became_peered":"2023-07-09T21:50:22.779462+0000","last_unstale":"2023-07-09T21:50:25.401701+0000","last_undegraded":"2023-07-09T21:50:25.401701+0000","last_fullsized":"2023-07-09T21:50:25.401701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:34.301244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802010+0000","last_change":"2023-07-09T21:50:23.793928+0000","last_active":"2023-07-09T21:50:23.802010+0000","last_peered":"2023-07-09T21:50:23.802010+0000","last_clean":"2023-07-09T21:50:23.802010+0000","last_became_active":"2023-07-09T21:50:23.793620+0000","last_became_peered":"2023-07-09T21:50:23.793620+0000","last_unstale":"2023-07-09T21:50:23.802010+0000","last_undegraded":"2023-07-09T21:50:23.802010+0000","last_fullsized":"2023-07-09T21:50:23.802010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:50.693532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.781593+0000","last_change":"2023-07-09T21:50:22.772850+0000","last_active":"2023-07-09T21:50:23.781593+0000","last_peered":"2023-07-09T21:50:23.781593+0000","last_clean":"2023-07-09T21:50:23.781593+0000","last_became_active":"2023-07-09T21:50:22.772522+0000","last_became_peered":"2023-07-09T21:50:22.772522+0000","last_unstale":"2023-07-09T21:50:23.781593+0000","last_undegraded":"2023-07-09T21:50:23.781593+0000","last_fullsized":"2023-07-09T21:50:23.781593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:32:07.041518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802085+0000","last_change":"2023-07-09T21:50:23.787502+0000","last_active":"2023-07-09T21:50:23.802085+0000","last_peered":"2023-07-09T21:50:23.802085+0000","last_clean":"2023-07-09T21:50:23.802085+0000","last_became_active":"2023-07-09T21:50:23.786685+0000","last_became_peered":"2023-07-09T21:50:23.786685+0000","last_unstale":"2023-07-09T21:50:23.802085+0000","last_undegraded":"2023-07-09T21:50:23.802085+0000","last_fullsized":"2023-07-09T21:50:23.802085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:05.764849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770315+0000","last_change":"2023-07-09T21:50:22.769583+0000","last_active":"2023-07-09T21:50:24.770315+0000","last_peered":"2023-07-09T21:50:24.770315+0000","last_clean":"2023-07-09T21:50:24.770315+0000","last_became_active":"2023-07-09T21:50:22.768169+0000","last_became_peered":"2023-07-09T21:50:22.768169+0000","last_unstale":"2023-07-09T21:50:24.770315+0000","last_undegraded":"2023-07-09T21:50:24.770315+0000","last_fullsized":"2023-07-09T21:50:24.770315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:24.750960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790139+0000","last_change":"2023-07-09T21:50:23.784726+0000","last_active":"2023-07-09T21:50:23.790139+0000","last_peered":"2023-07-09T21:50:23.790139+0000","last_clean":"2023-07-09T21:50:23.790139+0000","last_became_active":"2023-07-09T21:50:23.777193+0000","last_became_peered":"2023-07-09T21:50:23.777193+0000","last_unstale":"2023-07-09T21:50:23.790139+0000","last_undegraded":"2023-07-09T21:50:23.790139+0000","last_fullsized":"2023-07-09T21:50:23.790139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:34.646316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.779148+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:50:23.779148+0000","last_peered":"2023-07-09T21:50:23.779148+0000","last_clean":"2023-07-09T21:50:23.779148+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:50:23.779148+0000","last_undegraded":"2023-07-09T21:50:23.779148+0000","last_fullsized":"2023-07-09T21:50:23.779148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:35:50.473268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771985+0000","last_change":"2023-07-09T21:50:22.772281+0000","last_active":"2023-07-09T21:50:24.771985+0000","last_peered":"2023-07-09T21:50:24.771985+0000","last_clean":"2023-07-09T21:50:24.771985+0000","last_became_active":"2023-07-09T21:50:22.769167+0000","last_became_peered":"2023-07-09T21:50:22.769167+0000","last_unstale":"2023-07-09T21:50:24.771985+0000","last_undegraded":"2023-07-09T21:50:24.771985+0000","last_fullsized":"2023-07-09T21:50:24.771985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:05.547490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.787677+0000","last_change":"2023-07-09T21:50:23.783723+0000","last_active":"2023-07-09T21:50:23.787677+0000","last_peered":"2023-07-09T21:50:23.787677+0000","last_clean":"2023-07-09T21:50:23.787677+0000","last_became_active":"2023-07-09T21:50:23.783453+0000","last_became_peered":"2023-07-09T21:50:23.783453+0000","last_unstale":"2023-07-09T21:50:23.787677+0000","last_undegraded":"2023-07-09T21:50:23.787677+0000","last_fullsized":"2023-07-09T21:50:23.787677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:42:06.075539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771999+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:50:24.771999+0000","last_peered":"2023-07-09T21:50:24.771999+0000","last_clean":"2023-07-09T21:50:24.771999+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:50:24.771999+0000","last_undegraded":"2023-07-09T21:50:24.771999+0000","last_fullsized":"2023-07-09T21:50:24.771999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:48.089970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.779267+0000","last_change":"2023-07-09T21:50:22.778044+0000","last_active":"2023-07-09T21:50:23.779267+0000","last_peered":"2023-07-09T21:50:23.779267+0000","last_clean":"2023-07-09T21:50:23.779267+0000","last_became_active":"2023-07-09T21:50:22.777708+0000","last_became_peered":"2023-07-09T21:50:22.777708+0000","last_unstale":"2023-07-09T21:50:23.779267+0000","last_undegraded":"2023-07-09T21:50:23.779267+0000","last_fullsized":"2023-07-09T21:50:23.779267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:23.785505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.787438+0000","last_change":"2023-07-09T21:50:23.780850+0000","last_active":"2023-07-09T21:50:23.787438+0000","last_peered":"2023-07-09T21:50:23.787438+0000","last_clean":"2023-07-09T21:50:23.787438+0000","last_became_active":"2023-07-09T21:50:23.780529+0000","last_became_peered":"2023-07-09T21:50:23.780529+0000","last_unstale":"2023-07-09T21:50:23.787438+0000","last_undegraded":"2023-07-09T21:50:23.787438+0000","last_fullsized":"2023-07-09T21:50:23.787438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:10.298327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401178+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:50:25.401178+0000","last_peered":"2023-07-09T21:50:25.401178+0000","last_clean":"2023-07-09T21:50:25.401178+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:50:25.401178+0000","last_undegraded":"2023-07-09T21:50:25.401178+0000","last_fullsized":"2023-07-09T21:50:25.401178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:57:32.051923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.777557+0000","last_change":"2023-07-09T21:50:22.774908+0000","last_active":"2023-07-09T21:50:23.777557+0000","last_peered":"2023-07-09T21:50:23.777557+0000","last_clean":"2023-07-09T21:50:23.777557+0000","last_became_active":"2023-07-09T21:50:22.774600+0000","last_became_peered":"2023-07-09T21:50:22.774600+0000","last_unstale":"2023-07-09T21:50:23.777557+0000","last_undegraded":"2023-07-09T21:50:23.777557+0000","last_fullsized":"2023-07-09T21:50:23.777557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:08:56.300464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.790176+0000","last_change":"2023-07-09T21:50:23.786034+0000","last_active":"2023-07-09T21:50:23.790176+0000","last_peered":"2023-07-09T21:50:23.790176+0000","last_clean":"2023-07-09T21:50:23.790176+0000","last_became_active":"2023-07-09T21:50:23.785763+0000","last_became_peered":"2023-07-09T21:50:23.785763+0000","last_unstale":"2023-07-09T21:50:23.790176+0000","last_undegraded":"2023-07-09T21:50:23.790176+0000","last_fullsized":"2023-07-09T21:50:23.790176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:20:36.952568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771488+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:50:24.771488+0000","last_peered":"2023-07-09T21:50:24.771488+0000","last_clean":"2023-07-09T21:50:24.771488+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:50:24.771488+0000","last_undegraded":"2023-07-09T21:50:24.771488+0000","last_fullsized":"2023-07-09T21:50:24.771488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:00.619257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094325+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:50:25.094325+0000","last_peered":"2023-07-09T21:50:25.094325+0000","last_clean":"2023-07-09T21:50:25.094325+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:50:25.094325+0000","last_undegraded":"2023-07-09T21:50:25.094325+0000","last_fullsized":"2023-07-09T21:50:25.094325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:21:03.421360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770620+0000","last_change":"2023-07-09T21:50:22.766454+0000","last_active":"2023-07-09T21:50:24.770620+0000","last_peered":"2023-07-09T21:50:24.770620+0000","last_clean":"2023-07-09T21:50:24.770620+0000","last_became_active":"2023-07-09T21:50:22.766057+0000","last_became_peered":"2023-07-09T21:50:22.766057+0000","last_unstale":"2023-07-09T21:50:24.770620+0000","last_undegraded":"2023-07-09T21:50:24.770620+0000","last_fullsized":"2023-07-09T21:50:24.770620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:05.837076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401812+0000","last_change":"2023-07-09T21:50:23.795134+0000","last_active":"2023-07-09T21:50:25.401812+0000","last_peered":"2023-07-09T21:50:25.401812+0000","last_clean":"2023-07-09T21:50:25.401812+0000","last_became_active":"2023-07-09T21:50:23.794914+0000","last_became_peered":"2023-07-09T21:50:23.794914+0000","last_unstale":"2023-07-09T21:50:25.401812+0000","last_undegraded":"2023-07-09T21:50:25.401812+0000","last_fullsized":"2023-07-09T21:50:25.401812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:50.693532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094581+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:50:25.094581+0000","last_peered":"2023-07-09T21:50:25.094581+0000","last_clean":"2023-07-09T21:50:25.094581+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:50:25.094581+0000","last_undegraded":"2023-07-09T21:50:25.094581+0000","last_fullsized":"2023-07-09T21:50:25.094581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:13.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771706+0000","last_change":"2023-07-09T21:50:22.777350+0000","last_active":"2023-07-09T21:50:24.771706+0000","last_peered":"2023-07-09T21:50:24.771706+0000","last_clean":"2023-07-09T21:50:24.771706+0000","last_became_active":"2023-07-09T21:50:22.776974+0000","last_became_peered":"2023-07-09T21:50:22.776974+0000","last_unstale":"2023-07-09T21:50:24.771706+0000","last_undegraded":"2023-07-09T21:50:24.771706+0000","last_fullsized":"2023-07-09T21:50:24.771706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:32.888530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773336+0000","last_change":"2023-07-09T21:50:23.801310+0000","last_active":"2023-07-09T21:50:24.773336+0000","last_peered":"2023-07-09T21:50:24.773336+0000","last_clean":"2023-07-09T21:50:24.773336+0000","last_became_active":"2023-07-09T21:50:23.798687+0000","last_became_peered":"2023-07-09T21:50:23.798687+0000","last_unstale":"2023-07-09T21:50:24.773336+0000","last_undegraded":"2023-07-09T21:50:24.773336+0000","last_fullsized":"2023-07-09T21:50:24.773336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:54.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094422+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:50:25.094422+0000","last_peered":"2023-07-09T21:50:25.094422+0000","last_clean":"2023-07-09T21:50:25.094422+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:50:25.094422+0000","last_undegraded":"2023-07-09T21:50:25.094422+0000","last_fullsized":"2023-07-09T21:50:25.094422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:19:53.960138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.779375+0000","last_change":"2023-07-09T21:50:22.774621+0000","last_active":"2023-07-09T21:50:23.779375+0000","last_peered":"2023-07-09T21:50:23.779375+0000","last_clean":"2023-07-09T21:50:23.779375+0000","last_became_active":"2023-07-09T21:50:22.774322+0000","last_became_peered":"2023-07-09T21:50:22.774322+0000","last_unstale":"2023-07-09T21:50:23.779375+0000","last_undegraded":"2023-07-09T21:50:23.779375+0000","last_fullsized":"2023-07-09T21:50:23.779375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:49.341701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772919+0000","last_change":"2023-07-09T21:50:23.793311+0000","last_active":"2023-07-09T21:50:24.772919+0000","last_peered":"2023-07-09T21:50:24.772919+0000","last_clean":"2023-07-09T21:50:24.772919+0000","last_became_active":"2023-07-09T21:50:23.792913+0000","last_became_peered":"2023-07-09T21:50:23.792913+0000","last_unstale":"2023-07-09T21:50:24.772919+0000","last_undegraded":"2023-07-09T21:50:24.772919+0000","last_fullsized":"2023-07-09T21:50:24.772919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:36.978787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771232+0000","last_change":"2023-07-09T21:50:22.775713+0000","last_active":"2023-07-09T21:50:24.771232+0000","last_peered":"2023-07-09T21:50:24.771232+0000","last_clean":"2023-07-09T21:50:24.771232+0000","last_became_active":"2023-07-09T21:50:22.775420+0000","last_became_peered":"2023-07-09T21:50:22.775420+0000","last_unstale":"2023-07-09T21:50:24.771232+0000","last_undegraded":"2023-07-09T21:50:24.771232+0000","last_fullsized":"2023-07-09T21:50:24.771232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:47:53.248634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.778529+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:50:23.778529+0000","last_peered":"2023-07-09T21:50:23.778529+0000","last_clean":"2023-07-09T21:50:23.778529+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:50:23.778529+0000","last_undegraded":"2023-07-09T21:50:23.778529+0000","last_fullsized":"2023-07-09T21:50:23.778529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:28:48.759912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770239+0000","last_change":"2023-07-09T21:50:23.787661+0000","last_active":"2023-07-09T21:50:24.770239+0000","last_peered":"2023-07-09T21:50:24.770239+0000","last_clean":"2023-07-09T21:50:24.770239+0000","last_became_active":"2023-07-09T21:50:23.787366+0000","last_became_peered":"2023-07-09T21:50:23.787366+0000","last_unstale":"2023-07-09T21:50:24.770239+0000","last_undegraded":"2023-07-09T21:50:24.770239+0000","last_fullsized":"2023-07-09T21:50:24.770239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:33.892801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401827+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:50:25.401827+0000","last_peered":"2023-07-09T21:50:25.401827+0000","last_clean":"2023-07-09T21:50:25.401827+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:50:25.401827+0000","last_undegraded":"2023-07-09T21:50:25.401827+0000","last_fullsized":"2023-07-09T21:50:25.401827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:32:01.823699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773325+0000","last_change":"2023-07-09T21:50:22.772687+0000","last_active":"2023-07-09T21:50:24.773325+0000","last_peered":"2023-07-09T21:50:24.773325+0000","last_clean":"2023-07-09T21:50:24.773325+0000","last_became_active":"2023-07-09T21:50:22.772342+0000","last_became_peered":"2023-07-09T21:50:22.772342+0000","last_unstale":"2023-07-09T21:50:24.773325+0000","last_undegraded":"2023-07-09T21:50:24.773325+0000","last_fullsized":"2023-07-09T21:50:24.773325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.802227+0000","last_change":"2023-07-09T21:50:23.794661+0000","last_active":"2023-07-09T21:50:23.802227+0000","last_peered":"2023-07-09T21:50:23.802227+0000","last_clean":"2023-07-09T21:50:23.802227+0000","last_became_active":"2023-07-09T21:50:23.794107+0000","last_became_peered":"2023-07-09T21:50:23.794107+0000","last_unstale":"2023-07-09T21:50:23.802227+0000","last_undegraded":"2023-07-09T21:50:23.802227+0000","last_fullsized":"2023-07-09T21:50:23.802227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:35.305515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772952+0000","last_change":"2023-07-09T21:50:22.779822+0000","last_active":"2023-07-09T21:50:24.772952+0000","last_peered":"2023-07-09T21:50:24.772952+0000","last_clean":"2023-07-09T21:50:24.772952+0000","last_became_active":"2023-07-09T21:50:22.779595+0000","last_became_peered":"2023-07-09T21:50:22.779595+0000","last_unstale":"2023-07-09T21:50:24.772952+0000","last_undegraded":"2023-07-09T21:50:24.772952+0000","last_fullsized":"2023-07-09T21:50:24.772952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:37.144688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401494+0000","last_change":"2023-07-09T21:50:23.786609+0000","last_active":"2023-07-09T21:50:25.401494+0000","last_peered":"2023-07-09T21:50:25.401494+0000","last_clean":"2023-07-09T21:50:25.401494+0000","last_became_active":"2023-07-09T21:50:23.785938+0000","last_became_peered":"2023-07-09T21:50:23.785938+0000","last_unstale":"2023-07-09T21:50:25.401494+0000","last_undegraded":"2023-07-09T21:50:25.401494+0000","last_fullsized":"2023-07-09T21:50:25.401494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771497+0000","last_change":"2023-07-09T21:50:22.772154+0000","last_active":"2023-07-09T21:50:24.771497+0000","last_peered":"2023-07-09T21:50:24.771497+0000","last_clean":"2023-07-09T21:50:24.771497+0000","last_became_active":"2023-07-09T21:50:22.771882+0000","last_became_peered":"2023-07-09T21:50:22.771882+0000","last_unstale":"2023-07-09T21:50:24.771497+0000","last_undegraded":"2023-07-09T21:50:24.771497+0000","last_fullsized":"2023-07-09T21:50:24.771497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:35.974516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801927+0000","last_change":"2023-07-09T21:50:23.793009+0000","last_active":"2023-07-09T21:50:23.801927+0000","last_peered":"2023-07-09T21:50:23.801927+0000","last_clean":"2023-07-09T21:50:23.801927+0000","last_became_active":"2023-07-09T21:50:23.791995+0000","last_became_peered":"2023-07-09T21:50:23.791995+0000","last_unstale":"2023-07-09T21:50:23.801927+0000","last_undegraded":"2023-07-09T21:50:23.801927+0000","last_fullsized":"2023-07-09T21:50:23.801927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:40.779031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772036+0000","last_change":"2023-07-09T21:50:22.772972+0000","last_active":"2023-07-09T21:50:24.772036+0000","last_peered":"2023-07-09T21:50:24.772036+0000","last_clean":"2023-07-09T21:50:24.772036+0000","last_became_active":"2023-07-09T21:50:22.772647+0000","last_became_peered":"2023-07-09T21:50:22.772647+0000","last_unstale":"2023-07-09T21:50:24.772036+0000","last_undegraded":"2023-07-09T21:50:24.772036+0000","last_fullsized":"2023-07-09T21:50:24.772036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.801973+0000","last_change":"2023-07-09T21:50:23.790945+0000","last_active":"2023-07-09T21:50:23.801973+0000","last_peered":"2023-07-09T21:50:23.801973+0000","last_clean":"2023-07-09T21:50:23.801973+0000","last_became_active":"2023-07-09T21:50:23.790660+0000","last_became_peered":"2023-07-09T21:50:23.790660+0000","last_unstale":"2023-07-09T21:50:23.801973+0000","last_undegraded":"2023-07-09T21:50:23.801973+0000","last_fullsized":"2023-07-09T21:50:23.801973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:43.247529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770852+0000","last_change":"2023-07-09T21:50:22.770573+0000","last_active":"2023-07-09T21:50:24.770852+0000","last_peered":"2023-07-09T21:50:24.770852+0000","last_clean":"2023-07-09T21:50:24.770852+0000","last_became_active":"2023-07-09T21:50:22.770263+0000","last_became_peered":"2023-07-09T21:50:22.770263+0000","last_unstale":"2023-07-09T21:50:24.770852+0000","last_undegraded":"2023-07-09T21:50:24.770852+0000","last_fullsized":"2023-07-09T21:50:24.770852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770370+0000","last_change":"2023-07-09T21:50:23.791092+0000","last_active":"2023-07-09T21:50:24.770370+0000","last_peered":"2023-07-09T21:50:24.770370+0000","last_clean":"2023-07-09T21:50:24.770370+0000","last_became_active":"2023-07-09T21:50:23.789631+0000","last_became_peered":"2023-07-09T21:50:23.789631+0000","last_unstale":"2023-07-09T21:50:24.770370+0000","last_undegraded":"2023-07-09T21:50:24.770370+0000","last_fullsized":"2023-07-09T21:50:24.770370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:36.978787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773272+0000","last_change":"2023-07-09T21:50:22.776290+0000","last_active":"2023-07-09T21:50:24.773272+0000","last_peered":"2023-07-09T21:50:24.773272+0000","last_clean":"2023-07-09T21:50:24.773272+0000","last_became_active":"2023-07-09T21:50:22.775873+0000","last_became_peered":"2023-07-09T21:50:22.775873+0000","last_unstale":"2023-07-09T21:50:24.773272+0000","last_undegraded":"2023-07-09T21:50:24.773272+0000","last_fullsized":"2023-07-09T21:50:24.773272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:26.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.797500+0000","last_change":"2023-07-09T21:50:23.787350+0000","last_active":"2023-07-09T21:50:23.797500+0000","last_peered":"2023-07-09T21:50:23.797500+0000","last_clean":"2023-07-09T21:50:23.797500+0000","last_became_active":"2023-07-09T21:50:23.787079+0000","last_became_peered":"2023-07-09T21:50:23.787079+0000","last_unstale":"2023-07-09T21:50:23.797500+0000","last_undegraded":"2023-07-09T21:50:23.797500+0000","last_fullsized":"2023-07-09T21:50:23.797500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:07:12.088130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401659+0000","last_change":"2023-07-09T21:50:23.783603+0000","last_active":"2023-07-09T21:50:25.401659+0000","last_peered":"2023-07-09T21:50:25.401659+0000","last_clean":"2023-07-09T21:50:25.401659+0000","last_became_active":"2023-07-09T21:50:23.781930+0000","last_became_peered":"2023-07-09T21:50:23.781930+0000","last_unstale":"2023-07-09T21:50:25.401659+0000","last_undegraded":"2023-07-09T21:50:25.401659+0000","last_fullsized":"2023-07-09T21:50:25.401659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770323+0000","last_change":"2023-07-09T21:50:23.788879+0000","last_active":"2023-07-09T21:50:24.770323+0000","last_peered":"2023-07-09T21:50:24.770323+0000","last_clean":"2023-07-09T21:50:24.770323+0000","last_became_active":"2023-07-09T21:50:23.788458+0000","last_became_peered":"2023-07-09T21:50:23.788458+0000","last_unstale":"2023-07-09T21:50:24.770323+0000","last_undegraded":"2023-07-09T21:50:24.770323+0000","last_fullsized":"2023-07-09T21:50:24.770323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.797393+0000","last_change":"2023-07-09T21:50:23.787304+0000","last_active":"2023-07-09T21:50:23.797393+0000","last_peered":"2023-07-09T21:50:23.797393+0000","last_clean":"2023-07-09T21:50:23.797393+0000","last_became_active":"2023-07-09T21:50:23.787022+0000","last_became_peered":"2023-07-09T21:50:23.787022+0000","last_unstale":"2023-07-09T21:50:23.797393+0000","last_undegraded":"2023-07-09T21:50:23.797393+0000","last_fullsized":"2023-07-09T21:50:23.797393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:57:38.274013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770719+0000","last_change":"2023-07-09T21:50:23.785978+0000","last_active":"2023-07-09T21:50:24.770719+0000","last_peered":"2023-07-09T21:50:24.770719+0000","last_clean":"2023-07-09T21:50:24.770719+0000","last_became_active":"2023-07-09T21:50:23.785694+0000","last_became_peered":"2023-07-09T21:50:23.785694+0000","last_unstale":"2023-07-09T21:50:24.770719+0000","last_undegraded":"2023-07-09T21:50:24.770719+0000","last_fullsized":"2023-07-09T21:50:24.770719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:13.602484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T21:50:23.783621+0000","last_change":"2023-07-09T21:50:23.780066+0000","last_active":"2023-07-09T21:50:23.783621+0000","last_peered":"2023-07-09T21:50:23.783621+0000","last_clean":"2023-07-09T21:50:23.783621+0000","last_became_active":"2023-07-09T21:50:23.779691+0000","last_became_peered":"2023-07-09T21:50:23.779691+0000","last_unstale":"2023-07-09T21:50:23.783621+0000","last_undegraded":"2023-07-09T21:50:23.783621+0000","last_fullsized":"2023-07-09T21:50:23.783621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:51:58.642076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":83224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":83224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":97005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":856064,"data_stored":687955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":880640,"data_stored":689153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":97095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":97657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":97005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:50:33.232 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:50:33.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.441+0000 7f00cf7ff700 1 Processor -- start 2023-07-09T21:50:33.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.441+0000 7f00cf7ff700 1 -- start start 2023-07-09T21:50:33.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.442+0000 7f00cf7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c80d1220 0x7f00c80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.442+0000 7f00cf7ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c80d2ce0 con 0x7f00c80b2350 2023-07-09T21:50:33.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.442+0000 7f00cf7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c80b3350 con 0x7f00c80b1e00 2023-07-09T21:50:33.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.442+0000 7f00cf7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80b3630 con 0x7f00c80d1220 2023-07-09T21:50:33.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00cdd9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f00c80b2350 0x7f00c80afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56172/0 (socket says 172.21.15.53:56172) 2023-07-09T21:50:33.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00cdd9c700 1 -- 172.21.15.53:0/2197563952 learned_addr learned my addr 172.21.15.53:0/2197563952 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:33.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00ccd9a700 1 --2- 172.21.15.53:0/2197563952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c80d1220 0x7f00c80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:33.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248010413 0 0) 0x7f00c80d2ce0 con 0x7f00c80b2350 2023-07-09T21:50:33.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b40035b0 con 0x7f00c80b2350 2023-07-09T21:50:33.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242408516 0 0) 0x7f00c80b3350 con 0x7f00c80b1e00 2023-07-09T21:50:33.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c80d2ce0 con 0x7f00c80b1e00 2023-07-09T21:50:33.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2102733653 0 0) 0x7f00b40035b0 con 0x7f00c80b2350 2023-07-09T21:50:33.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c80d1220 msgr2=0x7f00c80b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:33.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00bffff700 1 --2- 172.21.15.53:0/2197563952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c80d1220 0x7f00c80b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 >> v1:172.21.15.184:6789/0 conn(0x7f00c80b1e00 legacy=0x7f00c80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:33.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c80b3910 con 0x7f00c80b2350 2023-07-09T21:50:33.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f00c00019f0 con 0x7f00c80b2350 2023-07-09T21:50:33.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 >> v1:172.21.15.53:6789/0 conn(0x7f00c80b2350 legacy=0x7f00c80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:33.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00bffff700 1 --2- 172.21.15.53:0/2197563952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00b4003bc0 0x7f00b4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.443+0000 7f00bffff700 1 --2- 172.21.15.53:0/2197563952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b4004850 0x7f00b4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00bffff700 1 --2- 172.21.15.53:0/2197563952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c80d1220 0x7f00b4005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80b3630 con 0x7f00b4003bc0 2023-07-09T21:50:33.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b400bba0 con 0x7f00b4004850 2023-07-09T21:50:33.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b400bd60 con 0x7f00c80d1220 2023-07-09T21:50:33.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00cd59b700 1 --2- 172.21.15.53:0/2197563952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00b4003bc0 0x7f00b4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:33.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00ccd9a700 1 --2- 172.21.15.53:0/2197563952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b4004850 0x7f00b4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:33.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00cdd9c700 1 --2- 172.21.15.53:0/2197563952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c80d1220 0x7f00b4005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:33.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00cd59b700 1 -- 172.21.15.53:0/2197563952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c80d1220 msgr2=0x7f00b4005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:33.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00cd59b700 1 --2- 172.21.15.53:0/2197563952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c80d1220 0x7f00b4005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00cd59b700 1 -- 172.21.15.53:0/2197563952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b4004850 msgr2=0x7f00b4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:33.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00cd59b700 1 --2- 172.21.15.53:0/2197563952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b4004850 0x7f00b4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00cd59b700 1 -- 172.21.15.53:0/2197563952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b40035b0 con 0x7f00b4003bc0 2023-07-09T21:50:33.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00ccd9a700 1 --2- 172.21.15.53:0/2197563952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b4004850 0x7f00b4004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:33.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.444+0000 7f00cd59b700 1 --2- 172.21.15.53:0/2197563952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00b4003bc0 0x7f00b4003fb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f00c40019e0 tx=0x7f00b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100b371be0719434 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:33.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.445+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c40014a0 con 0x7f00b4003bc0 2023-07-09T21:50:33.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.445+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c40052d0 con 0x7f00b4003bc0 2023-07-09T21:50:33.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.445+0000 7f00bffff700 1 -- 172.21.15.53:0/2197563952 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c40036d0 con 0x7f00b4003bc0 2023-07-09T21:50:33.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.445+0000 7f00cf7ff700 1 -- 172.21.15.53:0/2197563952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00b4003bc0 msgr2=0x7f00b4003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:33.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.445+0000 7f00cf7ff700 1 --2- 172.21.15.53:0/2197563952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00b4003bc0 0x7f00b4003fb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f00c40019e0 tx=0x7f00b4005880 comp rx=0 tx=0).stop 2023-07-09T21:50:33.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.445+0000 7f00cdd9c700 1 -- 172.21.15.53:0/2197563952 reap_dead start 2023-07-09T21:50:33.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.445+0000 7f00cf7ff700 1 -- 172.21.15.53:0/2197563952 shutdown_connections 2023-07-09T21:50:33.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.445+0000 7f00cf7ff700 1 -- 172.21.15.53:0/2197563952 >> 172.21.15.53:0/2197563952 conn(0x7f00c809c1d0 msgr2=0x7f00c80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:33.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.445+0000 7f00cf7ff700 1 -- 172.21.15.53:0/2197563952 shutdown_connections 2023-07-09T21:50:33.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.445+0000 7f00cf7ff700 1 -- 172.21.15.53:0/2197563952 wait complete. 2023-07-09T21:50:33.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.447+0000 7f00cf7ff700 1 Processor -- start 2023-07-09T21:50:33.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.447+0000 7f00cf7ff700 1 -- start start 2023-07-09T21:50:33.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.448+0000 7f00cf7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00b4003bc0 0x7f00c81589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.448+0000 7f00cf7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c81f1790 0x7f00c80b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.448+0000 7f00cf7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c81f1c00 0x7f00c80b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.448+0000 7f00cf7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80c88b0 con 0x7f00b4003bc0 2023-07-09T21:50:33.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.448+0000 7f00cf7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c8158f00 con 0x7f00c81f1790 2023-07-09T21:50:33.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.448+0000 7f00cf7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c815e610 con 0x7f00c81f1c00 2023-07-09T21:50:33.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.448+0000 7f00cd59b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00b4003bc0 0x7f00c81589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:33.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.448+0000 7f00cd59b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00b4003bc0 0x7f00c81589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52684/0 (socket says 172.21.15.53:52684) 2023-07-09T21:50:33.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.448+0000 7f00cd59b700 1 -- 172.21.15.53:0/4044075150 learned_addr learned my addr 172.21.15.53:0/4044075150 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:33.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.448+0000 7f00cd59b700 1 -- 172.21.15.53:0/4044075150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c81f1c00 msgr2=0x7f00c80b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:33.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.449+0000 7f00cd59b700 1 --2- 172.21.15.53:0/4044075150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c81f1c00 0x7f00c80b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.449+0000 7f00cd59b700 1 -- 172.21.15.53:0/4044075150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c81f1790 msgr2=0x7f00c80b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:33.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.449+0000 7f00cd59b700 1 --2- 172.21.15.53:0/4044075150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c81f1790 0x7f00c80b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.449+0000 7f00cd59b700 1 -- 172.21.15.53:0/4044075150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c80c7f10 con 0x7f00b4003bc0 2023-07-09T21:50:33.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.449+0000 7f00cd59b700 1 --2- 172.21.15.53:0/4044075150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00b4003bc0 0x7f00c81589c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00c400c3c0 tx=0x7f00c4001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:33.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.449+0000 7f00bdffb700 1 -- 172.21.15.53:0/4044075150 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4001440 con 0x7f00b4003bc0 2023-07-09T21:50:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.449+0000 7f00bdffb700 1 -- 172.21.15.53:0/4044075150 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c40050d0 con 0x7f00b4003bc0 2023-07-09T21:50:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.449+0000 7f00bdffb700 1 -- 172.21.15.53:0/4044075150 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4007240 con 0x7f00b4003bc0 2023-07-09T21:50:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.449+0000 7f00cf7ff700 1 -- 172.21.15.53:0/4044075150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c80c81f0 con 0x7f00b4003bc0 2023-07-09T21:50:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.449+0000 7f00cf7ff700 1 -- 172.21.15.53:0/4044075150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c815d8a0 con 0x7f00b4003bc0 2023-07-09T21:50:33.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.450+0000 7f00cf7ff700 1 -- 172.21.15.53:0/4044075150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c8157f10 con 0x7f00b4003bc0 2023-07-09T21:50:33.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.451+0000 7f00bdffb700 1 -- 172.21.15.53:0/4044075150 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00c40073a0 con 0x7f00b4003bc0 2023-07-09T21:50:33.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.452+0000 7f00bdffb700 1 --2- 172.21.15.53:0/4044075150 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f00ac06ace0 0x7f00ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.452+0000 7f00bdffb700 1 -- 172.21.15.53:0/4044075150 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00c408a0c0 con 0x7f00b4003bc0 2023-07-09T21:50:33.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.452+0000 7f00ccd9a700 1 --2- 172.21.15.53:0/4044075150 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f00ac06ace0 0x7f00ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:33.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.453+0000 7f00ccd9a700 1 --2- 172.21.15.53:0/4044075150 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f00ac06ace0 0x7f00ac06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f00c806c6f0 tx=0x7f00b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:33.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.456+0000 7f00bdffb700 1 -- 172.21.15.53:0/4044075150 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f00c4055280 con 0x7f00b4003bc0 2023-07-09T21:50:33.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.662+0000 7f00cf7ff700 1 -- 172.21.15.53:0/4044075150 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00c80b3ed0 con 0x7f00ac06ace0 2023-07-09T21:50:33.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.671+0000 7f00bdffb700 1 -- 172.21.15.53:0/4044075150 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286792 (secure 0 0 0) 0x7f00b8009660 con 0x7f00ac06ace0 2023-07-09T21:50:33.675 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:33.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.675+0000 7f00cf7ff700 1 -- 172.21.15.53:0/4044075150 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f00ac06ace0 msgr2=0x7f00ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:33.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.675+0000 7f00cf7ff700 1 --2- 172.21.15.53:0/4044075150 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f00ac06ace0 0x7f00ac06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f00c806c6f0 tx=0x7f00b8008040 comp rx=0 tx=0).stop 2023-07-09T21:50:33.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.675+0000 7f00cf7ff700 1 -- 172.21.15.53:0/4044075150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00b4003bc0 msgr2=0x7f00c81589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:33.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.675+0000 7f00cf7ff700 1 --2- 172.21.15.53:0/4044075150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00b4003bc0 0x7f00c81589c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00c400c3c0 tx=0x7f00c4001360 comp rx=0 tx=0).stop 2023-07-09T21:50:33.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.675+0000 7f00cf7ff700 1 -- 172.21.15.53:0/4044075150 shutdown_connections 2023-07-09T21:50:33.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.675+0000 7f00cf7ff700 1 --2- 172.21.15.53:0/4044075150 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f00ac06ace0 0x7f00ac06d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.675+0000 7f00cf7ff700 1 --2- 172.21.15.53:0/4044075150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c81f1c00 0x7f00c80b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.675+0000 7f00cf7ff700 1 --2- 172.21.15.53:0/4044075150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00b4003bc0 0x7f00c81589c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.675+0000 7f00cf7ff700 1 --2- 172.21.15.53:0/4044075150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c81f1790 0x7f00c80b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.675+0000 7f00cf7ff700 1 -- 172.21.15.53:0/4044075150 >> 172.21.15.53:0/4044075150 conn(0x7f00c809c1d0 msgr2=0x7f00c80afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:33.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.675+0000 7f00cf7ff700 1 -- 172.21.15.53:0/4044075150 shutdown_connections 2023-07-09T21:50:33.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.675+0000 7f00cf7ff700 1 -- 172.21.15.53:0/4044075150 wait complete. 2023-07-09T21:50:33.679 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:50:33.694 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-07-09T21:50:32.853110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222952,"kb_used_data":3240,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751768,"statfs":{"total":773094113280,"available":772865810432,"internally_reserved":0,"allocated":3317760,"data_stored":1961500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.086190"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401409+0000","last_change":"2023-07-09T21:50:23.789471+0000","last_active":"2023-07-09T21:50:25.401409+0000","last_peered":"2023-07-09T21:50:25.401409+0000","last_clean":"2023-07-09T21:50:25.401409+0000","last_became_active":"2023-07-09T21:50:23.789178+0000","last_became_peered":"2023-07-09T21:50:23.789178+0000","last_unstale":"2023-07-09T21:50:25.401409+0000","last_undegraded":"2023-07-09T21:50:25.401409+0000","last_fullsized":"2023-07-09T21:50:25.401409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:24.789777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771695+0000","last_change":"2023-07-09T21:50:23.789721+0000","last_active":"2023-07-09T21:50:24.771695+0000","last_peered":"2023-07-09T21:50:24.771695+0000","last_clean":"2023-07-09T21:50:24.771695+0000","last_became_active":"2023-07-09T21:50:23.789478+0000","last_became_peered":"2023-07-09T21:50:23.789478+0000","last_unstale":"2023-07-09T21:50:24.771695+0000","last_undegraded":"2023-07-09T21:50:24.771695+0000","last_fullsized":"2023-07-09T21:50:24.771695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778489+0000","last_change":"2023-07-09T21:50:23.792566+0000","last_active":"2023-07-09T21:50:24.778489+0000","last_peered":"2023-07-09T21:50:24.778489+0000","last_clean":"2023-07-09T21:50:24.778489+0000","last_became_active":"2023-07-09T21:50:23.792316+0000","last_became_peered":"2023-07-09T21:50:23.792316+0000","last_unstale":"2023-07-09T21:50:24.778489+0000","last_undegraded":"2023-07-09T21:50:24.778489+0000","last_fullsized":"2023-07-09T21:50:24.778489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:33.584119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401848+0000","last_change":"2023-07-09T21:50:23.790737+0000","last_active":"2023-07-09T21:50:25.401848+0000","last_peered":"2023-07-09T21:50:25.401848+0000","last_clean":"2023-07-09T21:50:25.401848+0000","last_became_active":"2023-07-09T21:50:23.790455+0000","last_became_peered":"2023-07-09T21:50:23.790455+0000","last_unstale":"2023-07-09T21:50:25.401848+0000","last_undegraded":"2023-07-09T21:50:25.401848+0000","last_fullsized":"2023-07-09T21:50:25.401848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:33:28.169248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771850+0000","last_change":"2023-07-09T21:50:23.799889+0000","last_active":"2023-07-09T21:50:24.771850+0000","last_peered":"2023-07-09T21:50:24.771850+0000","last_clean":"2023-07-09T21:50:24.771850+0000","last_became_active":"2023-07-09T21:50:23.798717+0000","last_became_peered":"2023-07-09T21:50:23.798717+0000","last_unstale":"2023-07-09T21:50:24.771850+0000","last_undegraded":"2023-07-09T21:50:24.771850+0000","last_fullsized":"2023-07-09T21:50:24.771850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:25.755232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778099+0000","last_change":"2023-07-09T21:50:23.798790+0000","last_active":"2023-07-09T21:50:24.778099+0000","last_peered":"2023-07-09T21:50:24.778099+0000","last_clean":"2023-07-09T21:50:24.778099+0000","last_became_active":"2023-07-09T21:50:23.798508+0000","last_became_peered":"2023-07-09T21:50:23.798508+0000","last_unstale":"2023-07-09T21:50:24.778099+0000","last_undegraded":"2023-07-09T21:50:24.778099+0000","last_fullsized":"2023-07-09T21:50:24.778099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:25.755232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094158+0000","last_change":"2023-07-09T21:50:23.791148+0000","last_active":"2023-07-09T21:50:25.094158+0000","last_peered":"2023-07-09T21:50:25.094158+0000","last_clean":"2023-07-09T21:50:25.094158+0000","last_became_active":"2023-07-09T21:50:23.790530+0000","last_became_peered":"2023-07-09T21:50:23.790530+0000","last_unstale":"2023-07-09T21:50:25.094158+0000","last_undegraded":"2023-07-09T21:50:25.094158+0000","last_fullsized":"2023-07-09T21:50:25.094158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771365+0000","last_change":"2023-07-09T21:50:23.786451+0000","last_active":"2023-07-09T21:50:24.771365+0000","last_peered":"2023-07-09T21:50:24.771365+0000","last_clean":"2023-07-09T21:50:24.771365+0000","last_became_active":"2023-07-09T21:50:23.786150+0000","last_became_peered":"2023-07-09T21:50:23.786150+0000","last_unstale":"2023-07-09T21:50:24.771365+0000","last_undegraded":"2023-07-09T21:50:24.771365+0000","last_fullsized":"2023-07-09T21:50:24.771365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773128+0000","last_change":"2023-07-09T21:50:23.799651+0000","last_active":"2023-07-09T21:50:24.773128+0000","last_peered":"2023-07-09T21:50:24.773128+0000","last_clean":"2023-07-09T21:50:24.773128+0000","last_became_active":"2023-07-09T21:50:23.799306+0000","last_became_peered":"2023-07-09T21:50:23.799306+0000","last_unstale":"2023-07-09T21:50:24.773128+0000","last_undegraded":"2023-07-09T21:50:24.773128+0000","last_fullsized":"2023-07-09T21:50:24.773128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:06.841347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772154+0000","last_change":"2023-07-09T21:50:23.807058+0000","last_active":"2023-07-09T21:50:24.772154+0000","last_peered":"2023-07-09T21:50:24.772154+0000","last_clean":"2023-07-09T21:50:24.772154+0000","last_became_active":"2023-07-09T21:50:23.805775+0000","last_became_peered":"2023-07-09T21:50:23.805775+0000","last_unstale":"2023-07-09T21:50:24.772154+0000","last_undegraded":"2023-07-09T21:50:24.772154+0000","last_fullsized":"2023-07-09T21:50:24.772154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:16.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778566+0000","last_change":"2023-07-09T21:50:23.787617+0000","last_active":"2023-07-09T21:50:24.778566+0000","last_peered":"2023-07-09T21:50:24.778566+0000","last_clean":"2023-07-09T21:50:24.778566+0000","last_became_active":"2023-07-09T21:50:23.787324+0000","last_became_peered":"2023-07-09T21:50:23.787324+0000","last_unstale":"2023-07-09T21:50:24.778566+0000","last_undegraded":"2023-07-09T21:50:24.778566+0000","last_fullsized":"2023-07-09T21:50:24.778566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:54.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401442+0000","last_change":"2023-07-09T21:50:23.786780+0000","last_active":"2023-07-09T21:50:25.401442+0000","last_peered":"2023-07-09T21:50:25.401442+0000","last_clean":"2023-07-09T21:50:25.401442+0000","last_became_active":"2023-07-09T21:50:23.786285+0000","last_became_peered":"2023-07-09T21:50:23.786285+0000","last_unstale":"2023-07-09T21:50:25.401442+0000","last_undegraded":"2023-07-09T21:50:25.401442+0000","last_fullsized":"2023-07-09T21:50:25.401442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:17:28.990837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401348+0000","last_change":"2023-07-09T21:50:23.779777+0000","last_active":"2023-07-09T21:50:25.401348+0000","last_peered":"2023-07-09T21:50:25.401348+0000","last_clean":"2023-07-09T21:50:25.401348+0000","last_became_active":"2023-07-09T21:50:23.779402+0000","last_became_peered":"2023-07-09T21:50:23.779402+0000","last_unstale":"2023-07-09T21:50:25.401348+0000","last_undegraded":"2023-07-09T21:50:25.401348+0000","last_fullsized":"2023-07-09T21:50:25.401348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:28.676168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771883+0000","last_change":"2023-07-09T21:50:23.785342+0000","last_active":"2023-07-09T21:50:24.771883+0000","last_peered":"2023-07-09T21:50:24.771883+0000","last_clean":"2023-07-09T21:50:24.771883+0000","last_became_active":"2023-07-09T21:50:23.785042+0000","last_became_peered":"2023-07-09T21:50:23.785042+0000","last_unstale":"2023-07-09T21:50:24.771883+0000","last_undegraded":"2023-07-09T21:50:24.771883+0000","last_fullsized":"2023-07-09T21:50:24.771883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:33.584119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094514+0000","last_change":"2023-07-09T21:50:23.791304+0000","last_active":"2023-07-09T21:50:25.094514+0000","last_peered":"2023-07-09T21:50:25.094514+0000","last_clean":"2023-07-09T21:50:25.094514+0000","last_became_active":"2023-07-09T21:50:23.790881+0000","last_became_peered":"2023-07-09T21:50:23.790881+0000","last_unstale":"2023-07-09T21:50:25.094514+0000","last_undegraded":"2023-07-09T21:50:25.094514+0000","last_fullsized":"2023-07-09T21:50:25.094514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:53:11.882162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778107+0000","last_change":"2023-07-09T21:50:23.792844+0000","last_active":"2023-07-09T21:50:24.778107+0000","last_peered":"2023-07-09T21:50:24.778107+0000","last_clean":"2023-07-09T21:50:24.778107+0000","last_became_active":"2023-07-09T21:50:23.792511+0000","last_became_peered":"2023-07-09T21:50:23.792511+0000","last_unstale":"2023-07-09T21:50:24.778107+0000","last_undegraded":"2023-07-09T21:50:24.778107+0000","last_fullsized":"2023-07-09T21:50:24.778107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:11.492653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773086+0000","last_change":"2023-07-09T21:50:23.801511+0000","last_active":"2023-07-09T21:50:24.773086+0000","last_peered":"2023-07-09T21:50:24.773086+0000","last_clean":"2023-07-09T21:50:24.773086+0000","last_became_active":"2023-07-09T21:50:23.799945+0000","last_became_peered":"2023-07-09T21:50:23.799945+0000","last_unstale":"2023-07-09T21:50:24.773086+0000","last_undegraded":"2023-07-09T21:50:24.773086+0000","last_fullsized":"2023-07-09T21:50:24.773086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:30.584499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778726+0000","last_change":"2023-07-09T21:50:23.791210+0000","last_active":"2023-07-09T21:50:24.778726+0000","last_peered":"2023-07-09T21:50:24.778726+0000","last_clean":"2023-07-09T21:50:24.778726+0000","last_became_active":"2023-07-09T21:50:23.790958+0000","last_became_peered":"2023-07-09T21:50:23.790958+0000","last_unstale":"2023-07-09T21:50:24.778726+0000","last_undegraded":"2023-07-09T21:50:24.778726+0000","last_fullsized":"2023-07-09T21:50:24.778726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:16.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401359+0000","last_change":"2023-07-09T21:50:23.781367+0000","last_active":"2023-07-09T21:50:25.401359+0000","last_peered":"2023-07-09T21:50:25.401359+0000","last_clean":"2023-07-09T21:50:25.401359+0000","last_became_active":"2023-07-09T21:50:23.781111+0000","last_became_peered":"2023-07-09T21:50:23.781111+0000","last_unstale":"2023-07-09T21:50:25.401359+0000","last_undegraded":"2023-07-09T21:50:25.401359+0000","last_fullsized":"2023-07-09T21:50:25.401359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:23.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778348+0000","last_change":"2023-07-09T21:50:23.788775+0000","last_active":"2023-07-09T21:50:24.778348+0000","last_peered":"2023-07-09T21:50:24.778348+0000","last_clean":"2023-07-09T21:50:24.778348+0000","last_became_active":"2023-07-09T21:50:23.788474+0000","last_became_peered":"2023-07-09T21:50:23.788474+0000","last_unstale":"2023-07-09T21:50:24.778348+0000","last_undegraded":"2023-07-09T21:50:24.778348+0000","last_fullsized":"2023-07-09T21:50:24.778348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094336+0000","last_change":"2023-07-09T21:50:23.782607+0000","last_active":"2023-07-09T21:50:25.094336+0000","last_peered":"2023-07-09T21:50:25.094336+0000","last_clean":"2023-07-09T21:50:25.094336+0000","last_became_active":"2023-07-09T21:50:23.782315+0000","last_became_peered":"2023-07-09T21:50:23.782315+0000","last_unstale":"2023-07-09T21:50:25.094336+0000","last_undegraded":"2023-07-09T21:50:25.094336+0000","last_fullsized":"2023-07-09T21:50:25.094336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:36.220738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771811+0000","last_change":"2023-07-09T21:50:23.796236+0000","last_active":"2023-07-09T21:50:24.771811+0000","last_peered":"2023-07-09T21:50:24.771811+0000","last_clean":"2023-07-09T21:50:24.771811+0000","last_became_active":"2023-07-09T21:50:23.795910+0000","last_became_peered":"2023-07-09T21:50:23.795910+0000","last_unstale":"2023-07-09T21:50:24.771811+0000","last_undegraded":"2023-07-09T21:50:24.771811+0000","last_fullsized":"2023-07-09T21:50:24.771811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770483+0000","last_change":"2023-07-09T21:50:23.795797+0000","last_active":"2023-07-09T21:50:24.770483+0000","last_peered":"2023-07-09T21:50:24.770483+0000","last_clean":"2023-07-09T21:50:24.770483+0000","last_became_active":"2023-07-09T21:50:23.795569+0000","last_became_peered":"2023-07-09T21:50:23.795569+0000","last_unstale":"2023-07-09T21:50:24.770483+0000","last_undegraded":"2023-07-09T21:50:24.770483+0000","last_fullsized":"2023-07-09T21:50:24.770483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094493+0000","last_change":"2023-07-09T21:50:23.782770+0000","last_active":"2023-07-09T21:50:25.094493+0000","last_peered":"2023-07-09T21:50:25.094493+0000","last_clean":"2023-07-09T21:50:25.094493+0000","last_became_active":"2023-07-09T21:50:23.782509+0000","last_became_peered":"2023-07-09T21:50:23.782509+0000","last_unstale":"2023-07-09T21:50:25.094493+0000","last_undegraded":"2023-07-09T21:50:25.094493+0000","last_fullsized":"2023-07-09T21:50:25.094493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:48:23.282646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832925+0000","last_change":"2023-07-09T21:50:23.785433+0000","last_active":"2023-07-09T21:50:24.832925+0000","last_peered":"2023-07-09T21:50:24.832925+0000","last_clean":"2023-07-09T21:50:24.832925+0000","last_became_active":"2023-07-09T21:50:23.785016+0000","last_became_peered":"2023-07-09T21:50:23.785016+0000","last_unstale":"2023-07-09T21:50:24.832925+0000","last_undegraded":"2023-07-09T21:50:24.832925+0000","last_fullsized":"2023-07-09T21:50:24.832925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:17:59.220999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833073+0000","last_change":"2023-07-09T21:50:23.781394+0000","last_active":"2023-07-09T21:50:24.833073+0000","last_peered":"2023-07-09T21:50:24.833073+0000","last_clean":"2023-07-09T21:50:24.833073+0000","last_became_active":"2023-07-09T21:50:23.781089+0000","last_became_peered":"2023-07-09T21:50:23.781089+0000","last_unstale":"2023-07-09T21:50:24.833073+0000","last_undegraded":"2023-07-09T21:50:24.833073+0000","last_fullsized":"2023-07-09T21:50:24.833073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:06:48.939947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771627+0000","last_change":"2023-07-09T21:50:23.783556+0000","last_active":"2023-07-09T21:50:24.771627+0000","last_peered":"2023-07-09T21:50:24.771627+0000","last_clean":"2023-07-09T21:50:24.771627+0000","last_became_active":"2023-07-09T21:50:23.783277+0000","last_became_peered":"2023-07-09T21:50:23.783277+0000","last_unstale":"2023-07-09T21:50:24.771627+0000","last_undegraded":"2023-07-09T21:50:24.771627+0000","last_fullsized":"2023-07-09T21:50:24.771627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.148959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778480+0000","last_change":"2023-07-09T21:50:22.774935+0000","last_active":"2023-07-09T21:50:24.778480+0000","last_peered":"2023-07-09T21:50:24.778480+0000","last_clean":"2023-07-09T21:50:24.778480+0000","last_became_active":"2023-07-09T21:50:22.774612+0000","last_became_peered":"2023-07-09T21:50:22.774612+0000","last_unstale":"2023-07-09T21:50:24.778480+0000","last_undegraded":"2023-07-09T21:50:24.778480+0000","last_fullsized":"2023-07-09T21:50:24.778480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:05.547490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770699+0000","last_change":"2023-07-09T21:50:23.777644+0000","last_active":"2023-07-09T21:50:24.770699+0000","last_peered":"2023-07-09T21:50:24.770699+0000","last_clean":"2023-07-09T21:50:24.770699+0000","last_became_active":"2023-07-09T21:50:23.777372+0000","last_became_peered":"2023-07-09T21:50:23.777372+0000","last_unstale":"2023-07-09T21:50:24.770699+0000","last_undegraded":"2023-07-09T21:50:24.770699+0000","last_fullsized":"2023-07-09T21:50:24.770699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:06.551761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832895+0000","last_change":"2023-07-09T21:50:22.772852+0000","last_active":"2023-07-09T21:50:24.832895+0000","last_peered":"2023-07-09T21:50:24.832895+0000","last_clean":"2023-07-09T21:50:24.832895+0000","last_became_active":"2023-07-09T21:50:22.772592+0000","last_became_peered":"2023-07-09T21:50:22.772592+0000","last_unstale":"2023-07-09T21:50:24.832895+0000","last_undegraded":"2023-07-09T21:50:24.832895+0000","last_fullsized":"2023-07-09T21:50:24.832895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:10:40.034217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773185+0000","last_change":"2023-07-09T21:50:23.802442+0000","last_active":"2023-07-09T21:50:24.773185+0000","last_peered":"2023-07-09T21:50:24.773185+0000","last_clean":"2023-07-09T21:50:24.773185+0000","last_became_active":"2023-07-09T21:50:23.801644+0000","last_became_peered":"2023-07-09T21:50:23.801644+0000","last_unstale":"2023-07-09T21:50:24.773185+0000","last_undegraded":"2023-07-09T21:50:24.773185+0000","last_fullsized":"2023-07-09T21:50:24.773185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:13.602484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770485+0000","last_change":"2023-07-09T21:50:22.771300+0000","last_active":"2023-07-09T21:50:24.770485+0000","last_peered":"2023-07-09T21:50:24.770485+0000","last_clean":"2023-07-09T21:50:24.770485+0000","last_became_active":"2023-07-09T21:50:22.770639+0000","last_became_peered":"2023-07-09T21:50:22.770639+0000","last_unstale":"2023-07-09T21:50:24.770485+0000","last_undegraded":"2023-07-09T21:50:24.770485+0000","last_fullsized":"2023-07-09T21:50:24.770485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:29.580228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401889+0000","last_change":"2023-07-09T21:50:23.783801+0000","last_active":"2023-07-09T21:50:25.401889+0000","last_peered":"2023-07-09T21:50:25.401889+0000","last_clean":"2023-07-09T21:50:25.401889+0000","last_became_active":"2023-07-09T21:50:23.783545+0000","last_became_peered":"2023-07-09T21:50:23.783545+0000","last_unstale":"2023-07-09T21:50:25.401889+0000","last_undegraded":"2023-07-09T21:50:25.401889+0000","last_fullsized":"2023-07-09T21:50:25.401889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:44:36.986572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773224+0000","last_change":"2023-07-09T21:50:22.781881+0000","last_active":"2023-07-09T21:50:24.773224+0000","last_peered":"2023-07-09T21:50:24.773224+0000","last_clean":"2023-07-09T21:50:24.773224+0000","last_became_active":"2023-07-09T21:50:22.781553+0000","last_became_peered":"2023-07-09T21:50:22.781553+0000","last_unstale":"2023-07-09T21:50:24.773224+0000","last_undegraded":"2023-07-09T21:50:24.773224+0000","last_fullsized":"2023-07-09T21:50:24.773224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:32.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770398+0000","last_change":"2023-07-09T21:50:23.782080+0000","last_active":"2023-07-09T21:50:24.770398+0000","last_peered":"2023-07-09T21:50:24.770398+0000","last_clean":"2023-07-09T21:50:24.770398+0000","last_became_active":"2023-07-09T21:50:23.781769+0000","last_became_peered":"2023-07-09T21:50:23.781769+0000","last_unstale":"2023-07-09T21:50:24.770398+0000","last_undegraded":"2023-07-09T21:50:24.770398+0000","last_fullsized":"2023-07-09T21:50:24.770398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.148959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771796+0000","last_change":"2023-07-09T21:50:22.775466+0000","last_active":"2023-07-09T21:50:24.771796+0000","last_peered":"2023-07-09T21:50:24.771796+0000","last_clean":"2023-07-09T21:50:24.771796+0000","last_became_active":"2023-07-09T21:50:22.775189+0000","last_became_peered":"2023-07-09T21:50:22.775189+0000","last_unstale":"2023-07-09T21:50:24.771796+0000","last_undegraded":"2023-07-09T21:50:24.771796+0000","last_fullsized":"2023-07-09T21:50:24.771796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:29.580228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771009+0000","last_change":"2023-07-09T21:50:23.776973+0000","last_active":"2023-07-09T21:50:24.771009+0000","last_peered":"2023-07-09T21:50:24.771009+0000","last_clean":"2023-07-09T21:50:24.771009+0000","last_became_active":"2023-07-09T21:50:23.776468+0000","last_became_peered":"2023-07-09T21:50:23.776468+0000","last_unstale":"2023-07-09T21:50:24.771009+0000","last_undegraded":"2023-07-09T21:50:24.771009+0000","last_fullsized":"2023-07-09T21:50:24.771009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:54.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094368+0000","last_change":"2023-07-09T21:50:22.776755+0000","last_active":"2023-07-09T21:50:25.094368+0000","last_peered":"2023-07-09T21:50:25.094368+0000","last_clean":"2023-07-09T21:50:25.094368+0000","last_became_active":"2023-07-09T21:50:22.776393+0000","last_became_peered":"2023-07-09T21:50:22.776393+0000","last_unstale":"2023-07-09T21:50:25.094368+0000","last_undegraded":"2023-07-09T21:50:25.094368+0000","last_fullsized":"2023-07-09T21:50:25.094368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:15.389440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832675+0000","last_change":"2023-07-09T21:50:23.781306+0000","last_active":"2023-07-09T21:50:24.832675+0000","last_peered":"2023-07-09T21:50:24.832675+0000","last_clean":"2023-07-09T21:50:24.832675+0000","last_became_active":"2023-07-09T21:50:23.781040+0000","last_became_peered":"2023-07-09T21:50:23.781040+0000","last_unstale":"2023-07-09T21:50:24.832675+0000","last_undegraded":"2023-07-09T21:50:24.832675+0000","last_fullsized":"2023-07-09T21:50:24.832675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:57:55.663222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778655+0000","last_change":"2023-07-09T21:50:22.778707+0000","last_active":"2023-07-09T21:50:24.778655+0000","last_peered":"2023-07-09T21:50:24.778655+0000","last_clean":"2023-07-09T21:50:24.778655+0000","last_became_active":"2023-07-09T21:50:22.778397+0000","last_became_peered":"2023-07-09T21:50:22.778397+0000","last_unstale":"2023-07-09T21:50:24.778655+0000","last_undegraded":"2023-07-09T21:50:24.778655+0000","last_fullsized":"2023-07-09T21:50:24.778655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:26.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778898+0000","last_change":"2023-07-09T21:50:23.793887+0000","last_active":"2023-07-09T21:50:24.778898+0000","last_peered":"2023-07-09T21:50:24.778898+0000","last_clean":"2023-07-09T21:50:24.778898+0000","last_became_active":"2023-07-09T21:50:23.793626+0000","last_became_peered":"2023-07-09T21:50:23.793626+0000","last_unstale":"2023-07-09T21:50:24.778898+0000","last_undegraded":"2023-07-09T21:50:24.778898+0000","last_fullsized":"2023-07-09T21:50:24.778898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:21:17.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094228+0000","last_change":"2023-07-09T21:50:22.781947+0000","last_active":"2023-07-09T21:50:25.094228+0000","last_peered":"2023-07-09T21:50:25.094228+0000","last_clean":"2023-07-09T21:50:25.094228+0000","last_became_active":"2023-07-09T21:50:22.780676+0000","last_became_peered":"2023-07-09T21:50:22.780676+0000","last_unstale":"2023-07-09T21:50:25.094228+0000","last_undegraded":"2023-07-09T21:50:25.094228+0000","last_fullsized":"2023-07-09T21:50:25.094228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:47:53.248634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770793+0000","last_change":"2023-07-09T21:50:23.788674+0000","last_active":"2023-07-09T21:50:24.770793+0000","last_peered":"2023-07-09T21:50:24.770793+0000","last_clean":"2023-07-09T21:50:24.770793+0000","last_became_active":"2023-07-09T21:50:23.788306+0000","last_became_peered":"2023-07-09T21:50:23.788306+0000","last_unstale":"2023-07-09T21:50:24.770793+0000","last_undegraded":"2023-07-09T21:50:24.770793+0000","last_fullsized":"2023-07-09T21:50:24.770793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771654+0000","last_change":"2023-07-09T21:50:22.777294+0000","last_active":"2023-07-09T21:50:24.771654+0000","last_peered":"2023-07-09T21:50:24.771654+0000","last_clean":"2023-07-09T21:50:24.771654+0000","last_became_active":"2023-07-09T21:50:22.776308+0000","last_became_peered":"2023-07-09T21:50:22.776308+0000","last_unstale":"2023-07-09T21:50:24.771654+0000","last_undegraded":"2023-07-09T21:50:24.771654+0000","last_fullsized":"2023-07-09T21:50:24.771654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:10.488382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771772+0000","last_change":"2023-07-09T21:50:23.782217+0000","last_active":"2023-07-09T21:50:24.771772+0000","last_peered":"2023-07-09T21:50:24.771772+0000","last_clean":"2023-07-09T21:50:24.771772+0000","last_became_active":"2023-07-09T21:50:23.781948+0000","last_became_peered":"2023-07-09T21:50:23.781948+0000","last_unstale":"2023-07-09T21:50:24.771772+0000","last_undegraded":"2023-07-09T21:50:24.771772+0000","last_fullsized":"2023-07-09T21:50:24.771772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094393+0000","last_change":"2023-07-09T21:50:22.780710+0000","last_active":"2023-07-09T21:50:25.094393+0000","last_peered":"2023-07-09T21:50:25.094393+0000","last_clean":"2023-07-09T21:50:25.094393+0000","last_became_active":"2023-07-09T21:50:22.780392+0000","last_became_peered":"2023-07-09T21:50:22.780392+0000","last_unstale":"2023-07-09T21:50:25.094393+0000","last_undegraded":"2023-07-09T21:50:25.094393+0000","last_fullsized":"2023-07-09T21:50:25.094393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:08.834959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773173+0000","last_change":"2023-07-09T21:50:23.803234+0000","last_active":"2023-07-09T21:50:24.773173+0000","last_peered":"2023-07-09T21:50:24.773173+0000","last_clean":"2023-07-09T21:50:24.773173+0000","last_became_active":"2023-07-09T21:50:23.802407+0000","last_became_peered":"2023-07-09T21:50:23.802407+0000","last_unstale":"2023-07-09T21:50:24.773173+0000","last_undegraded":"2023-07-09T21:50:24.773173+0000","last_fullsized":"2023-07-09T21:50:24.773173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:06.551761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401477+0000","last_change":"2023-07-09T21:50:22.770920+0000","last_active":"2023-07-09T21:50:25.401477+0000","last_peered":"2023-07-09T21:50:25.401477+0000","last_clean":"2023-07-09T21:50:25.401477+0000","last_became_active":"2023-07-09T21:50:22.770566+0000","last_became_peered":"2023-07-09T21:50:22.770566+0000","last_unstale":"2023-07-09T21:50:25.401477+0000","last_undegraded":"2023-07-09T21:50:25.401477+0000","last_fullsized":"2023-07-09T21:50:25.401477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:06.181402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771083+0000","last_change":"2023-07-09T21:50:23.786089+0000","last_active":"2023-07-09T21:50:24.771083+0000","last_peered":"2023-07-09T21:50:24.771083+0000","last_clean":"2023-07-09T21:50:24.771083+0000","last_became_active":"2023-07-09T21:50:23.785827+0000","last_became_peered":"2023-07-09T21:50:23.785827+0000","last_unstale":"2023-07-09T21:50:24.771083+0000","last_undegraded":"2023-07-09T21:50:24.771083+0000","last_fullsized":"2023-07-09T21:50:24.771083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:16.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094687+0000","last_change":"2023-07-09T21:50:22.781469+0000","last_active":"2023-07-09T21:50:25.094687+0000","last_peered":"2023-07-09T21:50:25.094687+0000","last_clean":"2023-07-09T21:50:25.094687+0000","last_became_active":"2023-07-09T21:50:22.781215+0000","last_became_peered":"2023-07-09T21:50:22.781215+0000","last_unstale":"2023-07-09T21:50:25.094687+0000","last_undegraded":"2023-07-09T21:50:25.094687+0000","last_fullsized":"2023-07-09T21:50:25.094687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:41:06.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771366+0000","last_change":"2023-07-09T21:50:23.781500+0000","last_active":"2023-07-09T21:50:24.771366+0000","last_peered":"2023-07-09T21:50:24.771366+0000","last_clean":"2023-07-09T21:50:24.771366+0000","last_became_active":"2023-07-09T21:50:23.781247+0000","last_became_peered":"2023-07-09T21:50:23.781247+0000","last_unstale":"2023-07-09T21:50:24.771366+0000","last_undegraded":"2023-07-09T21:50:24.771366+0000","last_fullsized":"2023-07-09T21:50:24.771366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:25.755232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094343+0000","last_change":"2023-07-09T21:50:22.780841+0000","last_active":"2023-07-09T21:50:25.094343+0000","last_peered":"2023-07-09T21:50:25.094343+0000","last_clean":"2023-07-09T21:50:25.094343+0000","last_became_active":"2023-07-09T21:50:22.780287+0000","last_became_peered":"2023-07-09T21:50:22.780287+0000","last_unstale":"2023-07-09T21:50:25.094343+0000","last_undegraded":"2023-07-09T21:50:25.094343+0000","last_fullsized":"2023-07-09T21:50:25.094343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:53.307790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778140+0000","last_change":"2023-07-09T21:50:23.794825+0000","last_active":"2023-07-09T21:50:24.778140+0000","last_peered":"2023-07-09T21:50:24.778140+0000","last_clean":"2023-07-09T21:50:24.778140+0000","last_became_active":"2023-07-09T21:50:23.794372+0000","last_became_peered":"2023-07-09T21:50:23.794372+0000","last_unstale":"2023-07-09T21:50:24.778140+0000","last_undegraded":"2023-07-09T21:50:24.778140+0000","last_fullsized":"2023-07-09T21:50:24.778140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094667+0000","last_change":"2023-07-09T21:50:22.782310+0000","last_active":"2023-07-09T21:50:25.094667+0000","last_peered":"2023-07-09T21:50:25.094667+0000","last_clean":"2023-07-09T21:50:25.094667+0000","last_became_active":"2023-07-09T21:50:22.782041+0000","last_became_peered":"2023-07-09T21:50:22.782041+0000","last_unstale":"2023-07-09T21:50:25.094667+0000","last_undegraded":"2023-07-09T21:50:25.094667+0000","last_fullsized":"2023-07-09T21:50:25.094667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:11:23.436562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401729+0000","last_change":"2023-07-09T21:50:23.789564+0000","last_active":"2023-07-09T21:50:25.401729+0000","last_peered":"2023-07-09T21:50:25.401729+0000","last_clean":"2023-07-09T21:50:25.401729+0000","last_became_active":"2023-07-09T21:50:23.789320+0000","last_became_peered":"2023-07-09T21:50:23.789320+0000","last_unstale":"2023-07-09T21:50:25.401729+0000","last_undegraded":"2023-07-09T21:50:25.401729+0000","last_fullsized":"2023-07-09T21:50:25.401729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:05.934271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771882+0000","last_change":"2023-07-09T21:50:22.769028+0000","last_active":"2023-07-09T21:50:24.771882+0000","last_peered":"2023-07-09T21:50:24.771882+0000","last_clean":"2023-07-09T21:50:24.771882+0000","last_became_active":"2023-07-09T21:50:22.768697+0000","last_became_peered":"2023-07-09T21:50:22.768697+0000","last_unstale":"2023-07-09T21:50:24.771882+0000","last_undegraded":"2023-07-09T21:50:24.771882+0000","last_fullsized":"2023-07-09T21:50:24.771882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:12.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773064+0000","last_change":"2023-07-09T21:50:23.792126+0000","last_active":"2023-07-09T21:50:24.773064+0000","last_peered":"2023-07-09T21:50:24.773064+0000","last_clean":"2023-07-09T21:50:24.773064+0000","last_became_active":"2023-07-09T21:50:23.790182+0000","last_became_peered":"2023-07-09T21:50:23.790182+0000","last_unstale":"2023-07-09T21:50:24.773064+0000","last_undegraded":"2023-07-09T21:50:24.773064+0000","last_fullsized":"2023-07-09T21:50:24.773064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770745+0000","last_change":"2023-07-09T21:50:22.769216+0000","last_active":"2023-07-09T21:50:24.770745+0000","last_peered":"2023-07-09T21:50:24.770745+0000","last_clean":"2023-07-09T21:50:24.770745+0000","last_became_active":"2023-07-09T21:50:22.768893+0000","last_became_peered":"2023-07-09T21:50:22.768893+0000","last_unstale":"2023-07-09T21:50:24.770745+0000","last_undegraded":"2023-07-09T21:50:24.770745+0000","last_fullsized":"2023-07-09T21:50:24.770745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:32.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778315+0000","last_change":"2023-07-09T21:50:23.790525+0000","last_active":"2023-07-09T21:50:24.778315+0000","last_peered":"2023-07-09T21:50:24.778315+0000","last_clean":"2023-07-09T21:50:24.778315+0000","last_became_active":"2023-07-09T21:50:23.790164+0000","last_became_peered":"2023-07-09T21:50:23.790164+0000","last_unstale":"2023-07-09T21:50:24.778315+0000","last_undegraded":"2023-07-09T21:50:24.778315+0000","last_fullsized":"2023-07-09T21:50:24.778315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.148959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401701+0000","last_change":"2023-07-09T21:50:22.779742+0000","last_active":"2023-07-09T21:50:25.401701+0000","last_peered":"2023-07-09T21:50:25.401701+0000","last_clean":"2023-07-09T21:50:25.401701+0000","last_became_active":"2023-07-09T21:50:22.779462+0000","last_became_peered":"2023-07-09T21:50:22.779462+0000","last_unstale":"2023-07-09T21:50:25.401701+0000","last_undegraded":"2023-07-09T21:50:25.401701+0000","last_fullsized":"2023-07-09T21:50:25.401701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:34.301244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778898+0000","last_change":"2023-07-09T21:50:23.793928+0000","last_active":"2023-07-09T21:50:24.778898+0000","last_peered":"2023-07-09T21:50:24.778898+0000","last_clean":"2023-07-09T21:50:24.778898+0000","last_became_active":"2023-07-09T21:50:23.793620+0000","last_became_peered":"2023-07-09T21:50:23.793620+0000","last_unstale":"2023-07-09T21:50:24.778898+0000","last_undegraded":"2023-07-09T21:50:24.778898+0000","last_fullsized":"2023-07-09T21:50:24.778898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:09.839230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778364+0000","last_change":"2023-07-09T21:50:22.772850+0000","last_active":"2023-07-09T21:50:24.778364+0000","last_peered":"2023-07-09T21:50:24.778364+0000","last_clean":"2023-07-09T21:50:24.778364+0000","last_became_active":"2023-07-09T21:50:22.772522+0000","last_became_peered":"2023-07-09T21:50:22.772522+0000","last_unstale":"2023-07-09T21:50:24.778364+0000","last_undegraded":"2023-07-09T21:50:24.778364+0000","last_fullsized":"2023-07-09T21:50:24.778364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:29.580228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778733+0000","last_change":"2023-07-09T21:50:23.787502+0000","last_active":"2023-07-09T21:50:24.778733+0000","last_peered":"2023-07-09T21:50:24.778733+0000","last_clean":"2023-07-09T21:50:24.778733+0000","last_became_active":"2023-07-09T21:50:23.786685+0000","last_became_peered":"2023-07-09T21:50:23.786685+0000","last_unstale":"2023-07-09T21:50:24.778733+0000","last_undegraded":"2023-07-09T21:50:24.778733+0000","last_fullsized":"2023-07-09T21:50:24.778733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:47:54.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770315+0000","last_change":"2023-07-09T21:50:22.769583+0000","last_active":"2023-07-09T21:50:24.770315+0000","last_peered":"2023-07-09T21:50:24.770315+0000","last_clean":"2023-07-09T21:50:24.770315+0000","last_became_active":"2023-07-09T21:50:22.768169+0000","last_became_peered":"2023-07-09T21:50:22.768169+0000","last_unstale":"2023-07-09T21:50:24.770315+0000","last_undegraded":"2023-07-09T21:50:24.770315+0000","last_fullsized":"2023-07-09T21:50:24.770315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:24.750960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833106+0000","last_change":"2023-07-09T21:50:23.784726+0000","last_active":"2023-07-09T21:50:24.833106+0000","last_peered":"2023-07-09T21:50:24.833106+0000","last_clean":"2023-07-09T21:50:24.833106+0000","last_became_active":"2023-07-09T21:50:23.777193+0000","last_became_peered":"2023-07-09T21:50:23.777193+0000","last_unstale":"2023-07-09T21:50:24.833106+0000","last_undegraded":"2023-07-09T21:50:24.833106+0000","last_fullsized":"2023-07-09T21:50:24.833106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:43:56.851579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833107+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:50:24.833107+0000","last_peered":"2023-07-09T21:50:24.833107+0000","last_clean":"2023-07-09T21:50:24.833107+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:50:24.833107+0000","last_undegraded":"2023-07-09T21:50:24.833107+0000","last_fullsized":"2023-07-09T21:50:24.833107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:30:59.285734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771985+0000","last_change":"2023-07-09T21:50:22.772281+0000","last_active":"2023-07-09T21:50:24.771985+0000","last_peered":"2023-07-09T21:50:24.771985+0000","last_clean":"2023-07-09T21:50:24.771985+0000","last_became_active":"2023-07-09T21:50:22.769167+0000","last_became_peered":"2023-07-09T21:50:22.769167+0000","last_unstale":"2023-07-09T21:50:24.771985+0000","last_undegraded":"2023-07-09T21:50:24.771985+0000","last_fullsized":"2023-07-09T21:50:24.771985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:05.547490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832719+0000","last_change":"2023-07-09T21:50:23.783723+0000","last_active":"2023-07-09T21:50:24.832719+0000","last_peered":"2023-07-09T21:50:24.832719+0000","last_clean":"2023-07-09T21:50:24.832719+0000","last_became_active":"2023-07-09T21:50:23.783453+0000","last_became_peered":"2023-07-09T21:50:23.783453+0000","last_unstale":"2023-07-09T21:50:24.832719+0000","last_undegraded":"2023-07-09T21:50:24.832719+0000","last_fullsized":"2023-07-09T21:50:24.832719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:19.725831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771999+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:50:24.771999+0000","last_peered":"2023-07-09T21:50:24.771999+0000","last_clean":"2023-07-09T21:50:24.771999+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:50:24.771999+0000","last_undegraded":"2023-07-09T21:50:24.771999+0000","last_fullsized":"2023-07-09T21:50:24.771999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:48.089970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778477+0000","last_change":"2023-07-09T21:50:22.778044+0000","last_active":"2023-07-09T21:50:24.778477+0000","last_peered":"2023-07-09T21:50:24.778477+0000","last_clean":"2023-07-09T21:50:24.778477+0000","last_became_active":"2023-07-09T21:50:22.777708+0000","last_became_peered":"2023-07-09T21:50:22.777708+0000","last_unstale":"2023-07-09T21:50:24.778477+0000","last_undegraded":"2023-07-09T21:50:24.778477+0000","last_fullsized":"2023-07-09T21:50:24.778477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:12.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833233+0000","last_change":"2023-07-09T21:50:23.780850+0000","last_active":"2023-07-09T21:50:24.833233+0000","last_peered":"2023-07-09T21:50:24.833233+0000","last_clean":"2023-07-09T21:50:24.833233+0000","last_became_active":"2023-07-09T21:50:23.780529+0000","last_became_peered":"2023-07-09T21:50:23.780529+0000","last_unstale":"2023-07-09T21:50:24.833233+0000","last_undegraded":"2023-07-09T21:50:24.833233+0000","last_fullsized":"2023-07-09T21:50:24.833233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:34:40.996681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401178+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:50:25.401178+0000","last_peered":"2023-07-09T21:50:25.401178+0000","last_clean":"2023-07-09T21:50:25.401178+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:50:25.401178+0000","last_undegraded":"2023-07-09T21:50:25.401178+0000","last_fullsized":"2023-07-09T21:50:25.401178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:57:32.051923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832617+0000","last_change":"2023-07-09T21:50:22.774908+0000","last_active":"2023-07-09T21:50:24.832617+0000","last_peered":"2023-07-09T21:50:24.832617+0000","last_clean":"2023-07-09T21:50:24.832617+0000","last_became_active":"2023-07-09T21:50:22.774600+0000","last_became_peered":"2023-07-09T21:50:22.774600+0000","last_unstale":"2023-07-09T21:50:24.832617+0000","last_undegraded":"2023-07-09T21:50:24.832617+0000","last_fullsized":"2023-07-09T21:50:24.832617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:14:37.334350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833092+0000","last_change":"2023-07-09T21:50:23.786034+0000","last_active":"2023-07-09T21:50:24.833092+0000","last_peered":"2023-07-09T21:50:24.833092+0000","last_clean":"2023-07-09T21:50:24.833092+0000","last_became_active":"2023-07-09T21:50:23.785763+0000","last_became_peered":"2023-07-09T21:50:23.785763+0000","last_unstale":"2023-07-09T21:50:24.833092+0000","last_undegraded":"2023-07-09T21:50:24.833092+0000","last_fullsized":"2023-07-09T21:50:24.833092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:29:47.157708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771488+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:50:24.771488+0000","last_peered":"2023-07-09T21:50:24.771488+0000","last_clean":"2023-07-09T21:50:24.771488+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:50:24.771488+0000","last_undegraded":"2023-07-09T21:50:24.771488+0000","last_fullsized":"2023-07-09T21:50:24.771488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:00.619257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094325+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:50:25.094325+0000","last_peered":"2023-07-09T21:50:25.094325+0000","last_clean":"2023-07-09T21:50:25.094325+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:50:25.094325+0000","last_undegraded":"2023-07-09T21:50:25.094325+0000","last_fullsized":"2023-07-09T21:50:25.094325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:21:03.421360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770620+0000","last_change":"2023-07-09T21:50:22.766454+0000","last_active":"2023-07-09T21:50:24.770620+0000","last_peered":"2023-07-09T21:50:24.770620+0000","last_clean":"2023-07-09T21:50:24.770620+0000","last_became_active":"2023-07-09T21:50:22.766057+0000","last_became_peered":"2023-07-09T21:50:22.766057+0000","last_unstale":"2023-07-09T21:50:24.770620+0000","last_undegraded":"2023-07-09T21:50:24.770620+0000","last_fullsized":"2023-07-09T21:50:24.770620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:05.837076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401812+0000","last_change":"2023-07-09T21:50:23.795134+0000","last_active":"2023-07-09T21:50:25.401812+0000","last_peered":"2023-07-09T21:50:25.401812+0000","last_clean":"2023-07-09T21:50:25.401812+0000","last_became_active":"2023-07-09T21:50:23.794914+0000","last_became_peered":"2023-07-09T21:50:23.794914+0000","last_unstale":"2023-07-09T21:50:25.401812+0000","last_undegraded":"2023-07-09T21:50:25.401812+0000","last_fullsized":"2023-07-09T21:50:25.401812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:50.693532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094581+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:50:25.094581+0000","last_peered":"2023-07-09T21:50:25.094581+0000","last_clean":"2023-07-09T21:50:25.094581+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:50:25.094581+0000","last_undegraded":"2023-07-09T21:50:25.094581+0000","last_fullsized":"2023-07-09T21:50:25.094581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:13.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771706+0000","last_change":"2023-07-09T21:50:22.777350+0000","last_active":"2023-07-09T21:50:24.771706+0000","last_peered":"2023-07-09T21:50:24.771706+0000","last_clean":"2023-07-09T21:50:24.771706+0000","last_became_active":"2023-07-09T21:50:22.776974+0000","last_became_peered":"2023-07-09T21:50:22.776974+0000","last_unstale":"2023-07-09T21:50:24.771706+0000","last_undegraded":"2023-07-09T21:50:24.771706+0000","last_fullsized":"2023-07-09T21:50:24.771706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:32.888530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773336+0000","last_change":"2023-07-09T21:50:23.801310+0000","last_active":"2023-07-09T21:50:24.773336+0000","last_peered":"2023-07-09T21:50:24.773336+0000","last_clean":"2023-07-09T21:50:24.773336+0000","last_became_active":"2023-07-09T21:50:23.798687+0000","last_became_peered":"2023-07-09T21:50:23.798687+0000","last_unstale":"2023-07-09T21:50:24.773336+0000","last_undegraded":"2023-07-09T21:50:24.773336+0000","last_fullsized":"2023-07-09T21:50:24.773336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:54.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094422+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:50:25.094422+0000","last_peered":"2023-07-09T21:50:25.094422+0000","last_clean":"2023-07-09T21:50:25.094422+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:50:25.094422+0000","last_undegraded":"2023-07-09T21:50:25.094422+0000","last_fullsized":"2023-07-09T21:50:25.094422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:19:53.960138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833243+0000","last_change":"2023-07-09T21:50:22.774621+0000","last_active":"2023-07-09T21:50:24.833243+0000","last_peered":"2023-07-09T21:50:24.833243+0000","last_clean":"2023-07-09T21:50:24.833243+0000","last_became_active":"2023-07-09T21:50:22.774322+0000","last_became_peered":"2023-07-09T21:50:22.774322+0000","last_unstale":"2023-07-09T21:50:24.833243+0000","last_undegraded":"2023-07-09T21:50:24.833243+0000","last_fullsized":"2023-07-09T21:50:24.833243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:38.364251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772919+0000","last_change":"2023-07-09T21:50:23.793311+0000","last_active":"2023-07-09T21:50:24.772919+0000","last_peered":"2023-07-09T21:50:24.772919+0000","last_clean":"2023-07-09T21:50:24.772919+0000","last_became_active":"2023-07-09T21:50:23.792913+0000","last_became_peered":"2023-07-09T21:50:23.792913+0000","last_unstale":"2023-07-09T21:50:24.772919+0000","last_undegraded":"2023-07-09T21:50:24.772919+0000","last_fullsized":"2023-07-09T21:50:24.772919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:36.978787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771232+0000","last_change":"2023-07-09T21:50:22.775713+0000","last_active":"2023-07-09T21:50:24.771232+0000","last_peered":"2023-07-09T21:50:24.771232+0000","last_clean":"2023-07-09T21:50:24.771232+0000","last_became_active":"2023-07-09T21:50:22.775420+0000","last_became_peered":"2023-07-09T21:50:22.775420+0000","last_unstale":"2023-07-09T21:50:24.771232+0000","last_undegraded":"2023-07-09T21:50:24.771232+0000","last_fullsized":"2023-07-09T21:50:24.771232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:47:53.248634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833113+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:50:24.833113+0000","last_peered":"2023-07-09T21:50:24.833113+0000","last_clean":"2023-07-09T21:50:24.833113+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:50:24.833113+0000","last_undegraded":"2023-07-09T21:50:24.833113+0000","last_fullsized":"2023-07-09T21:50:24.833113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:14:29.722207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770239+0000","last_change":"2023-07-09T21:50:23.787661+0000","last_active":"2023-07-09T21:50:24.770239+0000","last_peered":"2023-07-09T21:50:24.770239+0000","last_clean":"2023-07-09T21:50:24.770239+0000","last_became_active":"2023-07-09T21:50:23.787366+0000","last_became_peered":"2023-07-09T21:50:23.787366+0000","last_unstale":"2023-07-09T21:50:24.770239+0000","last_undegraded":"2023-07-09T21:50:24.770239+0000","last_fullsized":"2023-07-09T21:50:24.770239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:33.892801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401827+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:50:25.401827+0000","last_peered":"2023-07-09T21:50:25.401827+0000","last_clean":"2023-07-09T21:50:25.401827+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:50:25.401827+0000","last_undegraded":"2023-07-09T21:50:25.401827+0000","last_fullsized":"2023-07-09T21:50:25.401827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:32:01.823699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773325+0000","last_change":"2023-07-09T21:50:22.772687+0000","last_active":"2023-07-09T21:50:24.773325+0000","last_peered":"2023-07-09T21:50:24.773325+0000","last_clean":"2023-07-09T21:50:24.773325+0000","last_became_active":"2023-07-09T21:50:22.772342+0000","last_became_peered":"2023-07-09T21:50:22.772342+0000","last_unstale":"2023-07-09T21:50:24.773325+0000","last_undegraded":"2023-07-09T21:50:24.773325+0000","last_fullsized":"2023-07-09T21:50:24.773325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778250+0000","last_change":"2023-07-09T21:50:23.794661+0000","last_active":"2023-07-09T21:50:24.778250+0000","last_peered":"2023-07-09T21:50:24.778250+0000","last_clean":"2023-07-09T21:50:24.778250+0000","last_became_active":"2023-07-09T21:50:23.794107+0000","last_became_peered":"2023-07-09T21:50:23.794107+0000","last_unstale":"2023-07-09T21:50:24.778250+0000","last_undegraded":"2023-07-09T21:50:24.778250+0000","last_fullsized":"2023-07-09T21:50:24.778250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:36.978787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772952+0000","last_change":"2023-07-09T21:50:22.779822+0000","last_active":"2023-07-09T21:50:24.772952+0000","last_peered":"2023-07-09T21:50:24.772952+0000","last_clean":"2023-07-09T21:50:24.772952+0000","last_became_active":"2023-07-09T21:50:22.779595+0000","last_became_peered":"2023-07-09T21:50:22.779595+0000","last_unstale":"2023-07-09T21:50:24.772952+0000","last_undegraded":"2023-07-09T21:50:24.772952+0000","last_fullsized":"2023-07-09T21:50:24.772952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:37.144688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401494+0000","last_change":"2023-07-09T21:50:23.786609+0000","last_active":"2023-07-09T21:50:25.401494+0000","last_peered":"2023-07-09T21:50:25.401494+0000","last_clean":"2023-07-09T21:50:25.401494+0000","last_became_active":"2023-07-09T21:50:23.785938+0000","last_became_peered":"2023-07-09T21:50:23.785938+0000","last_unstale":"2023-07-09T21:50:25.401494+0000","last_undegraded":"2023-07-09T21:50:25.401494+0000","last_fullsized":"2023-07-09T21:50:25.401494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771497+0000","last_change":"2023-07-09T21:50:22.772154+0000","last_active":"2023-07-09T21:50:24.771497+0000","last_peered":"2023-07-09T21:50:24.771497+0000","last_clean":"2023-07-09T21:50:24.771497+0000","last_became_active":"2023-07-09T21:50:22.771882+0000","last_became_peered":"2023-07-09T21:50:22.771882+0000","last_unstale":"2023-07-09T21:50:24.771497+0000","last_undegraded":"2023-07-09T21:50:24.771497+0000","last_fullsized":"2023-07-09T21:50:24.771497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:35.974516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778410+0000","last_change":"2023-07-09T21:50:23.793009+0000","last_active":"2023-07-09T21:50:24.778410+0000","last_peered":"2023-07-09T21:50:24.778410+0000","last_clean":"2023-07-09T21:50:24.778410+0000","last_became_active":"2023-07-09T21:50:23.791995+0000","last_became_peered":"2023-07-09T21:50:23.791995+0000","last_unstale":"2023-07-09T21:50:24.778410+0000","last_undegraded":"2023-07-09T21:50:24.778410+0000","last_fullsized":"2023-07-09T21:50:24.778410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:06.841347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772036+0000","last_change":"2023-07-09T21:50:22.772972+0000","last_active":"2023-07-09T21:50:24.772036+0000","last_peered":"2023-07-09T21:50:24.772036+0000","last_clean":"2023-07-09T21:50:24.772036+0000","last_became_active":"2023-07-09T21:50:22.772647+0000","last_became_peered":"2023-07-09T21:50:22.772647+0000","last_unstale":"2023-07-09T21:50:24.772036+0000","last_undegraded":"2023-07-09T21:50:24.772036+0000","last_fullsized":"2023-07-09T21:50:24.772036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778686+0000","last_change":"2023-07-09T21:50:23.790945+0000","last_active":"2023-07-09T21:50:24.778686+0000","last_peered":"2023-07-09T21:50:24.778686+0000","last_clean":"2023-07-09T21:50:24.778686+0000","last_became_active":"2023-07-09T21:50:23.790660+0000","last_became_peered":"2023-07-09T21:50:23.790660+0000","last_unstale":"2023-07-09T21:50:24.778686+0000","last_undegraded":"2023-07-09T21:50:24.778686+0000","last_fullsized":"2023-07-09T21:50:24.778686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:36.220738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770852+0000","last_change":"2023-07-09T21:50:22.770573+0000","last_active":"2023-07-09T21:50:24.770852+0000","last_peered":"2023-07-09T21:50:24.770852+0000","last_clean":"2023-07-09T21:50:24.770852+0000","last_became_active":"2023-07-09T21:50:22.770263+0000","last_became_peered":"2023-07-09T21:50:22.770263+0000","last_unstale":"2023-07-09T21:50:24.770852+0000","last_undegraded":"2023-07-09T21:50:24.770852+0000","last_fullsized":"2023-07-09T21:50:24.770852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770370+0000","last_change":"2023-07-09T21:50:23.791092+0000","last_active":"2023-07-09T21:50:24.770370+0000","last_peered":"2023-07-09T21:50:24.770370+0000","last_clean":"2023-07-09T21:50:24.770370+0000","last_became_active":"2023-07-09T21:50:23.789631+0000","last_became_peered":"2023-07-09T21:50:23.789631+0000","last_unstale":"2023-07-09T21:50:24.770370+0000","last_undegraded":"2023-07-09T21:50:24.770370+0000","last_fullsized":"2023-07-09T21:50:24.770370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:36.978787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773272+0000","last_change":"2023-07-09T21:50:22.776290+0000","last_active":"2023-07-09T21:50:24.773272+0000","last_peered":"2023-07-09T21:50:24.773272+0000","last_clean":"2023-07-09T21:50:24.773272+0000","last_became_active":"2023-07-09T21:50:22.775873+0000","last_became_peered":"2023-07-09T21:50:22.775873+0000","last_unstale":"2023-07-09T21:50:24.773272+0000","last_undegraded":"2023-07-09T21:50:24.773272+0000","last_fullsized":"2023-07-09T21:50:24.773272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:26.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778003+0000","last_change":"2023-07-09T21:50:23.787350+0000","last_active":"2023-07-09T21:50:24.778003+0000","last_peered":"2023-07-09T21:50:24.778003+0000","last_clean":"2023-07-09T21:50:24.778003+0000","last_became_active":"2023-07-09T21:50:23.787079+0000","last_became_peered":"2023-07-09T21:50:23.787079+0000","last_unstale":"2023-07-09T21:50:24.778003+0000","last_undegraded":"2023-07-09T21:50:24.778003+0000","last_fullsized":"2023-07-09T21:50:24.778003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:57:30.199160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401659+0000","last_change":"2023-07-09T21:50:23.783603+0000","last_active":"2023-07-09T21:50:25.401659+0000","last_peered":"2023-07-09T21:50:25.401659+0000","last_clean":"2023-07-09T21:50:25.401659+0000","last_became_active":"2023-07-09T21:50:23.781930+0000","last_became_peered":"2023-07-09T21:50:23.781930+0000","last_unstale":"2023-07-09T21:50:25.401659+0000","last_undegraded":"2023-07-09T21:50:25.401659+0000","last_fullsized":"2023-07-09T21:50:25.401659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770323+0000","last_change":"2023-07-09T21:50:23.788879+0000","last_active":"2023-07-09T21:50:24.770323+0000","last_peered":"2023-07-09T21:50:24.770323+0000","last_clean":"2023-07-09T21:50:24.770323+0000","last_became_active":"2023-07-09T21:50:23.788458+0000","last_became_peered":"2023-07-09T21:50:23.788458+0000","last_unstale":"2023-07-09T21:50:24.770323+0000","last_undegraded":"2023-07-09T21:50:24.770323+0000","last_fullsized":"2023-07-09T21:50:24.770323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778113+0000","last_change":"2023-07-09T21:50:23.787304+0000","last_active":"2023-07-09T21:50:24.778113+0000","last_peered":"2023-07-09T21:50:24.778113+0000","last_clean":"2023-07-09T21:50:24.778113+0000","last_became_active":"2023-07-09T21:50:23.787022+0000","last_became_peered":"2023-07-09T21:50:23.787022+0000","last_unstale":"2023-07-09T21:50:24.778113+0000","last_undegraded":"2023-07-09T21:50:24.778113+0000","last_fullsized":"2023-07-09T21:50:24.778113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:33.892801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770719+0000","last_change":"2023-07-09T21:50:23.785978+0000","last_active":"2023-07-09T21:50:24.770719+0000","last_peered":"2023-07-09T21:50:24.770719+0000","last_clean":"2023-07-09T21:50:24.770719+0000","last_became_active":"2023-07-09T21:50:23.785694+0000","last_became_peered":"2023-07-09T21:50:23.785694+0000","last_unstale":"2023-07-09T21:50:24.770719+0000","last_undegraded":"2023-07-09T21:50:24.770719+0000","last_fullsized":"2023-07-09T21:50:24.770719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:13.602484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833070+0000","last_change":"2023-07-09T21:50:23.780066+0000","last_active":"2023-07-09T21:50:24.833070+0000","last_peered":"2023-07-09T21:50:24.833070+0000","last_clean":"2023-07-09T21:50:24.833070+0000","last_became_active":"2023-07-09T21:50:23.779691+0000","last_became_peered":"2023-07-09T21:50:23.779691+0000","last_unstale":"2023-07-09T21:50:24.833070+0000","last_undegraded":"2023-07-09T21:50:24.833070+0000","last_fullsized":"2023-07-09T21:50:24.833070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:41:54.434482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":98625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":258048,"data_stored":97005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":97005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":856064,"data_stored":687955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":880640,"data_stored":689153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":97095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":97657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":97005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:50:33.701 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T21:50:33.701 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-09T21:50:33.702 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-09T21:50:33.702 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-09T21:50:33.702 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-09T21:50:33.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.934+0000 7f55f57ff700 1 Processor -- start 2023-07-09T21:50:33.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.934+0000 7f55f57ff700 1 -- start start 2023-07-09T21:50:33.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.935+0000 7f55f57ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f55f00b1e00 0x7f55f00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.935+0000 7f55f57ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f55f00b2350 0x7f55f00d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.935+0000 7f55f57ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f00d2ce0 con 0x7f55f00d1050 2023-07-09T21:50:33.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.935+0000 7f55f57ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f00d14d0 con 0x7f55f00b1e00 2023-07-09T21:50:33.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.935+0000 7f55f57ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f00b3350 con 0x7f55f00b2350 2023-07-09T21:50:33.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.935+0000 7f55eeffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f55f00b1e00 0x7f55f00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:33.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.935+0000 7f55ef7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f55f00d1050 0x7f55f00afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56188/0 (socket says 172.21.15.53:56188) 2023-07-09T21:50:33.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.935+0000 7f55ef7fe700 1 -- 172.21.15.53:0/3043191694 learned_addr learned my addr 172.21.15.53:0/3043191694 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:33.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.936+0000 7f55ee7fc700 1 --2- 172.21.15.53:0/3043191694 >> v2:172.21.15.184:3300/0 conn(0x7f55f00b2350 0x7f55f00d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:33.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.936+0000 7f55eeffd700 1 -- 172.21.15.53:0/3043191694 >> v2:172.21.15.184:3300/0 conn(0x7f55f00b2350 msgr2=0x7f55f00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:33.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.936+0000 7f55eeffd700 1 --2- 172.21.15.53:0/3043191694 >> v2:172.21.15.184:3300/0 conn(0x7f55f00b2350 0x7f55f00d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.936+0000 7f55eeffd700 1 -- 172.21.15.53:0/3043191694 >> v1:172.21.15.53:6789/0 conn(0x7f55f00d1050 legacy=0x7f55f00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:33.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.936+0000 7f55eeffd700 1 -- 172.21.15.53:0/3043191694 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f00b3630 con 0x7f55f00b1e00 2023-07-09T21:50:33.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.936+0000 7f55edffb700 1 -- 172.21.15.53:0/3043191694 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235711272 0 0) 0x7f55f00d2ce0 con 0x7f55f00d1050 2023-07-09T21:50:33.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.936+0000 7f55eeffd700 1 --2- 172.21.15.53:0/3043191694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55f00b1e00 0x7f55f00b43f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f55f0072140 tx=0x7f55e0009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15f03974450015d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:33.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.936+0000 7f55edffb700 1 -- 172.21.15.53:0/3043191694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e0005e30 con 0x7f55f00b1e00 2023-07-09T21:50:33.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.936+0000 7f55edffb700 1 -- 172.21.15.53:0/3043191694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e0006030 con 0x7f55f00b1e00 2023-07-09T21:50:33.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.936+0000 7f55edffb700 1 -- 172.21.15.53:0/3043191694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e00063c0 con 0x7f55f00b1e00 2023-07-09T21:50:33.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.937+0000 7f55f57ff700 1 -- 172.21.15.53:0/3043191694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55f00b1e00 msgr2=0x7f55f00b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:33.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.937+0000 7f55f57ff700 1 --2- 172.21.15.53:0/3043191694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55f00b1e00 0x7f55f00b43f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f55f0072140 tx=0x7f55e0009b00 comp rx=0 tx=0).stop 2023-07-09T21:50:33.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.937+0000 7f55f57ff700 1 -- 172.21.15.53:0/3043191694 shutdown_connections 2023-07-09T21:50:33.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.937+0000 7f55f57ff700 1 --2- 172.21.15.53:0/3043191694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55f00b1e00 0x7f55f00b43f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.937+0000 7f55f57ff700 1 --2- 172.21.15.53:0/3043191694 >> v2:172.21.15.184:3300/0 conn(0x7f55f00b2350 0x7f55f00d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.937+0000 7f55f57ff700 1 -- 172.21.15.53:0/3043191694 >> 172.21.15.53:0/3043191694 conn(0x7f55f009c1d0 msgr2=0x7f55f00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:33.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.937+0000 7f55f57ff700 1 -- 172.21.15.53:0/3043191694 shutdown_connections 2023-07-09T21:50:33.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.937+0000 7f55f57ff700 1 -- 172.21.15.53:0/3043191694 wait complete. 2023-07-09T21:50:33.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.940+0000 7f55f57ff700 1 Processor -- start 2023-07-09T21:50:33.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.940+0000 7f55f57ff700 1 -- start start 2023-07-09T21:50:33.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.941+0000 7f55f57ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55f00b1e00 0x7f55f014b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.941+0000 7f55f57ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55f00b2350 0x7f55f00cea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.941+0000 7f55f57ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55f00d1050 0x7f55f00c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.941+0000 7f55f57ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00ce5f0 con 0x7f55f00b2350 2023-07-09T21:50:33.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.941+0000 7f55f57ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f014b8a0 con 0x7f55f00b1e00 2023-07-09T21:50:33.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.941+0000 7f55f57ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00cefc0 con 0x7f55f00d1050 2023-07-09T21:50:33.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.941+0000 7f55ee7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55f00b2350 0x7f55f00cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.941+0000 7f55ee7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55f00b2350 0x7f55f00cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52702/0 (socket says 172.21.15.53:52702) 2023-07-09T21:50:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.941+0000 7f55ee7fc700 1 -- 172.21.15.53:0/2436235214 learned_addr learned my addr 172.21.15.53:0/2436235214 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.941+0000 7f55eeffd700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55f00b1e00 0x7f55f014b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.942+0000 7f55ef7fe700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55f00d1050 0x7f55f00c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.942+0000 7f55ee7fc700 1 -- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55f00d1050 msgr2=0x7f55f00c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.942+0000 7f55ee7fc700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55f00d1050 0x7f55f00c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.942+0000 7f55ee7fc700 1 -- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55f00b1e00 msgr2=0x7f55f014b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.942+0000 7f55ee7fc700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55f00b1e00 0x7f55f014b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:33.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.942+0000 7f55ee7fc700 1 -- 172.21.15.53:0/2436235214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e0009430 con 0x7f55f00b2350 2023-07-09T21:50:33.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.942+0000 7f55ee7fc700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55f00b2350 0x7f55f00cea80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f55e400d830 tx=0x7f55e400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:33.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.942+0000 7f55d77fe700 1 -- 172.21.15.53:0/2436235214 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e40125f0 con 0x7f55f00b2350 2023-07-09T21:50:33.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.942+0000 7f55d77fe700 1 -- 172.21.15.53:0/2436235214 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e4012750 con 0x7f55f00b2350 2023-07-09T21:50:33.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.942+0000 7f55f57ff700 1 -- 172.21.15.53:0/2436235214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f00cd9e0 con 0x7f55f00b2350 2023-07-09T21:50:33.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.942+0000 7f55d77fe700 1 -- 172.21.15.53:0/2436235214 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4012b00 con 0x7f55f00b2350 2023-07-09T21:50:33.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.942+0000 7f55f57ff700 1 -- 172.21.15.53:0/2436235214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f00cdfa0 con 0x7f55f00b2350 2023-07-09T21:50:33.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.943+0000 7f55f57ff700 1 -- 172.21.15.53:0/2436235214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f00ce7a0 con 0x7f55f00b2350 2023-07-09T21:50:33.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.944+0000 7f55d77fe700 1 -- 172.21.15.53:0/2436235214 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f55e4012c60 con 0x7f55f00b2350 2023-07-09T21:50:33.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.945+0000 7f55d77fe700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f55dc06ace0 0x7f55dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:33.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.945+0000 7f55d77fe700 1 -- 172.21.15.53:0/2436235214 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f55e4089580 con 0x7f55f00b2350 2023-07-09T21:50:33.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.946+0000 7f55eeffd700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f55dc06ace0 0x7f55dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:33.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.946+0000 7f55eeffd700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f55dc06ace0 0x7f55dc06d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009b40 tx=0x7f55e0008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:33.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:33.950+0000 7f55d77fe700 1 -- 172.21.15.53:0/2436235214 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f55f00ce7a0 con 0x7f55f00b2350 2023-07-09T21:50:34.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.219+0000 7f55f57ff700 1 -- 172.21.15.53:0/2436235214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f55f00ce7a0 con 0x7f55f00b2350 2023-07-09T21:50:34.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.223+0000 7f55d77fe700 1 -- 172.21.15.53:0/2436235214 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170848 (secure 0 0 0) 0x7f55f00ce7a0 con 0x7f55f00b2350 2023-07-09T21:50:34.226 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.226+0000 7f55f57ff700 1 -- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f55dc06ace0 msgr2=0x7f55dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.226+0000 7f55f57ff700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f55dc06ace0 0x7f55dc06d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009b40 tx=0x7f55e0008070 comp rx=0 tx=0).stop 2023-07-09T21:50:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.226+0000 7f55f57ff700 1 -- 172.21.15.53:0/2436235214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55f00b2350 msgr2=0x7f55f00cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.226+0000 7f55f57ff700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55f00b2350 0x7f55f00cea80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f55e400d830 tx=0x7f55e400db40 comp rx=0 tx=0).stop 2023-07-09T21:50:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.226+0000 7f55f57ff700 1 -- 172.21.15.53:0/2436235214 shutdown_connections 2023-07-09T21:50:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.226+0000 7f55f57ff700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f55dc06ace0 0x7f55dc06d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.226+0000 7f55f57ff700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55f00d1050 0x7f55f00c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.226+0000 7f55f57ff700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55f00b1e00 0x7f55f014b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.226+0000 7f55f57ff700 1 --2- 172.21.15.53:0/2436235214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55f00b2350 0x7f55f00cea80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.226+0000 7f55f57ff700 1 -- 172.21.15.53:0/2436235214 >> 172.21.15.53:0/2436235214 conn(0x7f55f009c1d0 msgr2=0x7f55f00afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:34.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.226+0000 7f55f57ff700 1 -- 172.21.15.53:0/2436235214 shutdown_connections 2023-07-09T21:50:34.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.226+0000 7f55f57ff700 1 -- 172.21.15.53:0/2436235214 wait complete. 2023-07-09T21:50:34.245 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2043123506},{"type":"v1","addr":"172.21.15.184:6833","nonce":2043123506}]},"active_addr":"172.21.15.184:6833/2043123506","active_change":"2023-07-09T21:50:02.829609+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":3841713386}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":2218359563}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":3134681258}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":250998646}]}]} 2023-07-09T21:50:34.253 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-09T21:50:34.254 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-09T21:50:34.254 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:50:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.453+0000 7fb55f1ff700 1 Processor -- start 2023-07-09T21:50:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.454+0000 7fb55f1ff700 1 -- start start 2023-07-09T21:50:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.455+0000 7fb55f1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb5580b1e00 0x7fb5580b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.455+0000 7fb55f1ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb5580b2350 0x7fb5580d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.455+0000 7fb55f1ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5580d2ce0 con 0x7fb5580d1050 2023-07-09T21:50:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.455+0000 7fb55f1ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580d14d0 con 0x7fb5580b2350 2023-07-09T21:50:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.455+0000 7fb55f1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580b3350 con 0x7fb5580b1e00 2023-07-09T21:50:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.455+0000 7fb55d79c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb5580d1050 0x7fb5580afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56202/0 (socket says 172.21.15.53:56202) 2023-07-09T21:50:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.455+0000 7fb557fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb5580b2350 0x7fb5580d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.455+0000 7fb55d79c700 1 -- 172.21.15.53:0/3542896393 learned_addr learned my addr 172.21.15.53:0/3542896393 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.455+0000 7fb55cf9b700 1 --2- 172.21.15.53:0/3542896393 >> v2:172.21.15.184:3300/0 conn(0x7fb5580b1e00 0x7fb5580b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.455+0000 7fb5577fe700 1 -- 172.21.15.53:0/3542896393 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867090704 0 0) 0x7fb5580d2ce0 con 0x7fb5580d1050 2023-07-09T21:50:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.455+0000 7fb557fff700 1 -- 172.21.15.53:0/3542896393 >> v2:172.21.15.184:3300/0 conn(0x7fb5580b1e00 msgr2=0x7fb5580b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.455+0000 7fb557fff700 1 --2- 172.21.15.53:0/3542896393 >> v2:172.21.15.184:3300/0 conn(0x7fb5580b1e00 0x7fb5580b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.456+0000 7fb557fff700 1 -- 172.21.15.53:0/3542896393 >> v1:172.21.15.53:6789/0 conn(0x7fb5580d1050 legacy=0x7fb5580afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.456+0000 7fb557fff700 1 -- 172.21.15.53:0/3542896393 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5580b3630 con 0x7fb5580b2350 2023-07-09T21:50:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.456+0000 7fb557fff700 1 --2- 172.21.15.53:0/3542896393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5580b2350 0x7fb5580d0b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb55808d170 tx=0x7fb544009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ffcd3c49f96070 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.456+0000 7fb5577fe700 1 -- 172.21.15.53:0/3542896393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544011830 con 0x7fb5580b2350 2023-07-09T21:50:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.456+0000 7fb5577fe700 1 -- 172.21.15.53:0/3542896393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb544011990 con 0x7fb5580b2350 2023-07-09T21:50:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.456+0000 7fb5577fe700 1 -- 172.21.15.53:0/3542896393 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544011d20 con 0x7fb5580b2350 2023-07-09T21:50:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.456+0000 7fb55f1ff700 1 -- 172.21.15.53:0/3542896393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5580b2350 msgr2=0x7fb5580d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.456+0000 7fb55f1ff700 1 --2- 172.21.15.53:0/3542896393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5580b2350 0x7fb5580d0b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb55808d170 tx=0x7fb544009b20 comp rx=0 tx=0).stop 2023-07-09T21:50:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.457+0000 7fb55f1ff700 1 -- 172.21.15.53:0/3542896393 shutdown_connections 2023-07-09T21:50:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.457+0000 7fb55f1ff700 1 --2- 172.21.15.53:0/3542896393 >> v2:172.21.15.184:3300/0 conn(0x7fb5580b1e00 0x7fb5580b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.457+0000 7fb55f1ff700 1 --2- 172.21.15.53:0/3542896393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5580b2350 0x7fb5580d0b10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.457+0000 7fb55f1ff700 1 -- 172.21.15.53:0/3542896393 >> 172.21.15.53:0/3542896393 conn(0x7fb55809c1d0 msgr2=0x7fb5580d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.457+0000 7fb55f1ff700 1 -- 172.21.15.53:0/3542896393 shutdown_connections 2023-07-09T21:50:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.457+0000 7fb55f1ff700 1 -- 172.21.15.53:0/3542896393 wait complete. 2023-07-09T21:50:34.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.458+0000 7fb55f1ff700 1 Processor -- start 2023-07-09T21:50:34.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.459+0000 7fb55f1ff700 1 -- start start 2023-07-09T21:50:34.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.459+0000 7fb55f1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5580b1e00 0x7fb5580cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.459+0000 7fb55f1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5580b2350 0x7fb5581f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.459+0000 7fb55f1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5580d1050 0x7fb5580cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb55f1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5581f1c40 con 0x7fb5580b2350 2023-07-09T21:50:34.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb55f1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580cbfb0 con 0x7fb5580d1050 2023-07-09T21:50:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb55f1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580cdc40 con 0x7fb5580b1e00 2023-07-09T21:50:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb557fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5580b2350 0x7fb5581f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb557fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5580b2350 0x7fb5581f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52724/0 (socket says 172.21.15.53:52724) 2023-07-09T21:50:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb557fff700 1 -- 172.21.15.53:0/940055785 learned_addr learned my addr 172.21.15.53:0/940055785 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb55cf9b700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5580b1e00 0x7fb5580cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb55d79c700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5580d1050 0x7fb5580cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb557fff700 1 -- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5580b1e00 msgr2=0x7fb5580cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb557fff700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5580b1e00 0x7fb5580cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb557fff700 1 -- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5580d1050 msgr2=0x7fb5580cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb557fff700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5580d1050 0x7fb5580cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb557fff700 1 -- 172.21.15.53:0/940055785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5440094a0 con 0x7fb5580b2350 2023-07-09T21:50:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.460+0000 7fb557fff700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5580b2350 0x7fb5581f1700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb544009b60 tx=0x7fb544004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.461+0000 7fb5557fa700 1 -- 172.21.15.53:0/940055785 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440036a0 con 0x7fb5580b2350 2023-07-09T21:50:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.461+0000 7fb5557fa700 1 -- 172.21.15.53:0/940055785 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54401e070 con 0x7fb5580b2350 2023-07-09T21:50:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.461+0000 7fb55f1ff700 1 -- 172.21.15.53:0/940055785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5580cc1f0 con 0x7fb5580b2350 2023-07-09T21:50:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.461+0000 7fb5557fa700 1 -- 172.21.15.53:0/940055785 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544003a20 con 0x7fb5580b2350 2023-07-09T21:50:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.461+0000 7fb55f1ff700 1 -- 172.21.15.53:0/940055785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5580cd5f0 con 0x7fb5580b2350 2023-07-09T21:50:34.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.462+0000 7fb55f1ff700 1 -- 172.21.15.53:0/940055785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55804e280 con 0x7fb5580b2350 2023-07-09T21:50:34.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.463+0000 7fb5557fa700 1 -- 172.21.15.53:0/940055785 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb544003b80 con 0x7fb5580b2350 2023-07-09T21:50:34.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.464+0000 7fb5557fa700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb53c06ace0 0x7fb53c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.464+0000 7fb5557fa700 1 -- 172.21.15.53:0/940055785 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb54408a3b0 con 0x7fb5580b2350 2023-07-09T21:50:34.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.465+0000 7fb55cf9b700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb53c06ace0 0x7fb53c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:34.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.465+0000 7fb55cf9b700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb53c06ace0 0x7fb53c06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009b20 tx=0x7fb54c0091c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:34.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.468+0000 7fb5557fa700 1 -- 172.21.15.53:0/940055785 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb544055450 con 0x7fb5580b2350 2023-07-09T21:50:34.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.678+0000 7fb55f1ff700 1 -- 172.21.15.53:0/940055785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5580cdd80 con 0x7fb5580b2350 2023-07-09T21:50:34.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.679+0000 7fb5557fa700 1 -- 172.21.15.53:0/940055785 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fb544058a70 con 0x7fb5580b2350 2023-07-09T21:50:34.681 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:34.681 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:24.766288+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:50:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.681+0000 7fb55f1ff700 1 -- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb53c06ace0 msgr2=0x7fb53c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.681+0000 7fb55f1ff700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb53c06ace0 0x7fb53c06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009b20 tx=0x7fb54c0091c0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.681+0000 7fb55f1ff700 1 -- 172.21.15.53:0/940055785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5580b2350 msgr2=0x7fb5581f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.681+0000 7fb55f1ff700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5580b2350 0x7fb5581f1700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb544009b60 tx=0x7fb544004750 comp rx=0 tx=0).stop 2023-07-09T21:50:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.682+0000 7fb55f1ff700 1 -- 172.21.15.53:0/940055785 shutdown_connections 2023-07-09T21:50:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.682+0000 7fb55f1ff700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb53c06ace0 0x7fb53c06d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.682+0000 7fb55f1ff700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5580d1050 0x7fb5580cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.682+0000 7fb55f1ff700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5580b1e00 0x7fb5580cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.682+0000 7fb55f1ff700 1 --2- 172.21.15.53:0/940055785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5580b2350 0x7fb5581f1700 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.682+0000 7fb55f1ff700 1 -- 172.21.15.53:0/940055785 >> 172.21.15.53:0/940055785 conn(0x7fb55809c1d0 msgr2=0x7fb5580b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.682+0000 7fb55f1ff700 1 -- 172.21.15.53:0/940055785 shutdown_connections 2023-07-09T21:50:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.682+0000 7fb55f1ff700 1 -- 172.21.15.53:0/940055785 wait complete. 2023-07-09T21:50:34.701 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-09T21:50:34.701 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:50:34.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.899+0000 7fd1d37ff700 1 Processor -- start 2023-07-09T21:50:34.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.899+0000 7fd1d37ff700 1 -- start start 2023-07-09T21:50:34.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.900+0000 7fd1d37ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd1cc0b1e00 0x7fd1cc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.900+0000 7fd1d37ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc0d2ce0 con 0x7fd1cc0b2350 2023-07-09T21:50:34.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.900+0000 7fd1d37ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc0b3350 con 0x7fd1cc0d1220 2023-07-09T21:50:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.900+0000 7fd1d37ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1cc0b3630 con 0x7fd1cc0b1e00 2023-07-09T21:50:34.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.900+0000 7fd1d0d9a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd1cc0b2350 0x7fd1cc0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56204/0 (socket says 172.21.15.53:56204) 2023-07-09T21:50:34.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.900+0000 7fd1d0d9a700 1 -- 172.21.15.53:0/3624784481 learned_addr learned my addr 172.21.15.53:0/3624784481 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:34.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1d159b700 1 --2- 172.21.15.53:0/3624784481 >> v2:172.21.15.184:3300/0 conn(0x7fd1cc0b1e00 0x7fd1cc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:34.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78989613 0 0) 0x7fd1cc0d2ce0 con 0x7fd1cc0b2350 2023-07-09T21:50:34.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b80035b0 con 0x7fd1cc0b2350 2023-07-09T21:50:34.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1725529932 0 0) 0x7fd1b80035b0 con 0x7fd1cc0b2350 2023-07-09T21:50:34.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 >> v2:172.21.15.184:3300/0 conn(0x7fd1cc0b1e00 msgr2=0x7fd1cc0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:34.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1c3fff700 1 --2- 172.21.15.53:0/3624784481 >> v2:172.21.15.184:3300/0 conn(0x7fd1cc0b1e00 0x7fd1cc0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 >> v1:172.21.15.184:6789/0 conn(0x7fd1cc0d1220 legacy=0x7fd1cc0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:34.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc0b3910 con 0x7fd1cc0b2350 2023-07-09T21:50:34.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7fd1bc001670 con 0x7fd1cc0b2350 2023-07-09T21:50:34.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 >> v1:172.21.15.53:6789/0 conn(0x7fd1cc0b2350 legacy=0x7fd1cc0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:34.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1c3fff700 1 --2- 172.21.15.53:0/3624784481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1b8003a50 0x7fd1b8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1c3fff700 1 --2- 172.21.15.53:0/3624784481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1b8004850 0x7fd1b8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1c3fff700 1 --2- 172.21.15.53:0/3624784481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1b8005250 0x7fd1b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.901+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0b3630 con 0x7fd1b8004850 2023-07-09T21:50:34.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.902+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b800c160 con 0x7fd1b8003a50 2023-07-09T21:50:34.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.902+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b800c320 con 0x7fd1b8005250 2023-07-09T21:50:34.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.902+0000 7fd1d159b700 1 --2- 172.21.15.53:0/3624784481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1b8003a50 0x7fd1b8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:34.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.902+0000 7fd1d0d9a700 1 --2- 172.21.15.53:0/3624784481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1b8004850 0x7fd1b8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:34.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.902+0000 7fd1d1d9c700 1 --2- 172.21.15.53:0/3624784481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1b8005250 0x7fd1b800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:34.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.902+0000 7fd1d159b700 1 -- 172.21.15.53:0/3624784481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1b8005250 msgr2=0x7fd1b800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:34.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.902+0000 7fd1d159b700 1 --2- 172.21.15.53:0/3624784481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1b8005250 0x7fd1b800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.902+0000 7fd1d159b700 1 -- 172.21.15.53:0/3624784481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1b8004850 msgr2=0x7fd1b8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:34.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.902+0000 7fd1d159b700 1 --2- 172.21.15.53:0/3624784481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1b8004850 0x7fd1b8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.902+0000 7fd1d159b700 1 -- 172.21.15.53:0/3624784481 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b80035b0 con 0x7fd1b8003a50 2023-07-09T21:50:34.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.902+0000 7fd1d1d9c700 1 -- 172.21.15.53:0/3624784481 reap_dead start 2023-07-09T21:50:34.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.902+0000 7fd1d0d9a700 1 --2- 172.21.15.53:0/3624784481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1b8004850 0x7fd1b8004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:50:34.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.902+0000 7fd1d159b700 1 --2- 172.21.15.53:0/3624784481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1b8003a50 0x7fd1b8003e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009b40 tx=0x7fd1b8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b3d43617933f0f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:34.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.903+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8005a20 con 0x7fd1b8003a50 2023-07-09T21:50:34.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.903+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c8005b80 con 0x7fd1b8003a50 2023-07-09T21:50:34.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.903+0000 7fd1c3fff700 1 -- 172.21.15.53:0/3624784481 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c800e6c0 con 0x7fd1b8003a50 2023-07-09T21:50:34.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.903+0000 7fd1d37ff700 1 -- 172.21.15.53:0/3624784481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1b8003a50 msgr2=0x7fd1b8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:34.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.903+0000 7fd1d37ff700 1 --2- 172.21.15.53:0/3624784481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1b8003a50 0x7fd1b8003e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009b40 tx=0x7fd1b8005880 comp rx=0 tx=0).stop 2023-07-09T21:50:34.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.903+0000 7fd1d37ff700 1 -- 172.21.15.53:0/3624784481 shutdown_connections 2023-07-09T21:50:34.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.903+0000 7fd1d37ff700 1 --2- 172.21.15.53:0/3624784481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1b8003a50 0x7fd1b8003e60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.903+0000 7fd1d37ff700 1 -- 172.21.15.53:0/3624784481 >> 172.21.15.53:0/3624784481 conn(0x7fd1cc09c1d0 msgr2=0x7fd1cc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:34.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.903+0000 7fd1d37ff700 1 -- 172.21.15.53:0/3624784481 shutdown_connections 2023-07-09T21:50:34.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.903+0000 7fd1d37ff700 1 -- 172.21.15.53:0/3624784481 wait complete. 2023-07-09T21:50:34.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.905+0000 7fd1d37ff700 1 Processor -- start 2023-07-09T21:50:34.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.905+0000 7fd1d37ff700 1 -- start start 2023-07-09T21:50:34.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.906+0000 7fd1d37ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1b8003a50 0x7fd1cc0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.906+0000 7fd1d37ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1cc0cff70 0x7fd1cc0cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.906+0000 7fd1d37ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1cc0cdfa0 0x7fd1cc0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.906+0000 7fd1d37ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0d03c0 con 0x7fd1b8003a50 2023-07-09T21:50:34.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.906+0000 7fd1d37ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0cabe0 con 0x7fd1cc0cff70 2023-07-09T21:50:34.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.906+0000 7fd1d37ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0caec0 con 0x7fd1cc0cdfa0 2023-07-09T21:50:34.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.906+0000 7fd1d159b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1b8003a50 0x7fd1cc0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:34.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.906+0000 7fd1d159b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1b8003a50 0x7fd1cc0cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52748/0 (socket says 172.21.15.53:52748) 2023-07-09T21:50:34.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.906+0000 7fd1d159b700 1 -- 172.21.15.53:0/2978012934 learned_addr learned my addr 172.21.15.53:0/2978012934 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:34.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.907+0000 7fd1d159b700 1 -- 172.21.15.53:0/2978012934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1cc0cdfa0 msgr2=0x7fd1cc0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:34.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.907+0000 7fd1d159b700 1 --2- 172.21.15.53:0/2978012934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1cc0cdfa0 0x7fd1cc0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.907+0000 7fd1d159b700 1 -- 172.21.15.53:0/2978012934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1cc0cff70 msgr2=0x7fd1cc0cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:34.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.907+0000 7fd1d159b700 1 --2- 172.21.15.53:0/2978012934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1cc0cff70 0x7fd1cc0cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:34.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.907+0000 7fd1d159b700 1 -- 172.21.15.53:0/2978012934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc0cb1a0 con 0x7fd1b8003a50 2023-07-09T21:50:34.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.907+0000 7fd1d159b700 1 --2- 172.21.15.53:0/2978012934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1b8003a50 0x7fd1cc0cbc80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8000c00 tx=0x7fd1c80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:34.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.907+0000 7fd1c1ffb700 1 -- 172.21.15.53:0/2978012934 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8020070 con 0x7fd1b8003a50 2023-07-09T21:50:34.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.907+0000 7fd1c1ffb700 1 -- 172.21.15.53:0/2978012934 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c8005e30 con 0x7fd1b8003a50 2023-07-09T21:50:34.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.907+0000 7fd1d37ff700 1 -- 172.21.15.53:0/2978012934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1cc0cb480 con 0x7fd1b8003a50 2023-07-09T21:50:34.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.907+0000 7fd1c1ffb700 1 -- 172.21.15.53:0/2978012934 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8004460 con 0x7fd1b8003a50 2023-07-09T21:50:34.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.907+0000 7fd1d37ff700 1 -- 172.21.15.53:0/2978012934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1cc0ca800 con 0x7fd1b8003a50 2023-07-09T21:50:34.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.908+0000 7fd1d37ff700 1 -- 172.21.15.53:0/2978012934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc0cb9a0 con 0x7fd1b8003a50 2023-07-09T21:50:34.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.909+0000 7fd1c1ffb700 1 -- 172.21.15.53:0/2978012934 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd1c80036a0 con 0x7fd1b8003a50 2023-07-09T21:50:34.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.910+0000 7fd1c1ffb700 1 --2- 172.21.15.53:0/2978012934 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd1b006ad10 0x7fd1b006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:34.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.910+0000 7fd1c1ffb700 1 -- 172.21.15.53:0/2978012934 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd1c808a700 con 0x7fd1b8003a50 2023-07-09T21:50:34.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.911+0000 7fd1d0d9a700 1 --2- 172.21.15.53:0/2978012934 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd1b006ad10 0x7fd1b006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:34.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.911+0000 7fd1d0d9a700 1 --2- 172.21.15.53:0/2978012934 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd1b006ad10 0x7fd1b006d1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc007ca0 tx=0x7fd1bc007b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:34.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:34.915+0000 7fd1c1ffb700 1 -- 172.21.15.53:0/2978012934 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd1cc0cb9a0 con 0x7fd1b8003a50 2023-07-09T21:50:35.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.125+0000 7fd1d37ff700 1 -- 172.21.15.53:0/2978012934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1cc0cb9a0 con 0x7fd1b8003a50 2023-07-09T21:50:35.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.126+0000 7fd1c1ffb700 1 -- 172.21.15.53:0/2978012934 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fd1cc0cb9a0 con 0x7fd1b8003a50 2023-07-09T21:50:35.128 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:35.128 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:24.766288+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:50:35.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.129+0000 7fd1d37ff700 1 -- 172.21.15.53:0/2978012934 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd1b006ad10 msgr2=0x7fd1b006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.129+0000 7fd1d37ff700 1 --2- 172.21.15.53:0/2978012934 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd1b006ad10 0x7fd1b006d1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc007ca0 tx=0x7fd1bc007b90 comp rx=0 tx=0).stop 2023-07-09T21:50:35.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.129+0000 7fd1d37ff700 1 -- 172.21.15.53:0/2978012934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1b8003a50 msgr2=0x7fd1cc0cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.129+0000 7fd1d37ff700 1 --2- 172.21.15.53:0/2978012934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1b8003a50 0x7fd1cc0cbc80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8000c00 tx=0x7fd1c80047c0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.129+0000 7fd1d37ff700 1 -- 172.21.15.53:0/2978012934 shutdown_connections 2023-07-09T21:50:35.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.129+0000 7fd1d37ff700 1 --2- 172.21.15.53:0/2978012934 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd1b006ad10 0x7fd1b006d1c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.129+0000 7fd1d37ff700 1 --2- 172.21.15.53:0/2978012934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1cc0cdfa0 0x7fd1cc0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.129+0000 7fd1d37ff700 1 --2- 172.21.15.53:0/2978012934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1b8003a50 0x7fd1cc0cbc80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.129+0000 7fd1d37ff700 1 --2- 172.21.15.53:0/2978012934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1cc0cff70 0x7fd1cc0cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.129+0000 7fd1d37ff700 1 -- 172.21.15.53:0/2978012934 >> 172.21.15.53:0/2978012934 conn(0x7fd1cc09c1d0 msgr2=0x7fd1cc0afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.129+0000 7fd1d37ff700 1 -- 172.21.15.53:0/2978012934 shutdown_connections 2023-07-09T21:50:35.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.129+0000 7fd1d37ff700 1 -- 172.21.15.53:0/2978012934 wait complete. 2023-07-09T21:50:35.148 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-09T21:50:35.149 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-09T21:50:35.149 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-09T21:50:35.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-09T21:50:35.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-09T21:50:35.151 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-09T21:50:35.151 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-09T21:50:35.152 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-09T21:50:35.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.499+0000 7f0dfbfff700 1 Processor -- start 2023-07-09T21:50:35.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.499+0000 7f0dfbfff700 1 -- start start 2023-07-09T21:50:35.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.502+0000 7f0dfbfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0df40ce2f0 0x7f0df4164710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.502+0000 7f0dfbfff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df4161050 con 0x7f0df40cd6c0 2023-07-09T21:50:35.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.502+0000 7f0dfbfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df4165400 con 0x7f0df40cd2f0 2023-07-09T21:50:35.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.502+0000 7f0dfbfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40cc810 con 0x7f0df40ce2f0 2023-07-09T21:50:35.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.505+0000 7f0df959a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0df40ce2f0 0x7f0df4164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.505+0000 7f0df959a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0df40ce2f0 0x7f0df4164710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58280/0 (socket says 172.21.15.53:58280) 2023-07-09T21:50:35.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.505+0000 7f0df959a700 1 -- 172.21.15.53:0/2178633249 learned_addr learned my addr 172.21.15.53:0/2178633249 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:35.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.506+0000 7f0df959a700 1 -- 172.21.15.53:0/2178633249 >> v1:172.21.15.184:6789/0 conn(0x7f0df40cd2f0 legacy=0x7f0df40cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.506+0000 7f0df959a700 1 -- 172.21.15.53:0/2178633249 >> v1:172.21.15.53:6789/0 conn(0x7f0df40cd6c0 legacy=0x7f0df4164c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:35.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.506+0000 7f0df959a700 1 -- 172.21.15.53:0/2178633249 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40ccaf0 con 0x7f0df40ce2f0 2023-07-09T21:50:35.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.511+0000 7f0df959a700 1 --2- 172.21.15.53:0/2178633249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0df40ce2f0 0x7f0df4164710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009920 tx=0x7f0df0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64928d31909ed437 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.511+0000 7f0df8d99700 1 -- 172.21.15.53:0/2178633249 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0004230 con 0x7f0df40ce2f0 2023-07-09T21:50:35.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.511+0000 7f0df8d99700 1 -- 172.21.15.53:0/2178633249 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df0004390 con 0x7f0df40ce2f0 2023-07-09T21:50:35.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.511+0000 7f0df8d99700 1 -- 172.21.15.53:0/2178633249 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0009e70 con 0x7f0df40ce2f0 2023-07-09T21:50:35.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.512+0000 7f0dfbfff700 1 -- 172.21.15.53:0/2178633249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0df40ce2f0 msgr2=0x7f0df4164710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.512+0000 7f0dfbfff700 1 --2- 172.21.15.53:0/2178633249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0df40ce2f0 0x7f0df4164710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009920 tx=0x7f0df0009c30 comp rx=0 tx=0).stop 2023-07-09T21:50:35.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.512+0000 7f0dfbfff700 1 -- 172.21.15.53:0/2178633249 shutdown_connections 2023-07-09T21:50:35.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.512+0000 7f0dfbfff700 1 --2- 172.21.15.53:0/2178633249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0df40ce2f0 0x7f0df4164710 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.512+0000 7f0dfbfff700 1 -- 172.21.15.53:0/2178633249 >> 172.21.15.53:0/2178633249 conn(0x7f0df40b05d0 msgr2=0x7f0df40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.512+0000 7f0dfbfff700 1 -- 172.21.15.53:0/2178633249 shutdown_connections 2023-07-09T21:50:35.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.512+0000 7f0dfbfff700 1 -- 172.21.15.53:0/2178633249 wait complete. 2023-07-09T21:50:35.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.515+0000 7f0dfbfff700 1 Processor -- start 2023-07-09T21:50:35.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.516+0000 7f0dfbfff700 1 -- start start 2023-07-09T21:50:35.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.517+0000 7f0dfbfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0df40cd2f0 0x7f0df40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.518+0000 7f0dfbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df40cd6c0 0x7f0df4160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.518+0000 7f0dfbfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0df40ce2f0 0x7f0df40b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.518+0000 7f0dfbfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40c25f0 con 0x7f0df40cd6c0 2023-07-09T21:50:35.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.518+0000 7f0dfbfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40b4550 con 0x7f0df40ce2f0 2023-07-09T21:50:35.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.518+0000 7f0dfbfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df4160640 con 0x7f0df40cd2f0 2023-07-09T21:50:35.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.518+0000 7f0dfa59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0df40ce2f0 0x7f0df40b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.518+0000 7f0dfa59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0df40ce2f0 0x7f0df40b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57328/0 (socket says 172.21.15.53:57328) 2023-07-09T21:50:35.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.518+0000 7f0dfa59c700 1 -- 172.21.15.53:0/1168760269 learned_addr learned my addr 172.21.15.53:0/1168760269 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:35.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.519+0000 7f0df959a700 1 --2- 172.21.15.53:0/1168760269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df40cd6c0 0x7f0df4160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.519+0000 7f0dfa59c700 1 -- 172.21.15.53:0/1168760269 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0df40cd2f0 msgr2=0x7f0df40b3590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:50:35.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.519+0000 7f0dfa59c700 1 --2- 172.21.15.53:0/1168760269 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0df40cd2f0 0x7f0df40b3590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.520+0000 7f0dfa59c700 1 -- 172.21.15.53:0/1168760269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df40cd6c0 msgr2=0x7f0df4160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.520+0000 7f0dfa59c700 1 --2- 172.21.15.53:0/1168760269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df40cd6c0 0x7f0df4160100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.520+0000 7f0dfa59c700 1 -- 172.21.15.53:0/1168760269 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0009550 con 0x7f0df40ce2f0 2023-07-09T21:50:35.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.520+0000 7f0dfa59c700 1 --2- 172.21.15.53:0/1168760269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0df40ce2f0 0x7f0df40b3d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00c7a0 tx=0x7f0dec00cb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.521+0000 7f0dea7fc700 1 -- 172.21.15.53:0/1168760269 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec003e10 con 0x7f0df40ce2f0 2023-07-09T21:50:35.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.521+0000 7f0dea7fc700 1 -- 172.21.15.53:0/1168760269 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec005070 con 0x7f0df40ce2f0 2023-07-09T21:50:35.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.521+0000 7f0dea7fc700 1 -- 172.21.15.53:0/1168760269 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec005420 con 0x7f0df40ce2f0 2023-07-09T21:50:35.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.521+0000 7f0dfbfff700 1 -- 172.21.15.53:0/1168760269 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df41ff890 con 0x7f0df40ce2f0 2023-07-09T21:50:35.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.522+0000 7f0dfbfff700 1 -- 172.21.15.53:0/1168760269 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df41fead0 con 0x7f0df40ce2f0 2023-07-09T21:50:35.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.525+0000 7f9523fff700 1 Processor -- start 2023-07-09T21:50:35.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.525+0000 7f9523fff700 1 -- start start 2023-07-09T21:50:35.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.525+0000 7f1d7e7ff700 1 Processor -- start 2023-07-09T21:50:35.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.525+0000 7f1d7e7ff700 1 -- start start 2023-07-09T21:50:35.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.527+0000 7f1d7e7ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1d780ce2f0 0x7f1d78164710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.527+0000 7f1d7e7ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d78161050 con 0x7f1d780cd2f0 2023-07-09T21:50:35.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.527+0000 7f1d7e7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d78165400 con 0x7f1d780cd6c0 2023-07-09T21:50:35.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.527+0000 7f1d7e7ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d780cc810 con 0x7f1d780ce2f0 2023-07-09T21:50:35.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.527+0000 7f9523fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f951c0ce050 0x7f951c164630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.527+0000 7f9523fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f951c0cd530 con 0x7f951c06cd60 2023-07-09T21:50:35.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.527+0000 7f9523fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f951c1615d0 con 0x7f951c0cc690 2023-07-09T21:50:35.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.527+0000 7f9523fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0ccf70 con 0x7f951c0ce050 2023-07-09T21:50:35.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.528+0000 7f1d777fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1d780ce2f0 0x7f1d78164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.528+0000 7f1d777fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1d780ce2f0 0x7f1d78164710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57338/0 (socket says 172.21.15.53:57338) 2023-07-09T21:50:35.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.528+0000 7f1d7cd9c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f1d780cd6c0 0x7f1d78164c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:46948/0 (socket says 172.21.15.53:46948) 2023-07-09T21:50:35.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.528+0000 7f1d777fe700 1 -- 172.21.15.53:0/810796103 learned_addr learned my addr 172.21.15.53:0/810796103 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:35.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.528+0000 7f952159a700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f951c0cc690 0x7f951c0cd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:46962/0 (socket says 172.21.15.53:46962) 2023-07-09T21:50:35.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.528+0000 7f952159a700 1 -- 172.21.15.53:0/1453432402 learned_addr learned my addr 172.21.15.53:0/1453432402 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:35.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.528+0000 7f952259c700 1 --2- 172.21.15.53:0/1453432402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f951c0ce050 0x7f951c164630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.529+0000 7f1d777fe700 1 -- 172.21.15.53:0/810796103 >> v1:172.21.15.184:6789/0 conn(0x7f1d780cd6c0 legacy=0x7f1d78164c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.529+0000 7f1d777fe700 1 -- 172.21.15.53:0/810796103 >> v1:172.21.15.53:6789/0 conn(0x7f1d780cd2f0 legacy=0x7f1d780cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:35.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.529+0000 7f1d777fe700 1 -- 172.21.15.53:0/810796103 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d780ccaf0 con 0x7f1d780ce2f0 2023-07-09T21:50:35.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.529+0000 7f952259c700 1 -- 172.21.15.53:0/1453432402 >> v1:172.21.15.184:6789/0 conn(0x7f951c0cc690 legacy=0x7f951c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.529+0000 7f952259c700 1 -- 172.21.15.53:0/1453432402 >> v1:172.21.15.53:6789/0 conn(0x7f951c06cd60 legacy=0x7f951c161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:35.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.529+0000 7f952259c700 1 -- 172.21.15.53:0/1453432402 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c0cd250 con 0x7f951c0ce050 2023-07-09T21:50:35.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.525+0000 7f0dfbfff700 1 -- 172.21.15.53:0/1168760269 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ddc000fc0 con 0x7f0df40ce2f0 2023-07-09T21:50:35.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.527+0000 7f0dea7fc700 1 -- 172.21.15.53:0/1168760269 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0dec005580 con 0x7f0df40ce2f0 2023-07-09T21:50:35.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.529+0000 7f0dea7fc700 1 --2- 172.21.15.53:0/1168760269 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0dd806adb0 0x7f0dd806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.529+0000 7f0dea7fc700 1 -- 172.21.15.53:0/1168760269 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0dec088cb0 con 0x7f0df40ce2f0 2023-07-09T21:50:35.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.530+0000 7f1d777fe700 1 --2- 172.21.15.53:0/810796103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d780ce2f0 0x7f1d78164710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009e50 tx=0x7f1d7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a968a2b883862dcb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.530+0000 7f952259c700 1 --2- 172.21.15.53:0/1453432402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f951c0ce050 0x7f951c164630 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9514009dc0 tx=0x7f951400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=368ea9ccc621b785 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.530+0000 7f34ad5ff700 1 Processor -- start 2023-07-09T21:50:35.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.530+0000 7f34ad5ff700 1 -- start start 2023-07-09T21:50:35.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.530+0000 7f9520d99700 1 -- 172.21.15.53:0/1453432402 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400e070 con 0x7f951c0ce050 2023-07-09T21:50:35.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.530+0000 7f9520d99700 1 -- 172.21.15.53:0/1453432402 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951400bad0 con 0x7f951c0ce050 2023-07-09T21:50:35.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.530+0000 7f9520d99700 1 -- 172.21.15.53:0/1453432402 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400be60 con 0x7f951c0ce050 2023-07-09T21:50:35.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.531+0000 7f1d76ffd700 1 -- 172.21.15.53:0/810796103 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000e070 con 0x7f1d780ce2f0 2023-07-09T21:50:35.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.531+0000 7f1d76ffd700 1 -- 172.21.15.53:0/810796103 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d70003a20 con 0x7f1d780ce2f0 2023-07-09T21:50:35.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.531+0000 7f1d76ffd700 1 -- 172.21.15.53:0/810796103 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70003dd0 con 0x7f1d780ce2f0 2023-07-09T21:50:35.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.530+0000 7f0dea7fc700 1 --2- 172.21.15.53:0/1168760269 >> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] conn(0x7f0dd80735e0 0x7f0dd80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.530+0000 7f0dea7fc700 1 -- 172.21.15.53:0/1168760269 --> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0dd80760a0 con 0x7f0dd80735e0 2023-07-09T21:50:35.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.530+0000 7f0dea7fc700 1 -- 172.21.15.53:0/1168760269 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dec053d40 con 0x7f0df40ce2f0 2023-07-09T21:50:35.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.530+0000 7f0df9d9b700 1 --2- 172.21.15.53:0/1168760269 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0dd806adb0 0x7f0dd806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.531+0000 7f0df9d9b700 1 --2- 172.21.15.53:0/1168760269 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0dd806adb0 0x7f0dd806d260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0de4000f60 tx=0x7f0de4007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.531+0000 7f9523fff700 1 -- 172.21.15.53:0/1453432402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f951c0ce050 msgr2=0x7f951c164630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.531+0000 7f9523fff700 1 --2- 172.21.15.53:0/1453432402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f951c0ce050 0x7f951c164630 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9514009dc0 tx=0x7f951400b330 comp rx=0 tx=0).stop 2023-07-09T21:50:35.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.532+0000 7f9523fff700 1 -- 172.21.15.53:0/1453432402 shutdown_connections 2023-07-09T21:50:35.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.532+0000 7f9523fff700 1 --2- 172.21.15.53:0/1453432402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f951c0ce050 0x7f951c164630 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.532+0000 7f9523fff700 1 -- 172.21.15.53:0/1453432402 >> 172.21.15.53:0/1453432402 conn(0x7f951c0b05d0 msgr2=0x7f951c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.532+0000 7f0df959a700 1 --2- 172.21.15.53:0/1168760269 >> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] conn(0x7f0dd80735e0 0x7f0dd80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.532+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/810796103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d780ce2f0 msgr2=0x7f1d78164710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.532+0000 7f1d7e7ff700 1 --2- 172.21.15.53:0/810796103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d780ce2f0 0x7f1d78164710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009e50 tx=0x7f1d7000b330 comp rx=0 tx=0).stop 2023-07-09T21:50:35.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.533+0000 7f0df959a700 1 --2- 172.21.15.53:0/1168760269 >> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] conn(0x7f0dd80735e0 0x7f0dd80759f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.533+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/810796103 shutdown_connections 2023-07-09T21:50:35.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.533+0000 7f1d7e7ff700 1 --2- 172.21.15.53:0/810796103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d780ce2f0 0x7f1d78164710 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.533+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/810796103 >> 172.21.15.53:0/810796103 conn(0x7f1d780b05d0 msgr2=0x7f1d780b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.532+0000 7f28305ff700 1 Processor -- start 2023-07-09T21:50:35.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.532+0000 7f28305ff700 1 -- start start 2023-07-09T21:50:35.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.532+0000 7f34ad5ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34a8158560 0x7f34a806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.532+0000 7f34ad5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f34a806baf0 0x7f34a80cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.532+0000 7f34ad5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34a8158930 0x7f34a80ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.533+0000 7f34ad5ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a80cab60 con 0x7f34a8158560 2023-07-09T21:50:35.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.533+0000 7f34ad5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a815f5d0 con 0x7f34a806baf0 2023-07-09T21:50:35.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.533+0000 7f34ad5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a806c250 con 0x7f34a8158930 2023-07-09T21:50:35.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.533+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/810796103 shutdown_connections 2023-07-09T21:50:35.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.533+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/810796103 wait complete. 2023-07-09T21:50:35.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.534+0000 7f34a67fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f34a806baf0 0x7f34a80cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.534+0000 7f34a77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34a8158930 0x7f34a80ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.534+0000 7f34a77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34a8158930 0x7f34a80ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58300/0 (socket says 172.21.15.53:58300) 2023-07-09T21:50:35.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.534+0000 7f34a77fe700 1 -- 172.21.15.53:0/2530745889 learned_addr learned my addr 172.21.15.53:0/2530745889 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:35.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.534+0000 7f34a6ffd700 1 --2- 172.21.15.53:0/2530745889 >> v2:172.21.15.53:3300/0 conn(0x7f34a8158560 0x7f34a806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f9523fff700 1 -- 172.21.15.53:0/1453432402 shutdown_connections 2023-07-09T21:50:35.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f28305ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f28280ce2f0 0x7f2828164710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f28305ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28280cd6c0 0x7f2828164c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f28305ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2828161050 con 0x7f28280cd2f0 2023-07-09T21:50:35.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f28305ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2828165190 con 0x7f28280cd6c0 2023-07-09T21:50:35.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f28305ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2828165400 con 0x7f28280ce2f0 2023-07-09T21:50:35.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f34a77fe700 1 -- 172.21.15.53:0/2530745889 >> v2:172.21.15.184:3300/0 conn(0x7f34a806baf0 msgr2=0x7f34a80cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:35.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f34a77fe700 1 --2- 172.21.15.53:0/2530745889 >> v2:172.21.15.184:3300/0 conn(0x7f34a806baf0 0x7f34a80cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f34a77fe700 1 -- 172.21.15.53:0/2530745889 >> v2:172.21.15.53:3300/0 conn(0x7f34a8158560 msgr2=0x7f34a806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:35.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f34a77fe700 1 --2- 172.21.15.53:0/2530745889 >> v2:172.21.15.53:3300/0 conn(0x7f34a8158560 0x7f34a806b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f34a77fe700 1 -- 172.21.15.53:0/2530745889 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a806c530 con 0x7f34a8158930 2023-07-09T21:50:35.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f282e39b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f28280cd2f0 0x7f28280cdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:46972/0 (socket says 172.21.15.53:46972) 2023-07-09T21:50:35.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f282e39b700 1 -- 172.21.15.53:0/2769494646 learned_addr learned my addr 172.21.15.53:0/2769494646 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:35.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.536+0000 7f0dea7fc700 1 -- 172.21.15.53:0/1168760269 <== osd.0 v2:172.21.15.53:6808/1521858900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0dd80760a0 con 0x7f0dd80735e0 2023-07-09T21:50:35.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.536+0000 7f1d7e7ff700 1 Processor -- start 2023-07-09T21:50:35.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.536+0000 7f282eb9c700 1 --2- 172.21.15.53:0/2769494646 >> v2:172.21.15.53:3300/0 conn(0x7f28280cd6c0 0x7f2828164c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.536+0000 7f34a77fe700 1 --2- 172.21.15.53:0/2530745889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34a8158930 0x7f34a80ce480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f34a80cdaf0 tx=0x7f34a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f3c3e92fb7109d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.536+0000 7f282db9a700 1 --2- 172.21.15.53:0/2769494646 >> v2:172.21.15.184:3300/0 conn(0x7f28280ce2f0 0x7f2828164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.536+0000 7f1d7e7ff700 1 -- start start 2023-07-09T21:50:35.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.535+0000 7f9523fff700 1 -- 172.21.15.53:0/1453432402 wait complete. 2023-07-09T21:50:35.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.537+0000 7f139b1ff700 1 Processor -- start 2023-07-09T21:50:35.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.537+0000 7f282eb9c700 1 -- 172.21.15.53:0/2769494646 >> v2:172.21.15.184:3300/0 conn(0x7f28280ce2f0 msgr2=0x7f2828164710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:35.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.537+0000 7f282eb9c700 1 --2- 172.21.15.53:0/2769494646 >> v2:172.21.15.184:3300/0 conn(0x7f28280ce2f0 0x7f2828164710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.537+0000 7f282eb9c700 1 -- 172.21.15.53:0/2769494646 >> v1:172.21.15.184:6789/0 conn(0x7f28280cd2f0 legacy=0x7f28280cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.537+0000 7f282eb9c700 1 -- 172.21.15.53:0/2769494646 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28280cc810 con 0x7f28280cd6c0 2023-07-09T21:50:35.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.538+0000 7f282eb9c700 1 --2- 172.21.15.53:0/2769494646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28280cd6c0 0x7f2828164c50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2828067290 tx=0x7f282000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5962c7e0e2d74c53 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.538+0000 7f1d7e7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d780cd2f0 0x7f1d780cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.538+0000 7f1d7e7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d780cd6c0 0x7f1d780ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.538+0000 7f9523fff700 1 Processor -- start 2023-07-09T21:50:35.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.538+0000 7f1d7e7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d780ce2f0 0x7f1d780cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.538+0000 7f1d7e7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d78162dc0 con 0x7f1d780cd2f0 2023-07-09T21:50:35.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.538+0000 7f1d7e7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d78162140 con 0x7f1d780ce2f0 2023-07-09T21:50:35.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.538+0000 7f1d7e7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d78162420 con 0x7f1d780cd6c0 2023-07-09T21:50:35.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f1d777fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d780cd6c0 0x7f1d780ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f1d7cd9c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d780ce2f0 0x7f1d780cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f1d7cd9c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d780ce2f0 0x7f1d780cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57362/0 (socket says 172.21.15.53:57362) 2023-07-09T21:50:35.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f1d7cd9c700 1 -- 172.21.15.53:0/184123378 learned_addr learned my addr 172.21.15.53:0/184123378 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:35.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f1d7cd9c700 1 -- 172.21.15.53:0/184123378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d780cd6c0 msgr2=0x7f1d780ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f1d7cd9c700 1 --2- 172.21.15.53:0/184123378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d780cd6c0 0x7f1d780ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f1d7cd9c700 1 -- 172.21.15.53:0/184123378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d780cd2f0 msgr2=0x7f1d780cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f1d7cd9c700 1 --2- 172.21.15.53:0/184123378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d780cd2f0 0x7f1d780cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f1d7cd9c700 1 -- 172.21.15.53:0/184123378 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d70009b30 con 0x7f1d780ce2f0 2023-07-09T21:50:35.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.538+0000 7f34a5ffb700 1 -- 172.21.15.53:0/2530745889 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000e070 con 0x7f34a8158930 2023-07-09T21:50:35.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.538+0000 7f34a5ffb700 1 -- 172.21.15.53:0/2530745889 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a000b910 con 0x7f34a8158930 2023-07-09T21:50:35.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.538+0000 7f34a5ffb700 1 -- 172.21.15.53:0/2530745889 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000bcc0 con 0x7f34a8158930 2023-07-09T21:50:35.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f34ad5ff700 1 -- 172.21.15.53:0/2530745889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34a8158930 msgr2=0x7f34a80ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f34ad5ff700 1 --2- 172.21.15.53:0/2530745889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34a8158930 0x7f34a80ce480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f34a80cdaf0 tx=0x7f34a000b330 comp rx=0 tx=0).stop 2023-07-09T21:50:35.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f34ad5ff700 1 -- 172.21.15.53:0/2530745889 shutdown_connections 2023-07-09T21:50:35.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f34ad5ff700 1 --2- 172.21.15.53:0/2530745889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34a8158930 0x7f34a80ce480 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f34ad5ff700 1 --2- 172.21.15.53:0/2530745889 >> v2:172.21.15.53:3300/0 conn(0x7f34a8158560 0x7f34a806b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f34ad5ff700 1 --2- 172.21.15.53:0/2530745889 >> v2:172.21.15.184:3300/0 conn(0x7f34a806baf0 0x7f34a80cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f34ad5ff700 1 -- 172.21.15.53:0/2530745889 >> 172.21.15.53:0/2530745889 conn(0x7f34a80b05d0 msgr2=0x7f34a80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.537+0000 7f139b1ff700 1 -- start start 2023-07-09T21:50:35.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f139b1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13940cdf40 0x7f13940ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f139b1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13940caff0 0x7f13940cb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f139b1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13940cab60 con 0x7f13941587d0 2023-07-09T21:50:35.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f139b1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13940ce8f0 con 0x7f13940cdf40 2023-07-09T21:50:35.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f139b1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139406bcc0 con 0x7f13940caff0 2023-07-09T21:50:35.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f1d7cd9c700 1 --2- 172.21.15.53:0/184123378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d780ce2f0 0x7f1d780cac70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800c420 tx=0x7f1d6800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f1d74ff9700 1 -- 172.21.15.53:0/184123378 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68005cb0 con 0x7f1d780ce2f0 2023-07-09T21:50:35.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.541+0000 7f1d74ff9700 1 -- 172.21.15.53:0/184123378 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d68005e10 con 0x7f1d780ce2f0 2023-07-09T21:50:35.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.541+0000 7f1d74ff9700 1 -- 172.21.15.53:0/184123378 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68007310 con 0x7f1d780ce2f0 2023-07-09T21:50:35.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.541+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/184123378 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d78162700 con 0x7f1d780ce2f0 2023-07-09T21:50:35.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f282d399700 1 -- 172.21.15.53:0/2769494646 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282000e070 con 0x7f28280cd6c0 2023-07-09T21:50:35.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f282d399700 1 -- 172.21.15.53:0/2769494646 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282000bbd0 con 0x7f28280cd6c0 2023-07-09T21:50:35.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f282d399700 1 -- 172.21.15.53:0/2769494646 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2820012430 con 0x7f28280cd6c0 2023-07-09T21:50:35.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.541+0000 7f28305ff700 1 -- 172.21.15.53:0/2769494646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28280cd6c0 msgr2=0x7f2828164c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.541+0000 7f28305ff700 1 --2- 172.21.15.53:0/2769494646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28280cd6c0 0x7f2828164c50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2828067290 tx=0x7f282000b330 comp rx=0 tx=0).stop 2023-07-09T21:50:35.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.539+0000 7f9523fff700 1 -- start start 2023-07-09T21:50:35.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f9523fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f951c06cd60 0x7f951c1fec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f9523fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f951c0cc690 0x7f951c0c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f9523fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f951c0ce050 0x7f951c0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f9523fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c1ff170 con 0x7f951c0ce050 2023-07-09T21:50:35.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f9523fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0c2f60 con 0x7f951c06cd60 2023-07-09T21:50:35.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f9523fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0c3240 con 0x7f951c0cc690 2023-07-09T21:50:35.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.541+0000 7f952159a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f951c0cc690 0x7f951c0c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.541+0000 7f9521d9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f951c06cd60 0x7f951c1fec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.541+0000 7f952159a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f951c0cc690 0x7f951c0c25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58326/0 (socket says 172.21.15.53:58326) 2023-07-09T21:50:35.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.541+0000 7f952159a700 1 -- 172.21.15.53:0/2405465276 learned_addr learned my addr 172.21.15.53:0/2405465276 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:35.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f1398f9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f13941587d0 0x7f139406b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:46986/0 (socket says 172.21.15.53:46986) 2023-07-09T21:50:35.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.540+0000 7f1398f9b700 1 -- 172.21.15.53:0/1343782039 learned_addr learned my addr 172.21.15.53:0/1343782039 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:35.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.541+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/184123378 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d78161df0 con 0x7f1d780ce2f0 2023-07-09T21:50:35.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.542+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/184123378 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d780ccdd0 con 0x7f1d780ce2f0 2023-07-09T21:50:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.542+0000 7f34ad5ff700 1 -- 172.21.15.53:0/2530745889 shutdown_connections 2023-07-09T21:50:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.542+0000 7f952259c700 1 --2- 172.21.15.53:0/2405465276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f951c0ce050 0x7f951c0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.542+0000 7f952159a700 1 -- 172.21.15.53:0/2405465276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f951c06cd60 msgr2=0x7f951c1fec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.542+0000 7f952159a700 1 --2- 172.21.15.53:0/2405465276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f951c06cd60 0x7f951c1fec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.542+0000 7f952159a700 1 -- 172.21.15.53:0/2405465276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f951c0ce050 msgr2=0x7f951c0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.542+0000 7f952159a700 1 --2- 172.21.15.53:0/2405465276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f951c0ce050 0x7f951c0ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.542+0000 7f952159a700 1 -- 172.21.15.53:0/2405465276 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9514009a70 con 0x7f951c0cc690 2023-07-09T21:50:35.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.542+0000 7f34ad5ff700 1 -- 172.21.15.53:0/2530745889 wait complete. 2023-07-09T21:50:35.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.543+0000 7f952159a700 1 --2- 172.21.15.53:0/2405465276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f951c0cc690 0x7f951c0c25f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f950c00c6b0 tx=0x7f950c00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.543+0000 7f28305ff700 1 -- 172.21.15.53:0/2769494646 shutdown_connections 2023-07-09T21:50:35.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.543+0000 7f28305ff700 1 --2- 172.21.15.53:0/2769494646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28280cd6c0 0x7f2828164c50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.543+0000 7f28305ff700 1 --2- 172.21.15.53:0/2769494646 >> v2:172.21.15.184:3300/0 conn(0x7f28280ce2f0 0x7f2828164710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.543+0000 7f28305ff700 1 -- 172.21.15.53:0/2769494646 >> 172.21.15.53:0/2769494646 conn(0x7f28280b05d0 msgr2=0x7f28280b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.543+0000 7f139979c700 1 --2- 172.21.15.53:0/1343782039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13940caff0 0x7f13940cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.545+0000 7f28305ff700 1 -- 172.21.15.53:0/2769494646 shutdown_connections 2023-07-09T21:50:35.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.545+0000 7f34ad5ff700 1 Processor -- start 2023-07-09T21:50:35.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.543+0000 7f1393fff700 1 --2- 172.21.15.53:0/1343782039 >> v2:172.21.15.184:3300/0 conn(0x7f13940cdf40 0x7f13940ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.544+0000 7f139979c700 1 -- 172.21.15.53:0/1343782039 >> v2:172.21.15.184:3300/0 conn(0x7f13940cdf40 msgr2=0x7f13940ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:35.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.544+0000 7f139979c700 1 --2- 172.21.15.53:0/1343782039 >> v2:172.21.15.184:3300/0 conn(0x7f13940cdf40 0x7f13940ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.544+0000 7f139979c700 1 -- 172.21.15.53:0/1343782039 >> v1:172.21.15.184:6789/0 conn(0x7f13941587d0 legacy=0x7f139406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.544+0000 7f139979c700 1 -- 172.21.15.53:0/1343782039 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394158ba0 con 0x7f13940caff0 2023-07-09T21:50:35.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.545+0000 7f139979c700 1 --2- 172.21.15.53:0/1343782039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13940caff0 0x7f13940cb460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f138c009d90 tx=0x7f138c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e07114d83e5e46cb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.545+0000 7f1d74ff9700 1 -- 172.21.15.53:0/184123378 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d68007470 con 0x7f1d780ce2f0 2023-07-09T21:50:35.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.545+0000 7f34ad5ff700 1 -- start start 2023-07-09T21:50:35.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f1d74ff9700 1 --2- 172.21.15.53:0/184123378 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1d6406ad30 0x7f1d6406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f1d74ff9700 1 -- 172.21.15.53:0/184123378 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d68088f00 con 0x7f1d780ce2f0 2023-07-09T21:50:35.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.546+0000 7f28305ff700 1 -- 172.21.15.53:0/2769494646 wait complete. 2023-07-09T21:50:35.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.546+0000 7f95127fc700 1 -- 172.21.15.53:0/2405465276 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c004c80 con 0x7f951c0cc690 2023-07-09T21:50:35.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.546+0000 7f95127fc700 1 -- 172.21.15.53:0/2405465276 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c004de0 con 0x7f951c0cc690 2023-07-09T21:50:35.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.546+0000 7f95127fc700 1 -- 172.21.15.53:0/2405465276 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c007310 con 0x7f951c0cc690 2023-07-09T21:50:35.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.546+0000 7f34ad5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34a8158560 0x7f34a8144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f34ad5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34a8158930 0x7f34a81fa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f34ad5ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a80cc5f0 0x7f34a81fa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f34ad5ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8159870 con 0x7f34a80cc5f0 2023-07-09T21:50:35.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f34ad5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a815b9b0 con 0x7f34a8158930 2023-07-09T21:50:35.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f34ad5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a815b0c0 con 0x7f34a8158560 2023-07-09T21:50:35.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.546+0000 7f9523fff700 1 -- 172.21.15.53:0/2405465276 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c0c3520 con 0x7f951c0cc690 2023-07-09T21:50:35.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f9523fff700 1 -- 172.21.15.53:0/2405465276 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c0c3ae0 con 0x7f951c0cc690 2023-07-09T21:50:35.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f1d74ff9700 1 --2- 172.21.15.53:0/184123378 >> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] conn(0x7f1d640735e0 0x7f1d640759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f1d74ff9700 1 -- 172.21.15.53:0/184123378 --> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d640760a0 con 0x7f1d640735e0 2023-07-09T21:50:35.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f1d74ff9700 1 -- 172.21.15.53:0/184123378 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d68089270 con 0x7f1d780ce2f0 2023-07-09T21:50:35.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.548+0000 7f1d77fff700 1 --2- 172.21.15.53:0/184123378 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1d6406ad30 0x7f1d6406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f13937fe700 1 -- 172.21.15.53:0/1343782039 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c00e070 con 0x7f13940caff0 2023-07-09T21:50:35.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f13937fe700 1 -- 172.21.15.53:0/1343782039 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c00bbd0 con 0x7f13940caff0 2023-07-09T21:50:35.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.547+0000 7f13937fe700 1 -- 172.21.15.53:0/1343782039 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c012430 con 0x7f13940caff0 2023-07-09T21:50:35.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.548+0000 7f139b1ff700 1 -- 172.21.15.53:0/1343782039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13940caff0 msgr2=0x7f13940cb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.548+0000 7f139b1ff700 1 --2- 172.21.15.53:0/1343782039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13940caff0 0x7f13940cb460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f138c009d90 tx=0x7f138c00b330 comp rx=0 tx=0).stop 2023-07-09T21:50:35.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.549+0000 7f34a67fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34a8158930 0x7f34a81fa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.549+0000 7f34a67fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34a8158930 0x7f34a81fa170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57386/0 (socket says 172.21.15.53:57386) 2023-07-09T21:50:35.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.549+0000 7f34a67fc700 1 -- 172.21.15.53:0/893338024 learned_addr learned my addr 172.21.15.53:0/893338024 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:35.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.549+0000 7f1d777fe700 1 --2- 172.21.15.53:0/184123378 >> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] conn(0x7f1d640735e0 0x7f1d640759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.549+0000 7f28305ff700 1 Processor -- start 2023-07-09T21:50:35.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.549+0000 7f34a6ffd700 1 --2- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34a8158560 0x7f34a8144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.549+0000 7f34a67fc700 1 -- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34a8158560 msgr2=0x7f34a8144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.549+0000 7f34a67fc700 1 --2- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34a8158560 0x7f34a8144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.549+0000 7f34a67fc700 1 -- 172.21.15.53:0/893338024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a80cc5f0 msgr2=0x7f34a81fa6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:50:35.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.549+0000 7f34a67fc700 1 --2- 172.21.15.53:0/893338024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a80cc5f0 0x7f34a81fa6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.549+0000 7f34a67fc700 1 -- 172.21.15.53:0/893338024 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0009b30 con 0x7f34a8158930 2023-07-09T21:50:35.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.550+0000 7f1d777fe700 1 --2- 172.21.15.53:0/184123378 >> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] conn(0x7f1d640735e0 0x7f1d640759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.550+0000 7f1d77fff700 1 --2- 172.21.15.53:0/184123378 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1d6406ad30 0x7f1d6406d1e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c001600 tx=0x7f1d6c007a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.550+0000 7f28305ff700 1 -- start start 2023-07-09T21:50:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.548+0000 7f9523fff700 1 -- 172.21.15.53:0/2405465276 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9504000fc0 con 0x7f951c0cc690 2023-07-09T21:50:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.551+0000 7f34a67fc700 1 --2- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34a8158930 0x7f34a81fa170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f349800e9b0 tx=0x7f349800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.551+0000 7f1d74ff9700 1 -- 172.21.15.53:0/184123378 <== osd.1 v2:172.21.15.53:6816/801424543 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1d640760a0 con 0x7f1d640735e0 2023-07-09T21:50:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.551+0000 7f28305ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28280cd2f0 0x7f282815b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.551+0000 7f28305ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28280cd6c0 0x7f2828161c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.551+0000 7f28305ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28280ce2f0 0x7f2828070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.551+0000 7f28305ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282815b980 con 0x7f28280cd6c0 2023-07-09T21:50:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.551+0000 7f28305ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28281fa540 con 0x7f28280ce2f0 2023-07-09T21:50:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.551+0000 7f28305ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28281f9c10 con 0x7f28280cd2f0 2023-07-09T21:50:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.552+0000 7f95127fc700 1 -- 172.21.15.53:0/2405465276 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f950c007470 con 0x7f951c0cc690 2023-07-09T21:50:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.552+0000 7f6df67ff700 1 Processor -- start 2023-07-09T21:50:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.551+0000 7f139b1ff700 1 -- 172.21.15.53:0/1343782039 shutdown_connections 2023-07-09T21:50:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.551+0000 7f139b1ff700 1 --2- 172.21.15.53:0/1343782039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13940caff0 0x7f13940cb460 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.551+0000 7f139b1ff700 1 --2- 172.21.15.53:0/1343782039 >> v2:172.21.15.184:3300/0 conn(0x7f13940cdf40 0x7f13940ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.551+0000 7f139b1ff700 1 -- 172.21.15.53:0/1343782039 >> 172.21.15.53:0/1343782039 conn(0x7f13940b05d0 msgr2=0x7f13940b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.552+0000 7f282db9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28280cd6c0 0x7f2828161c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.552+0000 7f282db9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28280cd6c0 0x7f2828161c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52800/0 (socket says 172.21.15.53:52800) 2023-07-09T21:50:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.552+0000 7f282db9a700 1 -- 172.21.15.53:0/1711627894 learned_addr learned my addr 172.21.15.53:0/1711627894 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.552+0000 7f6df67ff700 1 -- start start 2023-07-09T21:50:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.552+0000 7f139b1ff700 1 -- 172.21.15.53:0/1343782039 shutdown_connections 2023-07-09T21:50:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.553+0000 7f282db9a700 1 -- 172.21.15.53:0/1711627894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28280cd2f0 msgr2=0x7f282815b440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:50:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.553+0000 7f282db9a700 1 --2- 172.21.15.53:0/1711627894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28280cd2f0 0x7f282815b440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.553+0000 7f282db9a700 1 -- 172.21.15.53:0/1711627894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28280ce2f0 msgr2=0x7f2828070780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T21:50:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.553+0000 7f282db9a700 1 --2- 172.21.15.53:0/1711627894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28280ce2f0 0x7f2828070780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.553+0000 7f282db9a700 1 -- 172.21.15.53:0/1711627894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2820009a70 con 0x7f28280cd6c0 2023-07-09T21:50:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.554+0000 7f282db9a700 1 --2- 172.21.15.53:0/1711627894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28280cd6c0 0x7f2828161c20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f281400d800 tx=0x7f281400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.553+0000 7f95127fc700 1 --2- 172.21.15.53:0/2405465276 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f950006adb0 0x7f950006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.553+0000 7f95127fc700 1 -- 172.21.15.53:0/2405465276 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f950c0890a0 con 0x7f951c0cc690 2023-07-09T21:50:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.554+0000 7f95127fc700 1 --2- 172.21.15.53:0/2405465276 >> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] conn(0x7f95000735e0 0x7f95000759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.554+0000 7f95127fc700 1 -- 172.21.15.53:0/2405465276 --> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95000760a0 con 0x7f95000735e0 2023-07-09T21:50:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.553+0000 7f348f7fe700 1 -- 172.21.15.53:0/893338024 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34980096b0 con 0x7f34a8158930 2023-07-09T21:50:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.553+0000 7f348f7fe700 1 -- 172.21.15.53:0/893338024 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349800c7f0 con 0x7f34a8158930 2023-07-09T21:50:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.553+0000 7f348f7fe700 1 -- 172.21.15.53:0/893338024 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349800cb60 con 0x7f34a8158930 2023-07-09T21:50:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.553+0000 7f34ad5ff700 1 -- 172.21.15.53:0/893338024 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a8159590 con 0x7f34a8158930 2023-07-09T21:50:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.553+0000 7f34ad5ff700 1 -- 172.21.15.53:0/893338024 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a815b640 con 0x7f34a8158930 2023-07-09T21:50:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.554+0000 7f6df67ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6df006b5b0 0x7f6df006b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.554+0000 7f6df67ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6df00cdf40 0x7f6df00ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.554+0000 7f6df67ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6df00cc690 0x7f6df00ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.554+0000 7f6df67ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df00ce8f0 con 0x7f6df00cc690 2023-07-09T21:50:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.554+0000 7f6df67ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df00cab60 con 0x7f6df00cdf40 2023-07-09T21:50:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.554+0000 7f6df67ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df0158bf0 con 0x7f6df006b5b0 2023-07-09T21:50:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.555+0000 7f952259c700 1 --2- 172.21.15.53:0/2405465276 >> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] conn(0x7f95000735e0 0x7f95000759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.555+0000 7f6deffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6df006b5b0 0x7f6df006b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.555+0000 7f6deffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6df006b5b0 0x7f6df006b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58354/0 (socket says 172.21.15.53:58354) 2023-07-09T21:50:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.555+0000 7f6deffff700 1 -- 172.21.15.53:0/3449452353 learned_addr learned my addr 172.21.15.53:0/3449452353 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.555+0000 7f6def7fe700 1 --2- 172.21.15.53:0/3449452353 >> v2:172.21.15.184:3300/0 conn(0x7f6df00cdf40 0x7f6df00ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.555+0000 7f6deffff700 1 -- 172.21.15.53:0/3449452353 >> v2:172.21.15.184:3300/0 conn(0x7f6df00cdf40 msgr2=0x7f6df00ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.555+0000 7f6deffff700 1 --2- 172.21.15.53:0/3449452353 >> v2:172.21.15.184:3300/0 conn(0x7f6df00cdf40 0x7f6df00ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.555+0000 7f6deffff700 1 -- 172.21.15.53:0/3449452353 >> v2:172.21.15.53:3300/0 conn(0x7f6df00cc690 msgr2=0x7f6df00ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.555+0000 7f6deffff700 1 --2- 172.21.15.53:0/3449452353 >> v2:172.21.15.53:3300/0 conn(0x7f6df00cc690 0x7f6df00ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.555+0000 7f6deffff700 1 -- 172.21.15.53:0/3449452353 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df006bf70 con 0x7f6df006b5b0 2023-07-09T21:50:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.556+0000 7f6deffff700 1 --2- 172.21.15.53:0/3449452353 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6df006b5b0 0x7f6df006b980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6df0067540 tx=0x7f6de000d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d09475dfc33f1931 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.556+0000 7f952259c700 1 --2- 172.21.15.53:0/2405465276 >> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] conn(0x7f95000735e0 0x7f95000759f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.557+0000 7f6deeffd700 1 -- 172.21.15.53:0/3449452353 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0010070 con 0x7f6df006b5b0 2023-07-09T21:50:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.557+0000 7f6deeffd700 1 -- 172.21.15.53:0/3449452353 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de000da80 con 0x7f6df006b5b0 2023-07-09T21:50:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.557+0000 7f6deeffd700 1 -- 172.21.15.53:0/3449452353 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000ddf0 con 0x7f6df006b5b0 2023-07-09T21:50:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.557+0000 7f95127fc700 1 -- 172.21.15.53:0/2405465276 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f950c001410 con 0x7f951c0cc690 2023-07-09T21:50:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.557+0000 7f9521d9b700 1 --2- 172.21.15.53:0/2405465276 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f950006adb0 0x7f950006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.554+0000 7f139b1ff700 1 -- 172.21.15.53:0/1343782039 wait complete. 2023-07-09T21:50:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.557+0000 7f139b1ff700 1 Processor -- start 2023-07-09T21:50:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.557+0000 7f348f7fe700 1 -- 172.21.15.53:0/893338024 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f349800ccc0 con 0x7f34a8158930 2023-07-09T21:50:35.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.558+0000 7f6df67ff700 1 -- 172.21.15.53:0/3449452353 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6df006b5b0 msgr2=0x7f6df006b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.558+0000 7f6df67ff700 1 --2- 172.21.15.53:0/3449452353 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6df006b5b0 0x7f6df006b980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6df0067540 tx=0x7f6de000d330 comp rx=0 tx=0).stop 2023-07-09T21:50:35.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.558+0000 7f6df67ff700 1 -- 172.21.15.53:0/3449452353 shutdown_connections 2023-07-09T21:50:35.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.558+0000 7f6df67ff700 1 --2- 172.21.15.53:0/3449452353 >> v2:172.21.15.53:3300/0 conn(0x7f6df00cc690 0x7f6df00ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.558+0000 7f6df67ff700 1 --2- 172.21.15.53:0/3449452353 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6df006b5b0 0x7f6df006b980 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.558+0000 7f6df67ff700 1 --2- 172.21.15.53:0/3449452353 >> v2:172.21.15.184:3300/0 conn(0x7f6df00cdf40 0x7f6df00ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.558+0000 7f6df67ff700 1 -- 172.21.15.53:0/3449452353 >> 172.21.15.53:0/3449452353 conn(0x7f6df00b05d0 msgr2=0x7f6df00b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.558+0000 7f95127fc700 1 -- 172.21.15.53:0/2405465276 <== osd.3 v2:172.21.15.53:6824/743855822 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f95000760a0 con 0x7f95000735e0 2023-07-09T21:50:35.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.558+0000 7f6df67ff700 1 -- 172.21.15.53:0/3449452353 shutdown_connections 2023-07-09T21:50:35.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.559+0000 7f348f7fe700 1 --2- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f349406adb0 0x7f349406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.559+0000 7f6df67ff700 1 -- 172.21.15.53:0/3449452353 wait complete. 2023-07-09T21:50:35.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.559+0000 7f348f7fe700 1 -- 172.21.15.53:0/893338024 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3498089490 con 0x7f34a8158930 2023-07-09T21:50:35.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.560+0000 7f34a6ffd700 1 --2- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f349406adb0 0x7f349406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.558+0000 7f139b1ff700 1 -- start start 2023-07-09T21:50:35.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.559+0000 7f139b1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13940caff0 0x7f13940c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.559+0000 7f139b1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13940cdf40 0x7f13940c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.559+0000 7f139b1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13941587d0 0x7f13940c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.559+0000 7f139b1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13940b1e70 con 0x7f13940cdf40 2023-07-09T21:50:35.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.559+0000 7f139b1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139406fbc0 con 0x7f13940caff0 2023-07-09T21:50:35.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.559+0000 7f139b1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1394149360 con 0x7f13941587d0 2023-07-09T21:50:35.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.560+0000 7f139979c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13941587d0 0x7f13940c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.560+0000 7f139979c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13941587d0 0x7f13940c2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58356/0 (socket says 172.21.15.53:58356) 2023-07-09T21:50:35.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.560+0000 7f139979c700 1 -- 172.21.15.53:0/2634608450 learned_addr learned my addr 172.21.15.53:0/2634608450 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:35.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.560+0000 7f34ad5ff700 1 --2- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] conn(0x7f34880015e0 0x7f3488003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.560+0000 7f34ad5ff700 1 -- 172.21.15.53:0/893338024 --> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3488006bc0 con 0x7f34880015e0 2023-07-09T21:50:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.561+0000 7f34a77fe700 1 --2- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] conn(0x7f34880015e0 0x7f3488003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.561+0000 7f34a6ffd700 1 --2- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f349406adb0 0x7f349406d260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f349c0098b0 tx=0x7f349c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.562+0000 7f6df67ff700 1 Processor -- start 2023-07-09T21:50:35.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.560+0000 7f2826ffd700 1 -- 172.21.15.53:0/1711627894 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28140125f0 con 0x7f28280cd6c0 2023-07-09T21:50:35.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.560+0000 7f2826ffd700 1 -- 172.21.15.53:0/1711627894 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2814012750 con 0x7f28280cd6c0 2023-07-09T21:50:35.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.560+0000 7f2826ffd700 1 -- 172.21.15.53:0/1711627894 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814012ac0 con 0x7f28280cd6c0 2023-07-09T21:50:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.562+0000 7f9521d9b700 1 --2- 172.21.15.53:0/2405465276 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f950006adb0 0x7f950006d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9518009960 tx=0x7f95180090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.560+0000 7f1398f9b700 1 --2- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13940caff0 0x7f13940c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.561+0000 7f139979c700 1 -- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13940caff0 msgr2=0x7f13940c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.561+0000 7f139979c700 1 --2- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13940caff0 0x7f13940c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.561+0000 7f139979c700 1 -- 172.21.15.53:0/2634608450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13940cdf40 msgr2=0x7f13940c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.561+0000 7f139979c700 1 --2- 172.21.15.53:0/2634608450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13940cdf40 0x7f13940c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.561+0000 7f139979c700 1 -- 172.21.15.53:0/2634608450 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c009a70 con 0x7f13941587d0 2023-07-09T21:50:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.562+0000 7f139979c700 1 --2- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13941587d0 0x7f13940c2b30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f138c00b370 tx=0x7f138c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.562+0000 7f28305ff700 1 -- 172.21.15.53:0/1711627894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28281f9ef0 con 0x7f28280cd6c0 2023-07-09T21:50:35.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.562+0000 7f28305ff700 1 -- 172.21.15.53:0/1711627894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2828162160 con 0x7f28280cd6c0 2023-07-09T21:50:35.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.562+0000 7f13917fa700 1 -- 172.21.15.53:0/2634608450 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c004970 con 0x7f13941587d0 2023-07-09T21:50:35.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.563+0000 7f13917fa700 1 -- 172.21.15.53:0/2634608450 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c012630 con 0x7f13941587d0 2023-07-09T21:50:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.563+0000 7f13917fa700 1 -- 172.21.15.53:0/2634608450 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c0129c0 con 0x7f13941587d0 2023-07-09T21:50:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.562+0000 7f6df67ff700 1 -- start start 2023-07-09T21:50:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.563+0000 7f6df67ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df006b5b0 0x7f6df014d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.563+0000 7f6df67ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6df00cc690 0x7f6df00703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.563+0000 7f6df67ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6df00cdf40 0x7f6df0070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.563+0000 7f6df67ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df014f100 con 0x7f6df006b5b0 2023-07-09T21:50:35.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.563+0000 7f6df67ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00b3ca0 con 0x7f6df00cdf40 2023-07-09T21:50:35.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.563+0000 7f6df67ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df0154aa0 con 0x7f6df00cc690 2023-07-09T21:50:35.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.563+0000 7f139b1ff700 1 -- 172.21.15.53:0/2634608450 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139406f890 con 0x7f13941587d0 2023-07-09T21:50:35.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.563+0000 7f139b1ff700 1 -- 172.21.15.53:0/2634608450 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1394157310 con 0x7f13941587d0 2023-07-09T21:50:35.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.564+0000 7f139b1ff700 1 -- 172.21.15.53:0/2634608450 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f139406c250 con 0x7f13941587d0 2023-07-09T21:50:35.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.564+0000 7f6deffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df006b5b0 0x7f6df014d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.564+0000 7f6deffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df006b5b0 0x7f6df014d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52832/0 (socket says 172.21.15.53:52832) 2023-07-09T21:50:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.564+0000 7f6deffff700 1 -- 172.21.15.53:0/1505833122 learned_addr learned my addr 172.21.15.53:0/1505833122 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.564+0000 7f28305ff700 1 -- 172.21.15.53:0/1711627894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28280ccdd0 con 0x7f28280cd6c0 2023-07-09T21:50:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.565+0000 7f6deffff700 1 -- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6df00cc690 msgr2=0x7f6df00703e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T21:50:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.565+0000 7f6deffff700 1 --2- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6df00cc690 0x7f6df00703e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.565+0000 7f6deffff700 1 -- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6df00cdf40 msgr2=0x7f6df0070920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T21:50:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.565+0000 7f6deffff700 1 --2- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6df00cdf40 0x7f6df0070920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.565+0000 7f6deffff700 1 -- 172.21.15.53:0/1505833122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de00085d0 con 0x7f6df006b5b0 2023-07-09T21:50:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.566+0000 7f6deffff700 1 --2- 172.21.15.53:0/1505833122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df006b5b0 0x7f6df014d660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6df0158d30 tx=0x7f6de0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.567+0000 7f6decff9700 1 -- 172.21.15.53:0/1505833122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0008e20 con 0x7f6df006b5b0 2023-07-09T21:50:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.567+0000 7f6decff9700 1 -- 172.21.15.53:0/1505833122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de0003820 con 0x7f6df006b5b0 2023-07-09T21:50:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.567+0000 7f6decff9700 1 -- 172.21.15.53:0/1505833122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0003bd0 con 0x7f6df006b5b0 2023-07-09T21:50:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.567+0000 7f6df67ff700 1 -- 172.21.15.53:0/1505833122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df00b39c0 con 0x7f6df006b5b0 2023-07-09T21:50:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.567+0000 7f6df67ff700 1 -- 172.21.15.53:0/1505833122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df014ed20 con 0x7f6df006b5b0 2023-07-09T21:50:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.568+0000 7f2826ffd700 1 -- 172.21.15.53:0/1711627894 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2814012c20 con 0x7f28280cd6c0 2023-07-09T21:50:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.568+0000 7f13917fa700 1 -- 172.21.15.53:0/2634608450 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f138c012b20 con 0x7f13941587d0 2023-07-09T21:50:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.569+0000 7f6df67ff700 1 -- 172.21.15.53:0/1505833122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6df006c530 con 0x7f6df006b5b0 2023-07-09T21:50:35.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.569+0000 7f34a77fe700 1 --2- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] conn(0x7f34880015e0 0x7f3488003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.569+0000 7f2826ffd700 1 --2- 172.21.15.53:0/1711627894 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f280c06adb0 0x7f280c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.569+0000 7f2826ffd700 1 -- 172.21.15.53:0/1711627894 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2814089800 con 0x7f28280cd6c0 2023-07-09T21:50:35.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.570+0000 7f2826ffd700 1 --2- 172.21.15.53:0/1711627894 >> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] conn(0x7f280c073660 0x7f280c075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.570+0000 7f2826ffd700 1 -- 172.21.15.53:0/1711627894 --> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f280c076120 con 0x7f280c073660 2023-07-09T21:50:35.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.570+0000 7f2826ffd700 1 -- 172.21.15.53:0/1711627894 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f281408be20 con 0x7f28280cd6c0 2023-07-09T21:50:35.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.571+0000 7f282e39b700 1 --2- 172.21.15.53:0/1711627894 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f280c06adb0 0x7f280c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.571+0000 7f348f7fe700 1 -- 172.21.15.53:0/893338024 <== osd.4 v2:172.21.15.184:6800/2051967353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3488006bc0 con 0x7f34880015e0 2023-07-09T21:50:35.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.570+0000 7f13917fa700 1 --2- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f138006ad30 0x7f138006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.570+0000 7f13917fa700 1 -- 172.21.15.53:0/2634608450 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f138c08bb20 con 0x7f13941587d0 2023-07-09T21:50:35.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.570+0000 7f13917fa700 1 --2- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] conn(0x7f13800735e0 0x7f13800759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.570+0000 7f13917fa700 1 -- 172.21.15.53:0/2634608450 --> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13800760a0 con 0x7f13800735e0 2023-07-09T21:50:35.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.570+0000 7f13917fa700 1 -- 172.21.15.53:0/2634608450 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f138c08be90 con 0x7f13941587d0 2023-07-09T21:50:35.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.571+0000 7f1393fff700 1 --2- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] conn(0x7f13800735e0 0x7f13800759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.571+0000 7f282eb9c700 1 --2- 172.21.15.53:0/1711627894 >> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] conn(0x7f280c073660 0x7f280c075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.571+0000 7f1398f9b700 1 --2- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f138006ad30 0x7f138006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.572+0000 7fc30abff700 1 Processor -- start 2023-07-09T21:50:35.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.573+0000 7f0dfbfff700 1 -- 172.21.15.53:0/1168760269 --> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ddc002d40 con 0x7f0dd80735e0 2023-07-09T21:50:35.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.572+0000 7f282eb9c700 1 --2- 172.21.15.53:0/1711627894 >> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] conn(0x7f280c073660 0x7f280c075a70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.572+0000 7f1393fff700 1 --2- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] conn(0x7f13800735e0 0x7f13800759f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.573+0000 7f1398f9b700 1 --2- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f138006ad30 0x7f138006d1e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1388005910 tx=0x7f1388009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.572+0000 7fc30abff700 1 -- start start 2023-07-09T21:50:35.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.574+0000 7f2826ffd700 1 -- 172.21.15.53:0/1711627894 <== osd.2 v2:172.21.15.53:6800/2275952419 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f280c076120 con 0x7f280c073660 2023-07-09T21:50:35.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.574+0000 7f6decff9700 1 -- 172.21.15.53:0/1505833122 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6de0003d30 con 0x7f6df006b5b0 2023-07-09T21:50:35.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.574+0000 7f0dea7fc700 1 -- 172.21.15.53:0/1168760269 <== osd.0 v2:172.21.15.53:6808/1521858900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ddc002d40 con 0x7f0dd80735e0 2023-07-09T21:50:35.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.574+0000 7f13917fa700 1 -- 172.21.15.53:0/2634608450 <== osd.6 v2:172.21.15.184:6813/587359560 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f13800760a0 con 0x7f13800735e0 2023-07-09T21:50:35.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.575+0000 7fc30abff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc30406cd60 0x7fc304161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.575+0000 7fc30abff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc3040cc690 0x7fc3040cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.575+0000 7fc30abff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3040cd530 con 0x7fc3040ccb00 2023-07-09T21:50:35.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.575+0000 7fc30abff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3041615d0 con 0x7fc3040cc690 2023-07-09T21:50:35.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.575+0000 7fc30abff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040ccf70 con 0x7fc30406cd60 2023-07-09T21:50:35.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.575+0000 7f0dfbfff700 1 -- 172.21.15.53:0/1168760269 >> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] conn(0x7f0dd80735e0 msgr2=0x7f0dd80759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.575+0000 7f0dfbfff700 1 --2- 172.21.15.53:0/1168760269 >> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] conn(0x7f0dd80735e0 0x7f0dd80759f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.575+0000 7f6decff9700 1 --2- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6ddc06adb0 0x7f6ddc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.575+0000 7f6decff9700 1 -- 172.21.15.53:0/1505833122 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6de008aae0 con 0x7f6df006b5b0 2023-07-09T21:50:35.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.576+0000 7fc30919c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc3040ccb00 0x7fc304164630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56248/0 (socket says 172.21.15.53:56248) 2023-07-09T21:50:35.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.576+0000 7fc30919c700 1 -- 172.21.15.53:0/2202054824 learned_addr learned my addr 172.21.15.53:0/2202054824 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:35.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.576+0000 7fc30899b700 1 --2- 172.21.15.53:0/2202054824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc30406cd60 0x7fc304161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.576+0000 7f6decff9700 1 --2- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] conn(0x7f6ddc073660 0x7f6ddc075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.576+0000 7f6decff9700 1 -- 172.21.15.53:0/1505833122 --> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ddc076120 con 0x7f6ddc073660 2023-07-09T21:50:35.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.576+0000 7f6decff9700 1 -- 172.21.15.53:0/1505833122 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6de008f2a0 con 0x7f6df006b5b0 2023-07-09T21:50:35.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.576+0000 7fc303fff700 1 --2- 172.21.15.53:0/2202054824 >> v2:172.21.15.53:3300/0 conn(0x7fc3040cc690 0x7fc3040cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.576+0000 7f6def7fe700 1 --2- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6ddc06adb0 0x7f6ddc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.576+0000 7f6df4d9c700 1 --2- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] conn(0x7f6ddc073660 0x7f6ddc075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.577+0000 7fc303fff700 1 -- 172.21.15.53:0/2202054824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc30406cd60 msgr2=0x7fc304161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:35.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.577+0000 7fc303fff700 1 --2- 172.21.15.53:0/2202054824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc30406cd60 0x7fc304161a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.577+0000 7fc303fff700 1 -- 172.21.15.53:0/2202054824 >> v1:172.21.15.53:6789/0 conn(0x7fc3040ccb00 legacy=0x7fc304164630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.577+0000 7fc303fff700 1 -- 172.21.15.53:0/2202054824 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3040cd250 con 0x7fc3040cc690 2023-07-09T21:50:35.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.577+0000 7f0dfbfff700 1 -- 172.21.15.53:0/1168760269 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0dd806adb0 msgr2=0x7f0dd806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.577+0000 7f0dfbfff700 1 --2- 172.21.15.53:0/1168760269 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0dd806adb0 0x7f0dd806d260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0de4000f60 tx=0x7f0de4007a40 comp rx=0 tx=0).stop 2023-07-09T21:50:35.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.577+0000 7f0dfbfff700 1 -- 172.21.15.53:0/1168760269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0df40ce2f0 msgr2=0x7f0df40b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.577+0000 7f0dfbfff700 1 --2- 172.21.15.53:0/1168760269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0df40ce2f0 0x7f0df40b3d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00c7a0 tx=0x7f0dec00cb60 comp rx=0 tx=0).stop 2023-07-09T21:50:35.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.577+0000 7f0dfa59c700 1 -- 172.21.15.53:0/1168760269 reap_dead start 2023-07-09T21:50:35.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.577+0000 7fc303fff700 1 --2- 172.21.15.53:0/2202054824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3040cc690 0x7fc3040cd940 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009840 tx=0x7fc2f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3c2c872831ba87 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.578+0000 7f0dfbfff700 1 -- 172.21.15.53:0/1168760269 shutdown_connections 2023-07-09T21:50:35.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.578+0000 7f0dfbfff700 1 -- 172.21.15.53:0/1168760269 >> 172.21.15.53:0/1168760269 conn(0x7f0df40b05d0 msgr2=0x7f0df40ae400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.578+0000 7f6df4d9c700 1 --2- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] conn(0x7f6ddc073660 0x7f6ddc075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.578+0000 7fc3037fe700 1 -- 172.21.15.53:0/2202054824 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0011830 con 0x7fc3040cc690 2023-07-09T21:50:35.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.578+0000 7fc3037fe700 1 -- 172.21.15.53:0/2202054824 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f0011990 con 0x7fc3040cc690 2023-07-09T21:50:35.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.578+0000 7fc3037fe700 1 -- 172.21.15.53:0/2202054824 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0011d00 con 0x7fc3040cc690 2023-07-09T21:50:35.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.578+0000 7f6def7fe700 1 --2- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6ddc06adb0 0x7f6ddc06d260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6df0157480 tx=0x7f6de4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.575+0000 7f282e39b700 1 --2- 172.21.15.53:0/1711627894 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f280c06adb0 0x7f280c06d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f28281f9ad0 tx=0x7f281c007ad0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.578+0000 7f0dfbfff700 1 -- 172.21.15.53:0/1168760269 shutdown_connections 2023-07-09T21:50:35.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.578+0000 7f0dfbfff700 1 -- 172.21.15.53:0/1168760269 wait complete. 2023-07-09T21:50:35.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.579+0000 7fc30abff700 1 -- 172.21.15.53:0/2202054824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3040cc690 msgr2=0x7fc3040cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.579+0000 7fc30abff700 1 --2- 172.21.15.53:0/2202054824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3040cc690 0x7fc3040cd940 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009840 tx=0x7fc2f0009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:35.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.579+0000 7f6decff9700 1 -- 172.21.15.53:0/1505833122 <== osd.5 v2:172.21.15.184:6808/1885482202 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6ddc076120 con 0x7f6ddc073660 2023-07-09T21:50:35.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.579+0000 7fc30abff700 1 -- 172.21.15.53:0/2202054824 shutdown_connections 2023-07-09T21:50:35.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.579+0000 7fc30abff700 1 --2- 172.21.15.53:0/2202054824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc30406cd60 0x7fc304161a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.579+0000 7fc30abff700 1 --2- 172.21.15.53:0/2202054824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3040cc690 0x7fc3040cd940 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.579+0000 7fc30abff700 1 -- 172.21.15.53:0/2202054824 >> 172.21.15.53:0/2202054824 conn(0x7fc3040b05d0 msgr2=0x7fc3040b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.580+0000 7fc30abff700 1 -- 172.21.15.53:0/2202054824 shutdown_connections 2023-07-09T21:50:35.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.580+0000 7fc30abff700 1 -- 172.21.15.53:0/2202054824 wait complete. 2023-07-09T21:50:35.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.583+0000 7fc30abff700 1 Processor -- start 2023-07-09T21:50:35.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.583+0000 7fc30abff700 1 -- start start 2023-07-09T21:50:35.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.585+0000 7fc30abff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc30406cd60 0x7fc304158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.586+0000 7fc30abff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3040cc690 0x7fc30415deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.586+0000 7fc30abff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3040ccb00 0x7fc30415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.586+0000 7fc30abff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3041eb110 con 0x7fc3040cc690 2023-07-09T21:50:35.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.586+0000 7fc30abff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3041eb3f0 con 0x7fc30406cd60 2023-07-09T21:50:35.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.586+0000 7fc30abff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3041eb6d0 con 0x7fc3040ccb00 2023-07-09T21:50:35.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.587+0000 7fc30899b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc30406cd60 0x7fc304158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.587+0000 7fc30919c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3040ccb00 0x7fc30415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.587+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/184123378 --> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1d78074350 con 0x7f1d640735e0 2023-07-09T21:50:35.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.588+0000 7f1d74ff9700 1 -- 172.21.15.53:0/184123378 <== osd.1 v2:172.21.15.53:6816/801424543 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1d78074350 con 0x7f1d640735e0 2023-07-09T21:50:35.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.587+0000 7fc30899b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc30406cd60 0x7fc304158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57418/0 (socket says 172.21.15.53:57418) 2023-07-09T21:50:35.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.587+0000 7fc30899b700 1 -- 172.21.15.53:0/1004997959 learned_addr learned my addr 172.21.15.53:0/1004997959 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:35.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.588+0000 7fc30899b700 1 -- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3040ccb00 msgr2=0x7fc30415e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.588+0000 7fc30899b700 1 --2- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3040ccb00 0x7fc30415e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.588+0000 7fc30899b700 1 -- 172.21.15.53:0/1004997959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3040cc690 msgr2=0x7fc30415deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.588+0000 7fc30899b700 1 --2- 172.21.15.53:0/1004997959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3040cc690 0x7fc30415deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.588+0000 7fc30899b700 1 -- 172.21.15.53:0/1004997959 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f00094a0 con 0x7fc30406cd60 2023-07-09T21:50:35.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.589+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/184123378 >> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] conn(0x7f1d640735e0 msgr2=0x7f1d640759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.589+0000 7f1d7e7ff700 1 --2- 172.21.15.53:0/184123378 >> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] conn(0x7f1d640735e0 0x7f1d640759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.589+0000 7fc30899b700 1 --2- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc30406cd60 0x7fc304158710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800e9b0 tx=0x7fc2f800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.590+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/184123378 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1d6406ad30 msgr2=0x7f1d6406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.590+0000 7f1d7e7ff700 1 --2- 172.21.15.53:0/184123378 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1d6406ad30 0x7f1d6406d1e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c001600 tx=0x7f1d6c007a20 comp rx=0 tx=0).stop 2023-07-09T21:50:35.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.590+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/184123378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d780ce2f0 msgr2=0x7f1d780cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.590+0000 7f1d7e7ff700 1 --2- 172.21.15.53:0/184123378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d780ce2f0 0x7f1d780cac70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800c420 tx=0x7f1d6800c730 comp rx=0 tx=0).stop 2023-07-09T21:50:35.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.589+0000 7fc3017fa700 1 -- 172.21.15.53:0/1004997959 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f800c850 con 0x7fc30406cd60 2023-07-09T21:50:35.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.590+0000 7fc3017fa700 1 -- 172.21.15.53:0/1004997959 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f800c9b0 con 0x7fc30406cd60 2023-07-09T21:50:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.590+0000 7fc3017fa700 1 -- 172.21.15.53:0/1004997959 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f800cd20 con 0x7fc30406cd60 2023-07-09T21:50:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.590+0000 7fc30abff700 1 -- 172.21.15.53:0/1004997959 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3041eb9b0 con 0x7fc30406cd60 2023-07-09T21:50:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.590+0000 7fc30abff700 1 -- 172.21.15.53:0/1004997959 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc304158c50 con 0x7fc30406cd60 2023-07-09T21:50:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.592+0000 7fc30abff700 1 -- 172.21.15.53:0/1004997959 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc304161fa0 con 0x7fc30406cd60 2023-07-09T21:50:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.593+0000 7f1d7cd9c700 1 -- 172.21.15.53:0/184123378 reap_dead start 2023-07-09T21:50:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.593+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/184123378 shutdown_connections 2023-07-09T21:50:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.593+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/184123378 >> 172.21.15.53:0/184123378 conn(0x7f1d780b05d0 msgr2=0x7f1d7815f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.598+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/184123378 shutdown_connections 2023-07-09T21:50:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.598+0000 7f1d7e7ff700 1 -- 172.21.15.53:0/184123378 wait complete. 2023-07-09T21:50:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.598+0000 7fc3017fa700 1 -- 172.21.15.53:0/1004997959 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc2f8013470 con 0x7fc30406cd60 2023-07-09T21:50:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.600+0000 7fc3017fa700 1 --2- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc2e806adb0 0x7fc2e806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.601+0000 7fc3017fa700 1 -- 172.21.15.53:0/1004997959 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc2f80899d0 con 0x7fc30406cd60 2023-07-09T21:50:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.601+0000 7fc3017fa700 1 --2- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] conn(0x7fc2e8073660 0x7fc2e8075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.601+0000 7fc3017fa700 1 -- 172.21.15.53:0/1004997959 --> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2e8076120 con 0x7fc2e8073660 2023-07-09T21:50:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.601+0000 7fc3017fa700 1 -- 172.21.15.53:0/1004997959 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2f8089d80 con 0x7fc30406cd60 2023-07-09T21:50:35.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.601+0000 7f9523fff700 1 -- 172.21.15.53:0/2405465276 --> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9504002d40 con 0x7f95000735e0 2023-07-09T21:50:35.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.602+0000 7fc30919c700 1 --2- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] conn(0x7fc2e8073660 0x7fc2e8075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.602+0000 7fc303fff700 1 --2- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc2e806adb0 0x7fc2e806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:35.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.603+0000 7f34ad5ff700 1 -- 172.21.15.53:0/893338024 --> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3488005c40 con 0x7f34880015e0 2023-07-09T21:50:35.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.603+0000 7f95127fc700 1 -- 172.21.15.53:0/2405465276 <== osd.3 v2:172.21.15.53:6824/743855822 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9504002d40 con 0x7f95000735e0 2023-07-09T21:50:35.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.603+0000 7fc30919c700 1 --2- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] conn(0x7fc2e8073660 0x7fc2e8075a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.603+0000 7fc303fff700 1 --2- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc2e806adb0 0x7fc2e806d260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc304164420 tx=0x7fc2f0010000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:35.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.603+0000 7f348f7fe700 1 -- 172.21.15.53:0/893338024 <== osd.4 v2:172.21.15.184:6800/2051967353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3488005c40 con 0x7f34880015e0 2023-07-09T21:50:35.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.604+0000 7f34ad5ff700 1 -- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] conn(0x7f34880015e0 msgr2=0x7f3488003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.604+0000 7f34ad5ff700 1 --2- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] conn(0x7f34880015e0 0x7f3488003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.604+0000 7fc3017fa700 1 -- 172.21.15.53:0/1004997959 <== osd.7 v2:172.21.15.184:6824/3630658135 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc2e8076120 con 0x7fc2e8073660 2023-07-09T21:50:35.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.604+0000 7f34ad5ff700 1 -- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f349406adb0 msgr2=0x7f349406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.604+0000 7f34ad5ff700 1 --2- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f349406adb0 0x7f349406d260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f349c0098b0 tx=0x7f349c008040 comp rx=0 tx=0).stop 2023-07-09T21:50:35.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.604+0000 7f34ad5ff700 1 -- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34a8158930 msgr2=0x7f34a81fa170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.604+0000 7f34ad5ff700 1 --2- 172.21.15.53:0/893338024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34a8158930 0x7f34a81fa170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f349800e9b0 tx=0x7f349800ed70 comp rx=0 tx=0).stop 2023-07-09T21:50:35.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.604+0000 7f9523fff700 1 -- 172.21.15.53:0/2405465276 >> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] conn(0x7f95000735e0 msgr2=0x7f95000759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.604+0000 7f9523fff700 1 --2- 172.21.15.53:0/2405465276 >> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] conn(0x7f95000735e0 0x7f95000759f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.604+0000 7f34a77fe700 1 -- 172.21.15.53:0/893338024 reap_dead start 2023-07-09T21:50:35.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.605+0000 7f9523fff700 1 -- 172.21.15.53:0/2405465276 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f950006adb0 msgr2=0x7f950006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.605+0000 7f9523fff700 1 --2- 172.21.15.53:0/2405465276 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f950006adb0 0x7f950006d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9518009960 tx=0x7f95180090e0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.605+0000 7f9523fff700 1 -- 172.21.15.53:0/2405465276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f951c0cc690 msgr2=0x7f951c0c25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.605+0000 7f9523fff700 1 --2- 172.21.15.53:0/2405465276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f951c0cc690 0x7f951c0c25f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f950c00c6b0 tx=0x7f950c00c9c0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.605+0000 7f952259c700 1 -- 172.21.15.53:0/2405465276 reap_dead start 2023-07-09T21:50:35.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.605+0000 7f34ad5ff700 1 -- 172.21.15.53:0/893338024 shutdown_connections 2023-07-09T21:50:35.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.605+0000 7f34ad5ff700 1 -- 172.21.15.53:0/893338024 >> 172.21.15.53:0/893338024 conn(0x7f34a80b05d0 msgr2=0x7f34a80712c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.605+0000 7f6df67ff700 1 -- 172.21.15.53:0/1505833122 --> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6df006c250 con 0x7f6ddc073660 2023-07-09T21:50:35.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.606+0000 7f9523fff700 1 -- 172.21.15.53:0/2405465276 shutdown_connections 2023-07-09T21:50:35.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.606+0000 7f9523fff700 1 -- 172.21.15.53:0/2405465276 >> 172.21.15.53:0/2405465276 conn(0x7f951c0b05d0 msgr2=0x7f951c163110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.660 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-07-09T21:50:35.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.606+0000 7f9523fff700 1 -- 172.21.15.53:0/2405465276 shutdown_connections 2023-07-09T21:50:35.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.606+0000 7f9523fff700 1 -- 172.21.15.53:0/2405465276 wait complete. 2023-07-09T21:50:35.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-09T21:50:35.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.606+0000 7f6decff9700 1 -- 172.21.15.53:0/1505833122 <== osd.5 v2:172.21.15.184:6808/1885482202 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6de800a720 con 0x7f6ddc073660 2023-07-09T21:50:35.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.607+0000 7f6df67ff700 1 -- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] conn(0x7f6ddc073660 msgr2=0x7f6ddc075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.607+0000 7f6df67ff700 1 --2- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] conn(0x7f6ddc073660 0x7f6ddc075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.607+0000 7f6df67ff700 1 -- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6ddc06adb0 msgr2=0x7f6ddc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.607+0000 7f6df67ff700 1 --2- 172.21.15.53:0/1505833122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6ddc06adb0 0x7f6ddc06d260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6df0157480 tx=0x7f6de4008040 comp rx=0 tx=0).stop 2023-07-09T21:50:35.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.607+0000 7f6df67ff700 1 -- 172.21.15.53:0/1505833122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df006b5b0 msgr2=0x7f6df014d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.607+0000 7f6df67ff700 1 --2- 172.21.15.53:0/1505833122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df006b5b0 0x7f6df014d660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6df0158d30 tx=0x7f6de0004750 comp rx=0 tx=0).stop 2023-07-09T21:50:35.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.607+0000 7f6df4d9c700 1 -- 172.21.15.53:0/1505833122 reap_dead start 2023-07-09T21:50:35.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.607+0000 7f6df67ff700 1 -- 172.21.15.53:0/1505833122 shutdown_connections 2023-07-09T21:50:35.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.607+0000 7f6df67ff700 1 -- 172.21.15.53:0/1505833122 >> 172.21.15.53:0/1505833122 conn(0x7f6df00b05d0 msgr2=0x7f6df0153400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.612+0000 7f28305ff700 1 -- 172.21.15.53:0/1711627894 --> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f28280ccaf0 con 0x7f280c073660 2023-07-09T21:50:35.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.612+0000 7f34ad5ff700 1 -- 172.21.15.53:0/893338024 shutdown_connections 2023-07-09T21:50:35.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.612+0000 7f34ad5ff700 1 -- 172.21.15.53:0/893338024 wait complete. 2023-07-09T21:50:35.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.613+0000 7f6df67ff700 1 -- 172.21.15.53:0/1505833122 shutdown_connections 2023-07-09T21:50:35.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.613+0000 7f139b1ff700 1 -- 172.21.15.53:0/2634608450 --> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f139406bf70 con 0x7f13800735e0 2023-07-09T21:50:35.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.613+0000 7f2826ffd700 1 -- 172.21.15.53:0/1711627894 <== osd.2 v2:172.21.15.53:6800/2275952419 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2820003a20 con 0x7f280c073660 2023-07-09T21:50:35.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.613+0000 7f6df67ff700 1 -- 172.21.15.53:0/1505833122 wait complete. 2023-07-09T21:50:35.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.613+0000 7f13917fa700 1 -- 172.21.15.53:0/2634608450 <== osd.6 v2:172.21.15.184:6813/587359560 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1384009530 con 0x7f13800735e0 2023-07-09T21:50:35.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.614+0000 7f28305ff700 1 -- 172.21.15.53:0/1711627894 >> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] conn(0x7f280c073660 msgr2=0x7f280c075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.614+0000 7f28305ff700 1 --2- 172.21.15.53:0/1711627894 >> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] conn(0x7f280c073660 0x7f280c075a70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.614+0000 7f139b1ff700 1 -- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] conn(0x7f13800735e0 msgr2=0x7f13800759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.614+0000 7f139b1ff700 1 --2- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] conn(0x7f13800735e0 0x7f13800759f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.615+0000 7f139b1ff700 1 -- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f138006ad30 msgr2=0x7f138006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.615+0000 7f139b1ff700 1 --2- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f138006ad30 0x7f138006d1e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1388005910 tx=0x7f1388009040 comp rx=0 tx=0).stop 2023-07-09T21:50:35.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.615+0000 7f139b1ff700 1 -- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13941587d0 msgr2=0x7f13940c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.615+0000 7f139b1ff700 1 --2- 172.21.15.53:0/2634608450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13941587d0 0x7f13940c2b30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f138c00b370 tx=0x7f138c004ad0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.618+0000 7f139979c700 1 -- 172.21.15.53:0/2634608450 reap_dead start 2023-07-09T21:50:35.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.618+0000 7f139b1ff700 1 -- 172.21.15.53:0/2634608450 shutdown_connections 2023-07-09T21:50:35.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.618+0000 7f139b1ff700 1 -- 172.21.15.53:0/2634608450 >> 172.21.15.53:0/2634608450 conn(0x7f13940b05d0 msgr2=0x7f13940b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.618+0000 7f28305ff700 1 -- 172.21.15.53:0/1711627894 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f280c06adb0 msgr2=0x7f280c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.618+0000 7f28305ff700 1 --2- 172.21.15.53:0/1711627894 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f280c06adb0 0x7f280c06d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f28281f9ad0 tx=0x7f281c007ad0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.618+0000 7f28305ff700 1 -- 172.21.15.53:0/1711627894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28280cd6c0 msgr2=0x7f2828161c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.618+0000 7f28305ff700 1 --2- 172.21.15.53:0/1711627894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28280cd6c0 0x7f2828161c20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f281400d800 tx=0x7f281400dbc0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.618+0000 7f282eb9c700 1 -- 172.21.15.53:0/1711627894 reap_dead start 2023-07-09T21:50:35.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.619+0000 7f28305ff700 1 -- 172.21.15.53:0/1711627894 shutdown_connections 2023-07-09T21:50:35.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.619+0000 7f28305ff700 1 -- 172.21.15.53:0/1711627894 >> 172.21.15.53:0/1711627894 conn(0x7f28280b05d0 msgr2=0x7f2828164450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.619+0000 7f139b1ff700 1 -- 172.21.15.53:0/2634608450 shutdown_connections 2023-07-09T21:50:35.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.619+0000 7f139b1ff700 1 -- 172.21.15.53:0/2634608450 wait complete. 2023-07-09T21:50:35.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.620+0000 7f28305ff700 1 -- 172.21.15.53:0/1711627894 shutdown_connections 2023-07-09T21:50:35.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.620+0000 7f28305ff700 1 -- 172.21.15.53:0/1711627894 wait complete. 2023-07-09T21:50:35.672 INFO:teuthology.orchestra.run.smithi053.stdout:64424509448 2023-07-09T21:50:35.672 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-09T21:50:35.673 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-07-09T21:50:35.673 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-09T21:50:35.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.632+0000 7fc30abff700 1 -- 172.21.15.53:0/1004997959 --> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc304161260 con 0x7fc2e8073660 2023-07-09T21:50:35.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.633+0000 7fc3017fa700 1 -- 172.21.15.53:0/1004997959 <== osd.7 v2:172.21.15.184:6824/3630658135 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc2fc0020d0 con 0x7fc2e8073660 2023-07-09T21:50:35.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.633+0000 7fc30abff700 1 -- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] conn(0x7fc2e8073660 msgr2=0x7fc2e8075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.633+0000 7fc30abff700 1 --2- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] conn(0x7fc2e8073660 0x7fc2e8075a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:35.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.634+0000 7fc30abff700 1 -- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc2e806adb0 msgr2=0x7fc2e806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.634+0000 7fc30abff700 1 --2- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc2e806adb0 0x7fc2e806d260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc304164420 tx=0x7fc2f0010000 comp rx=0 tx=0).stop 2023-07-09T21:50:35.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.634+0000 7fc30abff700 1 -- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc30406cd60 msgr2=0x7fc304158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:35.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.634+0000 7fc30abff700 1 --2- 172.21.15.53:0/1004997959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc30406cd60 0x7fc304158710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800e9b0 tx=0x7fc2f800ed70 comp rx=0 tx=0).stop 2023-07-09T21:50:35.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.634+0000 7fc30919c700 1 -- 172.21.15.53:0/1004997959 reap_dead start 2023-07-09T21:50:35.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.634+0000 7fc30abff700 1 -- 172.21.15.53:0/1004997959 shutdown_connections 2023-07-09T21:50:35.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.634+0000 7fc30abff700 1 -- 172.21.15.53:0/1004997959 >> 172.21.15.53:0/1004997959 conn(0x7fc3040b05d0 msgr2=0x7fc3040ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:35.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.634+0000 7fc30abff700 1 -- 172.21.15.53:0/1004997959 shutdown_connections 2023-07-09T21:50:35.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:35.634+0000 7fc30abff700 1 -- 172.21.15.53:0/1004997959 wait complete. 2023-07-09T21:50:35.677 INFO:teuthology.orchestra.run.smithi053.stdout:64424509448 2023-07-09T21:50:35.677 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-09T21:50:35.678 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-07-09T21:50:35.678 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-09T21:50:35.679 INFO:teuthology.orchestra.run.smithi053.stdout:60129542152 2023-07-09T21:50:35.679 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-09T21:50:35.680 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-07-09T21:50:35.680 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-09T21:50:35.681 INFO:teuthology.orchestra.run.smithi053.stdout:60129542152 2023-07-09T21:50:35.682 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-09T21:50:36.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.067+0000 7f15f35ff700 1 Processor -- start 2023-07-09T21:50:36.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.067+0000 7f134b1ff700 1 Processor -- start 2023-07-09T21:50:36.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.067+0000 7f134b1ff700 1 -- start start 2023-07-09T21:50:36.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.069+0000 7f134b1ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13440cd2f0 0x7f13440cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.069+0000 7f134b1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13440cd6c0 0x7f13440ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.069+0000 7f134b1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1344164710 0x7f1344164b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.069+0000 7f134b1ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1344161050 con 0x7f13440cd2f0 2023-07-09T21:50:36.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.069+0000 7f134b1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1344165400 con 0x7f13440cd6c0 2023-07-09T21:50:36.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.069+0000 7f134b1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13440cc810 con 0x7f1344164710 2023-07-09T21:50:36.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.070+0000 7f134979c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1344164710 0x7f1344164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.070+0000 7f1348f9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13440cd2f0 0x7f13440cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.070+0000 7f1348f9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13440cd2f0 0x7f13440cdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52850/0 (socket says 172.21.15.53:52850) 2023-07-09T21:50:36.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.070+0000 7f1348f9b700 1 -- 172.21.15.53:0/1013736470 learned_addr learned my addr 172.21.15.53:0/1013736470 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:36.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.071+0000 7f1343fff700 1 --2- 172.21.15.53:0/1013736470 >> v2:172.21.15.184:3300/0 conn(0x7f13440cd6c0 0x7f13440ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.071+0000 7f1348f9b700 1 -- 172.21.15.53:0/1013736470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1344164710 msgr2=0x7f1344164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:36.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.071+0000 7f1348f9b700 1 --2- 172.21.15.53:0/1013736470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1344164710 0x7f1344164b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.071+0000 7f1348f9b700 1 -- 172.21.15.53:0/1013736470 >> v2:172.21.15.184:3300/0 conn(0x7f13440cd6c0 msgr2=0x7f13440ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:36.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.071+0000 7f1348f9b700 1 --2- 172.21.15.53:0/1013736470 >> v2:172.21.15.184:3300/0 conn(0x7f13440cd6c0 0x7f13440ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.071+0000 7f1348f9b700 1 -- 172.21.15.53:0/1013736470 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13440ccaf0 con 0x7f13440cd2f0 2023-07-09T21:50:36.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.072+0000 7f1348f9b700 1 --2- 172.21.15.53:0/1013736470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13440cd2f0 0x7f13440cdbe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1344067290 tx=0x7f1338009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb7a55d44b6605e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.073+0000 7f13437fe700 1 -- 172.21.15.53:0/1013736470 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133800b870 con 0x7f13440cd2f0 2023-07-09T21:50:36.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.073+0000 7f13437fe700 1 -- 172.21.15.53:0/1013736470 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133800b9d0 con 0x7f13440cd2f0 2023-07-09T21:50:36.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.073+0000 7f13437fe700 1 -- 172.21.15.53:0/1013736470 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133800bd60 con 0x7f13440cd2f0 2023-07-09T21:50:36.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.074+0000 7f134b1ff700 1 -- 172.21.15.53:0/1013736470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13440cd2f0 msgr2=0x7f13440cdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.074+0000 7f134b1ff700 1 --2- 172.21.15.53:0/1013736470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13440cd2f0 0x7f13440cdbe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1344067290 tx=0x7f1338009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.071+0000 7f15f35ff700 1 -- start start 2023-07-09T21:50:36.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.073+0000 7f15f35ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f15ec06b5b0 0x7f15ec06b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.073+0000 7f15f35ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15ec0cdf40 0x7f15ec0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.073+0000 7f15f35ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ec0cc000 con 0x7f15ec0cc690 2023-07-09T21:50:36.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.073+0000 7f15f35ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ec0ce8f0 con 0x7f15ec06b5b0 2023-07-09T21:50:36.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.073+0000 7f15f35ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0cab60 con 0x7f15ec0cdf40 2023-07-09T21:50:36.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.074+0000 7f15f0b9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15ec0cdf40 0x7f15ec0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.075+0000 7f15f0b9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15ec0cdf40 0x7f15ec0ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58402/0 (socket says 172.21.15.53:58402) 2023-07-09T21:50:36.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.075+0000 7f15f0b9a700 1 -- 172.21.15.53:0/559962640 learned_addr learned my addr 172.21.15.53:0/559962640 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:36.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.075+0000 7f15f139b700 1 --2- 172.21.15.53:0/559962640 >> v2:172.21.15.184:3300/0 conn(0x7f15ec06b5b0 0x7f15ec06b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.075+0000 7f15f0b9a700 1 -- 172.21.15.53:0/559962640 >> v2:172.21.15.184:3300/0 conn(0x7f15ec06b5b0 msgr2=0x7f15ec06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:36.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.075+0000 7f15f0b9a700 1 --2- 172.21.15.53:0/559962640 >> v2:172.21.15.184:3300/0 conn(0x7f15ec06b5b0 0x7f15ec06b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.075+0000 7f15f0b9a700 1 -- 172.21.15.53:0/559962640 >> v1:172.21.15.184:6789/0 conn(0x7f15ec0cc690 legacy=0x7f15ec0ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:36.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.076+0000 7f15f0b9a700 1 -- 172.21.15.53:0/559962640 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec158bf0 con 0x7f15ec0cdf40 2023-07-09T21:50:36.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.076+0000 7f15f0b9a700 1 --2- 172.21.15.53:0/559962640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15ec0cdf40 0x7f15ec0ce3b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f15e80098f0 tx=0x7f15e8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e0cb9e4330c9c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.076+0000 7f15e3fff700 1 -- 172.21.15.53:0/559962640 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8004230 con 0x7f15ec0cdf40 2023-07-09T21:50:36.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.076+0000 7f15e3fff700 1 -- 172.21.15.53:0/559962640 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e8004390 con 0x7f15ec0cdf40 2023-07-09T21:50:36.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.076+0000 7f15e3fff700 1 -- 172.21.15.53:0/559962640 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e800f740 con 0x7f15ec0cdf40 2023-07-09T21:50:36.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.077+0000 7f15f35ff700 1 -- 172.21.15.53:0/559962640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15ec0cdf40 msgr2=0x7f15ec0ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.077+0000 7f15f35ff700 1 --2- 172.21.15.53:0/559962640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15ec0cdf40 0x7f15ec0ce3b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f15e80098f0 tx=0x7f15e8009c00 comp rx=0 tx=0).stop 2023-07-09T21:50:36.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.078+0000 7f15f35ff700 1 -- 172.21.15.53:0/559962640 shutdown_connections 2023-07-09T21:50:36.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.078+0000 7f15f35ff700 1 --2- 172.21.15.53:0/559962640 >> v2:172.21.15.184:3300/0 conn(0x7f15ec06b5b0 0x7f15ec06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.078+0000 7f15f35ff700 1 --2- 172.21.15.53:0/559962640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15ec0cdf40 0x7f15ec0ce3b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.078+0000 7f15f35ff700 1 -- 172.21.15.53:0/559962640 >> 172.21.15.53:0/559962640 conn(0x7f15ec0b05d0 msgr2=0x7f15ec0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.078+0000 7f15f35ff700 1 -- 172.21.15.53:0/559962640 shutdown_connections 2023-07-09T21:50:36.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.078+0000 7f15f35ff700 1 -- 172.21.15.53:0/559962640 wait complete. 2023-07-09T21:50:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.078+0000 7f5216dff700 1 Processor -- start 2023-07-09T21:50:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.081+0000 7f15f35ff700 1 Processor -- start 2023-07-09T21:50:36.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.079+0000 7f5216dff700 1 -- start start 2023-07-09T21:50:36.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.081+0000 7f5216dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52100ce650 0x7f521006b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.081+0000 7f5216dff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52100cab60 con 0x7f521006b5b0 2023-07-09T21:50:36.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.081+0000 7f5216dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5210158bf0 con 0x7f52100caff0 2023-07-09T21:50:36.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.081+0000 7f5216dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521006bf70 con 0x7f52100ce650 2023-07-09T21:50:36.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.082+0000 7f520ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52100ce650 0x7f521006b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.082+0000 7f520ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52100ce650 0x7f521006b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52864/0 (socket says 172.21.15.53:52864) 2023-07-09T21:50:36.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.082+0000 7f520ffff700 1 -- 172.21.15.53:0/4223929518 learned_addr learned my addr 172.21.15.53:0/4223929518 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:36.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.083+0000 7f520ffff700 1 -- 172.21.15.53:0/4223929518 >> v1:172.21.15.184:6789/0 conn(0x7f52100caff0 legacy=0x7f52100cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:36.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.083+0000 7f520ffff700 1 -- 172.21.15.53:0/4223929518 >> v1:172.21.15.53:6789/0 conn(0x7f521006b5b0 legacy=0x7f52100cdf40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:50:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.083+0000 7f520ffff700 1 -- 172.21.15.53:0/4223929518 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521006c250 con 0x7f52100ce650 2023-07-09T21:50:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.079+0000 7f134b1ff700 1 -- 172.21.15.53:0/1013736470 shutdown_connections 2023-07-09T21:50:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.079+0000 7f134b1ff700 1 --2- 172.21.15.53:0/1013736470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1344164710 0x7f1344164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.079+0000 7f134b1ff700 1 --2- 172.21.15.53:0/1013736470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13440cd2f0 0x7f13440cdbe0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.079+0000 7f134b1ff700 1 --2- 172.21.15.53:0/1013736470 >> v2:172.21.15.184:3300/0 conn(0x7f13440cd6c0 0x7f13440ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.079+0000 7f134b1ff700 1 -- 172.21.15.53:0/1013736470 >> 172.21.15.53:0/1013736470 conn(0x7f13440b05d0 msgr2=0x7f13440b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.079+0000 7f134b1ff700 1 -- 172.21.15.53:0/1013736470 shutdown_connections 2023-07-09T21:50:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.079+0000 7f134b1ff700 1 -- 172.21.15.53:0/1013736470 wait complete. 2023-07-09T21:50:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.081+0000 7f15f35ff700 1 -- start start 2023-07-09T21:50:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.083+0000 7f15f35ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15ec06b5b0 0x7f15ec1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.083+0000 7f15f35ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15ec0cc690 0x7f15ec15b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.083+0000 7f15f35ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15ec0cdf40 0x7f15ec1f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.083+0000 7f15f35ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1539f0 con 0x7f15ec0cc690 2023-07-09T21:50:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.083+0000 7f15f35ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1f7560 con 0x7f15ec06b5b0 2023-07-09T21:50:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.083+0000 7f15f35ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1f6fa0 con 0x7f15ec0cdf40 2023-07-09T21:50:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.084+0000 7f15f139b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15ec06b5b0 0x7f15ec1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.084+0000 7f15f1b9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15ec0cdf40 0x7f15ec1f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.084+0000 7f15f139b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15ec06b5b0 0x7f15ec1534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57456/0 (socket says 172.21.15.53:57456) 2023-07-09T21:50:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.084+0000 7f15f139b700 1 -- 172.21.15.53:0/555717410 learned_addr learned my addr 172.21.15.53:0/555717410 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.084+0000 7f15f1b9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15ec0cdf40 0x7f15ec1f6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58414/0 (socket says 172.21.15.53:58414) 2023-07-09T21:50:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.082+0000 7f134b1ff700 1 Processor -- start 2023-07-09T21:50:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.082+0000 7f134b1ff700 1 -- start start 2023-07-09T21:50:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.084+0000 7f520ffff700 1 --2- 172.21.15.53:0/4223929518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52100ce650 0x7f521006b980 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f52040088f0 tx=0x7f520400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bcc79c20b7d84d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.084+0000 7f15f0b9a700 1 --2- 172.21.15.53:0/555717410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15ec0cc690 0x7f15ec15b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.085+0000 7f520f7fe700 1 -- 172.21.15.53:0/4223929518 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204010070 con 0x7f52100ce650 2023-07-09T21:50:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.085+0000 7f520f7fe700 1 -- 172.21.15.53:0/4223929518 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520400da00 con 0x7f52100ce650 2023-07-09T21:50:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.085+0000 7f520f7fe700 1 -- 172.21.15.53:0/4223929518 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520400dd90 con 0x7f52100ce650 2023-07-09T21:50:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.086+0000 7f5216dff700 1 -- 172.21.15.53:0/4223929518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52100ce650 msgr2=0x7f521006b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.086+0000 7f5216dff700 1 --2- 172.21.15.53:0/4223929518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52100ce650 0x7f521006b980 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f52040088f0 tx=0x7f520400d330 comp rx=0 tx=0).stop 2023-07-09T21:50:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.085+0000 7f15f0b9a700 1 -- 172.21.15.53:0/555717410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15ec0cdf40 msgr2=0x7f15ec1f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.085+0000 7f15f0b9a700 1 --2- 172.21.15.53:0/555717410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15ec0cdf40 0x7f15ec1f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.085+0000 7f15f0b9a700 1 -- 172.21.15.53:0/555717410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15ec06b5b0 msgr2=0x7f15ec1534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.085+0000 7f15f0b9a700 1 --2- 172.21.15.53:0/555717410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15ec06b5b0 0x7f15ec1534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.085+0000 7f15f0b9a700 1 -- 172.21.15.53:0/555717410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8009550 con 0x7f15ec0cc690 2023-07-09T21:50:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.086+0000 7f15f0b9a700 1 --2- 172.21.15.53:0/555717410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15ec0cc690 0x7f15ec15b520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f15e8017000 tx=0x7f15e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.084+0000 7f134b1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13440cd2f0 0x7f134420a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.084+0000 7f134b1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1344164710 0x7f13440b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.084+0000 7f134b1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13440c4e80 0x7f13440c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.084+0000 7f134b1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13440b22b0 con 0x7f1344164710 2023-07-09T21:50:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.084+0000 7f134b1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13440c39c0 con 0x7f13440cd2f0 2023-07-09T21:50:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.084+0000 7f134b1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134420a9d0 con 0x7f13440c4e80 2023-07-09T21:50:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.085+0000 7f1343fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1344164710 0x7f13440b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.085+0000 7f1343fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1344164710 0x7f13440b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52892/0 (socket says 172.21.15.53:52892) 2023-07-09T21:50:36.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.085+0000 7f1343fff700 1 -- 172.21.15.53:0/1077121325 learned_addr learned my addr 172.21.15.53:0/1077121325 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:36.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.085+0000 7f1348f9b700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13440cd2f0 0x7f134420a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.085+0000 7f134979c700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13440c4e80 0x7f13440c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.086+0000 7f1343fff700 1 -- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13440c4e80 msgr2=0x7f13440c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.086+0000 7f1343fff700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13440c4e80 0x7f13440c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.086+0000 7f1343fff700 1 -- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13440cd2f0 msgr2=0x7f134420a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.086+0000 7f1343fff700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13440cd2f0 0x7f134420a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.086+0000 7f1343fff700 1 -- 172.21.15.53:0/1077121325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1338009550 con 0x7f1344164710 2023-07-09T21:50:36.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.087+0000 7f15e1ffb700 1 -- 172.21.15.53:0/555717410 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80036a0 con 0x7f15ec0cc690 2023-07-09T21:50:36.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.087+0000 7f15e1ffb700 1 -- 172.21.15.53:0/555717410 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e8003800 con 0x7f15ec0cc690 2023-07-09T21:50:36.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.087+0000 7f15e1ffb700 1 -- 172.21.15.53:0/555717410 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8003b70 con 0x7f15ec0cc690 2023-07-09T21:50:36.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.087+0000 7f15f35ff700 1 -- 172.21.15.53:0/555717410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec1f7280 con 0x7f15ec0cc690 2023-07-09T21:50:36.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.087+0000 7f1343fff700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1344164710 0x7f13440b40c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f133c007e10 tx=0x7f133c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.088+0000 7f15f35ff700 1 -- 172.21.15.53:0/555717410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ec15b000 con 0x7f15ec0cc690 2023-07-09T21:50:36.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.088+0000 7f13417fa700 1 -- 172.21.15.53:0/1077121325 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00ed80 con 0x7f1344164710 2023-07-09T21:50:36.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.088+0000 7f13417fa700 1 -- 172.21.15.53:0/1077121325 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c014420 con 0x7f1344164710 2023-07-09T21:50:36.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.088+0000 7f13417fa700 1 -- 172.21.15.53:0/1077121325 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00eee0 con 0x7f1344164710 2023-07-09T21:50:36.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.088+0000 7f134b1ff700 1 -- 172.21.15.53:0/1077121325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13440c3400 con 0x7f1344164710 2023-07-09T21:50:36.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.088+0000 7f134b1ff700 1 -- 172.21.15.53:0/1077121325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13440b24a0 con 0x7f1344164710 2023-07-09T21:50:36.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.090+0000 7f5216dff700 1 -- 172.21.15.53:0/4223929518 shutdown_connections 2023-07-09T21:50:36.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.090+0000 7f5216dff700 1 --2- 172.21.15.53:0/4223929518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52100ce650 0x7f521006b980 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.090+0000 7f5216dff700 1 -- 172.21.15.53:0/4223929518 >> 172.21.15.53:0/4223929518 conn(0x7f52100b05d0 msgr2=0x7f52100b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.089+0000 7f134b1ff700 1 -- 172.21.15.53:0/1077121325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13240052f0 con 0x7f1344164710 2023-07-09T21:50:36.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.090+0000 7f5216dff700 1 -- 172.21.15.53:0/4223929518 shutdown_connections 2023-07-09T21:50:36.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.091+0000 7f5216dff700 1 -- 172.21.15.53:0/4223929518 wait complete. 2023-07-09T21:50:36.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.091+0000 7f15f35ff700 1 -- 172.21.15.53:0/555717410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ec15ab80 con 0x7f15ec0cc690 2023-07-09T21:50:36.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.093+0000 7f5216dff700 1 Processor -- start 2023-07-09T21:50:36.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.094+0000 7f5216dff700 1 -- start start 2023-07-09T21:50:36.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.092+0000 7f15e1ffb700 1 -- 172.21.15.53:0/555717410 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15e8003cd0 con 0x7f15ec0cc690 2023-07-09T21:50:36.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.093+0000 7f15e1ffb700 1 --2- 172.21.15.53:0/555717410 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f15d006adb0 0x7f15d006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.093+0000 7f15e1ffb700 1 -- 172.21.15.53:0/555717410 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15e8013070 con 0x7f15ec0cc690 2023-07-09T21:50:36.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.094+0000 7f15f139b700 1 --2- 172.21.15.53:0/555717410 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f15d006adb0 0x7f15d006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.092+0000 7f13417fa700 1 -- 172.21.15.53:0/1077121325 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f133c0147d0 con 0x7f1344164710 2023-07-09T21:50:36.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.094+0000 7f13417fa700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f132c06af10 0x7f132c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.094+0000 7f13417fa700 1 -- 172.21.15.53:0/1077121325 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f133c08a580 con 0x7f1344164710 2023-07-09T21:50:36.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.094+0000 7ff83ebff700 1 Processor -- start 2023-07-09T21:50:36.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.096+0000 7f15f139b700 1 --2- 172.21.15.53:0/555717410 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f15d006adb0 0x7f15d006d260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f15e40094c0 tx=0x7f15e400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.095+0000 7f5216dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f521006b5b0 0x7f52100c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.095+0000 7f5216dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52100caff0 0x7f521015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.095+0000 7f5216dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52100ce650 0x7f521015b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.095+0000 7f5216dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52101590b0 con 0x7f52100ce650 2023-07-09T21:50:36.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.095+0000 7f5216dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210158d80 con 0x7f52100caff0 2023-07-09T21:50:36.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.095+0000 7f5216dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52100c3070 con 0x7f521006b5b0 2023-07-09T21:50:36.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.096+0000 7f5214b9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f521006b5b0 0x7f52100c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.096+0000 7f5214b9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f521006b5b0 0x7f52100c25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58430/0 (socket says 172.21.15.53:58430) 2023-07-09T21:50:36.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.096+0000 7f5214b9b700 1 -- 172.21.15.53:0/2337029472 learned_addr learned my addr 172.21.15.53:0/2337029472 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:36.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.096+0000 7f520ffff700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52100caff0 0x7f521015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.096+0000 7f521539c700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52100ce650 0x7f521015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.096+0000 7f520ffff700 1 -- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f521006b5b0 msgr2=0x7f52100c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.096+0000 7f520ffff700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f521006b5b0 0x7f52100c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.096+0000 7f520ffff700 1 -- 172.21.15.53:0/2337029472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52100ce650 msgr2=0x7f521015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.096+0000 7f520ffff700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52100ce650 0x7f521015b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.096+0000 7f520ffff700 1 -- 172.21.15.53:0/2337029472 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040085d0 con 0x7f52100caff0 2023-07-09T21:50:36.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.097+0000 7f520ffff700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52100caff0 0x7f521015b320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5204018000 tx=0x7f5204004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.097+0000 7f520d7fa700 1 -- 172.21.15.53:0/2337029472 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204009e20 con 0x7f52100caff0 2023-07-09T21:50:36.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.097+0000 7f5216dff700 1 -- 172.21.15.53:0/2337029472 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52100c3350 con 0x7f52100caff0 2023-07-09T21:50:36.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.098+0000 7f5216dff700 1 -- 172.21.15.53:0/2337029472 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52101532c0 con 0x7f52100caff0 2023-07-09T21:50:36.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.098+0000 7f520d7fa700 1 -- 172.21.15.53:0/2337029472 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52040036a0 con 0x7f52100caff0 2023-07-09T21:50:36.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.098+0000 7f520d7fa700 1 -- 172.21.15.53:0/2337029472 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204003a50 con 0x7f52100caff0 2023-07-09T21:50:36.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.098+0000 7f1348f9b700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f132c06af10 0x7f132c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.099+0000 7f5216dff700 1 -- 172.21.15.53:0/2337029472 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5210159220 con 0x7f52100caff0 2023-07-09T21:50:36.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.100+0000 7f1348f9b700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f132c06af10 0x7f132c06d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1338000c00 tx=0x7f1338008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.098+0000 7ff83ebff700 1 -- start start 2023-07-09T21:50:36.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.100+0000 7ff83ebff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff83806cd60 0x7ff838161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.100+0000 7ff83ebff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8380cd530 con 0x7ff8380ce050 2023-07-09T21:50:36.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.101+0000 7ff83ebff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8381615d0 con 0x7ff8380cc690 2023-07-09T21:50:36.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.101+0000 7ff83ebff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8380ccf70 con 0x7ff83806cd60 2023-07-09T21:50:36.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.101+0000 7f1882fff700 1 Processor -- start 2023-07-09T21:50:36.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.101+0000 7ff83d19c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff8380ce050 0x7ff838164630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56254/0 (socket says 172.21.15.53:56254) 2023-07-09T21:50:36.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.101+0000 7ff83d19c700 1 -- 172.21.15.53:0/1563477895 learned_addr learned my addr 172.21.15.53:0/1563477895 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:36.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.100+0000 7fab823ff700 1 Processor -- start 2023-07-09T21:50:36.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.101+0000 7fab823ff700 1 -- start start 2023-07-09T21:50:36.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.101+0000 7ff83c99b700 1 --2- 172.21.15.53:0/1563477895 >> v2:172.21.15.184:3300/0 conn(0x7ff83806cd60 0x7ff838161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.102+0000 7f520d7fa700 1 -- 172.21.15.53:0/2337029472 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5204003bb0 con 0x7f52100caff0 2023-07-09T21:50:36.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.103+0000 7ff83c99b700 1 -- 172.21.15.53:0/1563477895 >> v1:172.21.15.184:6789/0 conn(0x7ff8380cc690 legacy=0x7ff8380cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.103+0000 7ff83c99b700 1 -- 172.21.15.53:0/1563477895 >> v1:172.21.15.53:6789/0 conn(0x7ff8380ce050 legacy=0x7ff838164630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.103+0000 7ff83c99b700 1 -- 172.21.15.53:0/1563477895 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8380cd250 con 0x7ff83806cd60 2023-07-09T21:50:36.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.103+0000 7ff83c99b700 1 --2- 172.21.15.53:0/1563477895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff83806cd60 0x7ff838161a60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009840 tx=0x7ff82c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=970afb1e47af98cb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.103+0000 7fab823ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c0d1220 0x7fab7c0afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.103+0000 7fab823ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7c0b2800 con 0x7fab7c0b3f80 2023-07-09T21:50:36.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.103+0000 7fab823ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7c0b2ae0 con 0x7fab7c0c6020 2023-07-09T21:50:36.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.103+0000 7fab823ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0c63f0 con 0x7fab7c0d1220 2023-07-09T21:50:36.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.104+0000 7fab8099c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fab7c0b3f80 0x7fab7c0affe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56268/0 (socket says 172.21.15.53:56268) 2023-07-09T21:50:36.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.104+0000 7fab8099c700 1 -- 172.21.15.53:0/892411441 learned_addr learned my addr 172.21.15.53:0/892411441 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:36.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.102+0000 7f1882fff700 1 -- start start 2023-07-09T21:50:36.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.103+0000 7f1882fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f187c0b3ff0 0x7f187c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.104+0000 7f1882fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c0d0f90 0x7f187c0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.104+0000 7f1882fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187c0b8e80 con 0x7f187c0d0b10 2023-07-09T21:50:36.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.104+0000 7f1882fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187c0b1e30 con 0x7f187c0b3ff0 2023-07-09T21:50:36.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.104+0000 7f1882fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0d1410 con 0x7f187c0d0f90 2023-07-09T21:50:36.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.104+0000 7f520d7fa700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f51f406acb0 0x7f51f406d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.104+0000 7f520d7fa700 1 -- 172.21.15.53:0/2337029472 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f520408b130 con 0x7f52100caff0 2023-07-09T21:50:36.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.104+0000 7f187bfff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f187c0d0b10 0x7f187c0b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56278/0 (socket says 172.21.15.53:56278) 2023-07-09T21:50:36.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.104+0000 7f187bfff700 1 -- 172.21.15.53:0/3699022283 learned_addr learned my addr 172.21.15.53:0/3699022283 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:36.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.104+0000 7fab7b7fe700 1 --2- 172.21.15.53:0/892411441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c0d1220 0x7fab7c0afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.105+0000 7f188159c700 1 --2- 172.21.15.53:0/3699022283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c0d0f90 0x7f187c0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.105+0000 7f5214b9b700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f51f406acb0 0x7f51f406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.105+0000 7f13417fa700 1 -- 172.21.15.53:0/1077121325 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f133c0556a0 con 0x7f1344164710 2023-07-09T21:50:36.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.105+0000 7fab7b7fe700 1 -- 172.21.15.53:0/892411441 >> v1:172.21.15.184:6789/0 conn(0x7fab7c0c6020 legacy=0x7fab7c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:36.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.105+0000 7fab7b7fe700 1 -- 172.21.15.53:0/892411441 >> v1:172.21.15.53:6789/0 conn(0x7fab7c0b3f80 legacy=0x7fab7c0affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.105+0000 7fab7b7fe700 1 -- 172.21.15.53:0/892411441 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c0c6820 con 0x7fab7c0d1220 2023-07-09T21:50:36.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.106+0000 7f1880d9b700 1 --2- 172.21.15.53:0/3699022283 >> v2:172.21.15.184:3300/0 conn(0x7f187c0b3ff0 0x7f187c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.106+0000 7fab7b7fe700 1 --2- 172.21.15.53:0/892411441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c0d1220 0x7fab7c0afaa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fab70009870 tx=0x7fab70009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34d07b2ef34d620f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.106+0000 7f5214b9b700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f51f406acb0 0x7f51f406d160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f521015abb0 tx=0x7f520800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.106+0000 7ff8377fe700 1 -- 172.21.15.53:0/1563477895 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c011830 con 0x7ff83806cd60 2023-07-09T21:50:36.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.106+0000 7ff8377fe700 1 -- 172.21.15.53:0/1563477895 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c011990 con 0x7ff83806cd60 2023-07-09T21:50:36.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.106+0000 7ff8377fe700 1 -- 172.21.15.53:0/1563477895 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c011d20 con 0x7ff83806cd60 2023-07-09T21:50:36.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.106+0000 7f188159c700 1 -- 172.21.15.53:0/3699022283 >> v2:172.21.15.184:3300/0 conn(0x7f187c0b3ff0 msgr2=0x7f187c0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:36.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.106+0000 7f188159c700 1 --2- 172.21.15.53:0/3699022283 >> v2:172.21.15.184:3300/0 conn(0x7f187c0b3ff0 0x7f187c0b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.106+0000 7f188159c700 1 -- 172.21.15.53:0/3699022283 >> v1:172.21.15.53:6789/0 conn(0x7f187c0d0b10 legacy=0x7f187c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.106+0000 7f188159c700 1 -- 172.21.15.53:0/3699022283 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c0afaa0 con 0x7f187c0d0f90 2023-07-09T21:50:36.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.106+0000 7fab7affd700 1 -- 172.21.15.53:0/892411441 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70004230 con 0x7fab7c0d1220 2023-07-09T21:50:36.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.107+0000 7fab7affd700 1 -- 172.21.15.53:0/892411441 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab70004390 con 0x7fab7c0d1220 2023-07-09T21:50:36.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.107+0000 7fab7affd700 1 -- 172.21.15.53:0/892411441 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab700036a0 con 0x7fab7c0d1220 2023-07-09T21:50:36.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.106+0000 7f1880d9b700 1 --2- 172.21.15.53:0/3699022283 >> v2:172.21.15.184:3300/0 conn(0x7f187c0b3ff0 0x7f187c0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:36.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.106+0000 7f188159c700 1 --2- 172.21.15.53:0/3699022283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c0d0f90 0x7f187c0b2ce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1874009d90 tx=0x7f187400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44f6f3ddce2e23dd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.107+0000 7ff83ebff700 1 -- 172.21.15.53:0/1563477895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff83806cd60 msgr2=0x7ff838161a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.107+0000 7ff83ebff700 1 --2- 172.21.15.53:0/1563477895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff83806cd60 0x7ff838161a60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009840 tx=0x7ff82c009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:36.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.107+0000 7f520d7fa700 1 -- 172.21.15.53:0/2337029472 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5204056370 con 0x7f52100caff0 2023-07-09T21:50:36.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.107+0000 7ff83ebff700 1 -- 172.21.15.53:0/1563477895 shutdown_connections 2023-07-09T21:50:36.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.107+0000 7ff83ebff700 1 --2- 172.21.15.53:0/1563477895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff83806cd60 0x7ff838161a60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.108+0000 7ff83ebff700 1 -- 172.21.15.53:0/1563477895 >> 172.21.15.53:0/1563477895 conn(0x7ff8380b05d0 msgr2=0x7ff8380b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.107+0000 7f187b7fe700 1 -- 172.21.15.53:0/3699022283 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187400e070 con 0x7f187c0d0f90 2023-07-09T21:50:36.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.108+0000 7f187b7fe700 1 -- 172.21.15.53:0/3699022283 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187400bbd0 con 0x7f187c0d0f90 2023-07-09T21:50:36.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.108+0000 7f187b7fe700 1 -- 172.21.15.53:0/3699022283 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874012430 con 0x7f187c0d0f90 2023-07-09T21:50:36.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.108+0000 7fab823ff700 1 -- 172.21.15.53:0/892411441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c0d1220 msgr2=0x7fab7c0afaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.108+0000 7fab823ff700 1 --2- 172.21.15.53:0/892411441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c0d1220 0x7fab7c0afaa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fab70009870 tx=0x7fab70009b80 comp rx=0 tx=0).stop 2023-07-09T21:50:36.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.108+0000 7fab823ff700 1 -- 172.21.15.53:0/892411441 shutdown_connections 2023-07-09T21:50:36.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.108+0000 7fab823ff700 1 --2- 172.21.15.53:0/892411441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c0d1220 0x7fab7c0afaa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.108+0000 7fab823ff700 1 -- 172.21.15.53:0/892411441 >> 172.21.15.53:0/892411441 conn(0x7fab7c09c1b0 msgr2=0x7fab7c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.108+0000 7ff83ebff700 1 -- 172.21.15.53:0/1563477895 shutdown_connections 2023-07-09T21:50:36.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.108+0000 7fab823ff700 1 -- 172.21.15.53:0/892411441 shutdown_connections 2023-07-09T21:50:36.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.109+0000 7f1882fff700 1 -- 172.21.15.53:0/3699022283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c0d0f90 msgr2=0x7f187c0b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.109+0000 7f1882fff700 1 --2- 172.21.15.53:0/3699022283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c0d0f90 0x7f187c0b2ce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1874009d90 tx=0x7f187400b330 comp rx=0 tx=0).stop 2023-07-09T21:50:36.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.109+0000 7f1882fff700 1 -- 172.21.15.53:0/3699022283 shutdown_connections 2023-07-09T21:50:36.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.109+0000 7f1882fff700 1 --2- 172.21.15.53:0/3699022283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c0d0f90 0x7f187c0b2ce0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.109+0000 7f1882fff700 1 --2- 172.21.15.53:0/3699022283 >> v2:172.21.15.184:3300/0 conn(0x7f187c0b3ff0 0x7f187c0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.109+0000 7f1882fff700 1 -- 172.21.15.53:0/3699022283 >> 172.21.15.53:0/3699022283 conn(0x7f187c09c1b0 msgr2=0x7f187c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.108+0000 7ff83ebff700 1 -- 172.21.15.53:0/1563477895 wait complete. 2023-07-09T21:50:36.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.110+0000 7f15e1ffb700 1 -- 172.21.15.53:0/555717410 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f15ec15ab80 con 0x7f15ec0cc690 2023-07-09T21:50:36.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.110+0000 7f1882fff700 1 -- 172.21.15.53:0/3699022283 shutdown_connections 2023-07-09T21:50:36.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.111+0000 7ff83ebff700 1 Processor -- start 2023-07-09T21:50:36.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.110+0000 7f1882fff700 1 -- 172.21.15.53:0/3699022283 wait complete. 2023-07-09T21:50:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.111+0000 7fb66f9ff700 1 Processor -- start 2023-07-09T21:50:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.110+0000 7fab823ff700 1 -- 172.21.15.53:0/892411441 wait complete. 2023-07-09T21:50:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.112+0000 7fab823ff700 1 Processor -- start 2023-07-09T21:50:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.112+0000 7fb66f9ff700 1 -- start start 2023-07-09T21:50:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.113+0000 7f1882fff700 1 Processor -- start 2023-07-09T21:50:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.111+0000 7ff83ebff700 1 -- start start 2023-07-09T21:50:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.113+0000 7ff83ebff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff83806cd60 0x7ff838159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.113+0000 7ff83ebff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8380cc690 0x7ff8381597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.113+0000 7ff83ebff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8380ce050 0x7ff8381ea450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.113+0000 7ff83ebff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8380c8130 con 0x7ff8380ce050 2023-07-09T21:50:36.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.113+0000 7ff83ebff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8380c8410 con 0x7ff83806cd60 2023-07-09T21:50:36.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.113+0000 7ff83ebff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8381621c0 con 0x7ff8380cc690 2023-07-09T21:50:36.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.114+0000 7ff83d19c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8380ce050 0x7ff8381ea450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.114+0000 7ff83d19c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8380ce050 0x7ff8381ea450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52918/0 (socket says 172.21.15.53:52918) 2023-07-09T21:50:36.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.114+0000 7ff83d19c700 1 -- 172.21.15.53:0/2185736394 learned_addr learned my addr 172.21.15.53:0/2185736394 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:36.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.113+0000 7fab823ff700 1 -- start start 2023-07-09T21:50:36.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.114+0000 7fb66f9ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb66806cd60 0x7fb668161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.114+0000 7fb66f9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb6680ce050 0x7fb668164630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.114+0000 7fb66f9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6680cd530 con 0x7fb6680cc690 2023-07-09T21:50:36.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.114+0000 7fb66f9ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6681615d0 con 0x7fb66806cd60 2023-07-09T21:50:36.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.114+0000 7fb66f9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6680ccf70 con 0x7fb6680ce050 2023-07-09T21:50:36.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.114+0000 7fab823ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c0b3f80 0x7fab7c0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.114+0000 7fab823ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab7c0c6020 0x7fab7c0ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.114+0000 7ff83d19c700 1 -- 172.21.15.53:0/2185736394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8380cc690 msgr2=0x7ff8381597b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T21:50:36.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.114+0000 7ff83d19c700 1 --2- 172.21.15.53:0/2185736394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8380cc690 0x7ff8381597b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.115+0000 7ff83d19c700 1 -- 172.21.15.53:0/2185736394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff83806cd60 msgr2=0x7ff838159270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T21:50:36.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.115+0000 7ff83d19c700 1 --2- 172.21.15.53:0/2185736394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff83806cd60 0x7ff838159270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.115+0000 7ff83d19c700 1 -- 172.21.15.53:0/2185736394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0094a0 con 0x7ff8380ce050 2023-07-09T21:50:36.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.115+0000 7fab823ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab7c0d1220 0x7fab7c1f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.115+0000 7fab823ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c14f000 con 0x7fab7c0d1220 2023-07-09T21:50:36.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.115+0000 7fab823ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0b8250 con 0x7fab7c0c6020 2023-07-09T21:50:36.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.115+0000 7fab823ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0b8530 con 0x7fab7c0b3f80 2023-07-09T21:50:36.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.115+0000 7fab7bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c0b3f80 0x7fab7c0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.115+0000 7fab7bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c0b3f80 0x7fab7c0ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58470/0 (socket says 172.21.15.53:58470) 2023-07-09T21:50:36.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.115+0000 7fab7bfff700 1 -- 172.21.15.53:0/3402622766 learned_addr learned my addr 172.21.15.53:0/3402622766 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:36.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.115+0000 7fb66cf9a700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb6680cc690 0x7fb6680cd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:47016/0 (socket says 172.21.15.53:47016) 2023-07-09T21:50:36.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.115+0000 7fb66cf9a700 1 -- 172.21.15.53:0/1274222652 learned_addr learned my addr 172.21.15.53:0/1274222652 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:36.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.115+0000 7f1882fff700 1 -- start start 2023-07-09T21:50:36.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.116+0000 7fb66df9c700 1 --2- 172.21.15.53:0/1274222652 >> v2:172.21.15.184:3300/0 conn(0x7fb6680ce050 0x7fb668164630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.116+0000 7fab7bfff700 1 -- 172.21.15.53:0/3402622766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab7c0c6020 msgr2=0x7fab7c0ca550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T21:50:36.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.116+0000 7fab7bfff700 1 --2- 172.21.15.53:0/3402622766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab7c0c6020 0x7fab7c0ca550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.116+0000 7fab7bfff700 1 -- 172.21.15.53:0/3402622766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab7c0d1220 msgr2=0x7fab7c1f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.116+0000 7fab7bfff700 1 --2- 172.21.15.53:0/3402622766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab7c0d1220 0x7fab7c1f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.116+0000 7fab7bfff700 1 -- 172.21.15.53:0/3402622766 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab700094a0 con 0x7fab7c0b3f80 2023-07-09T21:50:36.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.116+0000 7fb66df9c700 1 -- 172.21.15.53:0/1274222652 >> v2:172.21.15.53:3300/0 conn(0x7fb66806cd60 msgr2=0x7fb668161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:36.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.116+0000 7fb66df9c700 1 --2- 172.21.15.53:0/1274222652 >> v2:172.21.15.53:3300/0 conn(0x7fb66806cd60 0x7fb668161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.116+0000 7fb66df9c700 1 -- 172.21.15.53:0/1274222652 >> v1:172.21.15.184:6789/0 conn(0x7fb6680cc690 legacy=0x7fb6680cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.116+0000 7fb66df9c700 1 -- 172.21.15.53:0/1274222652 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6680cd250 con 0x7fb6680ce050 2023-07-09T21:50:36.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.117+0000 7fab7bfff700 1 --2- 172.21.15.53:0/3402622766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c0b3f80 0x7fab7c0ca010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00b4a0 tx=0x7fab6c00b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7ff83d19c700 1 --2- 172.21.15.53:0/2185736394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8380ce050 0x7ff8381ea450 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff82800c370 tx=0x7ff82800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.117+0000 7fab78ff9700 1 -- 172.21.15.53:0/3402622766 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c011830 con 0x7fab7c0b3f80 2023-07-09T21:50:36.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.117+0000 7fab78ff9700 1 -- 172.21.15.53:0/3402622766 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c011990 con 0x7fab7c0b3f80 2023-07-09T21:50:36.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.117+0000 7fab78ff9700 1 -- 172.21.15.53:0/3402622766 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c011d40 con 0x7fab7c0b3f80 2023-07-09T21:50:36.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.117+0000 7fab823ff700 1 -- 172.21.15.53:0/3402622766 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7c14f250 con 0x7fab7c0b3f80 2023-07-09T21:50:36.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.117+0000 7fab823ff700 1 -- 172.21.15.53:0/3402622766 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7c151dd0 con 0x7fab7c0b3f80 2023-07-09T21:50:36.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.117+0000 7f1882fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c0b3ff0 0x7f187c0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.117+0000 7f1882fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c0d0b10 0x7f187c0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.117+0000 7f1882fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f187c0d0f90 0x7f187c1f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.117+0000 7f1882fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c15c2d0 con 0x7f187c0d0f90 2023-07-09T21:50:36.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.117+0000 7f1882fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0ceb50 con 0x7f187c0d0b10 2023-07-09T21:50:36.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.117+0000 7f1882fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0cf640 con 0x7f187c0b3ff0 2023-07-09T21:50:36.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.117+0000 7f187bfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c0d0b10 0x7f187c0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7f1880d9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c0b3ff0 0x7f187c0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7f187bfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c0d0b10 0x7f187c0ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57532/0 (socket says 172.21.15.53:57532) 2023-07-09T21:50:36.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7f187bfff700 1 -- 172.21.15.53:0/1822046769 learned_addr learned my addr 172.21.15.53:0/1822046769 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:36.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7f188159c700 1 --2- 172.21.15.53:0/1822046769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f187c0d0f90 0x7f187c1f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7f1880d9b700 1 -- 172.21.15.53:0/1822046769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c0d0b10 msgr2=0x7f187c0ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7f1880d9b700 1 --2- 172.21.15.53:0/1822046769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c0d0b10 0x7f187c0ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7f1880d9b700 1 -- 172.21.15.53:0/1822046769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f187c0d0f90 msgr2=0x7f187c1f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7f1880d9b700 1 --2- 172.21.15.53:0/1822046769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f187c0d0f90 0x7f187c1f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7f1880d9b700 1 -- 172.21.15.53:0/1822046769 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1874009a70 con 0x7f187c0b3ff0 2023-07-09T21:50:36.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7ff8357fa700 1 -- 172.21.15.53:0/2185736394 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828005d70 con 0x7ff8380ce050 2023-07-09T21:50:36.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7ff8357fa700 1 -- 172.21.15.53:0/2185736394 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8280070d0 con 0x7ff8380ce050 2023-07-09T21:50:36.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7ff8357fa700 1 -- 172.21.15.53:0/2185736394 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828007440 con 0x7ff8380ce050 2023-07-09T21:50:36.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7ff83ebff700 1 -- 172.21.15.53:0/2185736394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8381624a0 con 0x7ff8380ce050 2023-07-09T21:50:36.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.118+0000 7ff83ebff700 1 -- 172.21.15.53:0/2185736394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff838159df0 con 0x7ff8380ce050 2023-07-09T21:50:36.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.119+0000 7f1880d9b700 1 --2- 172.21.15.53:0/1822046769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c0b3ff0 0x7f187c0cefb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f187000e7e0 tx=0x7f187000eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.120+0000 7f3d9b1ff700 1 Processor -- start 2023-07-09T21:50:36.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.120+0000 7f18797fa700 1 -- 172.21.15.53:0/1822046769 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000c070 con 0x7f187c0b3ff0 2023-07-09T21:50:36.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.120+0000 7f18797fa700 1 -- 172.21.15.53:0/1822046769 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1870013610 con 0x7f187c0b3ff0 2023-07-09T21:50:36.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.120+0000 7f18797fa700 1 -- 172.21.15.53:0/1822046769 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870013980 con 0x7f187c0b3ff0 2023-07-09T21:50:36.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.120+0000 7f1882fff700 1 -- 172.21.15.53:0/1822046769 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187c0cf920 con 0x7f187c0b3ff0 2023-07-09T21:50:36.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.121+0000 7f1882fff700 1 -- 172.21.15.53:0/1822046769 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187c0cfee0 con 0x7f187c0b3ff0 2023-07-09T21:50:36.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.120+0000 7fab823ff700 1 -- 172.21.15.53:0/3402622766 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7c14f770 con 0x7fab7c0b3f80 2023-07-09T21:50:36.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.120+0000 7fb66df9c700 1 --2- 172.21.15.53:0/1274222652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6680ce050 0x7fb668164630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6680b13f0 tx=0x7fb66000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba15ae87e296d761 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.122+0000 7fb65ffff700 1 -- 172.21.15.53:0/1274222652 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66000e070 con 0x7fb6680ce050 2023-07-09T21:50:36.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.122+0000 7fb65ffff700 1 -- 172.21.15.53:0/1274222652 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66000bad0 con 0x7fb6680ce050 2023-07-09T21:50:36.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.122+0000 7fb65ffff700 1 -- 172.21.15.53:0/1274222652 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66000be80 con 0x7fb6680ce050 2023-07-09T21:50:36.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.122+0000 7f1882fff700 1 -- 172.21.15.53:0/1822046769 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187c074350 con 0x7f187c0b3ff0 2023-07-09T21:50:36.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.123+0000 7fb66f9ff700 1 -- 172.21.15.53:0/1274222652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6680ce050 msgr2=0x7fb668164630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.123+0000 7fb66f9ff700 1 --2- 172.21.15.53:0/1274222652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6680ce050 0x7fb668164630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6680b13f0 tx=0x7fb66000b330 comp rx=0 tx=0).stop 2023-07-09T21:50:36.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.123+0000 7fb66f9ff700 1 -- 172.21.15.53:0/1274222652 shutdown_connections 2023-07-09T21:50:36.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.123+0000 7fb66f9ff700 1 --2- 172.21.15.53:0/1274222652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6680ce050 0x7fb668164630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.123+0000 7fb66f9ff700 1 --2- 172.21.15.53:0/1274222652 >> v2:172.21.15.53:3300/0 conn(0x7fb66806cd60 0x7fb668161a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.123+0000 7fb66f9ff700 1 -- 172.21.15.53:0/1274222652 >> 172.21.15.53:0/1274222652 conn(0x7fb6680b05d0 msgr2=0x7fb6680b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.121+0000 7f3d9b1ff700 1 -- start start 2023-07-09T21:50:36.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.123+0000 7f3d9b1ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d9406cd60 0x7f3d94161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.123+0000 7f3d9b1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3d940cc690 0x7f3d940cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.124+0000 7f3d9b1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d940cde80 0x7f3d94164630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.124+0000 7f3d9b1ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d940cd530 con 0x7f3d9406cd60 2023-07-09T21:50:36.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.124+0000 7f3d9b1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d941615d0 con 0x7f3d940cc690 2023-07-09T21:50:36.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.124+0000 7f3d9b1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940ce2a0 con 0x7f3d940cde80 2023-07-09T21:50:36.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.124+0000 7fb66f9ff700 1 -- 172.21.15.53:0/1274222652 shutdown_connections 2023-07-09T21:50:36.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.124+0000 7fb66f9ff700 1 -- 172.21.15.53:0/1274222652 wait complete. 2023-07-09T21:50:36.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.127+0000 7fb66f9ff700 1 Processor -- start 2023-07-09T21:50:36.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.125+0000 7fab78ff9700 1 -- 172.21.15.53:0/3402622766 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab6c01a400 con 0x7fab7c0b3f80 2023-07-09T21:50:36.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.126+0000 7fab78ff9700 1 --2- 172.21.15.53:0/3402622766 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fab6806adb0 0x7fab6806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.126+0000 7fab78ff9700 1 -- 172.21.15.53:0/3402622766 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab6c0893f0 con 0x7fab7c0b3f80 2023-07-09T21:50:36.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.120+0000 7ff83ebff700 1 -- 172.21.15.53:0/2185736394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8381629c0 con 0x7ff8380ce050 2023-07-09T21:50:36.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.123+0000 7ff8357fa700 1 -- 172.21.15.53:0/2185736394 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8280075a0 con 0x7ff8380ce050 2023-07-09T21:50:36.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.124+0000 7ff8357fa700 1 --2- 172.21.15.53:0/2185736394 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff82406ace0 0x7ff82406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.124+0000 7ff8357fa700 1 -- 172.21.15.53:0/2185736394 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8280886d0 con 0x7ff8380ce050 2023-07-09T21:50:36.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.127+0000 7ff83c99b700 1 --2- 172.21.15.53:0/2185736394 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff82406ace0 0x7ff82406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.125+0000 7f18797fa700 1 -- 172.21.15.53:0/1822046769 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1870013ae0 con 0x7f187c0b3ff0 2023-07-09T21:50:36.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.127+0000 7f18797fa700 1 --2- 172.21.15.53:0/1822046769 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f186006adb0 0x7f186006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.127+0000 7f18797fa700 1 -- 172.21.15.53:0/1822046769 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1870089210 con 0x7f187c0b3ff0 2023-07-09T21:50:36.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.127+0000 7fab7b7fe700 1 --2- 172.21.15.53:0/3402622766 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fab6806adb0 0x7fab6806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.127+0000 7f3d93fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3d940cc690 0x7f3d940cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.127+0000 7f3d93fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3d940cc690 0x7f3d940cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57540/0 (socket says 172.21.15.53:57540) 2023-07-09T21:50:36.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.127+0000 7f3d93fff700 1 -- 172.21.15.53:0/201258039 learned_addr learned my addr 172.21.15.53:0/201258039 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:36.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.127+0000 7f3d98f9b700 1 --2- 172.21.15.53:0/201258039 >> v2:172.21.15.53:3300/0 conn(0x7f3d9406cd60 0x7f3d94161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.127+0000 7fb66f9ff700 1 -- start start 2023-07-09T21:50:36.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.128+0000 7f187bfff700 1 --2- 172.21.15.53:0/1822046769 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f186006adb0 0x7f186006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.128+0000 7f3d93fff700 1 -- 172.21.15.53:0/201258039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d940cde80 msgr2=0x7f3d94164630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-09T21:50:36.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.128+0000 7f3d93fff700 1 --2- 172.21.15.53:0/201258039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d940cde80 0x7f3d94164630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.128+0000 7f3d93fff700 1 -- 172.21.15.53:0/201258039 >> v2:172.21.15.53:3300/0 conn(0x7f3d9406cd60 msgr2=0x7f3d94161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:36.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.128+0000 7f3d93fff700 1 --2- 172.21.15.53:0/201258039 >> v2:172.21.15.53:3300/0 conn(0x7f3d9406cd60 0x7f3d94161a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.128+0000 7f3d93fff700 1 -- 172.21.15.53:0/201258039 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940ccf70 con 0x7f3d940cc690 2023-07-09T21:50:36.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.129+0000 7f3d93fff700 1 --2- 172.21.15.53:0/201258039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d940cc690 0x7f3d940cd940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3d940cea20 tx=0x7f3d88009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=941a28343224e023 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.129+0000 7ff83c99b700 1 --2- 172.21.15.53:0/2185736394 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff82406ace0 0x7ff82406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009b90 tx=0x7ff82c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.129+0000 7f187bfff700 1 --2- 172.21.15.53:0/1822046769 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f186006adb0 0x7f186006d260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f187c0b8350 tx=0x7f1868009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.129+0000 7fb66f9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb66806cd60 0x7fb668155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.129+0000 7fb66f9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6680cc690 0x7fb66815dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.129+0000 7fb66f9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6680ce050 0x7fb66815e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.129+0000 7fb66f9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb668159890 con 0x7fb6680cc690 2023-07-09T21:50:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.129+0000 7fb66f9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680c25f0 con 0x7fb6680ce050 2023-07-09T21:50:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.129+0000 7fb66f9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680c28d0 con 0x7fb66806cd60 2023-07-09T21:50:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.130+0000 7f18797fa700 1 -- 172.21.15.53:0/1822046769 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1870054330 con 0x7f187c0b3ff0 2023-07-09T21:50:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.130+0000 7f3d937fe700 1 -- 172.21.15.53:0/201258039 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88011830 con 0x7f3d940cc690 2023-07-09T21:50:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.130+0000 7f3d937fe700 1 -- 172.21.15.53:0/201258039 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d88011990 con 0x7f3d940cc690 2023-07-09T21:50:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.130+0000 7f3d937fe700 1 -- 172.21.15.53:0/201258039 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88011d20 con 0x7f3d940cc690 2023-07-09T21:50:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.130+0000 7fb66cf9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6680cc690 0x7fb66815dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.130+0000 7fb66cf9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6680cc690 0x7fb66815dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52960/0 (socket says 172.21.15.53:52960) 2023-07-09T21:50:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.130+0000 7fb66cf9a700 1 -- 172.21.15.53:0/2531002468 learned_addr learned my addr 172.21.15.53:0/2531002468 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.131+0000 7fb66cf9a700 1 -- 172.21.15.53:0/2531002468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb66806cd60 msgr2=0x7fb668155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.131+0000 7fb66cf9a700 1 --2- 172.21.15.53:0/2531002468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb66806cd60 0x7fb668155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.131+0000 7fb66cf9a700 1 -- 172.21.15.53:0/2531002468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6680ce050 msgr2=0x7fb66815e180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T21:50:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.131+0000 7fb66cf9a700 1 --2- 172.21.15.53:0/2531002468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6680ce050 0x7fb66815e180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.131+0000 7fb66cf9a700 1 -- 172.21.15.53:0/2531002468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb660009a70 con 0x7fb6680cc690 2023-07-09T21:50:36.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.131+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/201258039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d940cc690 msgr2=0x7f3d940cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.131+0000 7f3d9b1ff700 1 --2- 172.21.15.53:0/201258039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d940cc690 0x7f3d940cd940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3d940cea20 tx=0x7f3d88009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.131+0000 7fb66cf9a700 1 --2- 172.21.15.53:0/2531002468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6680cc690 0x7fb66815dc40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb65800c780 tx=0x7fb65800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.131+0000 7fab7b7fe700 1 --2- 172.21.15.53:0/3402622766 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fab6806adb0 0x7fab6806d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0d1610 tx=0x7fab70008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.132+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/201258039 shutdown_connections 2023-07-09T21:50:36.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.132+0000 7f3d9b1ff700 1 --2- 172.21.15.53:0/201258039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d940cde80 0x7f3d94164630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.132+0000 7f3d9b1ff700 1 --2- 172.21.15.53:0/201258039 >> v2:172.21.15.53:3300/0 conn(0x7f3d9406cd60 0x7f3d94161a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.132+0000 7f3d9b1ff700 1 --2- 172.21.15.53:0/201258039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d940cc690 0x7f3d940cd940 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.132+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/201258039 >> 172.21.15.53:0/201258039 conn(0x7f3d940b05d0 msgr2=0x7f3d940b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.132+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/201258039 shutdown_connections 2023-07-09T21:50:36.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.132+0000 7fb65dffb700 1 -- 172.21.15.53:0/2531002468 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658004c80 con 0x7fb6680cc690 2023-07-09T21:50:36.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.132+0000 7fb65dffb700 1 -- 172.21.15.53:0/2531002468 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb658004de0 con 0x7fb6680cc690 2023-07-09T21:50:36.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.132+0000 7fb65dffb700 1 -- 172.21.15.53:0/2531002468 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6580072f0 con 0x7fb6680cc690 2023-07-09T21:50:36.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.133+0000 7ff8357fa700 1 -- 172.21.15.53:0/2185736394 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff8381629c0 con 0x7ff8380ce050 2023-07-09T21:50:36.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.132+0000 7fb66f9ff700 1 -- 172.21.15.53:0/2531002468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6680c2bb0 con 0x7fb6680cc690 2023-07-09T21:50:36.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.133+0000 7fb66f9ff700 1 -- 172.21.15.53:0/2531002468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6680c3170 con 0x7fb6680cc690 2023-07-09T21:50:36.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.134+0000 7fab78ff9700 1 -- 172.21.15.53:0/3402622766 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab7c14f770 con 0x7fab7c0b3f80 2023-07-09T21:50:36.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.132+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/201258039 wait complete. 2023-07-09T21:50:36.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.134+0000 7fb66f9ff700 1 -- 172.21.15.53:0/2531002468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66806d2a0 con 0x7fb6680cc690 2023-07-09T21:50:36.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.135+0000 7f3d9b1ff700 1 Processor -- start 2023-07-09T21:50:36.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.136+0000 7f3d9b1ff700 1 -- start start 2023-07-09T21:50:36.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.137+0000 7f3d9b1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d9406cd60 0x7f3d94151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.137+0000 7f3d9b1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d940cc690 0x7f3d94152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.137+0000 7f3d9b1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d940cde80 0x7f3d941534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.137+0000 7f3d9b1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940c4380 con 0x7f3d940cde80 2023-07-09T21:50:36.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.137+0000 7f3d9b1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940c4590 con 0x7f3d9406cd60 2023-07-09T21:50:36.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.137+0000 7f3d9b1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940c4870 con 0x7f3d940cc690 2023-07-09T21:50:36.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.138+0000 7f3d93fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d940cc690 0x7f3d94152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.138+0000 7f3d98f9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d9406cd60 0x7f3d94151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.138+0000 7f3d93fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d940cc690 0x7f3d94152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58504/0 (socket says 172.21.15.53:58504) 2023-07-09T21:50:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.138+0000 7f3d93fff700 1 -- 172.21.15.53:0/1293832413 learned_addr learned my addr 172.21.15.53:0/1293832413 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.139+0000 7f3d93fff700 1 -- 172.21.15.53:0/1293832413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d9406cd60 msgr2=0x7f3d94151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.139+0000 7f3d93fff700 1 --2- 172.21.15.53:0/1293832413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d9406cd60 0x7f3d94151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.139+0000 7f3d93fff700 1 -- 172.21.15.53:0/1293832413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d940cde80 msgr2=0x7f3d941534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.139+0000 7f3d93fff700 1 --2- 172.21.15.53:0/1293832413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d940cde80 0x7f3d941534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.139+0000 7f3d93fff700 1 -- 172.21.15.53:0/1293832413 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d88009550 con 0x7f3d940cc690 2023-07-09T21:50:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.140+0000 7f3d93fff700 1 --2- 172.21.15.53:0/1293832413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d940cc690 0x7f3d94152f80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009c10 tx=0x7f3d88004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.140+0000 7f3d917fa700 1 -- 172.21.15.53:0/1293832413 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88004510 con 0x7f3d940cc690 2023-07-09T21:50:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.140+0000 7f3d917fa700 1 -- 172.21.15.53:0/1293832413 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d880036a0 con 0x7f3d940cc690 2023-07-09T21:50:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.140+0000 7f3d917fa700 1 -- 172.21.15.53:0/1293832413 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88003a50 con 0x7f3d940cc690 2023-07-09T21:50:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.140+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/1293832413 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d940c4b50 con 0x7f3d940cc690 2023-07-09T21:50:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.140+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/1293832413 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d940c5110 con 0x7f3d940cc690 2023-07-09T21:50:36.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.145+0000 7fb65dffb700 1 -- 172.21.15.53:0/2531002468 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb658007450 con 0x7fb6680cc690 2023-07-09T21:50:36.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.147+0000 7fb65dffb700 1 --2- 172.21.15.53:0/2531002468 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb64c06adb0 0x7fb64c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.147+0000 7fb65dffb700 1 -- 172.21.15.53:0/2531002468 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb658089100 con 0x7fb6680cc690 2023-07-09T21:50:36.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.148+0000 7fb66d79b700 1 --2- 172.21.15.53:0/2531002468 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb64c06adb0 0x7fb64c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.148+0000 7fb65dffb700 1 -- 172.21.15.53:0/2531002468 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb658054240 con 0x7fb6680cc690 2023-07-09T21:50:36.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.154+0000 7fb66d79b700 1 --2- 172.21.15.53:0/2531002468 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb64c06adb0 0x7fb64c06d260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb6640097b0 tx=0x7fb664006d20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.150+0000 7f3d917fa700 1 -- 172.21.15.53:0/1293832413 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d88003bb0 con 0x7f3d940cc690 2023-07-09T21:50:36.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.152+0000 7f3d917fa700 1 --2- 172.21.15.53:0/1293832413 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f3d7c06af10 0x7f3d7c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:36.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.152+0000 7f3d917fa700 1 -- 172.21.15.53:0/1293832413 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d8808a750 con 0x7f3d940cc690 2023-07-09T21:50:36.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.154+0000 7f3d98f9b700 1 --2- 172.21.15.53:0/1293832413 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f3d7c06af10 0x7f3d7c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:36.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.155+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/1293832413 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d740052f0 con 0x7f3d940cc690 2023-07-09T21:50:36.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.155+0000 7f3d98f9b700 1 --2- 172.21.15.53:0/1293832413 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f3d7c06af10 0x7f3d7c06d3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009b40 tx=0x7f3d84009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:36.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.161+0000 7f3d917fa700 1 -- 172.21.15.53:0/1293832413 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3d88055990 con 0x7f3d940cc690 2023-07-09T21:50:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.564+0000 7f15f35ff700 1 -- 172.21.15.53:0/555717410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f15ec15ab80 con 0x7f15ec0cc690 2023-07-09T21:50:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.565+0000 7f15e1ffb700 1 -- 172.21.15.53:0/555717410 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15ec15ab80 con 0x7f15ec0cc690 2023-07-09T21:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout:64424509447 2023-07-09T21:50:36.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.569+0000 7f15f35ff700 1 -- 172.21.15.53:0/555717410 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f15d006adb0 msgr2=0x7f15d006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.569+0000 7f15f35ff700 1 --2- 172.21.15.53:0/555717410 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f15d006adb0 0x7f15d006d260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f15e40094c0 tx=0x7f15e400b040 comp rx=0 tx=0).stop 2023-07-09T21:50:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.569+0000 7f15f35ff700 1 -- 172.21.15.53:0/555717410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15ec0cc690 msgr2=0x7f15ec15b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.569+0000 7f15f35ff700 1 --2- 172.21.15.53:0/555717410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15ec0cc690 0x7f15ec15b520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f15e8017000 tx=0x7f15e8004750 comp rx=0 tx=0).stop 2023-07-09T21:50:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.570+0000 7f15f35ff700 1 -- 172.21.15.53:0/555717410 shutdown_connections 2023-07-09T21:50:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.570+0000 7f15f35ff700 1 --2- 172.21.15.53:0/555717410 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f15d006adb0 0x7f15d006d260 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.570+0000 7f15f35ff700 1 --2- 172.21.15.53:0/555717410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15ec0cdf40 0x7f15ec1f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.570+0000 7f15f35ff700 1 --2- 172.21.15.53:0/555717410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15ec06b5b0 0x7f15ec1534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.570+0000 7f15f35ff700 1 --2- 172.21.15.53:0/555717410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15ec0cc690 0x7f15ec15b520 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.570+0000 7f15f35ff700 1 -- 172.21.15.53:0/555717410 >> 172.21.15.53:0/555717410 conn(0x7f15ec0b05d0 msgr2=0x7f15ec06f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.572+0000 7f15f35ff700 1 -- 172.21.15.53:0/555717410 shutdown_connections 2023-07-09T21:50:36.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.572+0000 7f15f35ff700 1 -- 172.21.15.53:0/555717410 wait complete. 2023-07-09T21:50:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.575+0000 7f134b1ff700 1 -- 172.21.15.53:0/1077121325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1324005870 con 0x7f1344164710 2023-07-09T21:50:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.576+0000 7f13417fa700 1 -- 172.21.15.53:0/1077121325 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f133c058cc0 con 0x7f1344164710 2023-07-09T21:50:36.577 INFO:teuthology.orchestra.run.smithi053.stdout:60129542150 2023-07-09T21:50:36.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.576+0000 7f5216dff700 1 -- 172.21.15.53:0/2337029472 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5210159220 con 0x7f52100caff0 2023-07-09T21:50:36.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.577+0000 7f520d7fa700 1 -- 172.21.15.53:0/2337029472 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f520401b090 con 0x7f52100caff0 2023-07-09T21:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout:60129542150 2023-07-09T21:50:36.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.580+0000 7f5216dff700 1 -- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f51f406acb0 msgr2=0x7f51f406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.580+0000 7f5216dff700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f51f406acb0 0x7f51f406d160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f521015abb0 tx=0x7f520800b040 comp rx=0 tx=0).stop 2023-07-09T21:50:36.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.580+0000 7f5216dff700 1 -- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52100caff0 msgr2=0x7f521015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.580+0000 7f5216dff700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52100caff0 0x7f521015b320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5204018000 tx=0x7f5204004750 comp rx=0 tx=0).stop 2023-07-09T21:50:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.581+0000 7f5216dff700 1 -- 172.21.15.53:0/2337029472 shutdown_connections 2023-07-09T21:50:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.581+0000 7f5216dff700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f51f406acb0 0x7f51f406d160 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.581+0000 7f5216dff700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52100ce650 0x7f521015b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.581+0000 7f5216dff700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f521006b5b0 0x7f52100c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.581+0000 7f5216dff700 1 --2- 172.21.15.53:0/2337029472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52100caff0 0x7f521015b320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.581+0000 7f5216dff700 1 -- 172.21.15.53:0/2337029472 >> 172.21.15.53:0/2337029472 conn(0x7f52100b05d0 msgr2=0x7f52100b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.581+0000 7f5216dff700 1 -- 172.21.15.53:0/2337029472 shutdown_connections 2023-07-09T21:50:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.581+0000 7f5216dff700 1 -- 172.21.15.53:0/2337029472 wait complete. 2023-07-09T21:50:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.582+0000 7f134b1ff700 1 -- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f132c06af10 msgr2=0x7f132c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.582+0000 7f134b1ff700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f132c06af10 0x7f132c06d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1338000c00 tx=0x7f1338008030 comp rx=0 tx=0).stop 2023-07-09T21:50:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.582+0000 7f134b1ff700 1 -- 172.21.15.53:0/1077121325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1344164710 msgr2=0x7f13440b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.582+0000 7f134b1ff700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1344164710 0x7f13440b40c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f133c007e10 tx=0x7f133c00e3c0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.582+0000 7f134b1ff700 1 -- 172.21.15.53:0/1077121325 shutdown_connections 2023-07-09T21:50:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.582+0000 7f134b1ff700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f132c06af10 0x7f132c06d3c0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1338000c00 tx=0x7f1338008030 comp rx=0 tx=0).stop 2023-07-09T21:50:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.582+0000 7f134b1ff700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13440c4e80 0x7f13440c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.582+0000 7f134b1ff700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13440cd2f0 0x7f134420a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.582+0000 7f134b1ff700 1 --2- 172.21.15.53:0/1077121325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1344164710 0x7f13440b40c0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f133c007e10 tx=0x7f133c00e3c0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.582+0000 7f134b1ff700 1 -- 172.21.15.53:0/1077121325 >> 172.21.15.53:0/1077121325 conn(0x7f13440b05d0 msgr2=0x7f13440cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.584+0000 7f134b1ff700 1 -- 172.21.15.53:0/1077121325 shutdown_connections 2023-07-09T21:50:36.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.587+0000 7f134b1ff700 1 -- 172.21.15.53:0/1077121325 wait complete. 2023-07-09T21:50:36.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.600+0000 7ff83ebff700 1 -- 172.21.15.53:0/2185736394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff8381629c0 con 0x7ff8380ce050 2023-07-09T21:50:36.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.600+0000 7f1882fff700 1 -- 172.21.15.53:0/1822046769 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f187c06b340 con 0x7f187c0b3ff0 2023-07-09T21:50:36.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.601+0000 7f18797fa700 1 -- 172.21.15.53:0/1822046769 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1870057950 con 0x7f187c0b3ff0 2023-07-09T21:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout:60129542150 2023-07-09T21:50:36.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.604+0000 7ff8357fa700 1 -- 172.21.15.53:0/2185736394 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff8381629c0 con 0x7ff8380ce050 2023-07-09T21:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout:64424509447 2023-07-09T21:50:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.605+0000 7f1882fff700 1 -- 172.21.15.53:0/1822046769 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f186006adb0 msgr2=0x7f186006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.605+0000 7f1882fff700 1 --2- 172.21.15.53:0/1822046769 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f186006adb0 0x7f186006d260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f187c0b8350 tx=0x7f1868009040 comp rx=0 tx=0).stop 2023-07-09T21:50:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.605+0000 7f1882fff700 1 -- 172.21.15.53:0/1822046769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c0b3ff0 msgr2=0x7f187c0cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.605+0000 7f1882fff700 1 --2- 172.21.15.53:0/1822046769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c0b3ff0 0x7f187c0cefb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f187000e7e0 tx=0x7f187000eaf0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.606+0000 7f1882fff700 1 -- 172.21.15.53:0/1822046769 shutdown_connections 2023-07-09T21:50:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.606+0000 7f1882fff700 1 --2- 172.21.15.53:0/1822046769 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f186006adb0 0x7f186006d260 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f187c0b8350 tx=0x7f1868009040 comp rx=0 tx=0).stop 2023-07-09T21:50:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.606+0000 7f1882fff700 1 --2- 172.21.15.53:0/1822046769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f187c0d0f90 0x7f187c1f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.606+0000 7f1882fff700 1 --2- 172.21.15.53:0/1822046769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c0b3ff0 0x7f187c0cefb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.606+0000 7f1882fff700 1 --2- 172.21.15.53:0/1822046769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c0d0b10 0x7f187c0ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.606+0000 7f1882fff700 1 -- 172.21.15.53:0/1822046769 >> 172.21.15.53:0/1822046769 conn(0x7f187c09c1b0 msgr2=0x7f187c06bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.606+0000 7fab823ff700 1 -- 172.21.15.53:0/3402622766 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fab7c14f770 con 0x7fab7c0b3f80 2023-07-09T21:50:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.606+0000 7f1882fff700 1 -- 172.21.15.53:0/1822046769 shutdown_connections 2023-07-09T21:50:36.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.607+0000 7f1882fff700 1 -- 172.21.15.53:0/1822046769 wait complete. 2023-07-09T21:50:36.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.608+0000 7fab78ff9700 1 -- 172.21.15.53:0/3402622766 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab6c054510 con 0x7fab7c0b3f80 2023-07-09T21:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-07-09T21:50:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7ff83ebff700 1 -- 172.21.15.53:0/2185736394 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff82406ace0 msgr2=0x7ff82406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7ff83ebff700 1 --2- 172.21.15.53:0/2185736394 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff82406ace0 0x7ff82406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009b90 tx=0x7ff82c008030 comp rx=0 tx=0).stop 2023-07-09T21:50:36.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7fb66f9ff700 1 -- 172.21.15.53:0/2531002468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb668161fa0 con 0x7fb6680cc690 2023-07-09T21:50:36.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7ff83ebff700 1 -- 172.21.15.53:0/2185736394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8380ce050 msgr2=0x7ff8381ea450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7ff83ebff700 1 --2- 172.21.15.53:0/2185736394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8380ce050 0x7ff8381ea450 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff82800c370 tx=0x7ff82800c730 comp rx=0 tx=0).stop 2023-07-09T21:50:36.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2023-07-09T21:50:36.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7ff83ebff700 1 -- 172.21.15.53:0/2185736394 shutdown_connections 2023-07-09T21:50:36.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7ff83ebff700 1 --2- 172.21.15.53:0/2185736394 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff82406ace0 0x7ff82406d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7ff83ebff700 1 --2- 172.21.15.53:0/2185736394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8380ce050 0x7ff8381ea450 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7ff83ebff700 1 --2- 172.21.15.53:0/2185736394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff83806cd60 0x7ff838159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7ff83ebff700 1 --2- 172.21.15.53:0/2185736394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8380cc690 0x7ff8381597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7ff83ebff700 1 -- 172.21.15.53:0/2185736394 >> 172.21.15.53:0/2185736394 conn(0x7ff8380b05d0 msgr2=0x7ff8380c1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7ff83ebff700 1 -- 172.21.15.53:0/2185736394 shutdown_connections 2023-07-09T21:50:36.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7fb65dffb700 1 -- 172.21.15.53:0/2531002468 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb658022090 con 0x7fb6680cc690 2023-07-09T21:50:36.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.609+0000 7ff83ebff700 1 -- 172.21.15.53:0/2185736394 wait complete. 2023-07-09T21:50:36.619 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-07-09T21:50:36.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.613+0000 7fab823ff700 1 -- 172.21.15.53:0/3402622766 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fab6806adb0 msgr2=0x7fab6806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.613+0000 7fab823ff700 1 --2- 172.21.15.53:0/3402622766 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fab6806adb0 0x7fab6806d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0d1610 tx=0x7fab70008030 comp rx=0 tx=0).stop 2023-07-09T21:50:36.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.613+0000 7fab823ff700 1 -- 172.21.15.53:0/3402622766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c0b3f80 msgr2=0x7fab7c0ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.613+0000 7fab823ff700 1 --2- 172.21.15.53:0/3402622766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c0b3f80 0x7fab7c0ca010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00b4a0 tx=0x7fab6c00b860 comp rx=0 tx=0).stop 2023-07-09T21:50:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.613+0000 7fab823ff700 1 -- 172.21.15.53:0/3402622766 shutdown_connections 2023-07-09T21:50:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.613+0000 7fab823ff700 1 --2- 172.21.15.53:0/3402622766 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fab6806adb0 0x7fab6806d260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.613+0000 7fab823ff700 1 --2- 172.21.15.53:0/3402622766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab7c0d1220 0x7fab7c1f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.613+0000 7fab823ff700 1 --2- 172.21.15.53:0/3402622766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c0b3f80 0x7fab7c0ca010 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.613+0000 7fab823ff700 1 --2- 172.21.15.53:0/3402622766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab7c0c6020 0x7fab7c0ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.613+0000 7fab823ff700 1 -- 172.21.15.53:0/3402622766 >> 172.21.15.53:0/3402622766 conn(0x7fab7c09c1b0 msgr2=0x7fab7c0b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.613+0000 7fab823ff700 1 -- 172.21.15.53:0/3402622766 shutdown_connections 2023-07-09T21:50:36.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.613+0000 7fab823ff700 1 -- 172.21.15.53:0/3402622766 wait complete. 2023-07-09T21:50:36.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.614+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/1293832413 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3d740055a0 con 0x7f3d940cc690 2023-07-09T21:50:36.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.0 2023-07-09T21:50:36.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.615+0000 7fb66f9ff700 1 -- 172.21.15.53:0/2531002468 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb64c06adb0 msgr2=0x7fb64c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.615+0000 7fb66f9ff700 1 --2- 172.21.15.53:0/2531002468 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb64c06adb0 0x7fb64c06d260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb6640097b0 tx=0x7fb664006d20 comp rx=0 tx=0).stop 2023-07-09T21:50:36.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.615+0000 7fb66f9ff700 1 -- 172.21.15.53:0/2531002468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6680cc690 msgr2=0x7fb66815dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.615+0000 7fb66f9ff700 1 --2- 172.21.15.53:0/2531002468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6680cc690 0x7fb66815dc40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb65800c780 tx=0x7fb65800cb40 comp rx=0 tx=0).stop 2023-07-09T21:50:36.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.615+0000 7f3d917fa700 1 -- 172.21.15.53:0/1293832413 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d88015030 con 0x7f3d940cc690 2023-07-09T21:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout:60129542150 2023-07-09T21:50:36.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.616+0000 7fb66f9ff700 1 -- 172.21.15.53:0/2531002468 shutdown_connections 2023-07-09T21:50:36.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.616+0000 7fb66f9ff700 1 --2- 172.21.15.53:0/2531002468 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb64c06adb0 0x7fb64c06d260 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.616+0000 7fb66f9ff700 1 --2- 172.21.15.53:0/2531002468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6680ce050 0x7fb66815e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.616+0000 7fb66f9ff700 1 --2- 172.21.15.53:0/2531002468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb66806cd60 0x7fb668155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.616+0000 7fb66f9ff700 1 --2- 172.21.15.53:0/2531002468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6680cc690 0x7fb66815dc40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.616+0000 7fb66f9ff700 1 -- 172.21.15.53:0/2531002468 >> 172.21.15.53:0/2531002468 conn(0x7fb6680b05d0 msgr2=0x7fb6680cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.616+0000 7fb66f9ff700 1 -- 172.21.15.53:0/2531002468 shutdown_connections 2023-07-09T21:50:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.616+0000 7fb66f9ff700 1 -- 172.21.15.53:0/2531002468 wait complete. 2023-07-09T21:50:36.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.3 2023-07-09T21:50:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.619+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/1293832413 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f3d7c06af10 msgr2=0x7f3d7c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.619+0000 7f3d9b1ff700 1 --2- 172.21.15.53:0/1293832413 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f3d7c06af10 0x7f3d7c06d3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009b40 tx=0x7f3d84009210 comp rx=0 tx=0).stop 2023-07-09T21:50:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.619+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/1293832413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d940cc690 msgr2=0x7f3d94152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.619+0000 7f3d9b1ff700 1 --2- 172.21.15.53:0/1293832413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d940cc690 0x7f3d94152f80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009c10 tx=0x7f3d88004750 comp rx=0 tx=0).stop 2023-07-09T21:50:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.619+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/1293832413 shutdown_connections 2023-07-09T21:50:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.619+0000 7f3d9b1ff700 1 --2- 172.21.15.53:0/1293832413 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f3d7c06af10 0x7f3d7c06d3c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.619+0000 7f3d9b1ff700 1 --2- 172.21.15.53:0/1293832413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d940cde80 0x7f3d941534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.619+0000 7f3d9b1ff700 1 --2- 172.21.15.53:0/1293832413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d9406cd60 0x7f3d94151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.619+0000 7f3d9b1ff700 1 --2- 172.21.15.53:0/1293832413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d940cc690 0x7f3d94152f80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.619+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/1293832413 >> 172.21.15.53:0/1293832413 conn(0x7f3d940b05d0 msgr2=0x7f3d940cb550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.619+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/1293832413 shutdown_connections 2023-07-09T21:50:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:36.619+0000 7f3d9b1ff700 1 -- 172.21.15.53:0/1293832413 wait complete. 2023-07-09T21:50:36.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2023-07-09T21:50:36.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.2 2023-07-09T21:50:36.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.6 2023-07-09T21:50:36.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.7 2023-07-09T21:50:36.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.5 2023-07-09T21:50:37.616 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-09T21:50:37.625 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-09T21:50:37.630 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-09T21:50:37.641 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-09T21:50:37.645 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-09T21:50:37.645 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-09T21:50:37.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-09T21:50:37.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-09T21:50:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.957+0000 7f349c9ff700 1 Processor -- start 2023-07-09T21:50:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.957+0000 7f349c9ff700 1 -- start start 2023-07-09T21:50:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.960+0000 7f349c9ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34980cd6c0 0x7f3498164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.960+0000 7f349c9ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3498161050 con 0x7f34980cd2f0 2023-07-09T21:50:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.960+0000 7f349c9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3498165400 con 0x7f34980ce2f0 2023-07-09T21:50:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.960+0000 7f349c9ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34980cc810 con 0x7f34980cd6c0 2023-07-09T21:50:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.961+0000 7f3496d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34980cd6c0 0x7f3498164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.962+0000 7f3496d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34980cd6c0 0x7f3498164e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52982/0 (socket says 172.21.15.53:52982) 2023-07-09T21:50:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.962+0000 7f3496d9d700 1 -- 172.21.15.53:0/2260437280 learned_addr learned my addr 172.21.15.53:0/2260437280 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.962+0000 7f3496d9d700 1 -- 172.21.15.53:0/2260437280 >> v1:172.21.15.184:6789/0 conn(0x7f34980ce2f0 legacy=0x7f3498164710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.962+0000 7f3496d9d700 1 -- 172.21.15.53:0/2260437280 >> v1:172.21.15.53:6789/0 conn(0x7f34980cd2f0 legacy=0x7f34980cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.962+0000 7f3496d9d700 1 -- 172.21.15.53:0/2260437280 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34980ccaf0 con 0x7f34980cd6c0 2023-07-09T21:50:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.963+0000 7f3496d9d700 1 --2- 172.21.15.53:0/2260437280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980cd6c0 0x7f3498164e20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f34980ce6c0 tx=0x7f3488009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6506f29c4229a4f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.965+0000 7f349559a700 1 -- 172.21.15.53:0/2260437280 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488004230 con 0x7f34980cd6c0 2023-07-09T21:50:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.965+0000 7f349559a700 1 -- 172.21.15.53:0/2260437280 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3488004390 con 0x7f34980cd6c0 2023-07-09T21:50:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.965+0000 7f349559a700 1 -- 172.21.15.53:0/2260437280 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880036a0 con 0x7f34980cd6c0 2023-07-09T21:50:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.966+0000 7f349c9ff700 1 -- 172.21.15.53:0/2260437280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980cd6c0 msgr2=0x7f3498164e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.966+0000 7f349c9ff700 1 --2- 172.21.15.53:0/2260437280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980cd6c0 0x7f3498164e20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f34980ce6c0 tx=0x7f3488009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.967+0000 7f349c9ff700 1 -- 172.21.15.53:0/2260437280 shutdown_connections 2023-07-09T21:50:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.967+0000 7f349c9ff700 1 --2- 172.21.15.53:0/2260437280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980cd6c0 0x7f3498164e20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.967+0000 7f349c9ff700 1 -- 172.21.15.53:0/2260437280 >> 172.21.15.53:0/2260437280 conn(0x7f34980b05d0 msgr2=0x7f34980b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.967+0000 7f349c9ff700 1 -- 172.21.15.53:0/2260437280 shutdown_connections 2023-07-09T21:50:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.967+0000 7f349c9ff700 1 -- 172.21.15.53:0/2260437280 wait complete. 2023-07-09T21:50:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.970+0000 7f349c9ff700 1 Processor -- start 2023-07-09T21:50:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.970+0000 7f349c9ff700 1 -- start start 2023-07-09T21:50:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.972+0000 7f349c9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980cd2f0 0x7f349813cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.972+0000 7f349c9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34980cd6c0 0x7f349814d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.972+0000 7f349c9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980ce2f0 0x7f349806f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.972+0000 7f349c9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34980b2ee0 con 0x7f34980cd2f0 2023-07-09T21:50:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.972+0000 7f349c9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34980c8ef0 con 0x7f34980cd6c0 2023-07-09T21:50:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.972+0000 7f349c9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349813c8a0 con 0x7f34980ce2f0 2023-07-09T21:50:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.973+0000 7f349659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980cd2f0 0x7f349813cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.973+0000 7f349659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980cd2f0 0x7f349813cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52996/0 (socket says 172.21.15.53:52996) 2023-07-09T21:50:37.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.973+0000 7f349659c700 1 -- 172.21.15.53:0/3029619083 learned_addr learned my addr 172.21.15.53:0/3029619083 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:37.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.974+0000 7f349659c700 1 -- 172.21.15.53:0/3029619083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980ce2f0 msgr2=0x7f349806f730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T21:50:37.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.974+0000 7f349659c700 1 --2- 172.21.15.53:0/3029619083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980ce2f0 0x7f349806f730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:37.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.974+0000 7f349659c700 1 -- 172.21.15.53:0/3029619083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34980cd6c0 msgr2=0x7f349814d660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:50:37.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.974+0000 7f349659c700 1 --2- 172.21.15.53:0/3029619083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34980cd6c0 0x7f349814d660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:37.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.974+0000 7f349659c700 1 -- 172.21.15.53:0/3029619083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3488009550 con 0x7f34980cd2f0 2023-07-09T21:50:37.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.975+0000 7f349659c700 1 --2- 172.21.15.53:0/3029619083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980cd2f0 0x7f349813cd30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f349000c8f0 tx=0x7f349000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:37.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.978+0000 7f3486ffd700 1 -- 172.21.15.53:0/3029619083 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490003e10 con 0x7f34980cd2f0 2023-07-09T21:50:37.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.978+0000 7f3486ffd700 1 -- 172.21.15.53:0/3029619083 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349000ce90 con 0x7f34980cd2f0 2023-07-09T21:50:37.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.978+0000 7f3486ffd700 1 -- 172.21.15.53:0/3029619083 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900052b0 con 0x7f34980cd2f0 2023-07-09T21:50:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.978+0000 7f349c9ff700 1 -- 172.21.15.53:0/3029619083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349813c5a0 con 0x7f34980cd2f0 2023-07-09T21:50:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.978+0000 7f349c9ff700 1 -- 172.21.15.53:0/3029619083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34980c9420 con 0x7f34980cd2f0 2023-07-09T21:50:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.983+0000 7f3486ffd700 1 -- 172.21.15.53:0/3029619083 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3490005410 con 0x7f34980cd2f0 2023-07-09T21:50:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.985+0000 7f3486ffd700 1 --2- 172.21.15.53:0/3029619083 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f347806adb0 0x7f347806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.985+0000 7f3486ffd700 1 -- 172.21.15.53:0/3029619083 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3490088c40 con 0x7f34980cd2f0 2023-07-09T21:50:37.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.985+0000 7f349c9ff700 1 -- 172.21.15.53:0/3029619083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347c0052f0 con 0x7f34980cd2f0 2023-07-09T21:50:37.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.986+0000 7f3495d9b700 1 --2- 172.21.15.53:0/3029619083 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f347806adb0 0x7f347806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:37.996+0000 7f3486ffd700 1 -- 172.21.15.53:0/3029619083 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3490053cd0 con 0x7f34980cd2f0 2023-07-09T21:50:38.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.002+0000 7f3495d9b700 1 --2- 172.21.15.53:0/3029619083 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f347806adb0 0x7f347806d260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f348c006fd0 tx=0x7f348c006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.033+0000 7fa80b3ff700 1 Processor -- start 2023-07-09T21:50:38.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.033+0000 7fa80b3ff700 1 -- start start 2023-07-09T21:50:38.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.035+0000 7fa80b3ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa8040cc850 0x7fa80406d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.035+0000 7fa80b3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8040cb4d0 0x7fa8040cb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.035+0000 7fa80b3ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80406bfc0 con 0x7fa804160200 2023-07-09T21:50:38.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.035+0000 7fa80b3ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8040cbe80 con 0x7fa8040cc850 2023-07-09T21:50:38.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.035+0000 7fa80b3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040ca120 con 0x7fa8040cb4d0 2023-07-09T21:50:38.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.036+0000 7fdd4f9ff700 1 Processor -- start 2023-07-09T21:50:38.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.036+0000 7fa80899a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8040cb4d0 0x7fa8040cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.036+0000 7fa80899a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8040cb4d0 0x7fa8040cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58522/0 (socket says 172.21.15.53:58522) 2023-07-09T21:50:38.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.036+0000 7fa80899a700 1 -- 172.21.15.53:0/3794631285 learned_addr learned my addr 172.21.15.53:0/3794631285 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.036+0000 7fa80919b700 1 --2- 172.21.15.53:0/3794631285 >> v2:172.21.15.184:3300/0 conn(0x7fa8040cc850 0x7fa80406d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.036+0000 7fdd4f9ff700 1 -- start start 2023-07-09T21:50:38.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.037+0000 7fa80899a700 1 -- 172.21.15.53:0/3794631285 >> v2:172.21.15.184:3300/0 conn(0x7fa8040cc850 msgr2=0x7fa80406d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:38.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.037+0000 7fa80899a700 1 --2- 172.21.15.53:0/3794631285 >> v2:172.21.15.184:3300/0 conn(0x7fa8040cc850 0x7fa80406d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.037+0000 7fa80899a700 1 -- 172.21.15.53:0/3794631285 >> v1:172.21.15.184:6789/0 conn(0x7fa804160200 legacy=0x7fa804160680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-09T21:50:38.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.037+0000 7fa80899a700 1 -- 172.21.15.53:0/3794631285 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80415cb10 con 0x7fa8040cb4d0 2023-07-09T21:50:38.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.037+0000 7fa80899a700 1 --2- 172.21.15.53:0/3794631285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8040cb4d0 0x7fa8040cb940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00098f0 tx=0x7fa7f0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=749f028e144726ea server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.038+0000 7fdd4f9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd480ce650 0x7fdd4806b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.038+0000 7fdd4f9ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd480caff0 0x7fdd480cb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.038+0000 7fdd4f9ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd480cab60 con 0x7fdd4806b5b0 2023-07-09T21:50:38.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.038+0000 7fdd4f9ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd48158bf0 con 0x7fdd480caff0 2023-07-09T21:50:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.038+0000 7fdd4f9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4806bf70 con 0x7fdd480ce650 2023-07-09T21:50:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.038+0000 7fa803fff700 1 -- 172.21.15.53:0/3794631285 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0004230 con 0x7fa8040cb4d0 2023-07-09T21:50:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.039+0000 7fa803fff700 1 -- 172.21.15.53:0/3794631285 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f0004390 con 0x7fa8040cb4d0 2023-07-09T21:50:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.039+0000 7fa803fff700 1 -- 172.21.15.53:0/3794631285 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f00036a0 con 0x7fa8040cb4d0 2023-07-09T21:50:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.039+0000 7fdd4df9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd480caff0 0x7fdd480cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.039+0000 7fdd4df9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd480caff0 0x7fdd480cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53012/0 (socket says 172.21.15.53:53012) 2023-07-09T21:50:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.039+0000 7fdd4df9c700 1 -- 172.21.15.53:0/613235101 learned_addr learned my addr 172.21.15.53:0/613235101 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.040+0000 7fdd4df9c700 1 -- 172.21.15.53:0/613235101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd480ce650 msgr2=0x7fdd4806b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:50:38.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.040+0000 7fdd4df9c700 1 --2- 172.21.15.53:0/613235101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd480ce650 0x7fdd4806b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.040+0000 7fdd4df9c700 1 -- 172.21.15.53:0/613235101 >> v1:172.21.15.53:6789/0 conn(0x7fdd4806b5b0 legacy=0x7fdd480cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:38.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.040+0000 7fdd4df9c700 1 -- 172.21.15.53:0/613235101 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4806c250 con 0x7fdd480caff0 2023-07-09T21:50:38.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.040+0000 7f2ea1bff700 1 Processor -- start 2023-07-09T21:50:38.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.040+0000 7fdd4df9c700 1 --2- 172.21.15.53:0/613235101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd480caff0 0x7fdd480cb460 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdd440092e0 tx=0x7fdd440095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194c9ea8855671cf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.041+0000 7fa80b3ff700 1 -- 172.21.15.53:0/3794631285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8040cb4d0 msgr2=0x7fa8040cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.041+0000 7fa80b3ff700 1 --2- 172.21.15.53:0/3794631285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8040cb4d0 0x7fa8040cb940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00098f0 tx=0x7fa7f0009c00 comp rx=0 tx=0).stop 2023-07-09T21:50:38.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.041+0000 7fa80b3ff700 1 -- 172.21.15.53:0/3794631285 shutdown_connections 2023-07-09T21:50:38.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.041+0000 7fa80b3ff700 1 --2- 172.21.15.53:0/3794631285 >> v2:172.21.15.184:3300/0 conn(0x7fa8040cc850 0x7fa80406d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.041+0000 7fa80b3ff700 1 --2- 172.21.15.53:0/3794631285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8040cb4d0 0x7fa8040cb940 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.041+0000 7fa80b3ff700 1 -- 172.21.15.53:0/3794631285 >> 172.21.15.53:0/3794631285 conn(0x7fa8040b05d0 msgr2=0x7fa8040b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.041+0000 7fdd3ffff700 1 -- 172.21.15.53:0/613235101 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44004230 con 0x7fdd480caff0 2023-07-09T21:50:38.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.041+0000 7fdd3ffff700 1 -- 172.21.15.53:0/613235101 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd44004390 con 0x7fdd480caff0 2023-07-09T21:50:38.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.041+0000 7fdd3ffff700 1 -- 172.21.15.53:0/613235101 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4400c770 con 0x7fdd480caff0 2023-07-09T21:50:38.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.040+0000 7f2ea1bff700 1 -- start start 2023-07-09T21:50:38.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.041+0000 7fa80b3ff700 1 -- 172.21.15.53:0/3794631285 shutdown_connections 2023-07-09T21:50:38.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.042+0000 7f2ea1bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e9c0ce050 0x7f2e9c164630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.042+0000 7f2ea1bff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c0cd530 con 0x7f2e9c0cc690 2023-07-09T21:50:38.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.042+0000 7f2ea1bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c1615d0 con 0x7f2e9c06cd60 2023-07-09T21:50:38.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.042+0000 7f2ea1bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0ccf70 con 0x7f2e9c0ce050 2023-07-09T21:50:38.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.042+0000 7fa80b3ff700 1 -- 172.21.15.53:0/3794631285 wait complete. 2023-07-09T21:50:38.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.043+0000 7f2e9affd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2e9c0cc690 0x7f2e9c0cd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56312/0 (socket says 172.21.15.53:56312) 2023-07-09T21:50:38.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.043+0000 7f2e9affd700 1 -- 172.21.15.53:0/274814160 learned_addr learned my addr 172.21.15.53:0/274814160 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:38.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.043+0000 7f2e9bfff700 1 --2- 172.21.15.53:0/274814160 >> v2:172.21.15.53:3300/0 conn(0x7f2e9c0ce050 0x7f2e9c164630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.044+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826304791 0 0) 0x7f2e9c1615d0 con 0x7f2e9c06cd60 2023-07-09T21:50:38.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.044+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e880035b0 con 0x7f2e9c06cd60 2023-07-09T21:50:38.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.044+0000 7fa80b3ff700 1 Processor -- start 2023-07-09T21:50:38.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.042+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/613235101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd480caff0 msgr2=0x7fdd480cb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.042+0000 7fdd4f9ff700 1 --2- 172.21.15.53:0/613235101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd480caff0 0x7fdd480cb460 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdd440092e0 tx=0x7fdd440095f0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.044+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/613235101 shutdown_connections 2023-07-09T21:50:38.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.044+0000 7fdd4f9ff700 1 --2- 172.21.15.53:0/613235101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd480caff0 0x7fdd480cb460 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.044+0000 7fdd4f9ff700 1 --2- 172.21.15.53:0/613235101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd480ce650 0x7fdd4806b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.044+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/613235101 >> 172.21.15.53:0/613235101 conn(0x7fdd480b05d0 msgr2=0x7fdd480b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7fa80b3ff700 1 -- start start 2023-07-09T21:50:38.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/613235101 shutdown_connections 2023-07-09T21:50:38.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 336483460 0 0) 0x7f2e880035b0 con 0x7f2e9c06cd60 2023-07-09T21:50:38.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 >> v2:172.21.15.53:3300/0 conn(0x7f2e9c0ce050 msgr2=0x7f2e9c164630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:38.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7f2e9a7fc700 1 --2- 172.21.15.53:0/274814160 >> v2:172.21.15.53:3300/0 conn(0x7f2e9c0ce050 0x7f2e9c164630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 >> v1:172.21.15.53:6789/0 conn(0x7f2e9c0cc690 legacy=0x7f2e9c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0cd250 con 0x7f2e9c06cd60 2023-07-09T21:50:38.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f2e940016b0 con 0x7f2e9c06cd60 2023-07-09T21:50:38.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 >> v1:172.21.15.184:6789/0 conn(0x7f2e9c06cd60 legacy=0x7f2e9c161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7f2e9a7fc700 1 --2- 172.21.15.53:0/274814160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e88003a50 0x7f2e88003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7f2e9a7fc700 1 --2- 172.21.15.53:0/274814160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e88004850 0x7f2e88004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7f2e9a7fc700 1 --2- 172.21.15.53:0/274814160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e88005200 0x7f2e8800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0ccf70 con 0x7f2e88003a50 2023-07-09T21:50:38.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8800c0e0 con 0x7f2e88004850 2023-07-09T21:50:38.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.045+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8800c2a0 con 0x7f2e88005200 2023-07-09T21:50:38.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.046+0000 7f2e9b7fe700 1 --2- 172.21.15.53:0/274814160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e88003a50 0x7f2e88003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.047+0000 7f2e9affd700 1 --2- 172.21.15.53:0/274814160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e88004850 0x7f2e88004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.047+0000 7fa80b3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8040cb4d0 0x7fa8040b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.047+0000 7fa80b3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8040cc850 0x7fa80415f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.047+0000 7fa80b3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa804160200 0x7fa80415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.047+0000 7fa80b3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa804158b60 con 0x7fa804160200 2023-07-09T21:50:38.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.047+0000 7fa80b3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c4e20 con 0x7fa8040cc850 2023-07-09T21:50:38.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.047+0000 7fa80b3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c2490 con 0x7fa8040cb4d0 2023-07-09T21:50:38.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.048+0000 7fa80999c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa804160200 0x7fa80415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.048+0000 7fa80999c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa804160200 0x7fa80415f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53038/0 (socket says 172.21.15.53:53038) 2023-07-09T21:50:38.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.048+0000 7fa80999c700 1 -- 172.21.15.53:0/863544875 learned_addr learned my addr 172.21.15.53:0/863544875 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.048+0000 7fa80899a700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8040cc850 0x7fa80415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.046+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/613235101 wait complete. 2023-07-09T21:50:38.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.048+0000 7fdd4f9ff700 1 Processor -- start 2023-07-09T21:50:38.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7fa80919b700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8040cb4d0 0x7fa8040b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7fa80999c700 1 -- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8040cb4d0 msgr2=0x7fa8040b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.047+0000 7f2e9b7fe700 1 -- 172.21.15.53:0/274814160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e88005200 msgr2=0x7f2e8800ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-09T21:50:38.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.047+0000 7f2e9b7fe700 1 --2- 172.21.15.53:0/274814160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e88005200 0x7f2e8800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.047+0000 7f2e9b7fe700 1 -- 172.21.15.53:0/274814160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e88004850 msgr2=0x7f2e88004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:38.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.047+0000 7f2e9b7fe700 1 --2- 172.21.15.53:0/274814160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e88004850 0x7f2e88004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.047+0000 7f2e9b7fe700 1 -- 172.21.15.53:0/274814160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0cd250 con 0x7f2e88003a50 2023-07-09T21:50:38.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.048+0000 7f2e9b7fe700 1 --2- 172.21.15.53:0/274814160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e88003a50 0x7f2e88003e60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2e94001eb0 tx=0x7f2e88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82001a3ca176dbe1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.048+0000 7f2e9bfff700 1 -- 172.21.15.53:0/274814160 reap_dead start 2023-07-09T21:50:38.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9400ccd0 con 0x7f2e88003a50 2023-07-09T21:50:38.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9400ce30 con 0x7f2e88003a50 2023-07-09T21:50:38.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7f2e9a7fc700 1 -- 172.21.15.53:0/274814160 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e94012620 con 0x7f2e88003a50 2023-07-09T21:50:38.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7fa80999c700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8040cb4d0 0x7fa8040b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7fa80999c700 1 -- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8040cc850 msgr2=0x7fa80415f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7fa80999c700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8040cc850 0x7fa80415f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7fa80999c700 1 -- 172.21.15.53:0/863544875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0009550 con 0x7fa804160200 2023-07-09T21:50:38.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7fa80899a700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8040cc850 0x7fa80415f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:38.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7fa80919b700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8040cb4d0 0x7fa8040b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:38.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7f2ea1bff700 1 -- 172.21.15.53:0/274814160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e88003a50 msgr2=0x7f2e88003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7f2ea1bff700 1 --2- 172.21.15.53:0/274814160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e88003a50 0x7f2e88003e60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2e94001eb0 tx=0x7f2e88005880 comp rx=0 tx=0).stop 2023-07-09T21:50:38.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7fa80999c700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa804160200 0x7fa80415f7f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800b7b0 tx=0x7fa7f800bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7f2ea1bff700 1 -- 172.21.15.53:0/274814160 shutdown_connections 2023-07-09T21:50:38.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7f2ea1bff700 1 --2- 172.21.15.53:0/274814160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e88003a50 0x7f2e88003e60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7f2ea1bff700 1 -- 172.21.15.53:0/274814160 >> 172.21.15.53:0/274814160 conn(0x7f2e9c0b05d0 msgr2=0x7f2e9c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7f2ea1bff700 1 -- 172.21.15.53:0/274814160 shutdown_connections 2023-07-09T21:50:38.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7fa801ffb700 1 -- 172.21.15.53:0/863544875 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8010880 con 0x7fa804160200 2023-07-09T21:50:38.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7fa801ffb700 1 -- 172.21.15.53:0/863544875 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f80109e0 con 0x7fa804160200 2023-07-09T21:50:38.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7fa801ffb700 1 -- 172.21.15.53:0/863544875 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8010d90 con 0x7fa804160200 2023-07-09T21:50:38.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7fa80b3ff700 1 -- 172.21.15.53:0/863544875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8040b4360 con 0x7fa804160200 2023-07-09T21:50:38.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.051+0000 7fa80b3ff700 1 -- 172.21.15.53:0/863544875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8040c26e0 con 0x7fa804160200 2023-07-09T21:50:38.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.052+0000 7fa80b3ff700 1 -- 172.21.15.53:0/863544875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8040b45c0 con 0x7fa804160200 2023-07-09T21:50:38.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.055+0000 7fa801ffb700 1 -- 172.21.15.53:0/863544875 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa7f800f3d0 con 0x7fa804160200 2023-07-09T21:50:38.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.049+0000 7fdd4f9ff700 1 -- start start 2023-07-09T21:50:38.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7fdd4f9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd4806b5b0 0x7fdd481577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7fdd4f9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd480caff0 0x7fdd480c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7fdd4f9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd480ce650 0x7fdd480c3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7fdd4f9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd48158f60 con 0x7fdd480caff0 2023-07-09T21:50:38.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.051+0000 7fdd4f9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480c3b10 con 0x7fdd4806b5b0 2023-07-09T21:50:38.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.051+0000 7fdd4f9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480c3830 con 0x7fdd480ce650 2023-07-09T21:50:38.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.052+0000 7fdd4d79b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd4806b5b0 0x7fdd481577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.053+0000 7fdd4df9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd480ce650 0x7fdd480c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.053+0000 7fdd4d79b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd4806b5b0 0x7fdd481577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57588/0 (socket says 172.21.15.53:57588) 2023-07-09T21:50:38.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.053+0000 7fdd4d79b700 1 -- 172.21.15.53:0/3208199345 learned_addr learned my addr 172.21.15.53:0/3208199345 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.053+0000 7fdd4cf9a700 1 --2- 172.21.15.53:0/3208199345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd480caff0 0x7fdd480c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.054+0000 7fdd4df9c700 1 -- 172.21.15.53:0/3208199345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd4806b5b0 msgr2=0x7fdd481577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.054+0000 7fdd4df9c700 1 --2- 172.21.15.53:0/3208199345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd4806b5b0 0x7fdd481577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.054+0000 7fdd4df9c700 1 -- 172.21.15.53:0/3208199345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd480caff0 msgr2=0x7fdd480c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.054+0000 7fdd4df9c700 1 --2- 172.21.15.53:0/3208199345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd480caff0 0x7fdd480c2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.054+0000 7fdd4df9c700 1 -- 172.21.15.53:0/3208199345 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd44009de0 con 0x7fdd480ce650 2023-07-09T21:50:38.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.054+0000 7fdd4df9c700 1 --2- 172.21.15.53:0/3208199345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd480ce650 0x7fdd480c3240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd44016000 tx=0x7fdd44004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.050+0000 7f2ea1bff700 1 -- 172.21.15.53:0/274814160 wait complete. 2023-07-09T21:50:38.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.053+0000 7f2ea1bff700 1 Processor -- start 2023-07-09T21:50:38.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.054+0000 7f2ea1bff700 1 -- start start 2023-07-09T21:50:38.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.055+0000 7f2ea1bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e88003a50 0x7f2e9c1586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.055+0000 7f2ea1bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e9c0b18f0 0x7f2e9c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.055+0000 7f2ea1bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e9c0c8230 0x7f2e9c1629b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.055+0000 7f2ea1bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0c8a20 con 0x7f2e9c0b18f0 2023-07-09T21:50:38.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.055+0000 7f2ea1bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c1eabe0 con 0x7f2e9c0c8230 2023-07-09T21:50:38.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.055+0000 7f2ea1bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c1ea5d0 con 0x7f2e88003a50 2023-07-09T21:50:38.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.055+0000 7fa2c9fff700 1 Processor -- start 2023-07-09T21:50:38.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.056+0000 7f55029ff700 1 Processor -- start 2023-07-09T21:50:38.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.056+0000 7f2e9affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e9c0b18f0 0x7f2e9c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.056+0000 7f2e9affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e9c0b18f0 0x7f2e9c0c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53050/0 (socket says 172.21.15.53:53050) 2023-07-09T21:50:38.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.056+0000 7f2e9affd700 1 -- 172.21.15.53:0/2956924952 learned_addr learned my addr 172.21.15.53:0/2956924952 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7f2e9bfff700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e9c0c8230 0x7f2e9c1629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7f2e9b7fe700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e88003a50 0x7f2e9c1586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.055+0000 7fa2c9fff700 1 -- start start 2023-07-09T21:50:38.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7f55029ff700 1 -- start start 2023-07-09T21:50:38.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.055+0000 7fdd3dffb700 1 -- 172.21.15.53:0/3208199345 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4401e070 con 0x7fdd480ce650 2023-07-09T21:50:38.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.055+0000 7fdd3dffb700 1 -- 172.21.15.53:0/3208199345 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4400c050 con 0x7fdd480ce650 2023-07-09T21:50:38.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.055+0000 7fdd3dffb700 1 -- 172.21.15.53:0/3208199345 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd440038c0 con 0x7fdd480ce650 2023-07-09T21:50:38.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7ff1b7fff700 1 Processor -- start 2023-07-09T21:50:38.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7fa2c9fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2c406cd60 0x7fa2c4161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7fa2c9fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2c40ce050 0x7fa2c4164630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7fa2c9fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c40cd530 con 0x7fa2c40cc690 2023-07-09T21:50:38.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7fa2c9fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c41615d0 con 0x7fa2c406cd60 2023-07-09T21:50:38.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7fa2c9fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c40ccf70 con 0x7fa2c40ce050 2023-07-09T21:50:38.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.058+0000 7fa2c37fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2c406cd60 0x7fa2c4161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.058+0000 7fa2c37fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2c406cd60 0x7fa2c4161a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53064/0 (socket says 172.21.15.53:53064) 2023-07-09T21:50:38.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.058+0000 7fa2c37fe700 1 -- 172.21.15.53:0/984911808 learned_addr learned my addr 172.21.15.53:0/984911808 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.058+0000 7ff1b7fff700 1 -- start start 2023-07-09T21:50:38.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7f2e9bfff700 1 -- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e88003a50 msgr2=0x7f2e9c1586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7f2e9bfff700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e88003a50 0x7f2e9c1586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7f2e9bfff700 1 -- 172.21.15.53:0/2956924952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e9c0b18f0 msgr2=0x7f2e9c0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7f2e9bfff700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e9c0b18f0 0x7f2e9c0c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7f2e9bfff700 1 -- 172.21.15.53:0/2956924952 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0c8740 con 0x7f2e9c0c8230 2023-07-09T21:50:38.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.059+0000 7fa2c3fff700 1 --2- 172.21.15.53:0/984911808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2c40ce050 0x7fa2c4164630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7fa801ffb700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa7e806adb0 0x7fa7e806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.057+0000 7fa801ffb700 1 -- 172.21.15.53:0/863544875 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa7f80898c0 con 0x7fa804160200 2023-07-09T21:50:38.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.059+0000 7f55029ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f54fc0cf030 0x7f54fc0cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.059+0000 7f55029ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f54fc0d39d0 0x7f54fc1608c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.059+0000 7f55029ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54fc0cd8e0 con 0x7f54fc0cfdd0 2023-07-09T21:50:38.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.059+0000 7f55029ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54fc0d0220 con 0x7f54fc0cf030 2023-07-09T21:50:38.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.059+0000 7f55029ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54fc0d2760 con 0x7f54fc0d39d0 2023-07-09T21:50:38.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.058+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/3208199345 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd48159200 con 0x7fdd480ce650 2023-07-09T21:50:38.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.058+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/3208199345 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd480c5300 con 0x7fdd480ce650 2023-07-09T21:50:38.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.059+0000 7fa2c3fff700 1 -- 172.21.15.53:0/984911808 >> v2:172.21.15.53:3300/0 conn(0x7fa2c406cd60 msgr2=0x7fa2c4161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:38.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.059+0000 7fa2c3fff700 1 --2- 172.21.15.53:0/984911808 >> v2:172.21.15.53:3300/0 conn(0x7fa2c406cd60 0x7fa2c4161a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.059+0000 7fa2c3fff700 1 -- 172.21.15.53:0/984911808 >> v1:172.21.15.53:6789/0 conn(0x7fa2c40cc690 legacy=0x7fa2c40cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:38.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.059+0000 7fa2c3fff700 1 -- 172.21.15.53:0/984911808 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c40cd250 con 0x7fa2c40ce050 2023-07-09T21:50:38.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.060+0000 7ff1b7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b0158560 0x7ff1b006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.060+0000 7ff1b7fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1b006baf0 0x7ff1b00cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.060+0000 7ff1b7fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff1b0158930 0x7ff1b00ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.060+0000 7f5500f9c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f54fc0d39d0 0x7f54fc1608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.060+0000 7f5500f9c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f54fc0d39d0 0x7f54fc1608c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57616/0 (socket says 172.21.15.53:57616) 2023-07-09T21:50:38.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.060+0000 7f5500f9c700 1 -- 172.21.15.53:0/716337745 learned_addr learned my addr 172.21.15.53:0/716337745 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.060+0000 7ff1b7fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b00cab60 con 0x7ff1b006baf0 2023-07-09T21:50:38.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.060+0000 7ff1b7fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b015f5d0 con 0x7ff1b0158930 2023-07-09T21:50:38.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.060+0000 7ff1b7fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b006c250 con 0x7ff1b0158560 2023-07-09T21:50:38.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.060+0000 7fa80919b700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa7e806adb0 0x7fa7e806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/3208199345 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd280052f0 con 0x7fdd480ce650 2023-07-09T21:50:38.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7f6f3f9ff700 1 Processor -- start 2023-07-09T21:50:38.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.061+0000 7ff1b5d9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b0158560 0x7ff1b006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.061+0000 7ff1b5d9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b0158560 0x7ff1b006b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58578/0 (socket says 172.21.15.53:58578) 2023-07-09T21:50:38.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.061+0000 7ff1b5d9b700 1 -- 172.21.15.53:0/2400714653 learned_addr learned my addr 172.21.15.53:0/2400714653 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.061+0000 7ff1b659c700 1 --2- 172.21.15.53:0/2400714653 >> v2:172.21.15.184:3300/0 conn(0x7ff1b0158930 0x7ff1b00ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7ff1b5d9b700 1 -- 172.21.15.53:0/2400714653 >> v2:172.21.15.184:3300/0 conn(0x7ff1b0158930 msgr2=0x7ff1b00ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:38.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7ff1b5d9b700 1 --2- 172.21.15.53:0/2400714653 >> v2:172.21.15.184:3300/0 conn(0x7ff1b0158930 0x7ff1b00ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7ff1b5d9b700 1 -- 172.21.15.53:0/2400714653 >> v2:172.21.15.53:3300/0 conn(0x7ff1b006baf0 msgr2=0x7ff1b00cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:38.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7ff1b5d9b700 1 --2- 172.21.15.53:0/2400714653 >> v2:172.21.15.53:3300/0 conn(0x7ff1b006baf0 0x7ff1b00cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7ff1b5d9b700 1 -- 172.21.15.53:0/2400714653 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b006c530 con 0x7ff1b0158560 2023-07-09T21:50:38.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.061+0000 7f2e9bfff700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e9c0c8230 0x7f2e9c1629b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c1656f0 tx=0x7f2e8400eae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.061+0000 7f2e93fff700 1 -- 172.21.15.53:0/2956924952 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84013680 con 0x7f2e9c0c8230 2023-07-09T21:50:38.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.061+0000 7f2e93fff700 1 -- 172.21.15.53:0/2956924952 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e840137e0 con 0x7f2e9c0c8230 2023-07-09T21:50:38.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.061+0000 7f2e93fff700 1 -- 172.21.15.53:0/2956924952 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84013b90 con 0x7f2e9c0c8230 2023-07-09T21:50:38.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.061+0000 7f54fbfff700 1 --2- 172.21.15.53:0/716337745 >> v2:172.21.15.53:3300/0 conn(0x7f54fc0cf030 0x7f54fc0cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.061+0000 7f5500f9c700 1 -- 172.21.15.53:0/716337745 >> v2:172.21.15.53:3300/0 conn(0x7f54fc0cf030 msgr2=0x7f54fc0cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:38.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.061+0000 7f5500f9c700 1 --2- 172.21.15.53:0/716337745 >> v2:172.21.15.53:3300/0 conn(0x7f54fc0cf030 0x7f54fc0cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7f5500f9c700 1 -- 172.21.15.53:0/716337745 >> v1:172.21.15.53:6789/0 conn(0x7f54fc0cfdd0 legacy=0x7f54fc1601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:38.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7f5500f9c700 1 -- 172.21.15.53:0/716337745 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc0d1740 con 0x7f54fc0d39d0 2023-07-09T21:50:38.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.061+0000 7fa2c3fff700 1 --2- 172.21.15.53:0/984911808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2c40ce050 0x7fa2c4164630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009d90 tx=0x7fa2bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=546d157fb98a1433 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7fa2c27fc700 1 -- 172.21.15.53:0/984911808 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00e070 con 0x7fa2c40ce050 2023-07-09T21:50:38.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7fa2c27fc700 1 -- 172.21.15.53:0/984911808 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc00bb90 con 0x7fa2c40ce050 2023-07-09T21:50:38.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7fa2c27fc700 1 -- 172.21.15.53:0/984911808 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc003a20 con 0x7fa2c40ce050 2023-07-09T21:50:38.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7fa80919b700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa7e806adb0 0x7fa7e806d260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009b60 tx=0x7fa7fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7f5500f9c700 1 --2- 172.21.15.53:0/716337745 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc0d39d0 0x7f54fc1608c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f54fc06bb90 tx=0x7f54f4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a96a316d4fffcb79 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.063+0000 7ff1b5d9b700 1 --2- 172.21.15.53:0/2400714653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b0158560 0x7ff1b006b5b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff1b015d380 tx=0x7ff1ac009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b5dcd3b69242a04 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.063+0000 7ff1b4d99700 1 -- 172.21.15.53:0/2400714653 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00b870 con 0x7ff1b0158560 2023-07-09T21:50:38.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.063+0000 7ff1b4d99700 1 -- 172.21.15.53:0/2400714653 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac00b9d0 con 0x7ff1b0158560 2023-07-09T21:50:38.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.063+0000 7ff1b4d99700 1 -- 172.21.15.53:0/2400714653 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00bd60 con 0x7ff1b0158560 2023-07-09T21:50:38.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.063+0000 7f54fb7fe700 1 -- 172.21.15.53:0/716337745 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4004230 con 0x7f54fc0d39d0 2023-07-09T21:50:38.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.063+0000 7f54fb7fe700 1 -- 172.21.15.53:0/716337745 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f4004390 con 0x7f54fc0d39d0 2023-07-09T21:50:38.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.063+0000 7f54fb7fe700 1 -- 172.21.15.53:0/716337745 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f40036a0 con 0x7f54fc0d39d0 2023-07-09T21:50:38.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7f55029ff700 1 -- 172.21.15.53:0/716337745 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc0d39d0 msgr2=0x7f54fc1608c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7f55029ff700 1 --2- 172.21.15.53:0/716337745 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc0d39d0 0x7f54fc1608c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f54fc06bb90 tx=0x7f54f4009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2400714653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b0158560 msgr2=0x7ff1b006b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7ff1b7fff700 1 --2- 172.21.15.53:0/2400714653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b0158560 0x7ff1b006b5b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff1b015d380 tx=0x7ff1ac009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7f55029ff700 1 -- 172.21.15.53:0/716337745 shutdown_connections 2023-07-09T21:50:38.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7f55029ff700 1 --2- 172.21.15.53:0/716337745 >> v2:172.21.15.53:3300/0 conn(0x7f54fc0cf030 0x7f54fc0cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7f55029ff700 1 --2- 172.21.15.53:0/716337745 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc0d39d0 0x7f54fc1608c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7f55029ff700 1 -- 172.21.15.53:0/716337745 >> 172.21.15.53:0/716337745 conn(0x7f54fc06c170 msgr2=0x7f54fc06c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.063+0000 7f2ea1bff700 1 -- 172.21.15.53:0/2956924952 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c1ea870 con 0x7f2e9c0c8230 2023-07-09T21:50:38.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.063+0000 7f2ea1bff700 1 -- 172.21.15.53:0/2956924952 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c1590d0 con 0x7f2e9c0c8230 2023-07-09T21:50:38.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2400714653 shutdown_connections 2023-07-09T21:50:38.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7ff1b7fff700 1 --2- 172.21.15.53:0/2400714653 >> v2:172.21.15.184:3300/0 conn(0x7ff1b0158930 0x7ff1b00ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7ff1b7fff700 1 --2- 172.21.15.53:0/2400714653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b0158560 0x7ff1b006b5b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7ff1b7fff700 1 --2- 172.21.15.53:0/2400714653 >> v2:172.21.15.53:3300/0 conn(0x7ff1b006baf0 0x7ff1b00cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2400714653 >> 172.21.15.53:0/2400714653 conn(0x7ff1b00b05d0 msgr2=0x7ff1b00b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.062+0000 7f6f3f9ff700 1 -- start start 2023-07-09T21:50:38.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7f6f3f9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f3806b5b0 0x7f6f3806b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7f6f3f9ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f380cc000 con 0x7f6f380ce3b0 2023-07-09T21:50:38.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7f6f3f9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f380cab60 con 0x7f6f380cdf40 2023-07-09T21:50:38.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7f6f3f9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38158bf0 con 0x7f6f3806b5b0 2023-07-09T21:50:38.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7fa2c9fff700 1 -- 172.21.15.53:0/984911808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2c40ce050 msgr2=0x7fa2c4164630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7fa2c9fff700 1 --2- 172.21.15.53:0/984911808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2c40ce050 0x7fa2c4164630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009d90 tx=0x7fa2bc00b330 comp rx=0 tx=0).stop 2023-07-09T21:50:38.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7f2ea1bff700 1 -- 172.21.15.53:0/2956924952 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c1ea430 con 0x7f2e9c0c8230 2023-07-09T21:50:38.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7f55029ff700 1 -- 172.21.15.53:0/716337745 shutdown_connections 2023-07-09T21:50:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2400714653 shutdown_connections 2023-07-09T21:50:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.067+0000 7fa801ffb700 1 -- 172.21.15.53:0/863544875 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa7f8054950 con 0x7fa804160200 2023-07-09T21:50:38.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.064+0000 7fdd3dffb700 1 -- 172.21.15.53:0/3208199345 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd44003a20 con 0x7fdd480ce650 2023-07-09T21:50:38.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.066+0000 7fdd3dffb700 1 --2- 172.21.15.53:0/3208199345 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdd2c06adb0 0x7fdd2c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.066+0000 7fdd3dffb700 1 -- 172.21.15.53:0/3208199345 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd4408a570 con 0x7fdd480ce650 2023-07-09T21:50:38.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.067+0000 7fdd4d79b700 1 --2- 172.21.15.53:0/3208199345 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdd2c06adb0 0x7fdd2c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.068+0000 7fdd4d79b700 1 --2- 172.21.15.53:0/3208199345 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdd2c06adb0 0x7fdd2c06d260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd38003ac0 tx=0x7fdd38003a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.066+0000 7f6f3cf9a700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f6f380cdf40 0x7f6f380cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:47050/0 (socket says 172.21.15.53:47050) 2023-07-09T21:50:38.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.066+0000 7f6f3cf9a700 1 -- 172.21.15.53:0/730120964 learned_addr learned my addr 172.21.15.53:0/730120964 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:38.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.067+0000 7f6f3d79b700 1 --2- 172.21.15.53:0/730120964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f3806b5b0 0x7f6f3806b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.068+0000 7f6f3d79b700 1 -- 172.21.15.53:0/730120964 >> v1:172.21.15.184:6789/0 conn(0x7f6f380cdf40 legacy=0x7f6f380cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.068+0000 7f6f3d79b700 1 -- 172.21.15.53:0/730120964 >> v1:172.21.15.53:6789/0 conn(0x7f6f380ce3b0 legacy=0x7f6f380ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:38.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.068+0000 7f6f3d79b700 1 -- 172.21.15.53:0/730120964 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f380cd4b0 con 0x7f6f3806b5b0 2023-07-09T21:50:38.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2400714653 wait complete. 2023-07-09T21:50:38.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.068+0000 7ff1b7fff700 1 Processor -- start 2023-07-09T21:50:38.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7f55029ff700 1 -- 172.21.15.53:0/716337745 wait complete. 2023-07-09T21:50:38.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.068+0000 7f55029ff700 1 Processor -- start 2023-07-09T21:50:38.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.068+0000 7f55029ff700 1 -- start start 2023-07-09T21:50:38.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7fa2c9fff700 1 -- 172.21.15.53:0/984911808 shutdown_connections 2023-07-09T21:50:38.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7fa2c9fff700 1 --2- 172.21.15.53:0/984911808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2c40ce050 0x7fa2c4164630 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7fa2c9fff700 1 --2- 172.21.15.53:0/984911808 >> v2:172.21.15.53:3300/0 conn(0x7fa2c406cd60 0x7fa2c4161a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.065+0000 7fa2c9fff700 1 -- 172.21.15.53:0/984911808 >> 172.21.15.53:0/984911808 conn(0x7fa2c40b05d0 msgr2=0x7fa2c40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.066+0000 7fa2c9fff700 1 -- 172.21.15.53:0/984911808 shutdown_connections 2023-07-09T21:50:38.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.066+0000 7fa2c9fff700 1 -- 172.21.15.53:0/984911808 wait complete. 2023-07-09T21:50:38.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.069+0000 7f6f3d79b700 1 --2- 172.21.15.53:0/730120964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f3806b5b0 0x7f6f3806b980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009870 tx=0x7f6f28009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=248157efbd63a279 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.069+0000 7fa2c9fff700 1 Processor -- start 2023-07-09T21:50:38.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.070+0000 7fdd3dffb700 1 -- 172.21.15.53:0/3208199345 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd44055690 con 0x7fdd480ce650 2023-07-09T21:50:38.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.070+0000 7f6f2ffff700 1 -- 172.21.15.53:0/730120964 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28004230 con 0x7f6f3806b5b0 2023-07-09T21:50:38.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.070+0000 7f6f2ffff700 1 -- 172.21.15.53:0/730120964 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f28004390 con 0x7f6f3806b5b0 2023-07-09T21:50:38.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.070+0000 7f6f2ffff700 1 -- 172.21.15.53:0/730120964 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800c700 con 0x7f6f3806b5b0 2023-07-09T21:50:38.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.069+0000 7fa2c9fff700 1 -- start start 2023-07-09T21:50:38.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.069+0000 7ff1b7fff700 1 -- start start 2023-07-09T21:50:38.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.070+0000 7ff1b7fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1b0158560 0x7ff1b0147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7ff1b7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b0158930 0x7ff1b0070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7ff1b7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b00c1840 0x7ff1b0149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7ff1b7fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b00b43d0 con 0x7ff1b0158930 2023-07-09T21:50:38.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7ff1b7fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b0147300 con 0x7ff1b0158560 2023-07-09T21:50:38.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7ff1b7fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b01475e0 con 0x7ff1b00c1840 2023-07-09T21:50:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7ff1b659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b00c1840 0x7ff1b0149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7ff1b659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b00c1840 0x7ff1b0149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58618/0 (socket says 172.21.15.53:58618) 2023-07-09T21:50:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7ff1b659c700 1 -- 172.21.15.53:0/2887872586 learned_addr learned my addr 172.21.15.53:0/2887872586 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.070+0000 7f55029ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54fc0cf030 0x7f54fc15e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.070+0000 7f55029ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54fc0cfdd0 0x7f54fc06d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.070+0000 7f55029ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc0d39d0 0x7f54fc15c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.070+0000 7f55029ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc06df30 con 0x7f54fc0cf030 2023-07-09T21:50:38.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.070+0000 7f55029ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc06e180 con 0x7f54fc0d39d0 2023-07-09T21:50:38.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.070+0000 7f55029ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc06e460 con 0x7f54fc0cfdd0 2023-07-09T21:50:38.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7f5500f9c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc0d39d0 0x7f54fc15c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7f5500f9c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc0d39d0 0x7f54fc15c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57632/0 (socket says 172.21.15.53:57632) 2023-07-09T21:50:38.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7f5500f9c700 1 -- 172.21.15.53:0/3936685303 learned_addr learned my addr 172.21.15.53:0/3936685303 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7f5500f9c700 1 -- 172.21.15.53:0/3936685303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54fc0cfdd0 msgr2=0x7f54fc06d9f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T21:50:38.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7f5500f9c700 1 --2- 172.21.15.53:0/3936685303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54fc0cfdd0 0x7f54fc06d9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7f5500f9c700 1 -- 172.21.15.53:0/3936685303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54fc0cf030 msgr2=0x7f54fc15e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.072+0000 7f5500f9c700 1 --2- 172.21.15.53:0/3936685303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54fc0cf030 0x7f54fc15e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.072+0000 7f5500f9c700 1 -- 172.21.15.53:0/3936685303 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f4009550 con 0x7f54fc0d39d0 2023-07-09T21:50:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.072+0000 7ff1b5d9b700 1 --2- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1b0158560 0x7ff1b0147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.072+0000 7ff1b659c700 1 -- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1b0158560 msgr2=0x7ff1b0147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.072+0000 7ff1b659c700 1 --2- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1b0158560 0x7ff1b0147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.072+0000 7ff1b659c700 1 -- 172.21.15.53:0/2887872586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b0158930 msgr2=0x7ff1b0070f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:50:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.072+0000 7ff1b659c700 1 --2- 172.21.15.53:0/2887872586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b0158930 0x7ff1b0070f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.072+0000 7ff1b659c700 1 -- 172.21.15.53:0/2887872586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac009550 con 0x7ff1b00c1840 2023-07-09T21:50:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.070+0000 7f2e93fff700 1 -- 172.21.15.53:0/2956924952 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e84013cf0 con 0x7f2e9c0c8230 2023-07-09T21:50:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.072+0000 7f2e93fff700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2e7c06ade0 0x7f2e7c06d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.072+0000 7f2e93fff700 1 -- 172.21.15.53:0/2956924952 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e84089450 con 0x7f2e9c0c8230 2023-07-09T21:50:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.073+0000 7f2e93fff700 1 -- 172.21.15.53:0/2956924952 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2e84054450 con 0x7f2e9c0c8230 2023-07-09T21:50:38.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.073+0000 7f5500f9c700 1 --2- 172.21.15.53:0/3936685303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc0d39d0 0x7f54fc15c290 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009fd0 tx=0x7f54f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.073+0000 7ff1b659c700 1 --2- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b00c1840 0x7ff1b0149690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8007e60 tx=0x7ff1a800e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/730120964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f3806b5b0 msgr2=0x7f6f3806b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7f6f3f9ff700 1 --2- 172.21.15.53:0/730120964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f3806b5b0 0x7f6f3806b980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009870 tx=0x7f6f28009b80 comp rx=0 tx=0).stop 2023-07-09T21:50:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/730120964 shutdown_connections 2023-07-09T21:50:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7f6f3f9ff700 1 --2- 172.21.15.53:0/730120964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f3806b5b0 0x7f6f3806b980 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009870 tx=0x7f6f28009b80 comp rx=0 tx=0).stop 2023-07-09T21:50:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.071+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/730120964 >> 172.21.15.53:0/730120964 conn(0x7f6f380b05d0 msgr2=0x7f6f380b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.073+0000 7f54f97fa700 1 -- 172.21.15.53:0/3936685303 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f40045d0 con 0x7f54fc0d39d0 2023-07-09T21:50:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.073+0000 7f54f97fa700 1 -- 172.21.15.53:0/3936685303 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f4011630 con 0x7f54fc0d39d0 2023-07-09T21:50:38.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.073+0000 7f54f97fa700 1 -- 172.21.15.53:0/3936685303 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f40119c0 con 0x7f54fc0d39d0 2023-07-09T21:50:38.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.073+0000 7f55029ff700 1 -- 172.21.15.53:0/3936685303 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc06e740 con 0x7f54fc0d39d0 2023-07-09T21:50:38.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7ff1a67fc700 1 -- 172.21.15.53:0/2887872586 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a800ede0 con 0x7ff1b00c1840 2023-07-09T21:50:38.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7ff1a67fc700 1 -- 172.21.15.53:0/2887872586 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a8014420 con 0x7ff1b00c1840 2023-07-09T21:50:38.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7ff1a67fc700 1 -- 172.21.15.53:0/2887872586 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a80147d0 con 0x7ff1b00c1840 2023-07-09T21:50:38.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2887872586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b01478c0 con 0x7ff1b00c1840 2023-07-09T21:50:38.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2887872586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b0071690 con 0x7ff1b00c1840 2023-07-09T21:50:38.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.075+0000 7f2e9b7fe700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2e7c06ade0 0x7f2e7c06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.073+0000 7f55029ff700 1 -- 172.21.15.53:0/3936685303 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc06ed00 con 0x7f54fc0d39d0 2023-07-09T21:50:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7fa2c9fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c406cd60 0x7fa2c41eb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7fa2c9fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c40cc690 0x7fa2c4159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7fa2c9fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2c40ce050 0x7fa2c4070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7fa2c9fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c40c3740 con 0x7fa2c406cd60 2023-07-09T21:50:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7fa2c9fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c40c2ee0 con 0x7fa2c40cc690 2023-07-09T21:50:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7fa2c9fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c4159540 con 0x7fa2c40ce050 2023-07-09T21:50:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7fa2c3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2c40ce050 0x7fa2c4070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7fa2c3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2c40ce050 0x7fa2c4070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58624/0 (socket says 172.21.15.53:58624) 2023-07-09T21:50:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7fa2c3fff700 1 -- 172.21.15.53:0/1254223877 learned_addr learned my addr 172.21.15.53:0/1254223877 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.074+0000 7fa2c2ffd700 1 --2- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c40cc690 0x7fa2c4159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.075+0000 7fa2c2ffd700 1 -- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2c40ce050 msgr2=0x7fa2c4070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.075+0000 7fa2c2ffd700 1 --2- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2c40ce050 0x7fa2c4070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.075+0000 7fa2c2ffd700 1 -- 172.21.15.53:0/1254223877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c406cd60 msgr2=0x7fa2c41eb320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:50:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.075+0000 7fa2c2ffd700 1 --2- 172.21.15.53:0/1254223877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c406cd60 0x7fa2c41eb320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.075+0000 7fa2c2ffd700 1 -- 172.21.15.53:0/1254223877 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc009a70 con 0x7fa2c40cc690 2023-07-09T21:50:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.076+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2887872586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1980052f0 con 0x7ff1b00c1840 2023-07-09T21:50:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.076+0000 7f55029ff700 1 -- 172.21.15.53:0/3936685303 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e00052f0 con 0x7f54fc0d39d0 2023-07-09T21:50:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.076+0000 7fa2c2ffd700 1 --2- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c40cc690 0x7fa2c4159000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800c430 tx=0x7fa2b800c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.076+0000 7fa2abfff700 1 -- 172.21.15.53:0/1254223877 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8011790 con 0x7fa2c40cc690 2023-07-09T21:50:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.076+0000 7fa2abfff700 1 -- 172.21.15.53:0/1254223877 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b80118f0 con 0x7fa2c40cc690 2023-07-09T21:50:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.076+0000 7fa2abfff700 1 -- 172.21.15.53:0/1254223877 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8011ca0 con 0x7fa2c40cc690 2023-07-09T21:50:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.078+0000 7fa2c9fff700 1 -- 172.21.15.53:0/1254223877 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c41ecc80 con 0x7fa2c40cc690 2023-07-09T21:50:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.078+0000 7fa2c9fff700 1 -- 172.21.15.53:0/1254223877 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c40c3460 con 0x7fa2c40cc690 2023-07-09T21:50:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.078+0000 7f54f97fa700 1 -- 172.21.15.53:0/3936685303 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f54f4022070 con 0x7f54fc0d39d0 2023-07-09T21:50:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.078+0000 7ff1a67fc700 1 -- 172.21.15.53:0/2887872586 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff1a8014930 con 0x7ff1b00c1840 2023-07-09T21:50:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.079+0000 7f2e9b7fe700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2e7c06ade0 0x7f2e7c06d290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e94000c00 tx=0x7f2e94005040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.080+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/730120964 shutdown_connections 2023-07-09T21:50:38.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.080+0000 7f54f97fa700 1 --2- 172.21.15.53:0/3936685303 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f54dc06ad30 0x7f54dc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.080+0000 7f54f97fa700 1 -- 172.21.15.53:0/3936685303 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54f408af70 con 0x7f54fc0d39d0 2023-07-09T21:50:38.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.080+0000 7ff1a67fc700 1 --2- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff19406adb0 0x7ff19406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.080+0000 7ff1a67fc700 1 -- 172.21.15.53:0/2887872586 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1a80899f0 con 0x7ff1b00c1840 2023-07-09T21:50:38.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.081+0000 7f54fbfff700 1 --2- 172.21.15.53:0/3936685303 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f54dc06ad30 0x7f54dc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.081+0000 7ff1b5d9b700 1 --2- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff19406adb0 0x7ff19406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.082+0000 7f54fbfff700 1 --2- 172.21.15.53:0/3936685303 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f54dc06ad30 0x7f54dc06d1e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0070b0 tx=0x7f54ec007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.082+0000 7ff1b5d9b700 1 --2- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff19406adb0 0x7ff19406d260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac000c00 tx=0x7ff1ac008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.080+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/730120964 wait complete. 2023-07-09T21:50:38.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.083+0000 7f6f3f9ff700 1 Processor -- start 2023-07-09T21:50:38.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.083+0000 7f6f3f9ff700 1 -- start start 2023-07-09T21:50:38.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.084+0000 7ff1a67fc700 1 -- 172.21.15.53:0/2887872586 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff1a8054b10 con 0x7ff1b00c1840 2023-07-09T21:50:38.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.085+0000 7f54f97fa700 1 -- 172.21.15.53:0/3936685303 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f54f4056090 con 0x7f54fc0d39d0 2023-07-09T21:50:38.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.085+0000 7f6f3f9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f380cdf40 0x7f6f3814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.085+0000 7f6f3f9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f380ce3b0 0x7f6f380c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.085+0000 7f6f3f9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f380b1e30 0x7f6f380b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.085+0000 7f6f3f9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38159d80 con 0x7f6f380cdf40 2023-07-09T21:50:38.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.085+0000 7f6f3f9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38159fd0 con 0x7f6f380b1e30 2023-07-09T21:50:38.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.085+0000 7f6f3f9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3815a2b0 con 0x7f6f380ce3b0 2023-07-09T21:50:38.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.086+0000 7f6f3df9c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f380b1e30 0x7f6f380b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.086+0000 7f6f3df9c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f380b1e30 0x7f6f380b22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57666/0 (socket says 172.21.15.53:57666) 2023-07-09T21:50:38.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.086+0000 7f6f3df9c700 1 -- 172.21.15.53:0/2099707062 learned_addr learned my addr 172.21.15.53:0/2099707062 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.086+0000 7f6f3cf9a700 1 --2- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f380ce3b0 0x7f6f380c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.087+0000 7fa2abfff700 1 -- 172.21.15.53:0/1254223877 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa2b801c460 con 0x7fa2c40cc690 2023-07-09T21:50:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.089+0000 7fa2abfff700 1 --2- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa2b006ad30 0x7fa2b006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.089+0000 7fa2abfff700 1 -- 172.21.15.53:0/1254223877 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa2b80891d0 con 0x7fa2c40cc690 2023-07-09T21:50:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.087+0000 7f6f3df9c700 1 -- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f380ce3b0 msgr2=0x7f6f380c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.087+0000 7f6f3df9c700 1 --2- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f380ce3b0 0x7f6f380c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.087+0000 7f6f3df9c700 1 -- 172.21.15.53:0/2099707062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f380cdf40 msgr2=0x7f6f3814fdb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:50:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.087+0000 7f6f3df9c700 1 --2- 172.21.15.53:0/2099707062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f380cdf40 0x7f6f3814fdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.087+0000 7f6f3df9c700 1 -- 172.21.15.53:0/2099707062 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f280094a0 con 0x7f6f380b1e30 2023-07-09T21:50:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.089+0000 7f6f3df9c700 1 --2- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f380b1e30 0x7f6f380b22b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000c7a0 tx=0x7f6f3000cb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.090+0000 7fa2c9fff700 1 -- 172.21.15.53:0/1254223877 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c40c9b90 con 0x7fa2c40cc690 2023-07-09T21:50:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.090+0000 7f6f2dffb700 1 -- 172.21.15.53:0/2099707062 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30003e10 con 0x7f6f380b1e30 2023-07-09T21:50:38.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.090+0000 7f6f2dffb700 1 -- 172.21.15.53:0/2099707062 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f30005070 con 0x7f6f380b1e30 2023-07-09T21:50:38.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.090+0000 7f6f2dffb700 1 -- 172.21.15.53:0/2099707062 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30005420 con 0x7f6f380b1e30 2023-07-09T21:50:38.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.091+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/2099707062 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3815a590 con 0x7f6f380b1e30 2023-07-09T21:50:38.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.091+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/2099707062 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3815ab50 con 0x7f6f380b1e30 2023-07-09T21:50:38.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.093+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/2099707062 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3815ad70 con 0x7f6f380b1e30 2023-07-09T21:50:38.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.093+0000 7fa2c37fe700 1 --2- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa2b006ad30 0x7fa2b006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.094+0000 7fa2c37fe700 1 --2- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa2b006ad30 0x7fa2b006d1e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400c6e0 tx=0x7fa2b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.095+0000 7fa2abfff700 1 -- 172.21.15.53:0/1254223877 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa2b80541d0 con 0x7fa2c40cc690 2023-07-09T21:50:38.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.104+0000 7f6f2dffb700 1 -- 172.21.15.53:0/2099707062 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f30005580 con 0x7f6f380b1e30 2023-07-09T21:50:38.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.105+0000 7f6f2dffb700 1 --2- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6f1c06adb0 0x7f6f1c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.106+0000 7f6f2dffb700 1 -- 172.21.15.53:0/2099707062 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f300891b0 con 0x7f6f380b1e30 2023-07-09T21:50:38.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.106+0000 7f6f2dffb700 1 -- 172.21.15.53:0/2099707062 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6f30089630 con 0x7f6f380b1e30 2023-07-09T21:50:38.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.107+0000 7f6f3d79b700 1 --2- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6f1c06adb0 0x7f6f1c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.148+0000 7f6f3d79b700 1 --2- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6f1c06adb0 0x7f6f1c06d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6f380669f0 tx=0x7f6f28008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.442+0000 7f349c9ff700 1 -- 172.21.15.53:0/3029619083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f347c0055a0 con 0x7f34980cd2f0 2023-07-09T21:50:38.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.442+0000 7f3486ffd700 1 -- 172.21.15.53:0/3029619083 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3490017090 con 0x7f34980cd2f0 2023-07-09T21:50:38.447 INFO:teuthology.orchestra.run.smithi053.stdout:64424509448 2023-07-09T21:50:38.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.446+0000 7f349c9ff700 1 -- 172.21.15.53:0/3029619083 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f347806adb0 msgr2=0x7f347806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.446+0000 7f349c9ff700 1 --2- 172.21.15.53:0/3029619083 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f347806adb0 0x7f347806d260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f348c006fd0 tx=0x7f348c006bc0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.446+0000 7f349c9ff700 1 -- 172.21.15.53:0/3029619083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980cd2f0 msgr2=0x7f349813cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.446+0000 7f349c9ff700 1 --2- 172.21.15.53:0/3029619083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980cd2f0 0x7f349813cd30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f349000c8f0 tx=0x7f349000ccb0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.447+0000 7f349c9ff700 1 -- 172.21.15.53:0/3029619083 shutdown_connections 2023-07-09T21:50:38.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.447+0000 7f349c9ff700 1 --2- 172.21.15.53:0/3029619083 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f347806adb0 0x7f347806d260 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.447+0000 7f349c9ff700 1 --2- 172.21.15.53:0/3029619083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980ce2f0 0x7f349806f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.447+0000 7f349c9ff700 1 --2- 172.21.15.53:0/3029619083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980cd2f0 0x7f349813cd30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.447+0000 7f349c9ff700 1 --2- 172.21.15.53:0/3029619083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34980cd6c0 0x7f349814d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.447+0000 7f349c9ff700 1 -- 172.21.15.53:0/3029619083 >> 172.21.15.53:0/3029619083 conn(0x7f34980b05d0 msgr2=0x7f34980caf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.448+0000 7f349c9ff700 1 -- 172.21.15.53:0/3029619083 shutdown_connections 2023-07-09T21:50:38.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.448+0000 7f349c9ff700 1 -- 172.21.15.53:0/3029619083 wait complete. 2023-07-09T21:50:38.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2023-07-09T21:50:38.481 DEBUG:teuthology.parallel:result is None 2023-07-09T21:50:38.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.512+0000 7fa2c9fff700 1 -- 172.21.15.53:0/1254223877 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa2c40ccaf0 con 0x7fa2c40cc690 2023-07-09T21:50:38.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.513+0000 7fa80b3ff700 1 -- 172.21.15.53:0/863544875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa80415c260 con 0x7fa804160200 2023-07-09T21:50:38.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.513+0000 7fa2abfff700 1 -- 172.21.15.53:0/1254223877 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa2c40ccaf0 con 0x7fa2c40cc690 2023-07-09T21:50:38.515 INFO:teuthology.orchestra.run.smithi053.stdout:60129542152 2023-07-09T21:50:38.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.513+0000 7fa801ffb700 1 -- 172.21.15.53:0/863544875 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7f8057f70 con 0x7fa804160200 2023-07-09T21:50:38.517 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-07-09T21:50:38.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.516+0000 7fa2c9fff700 1 -- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa2b006ad30 msgr2=0x7fa2b006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.516+0000 7fa2c9fff700 1 --2- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa2b006ad30 0x7fa2b006d1e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400c6e0 tx=0x7fa2b4008040 comp rx=0 tx=0).stop 2023-07-09T21:50:38.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.516+0000 7fa2c9fff700 1 -- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c40cc690 msgr2=0x7fa2c4159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.516+0000 7fa2c9fff700 1 --2- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c40cc690 0x7fa2c4159000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800c430 tx=0x7fa2b800c740 comp rx=0 tx=0).stop 2023-07-09T21:50:38.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.516+0000 7fa2c9fff700 1 -- 172.21.15.53:0/1254223877 shutdown_connections 2023-07-09T21:50:38.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.516+0000 7fa2c9fff700 1 --2- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa2b006ad30 0x7fa2b006d1e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.516+0000 7fa2c9fff700 1 --2- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2c40ce050 0x7fa2c4070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.516+0000 7fa2c9fff700 1 --2- 172.21.15.53:0/1254223877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c406cd60 0x7fa2c41eb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.516+0000 7fa2c9fff700 1 --2- 172.21.15.53:0/1254223877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c40cc690 0x7fa2c4159000 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.516+0000 7fa2c9fff700 1 -- 172.21.15.53:0/1254223877 >> 172.21.15.53:0/1254223877 conn(0x7fa2c40b05d0 msgr2=0x7fa2c4162120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.516+0000 7fa2c9fff700 1 -- 172.21.15.53:0/1254223877 shutdown_connections 2023-07-09T21:50:38.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.517+0000 7fa2c9fff700 1 -- 172.21.15.53:0/1254223877 wait complete. 2023-07-09T21:50:38.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.518+0000 7fa80b3ff700 1 -- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa7e806adb0 msgr2=0x7fa7e806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.518+0000 7fa80b3ff700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa7e806adb0 0x7fa7e806d260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009b60 tx=0x7fa7fc008040 comp rx=0 tx=0).stop 2023-07-09T21:50:38.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.518+0000 7fa80b3ff700 1 -- 172.21.15.53:0/863544875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa804160200 msgr2=0x7fa80415f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.518+0000 7fa80b3ff700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa804160200 0x7fa80415f7f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800b7b0 tx=0x7fa7f800bb70 comp rx=0 tx=0).stop 2023-07-09T21:50:38.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.518+0000 7fa80b3ff700 1 -- 172.21.15.53:0/863544875 shutdown_connections 2023-07-09T21:50:38.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.518+0000 7fa80b3ff700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa7e806adb0 0x7fa7e806d260 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009b60 tx=0x7fa7fc008040 comp rx=0 tx=0).stop 2023-07-09T21:50:38.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.518+0000 7fa80b3ff700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa804160200 0x7fa80415f7f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.518+0000 7fa80b3ff700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8040cb4d0 0x7fa8040b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.518+0000 7fa80b3ff700 1 --2- 172.21.15.53:0/863544875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8040cc850 0x7fa80415f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.518+0000 7fa80b3ff700 1 -- 172.21.15.53:0/863544875 >> 172.21.15.53:0/863544875 conn(0x7fa8040b05d0 msgr2=0x7fa8040b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.519+0000 7fa80b3ff700 1 -- 172.21.15.53:0/863544875 shutdown_connections 2023-07-09T21:50:38.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.519+0000 7fa80b3ff700 1 -- 172.21.15.53:0/863544875 wait complete. 2023-07-09T21:50:38.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.535+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/3208199345 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdd280055a0 con 0x7fdd480ce650 2023-07-09T21:50:38.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.536+0000 7fdd3dffb700 1 -- 172.21.15.53:0/3208199345 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd44058cb0 con 0x7fdd480ce650 2023-07-09T21:50:38.541 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-07-09T21:50:38.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.5 2023-07-09T21:50:38.543 DEBUG:teuthology.parallel:result is None 2023-07-09T21:50:38.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.540+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/3208199345 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdd2c06adb0 msgr2=0x7fdd2c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.540+0000 7fdd4f9ff700 1 --2- 172.21.15.53:0/3208199345 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdd2c06adb0 0x7fdd2c06d260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd38003ac0 tx=0x7fdd38003a50 comp rx=0 tx=0).stop 2023-07-09T21:50:38.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.540+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/3208199345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd480ce650 msgr2=0x7fdd480c3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.540+0000 7fdd4f9ff700 1 --2- 172.21.15.53:0/3208199345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd480ce650 0x7fdd480c3240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd44016000 tx=0x7fdd44004750 comp rx=0 tx=0).stop 2023-07-09T21:50:38.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.540+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/3208199345 shutdown_connections 2023-07-09T21:50:38.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.540+0000 7fdd4f9ff700 1 --2- 172.21.15.53:0/3208199345 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdd2c06adb0 0x7fdd2c06d260 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.541+0000 7fdd4f9ff700 1 --2- 172.21.15.53:0/3208199345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd480ce650 0x7fdd480c3240 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.541+0000 7fdd4f9ff700 1 --2- 172.21.15.53:0/3208199345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd4806b5b0 0x7fdd481577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.541+0000 7fdd4f9ff700 1 --2- 172.21.15.53:0/3208199345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd480caff0 0x7fdd480c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.541+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/3208199345 >> 172.21.15.53:0/3208199345 conn(0x7fdd480b05d0 msgr2=0x7fdd480cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.541+0000 7f2ea1bff700 1 -- 172.21.15.53:0/2956924952 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2e9c1ea430 con 0x7f2e9c0c8230 2023-07-09T21:50:38.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.542+0000 7f2e93fff700 1 -- 172.21.15.53:0/2956924952 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e9c1ea430 con 0x7f2e9c0c8230 2023-07-09T21:50:38.546 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-07-09T21:50:38.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.544+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/3208199345 shutdown_connections 2023-07-09T21:50:38.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.544+0000 7f2ea1bff700 1 -- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2e7c06ade0 msgr2=0x7f2e7c06d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.544+0000 7f2ea1bff700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2e7c06ade0 0x7f2e7c06d290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e94000c00 tx=0x7f2e94005040 comp rx=0 tx=0).stop 2023-07-09T21:50:38.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.544+0000 7f2ea1bff700 1 -- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e9c0c8230 msgr2=0x7f2e9c1629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.544+0000 7f2ea1bff700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e9c0c8230 0x7f2e9c1629b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c1656f0 tx=0x7f2e8400eae0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.544+0000 7f2ea1bff700 1 -- 172.21.15.53:0/2956924952 shutdown_connections 2023-07-09T21:50:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.544+0000 7f2ea1bff700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2e7c06ade0 0x7f2e7c06d290 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.544+0000 7f2ea1bff700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e9c0c8230 0x7f2e9c1629b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.544+0000 7f2ea1bff700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e88003a50 0x7f2e9c1586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.544+0000 7f2ea1bff700 1 --2- 172.21.15.53:0/2956924952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e9c0b18f0 0x7f2e9c0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.544+0000 7f2ea1bff700 1 -- 172.21.15.53:0/2956924952 >> 172.21.15.53:0/2956924952 conn(0x7f2e9c0b05d0 msgr2=0x7f2e9c15f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.544+0000 7f2ea1bff700 1 -- 172.21.15.53:0/2956924952 shutdown_connections 2023-07-09T21:50:38.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.544+0000 7f2ea1bff700 1 -- 172.21.15.53:0/2956924952 wait complete. 2023-07-09T21:50:38.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.545+0000 7fdd4f9ff700 1 -- 172.21.15.53:0/3208199345 wait complete. 2023-07-09T21:50:38.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2023-07-09T21:50:38.553 DEBUG:teuthology.parallel:result is None 2023-07-09T21:50:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.555+0000 7f55029ff700 1 -- 172.21.15.53:0/3936685303 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f54e00055a0 con 0x7f54fc0d39d0 2023-07-09T21:50:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.556+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2887872586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff1980055a0 con 0x7ff1b00c1840 2023-07-09T21:50:38.557 INFO:teuthology.orchestra.run.smithi053.stdout:60129542152 2023-07-09T21:50:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.556+0000 7f54f97fa700 1 -- 172.21.15.53:0/3936685303 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54f4025470 con 0x7f54fc0d39d0 2023-07-09T21:50:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.556+0000 7ff1a67fc700 1 -- 172.21.15.53:0/2887872586 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1a8058130 con 0x7ff1b00c1840 2023-07-09T21:50:38.558 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-07-09T21:50:38.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.557+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/2099707062 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6f38074350 con 0x7f6f380b1e30 2023-07-09T21:50:38.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.559+0000 7f6f2dffb700 1 -- 172.21.15.53:0/2099707062 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f300541b0 con 0x7f6f380b1e30 2023-07-09T21:50:38.560 INFO:teuthology.orchestra.run.smithi053.stdout:64424509448 2023-07-09T21:50:38.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.559+0000 7f55029ff700 1 -- 172.21.15.53:0/3936685303 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f54dc06ad30 msgr2=0x7f54dc06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.559+0000 7f55029ff700 1 --2- 172.21.15.53:0/3936685303 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f54dc06ad30 0x7f54dc06d1e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0070b0 tx=0x7f54ec007040 comp rx=0 tx=0).stop 2023-07-09T21:50:38.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.559+0000 7f55029ff700 1 -- 172.21.15.53:0/3936685303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc0d39d0 msgr2=0x7f54fc15c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.559+0000 7f55029ff700 1 --2- 172.21.15.53:0/3936685303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc0d39d0 0x7f54fc15c290 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009fd0 tx=0x7f54f4004750 comp rx=0 tx=0).stop 2023-07-09T21:50:38.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.559+0000 7f55029ff700 1 -- 172.21.15.53:0/3936685303 shutdown_connections 2023-07-09T21:50:38.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.559+0000 7f55029ff700 1 --2- 172.21.15.53:0/3936685303 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f54dc06ad30 0x7f54dc06d1e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.559+0000 7f55029ff700 1 --2- 172.21.15.53:0/3936685303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc0d39d0 0x7f54fc15c290 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.559+0000 7f55029ff700 1 --2- 172.21.15.53:0/3936685303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54fc0cf030 0x7f54fc15e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.559+0000 7f55029ff700 1 --2- 172.21.15.53:0/3936685303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54fc0cfdd0 0x7f54fc06d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.559+0000 7f55029ff700 1 -- 172.21.15.53:0/3936685303 >> 172.21.15.53:0/3936685303 conn(0x7f54fc06c170 msgr2=0x7f54fc0b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.559+0000 7f55029ff700 1 -- 172.21.15.53:0/3936685303 shutdown_connections 2023-07-09T21:50:38.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.559+0000 7f55029ff700 1 -- 172.21.15.53:0/3936685303 wait complete. 2023-07-09T21:50:38.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.560+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff19406adb0 msgr2=0x7ff19406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.560+0000 7ff1b7fff700 1 --2- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff19406adb0 0x7ff19406d260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac000c00 tx=0x7ff1ac008030 comp rx=0 tx=0).stop 2023-07-09T21:50:38.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.560+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b00c1840 msgr2=0x7ff1b0149690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.560+0000 7ff1b7fff700 1 --2- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b00c1840 0x7ff1b0149690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8007e60 tx=0x7ff1a800e3c0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.560+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2887872586 shutdown_connections 2023-07-09T21:50:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.560+0000 7ff1b7fff700 1 --2- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff19406adb0 0x7ff19406d260 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.560+0000 7ff1b7fff700 1 --2- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1b00c1840 0x7ff1b0149690 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.560+0000 7ff1b7fff700 1 --2- 172.21.15.53:0/2887872586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1b0158560 0x7ff1b0147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.560+0000 7ff1b7fff700 1 --2- 172.21.15.53:0/2887872586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b0158930 0x7ff1b0070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.560+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2887872586 >> 172.21.15.53:0/2887872586 conn(0x7ff1b00b05d0 msgr2=0x7ff1b0148810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.560+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2887872586 shutdown_connections 2023-07-09T21:50:38.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.561+0000 7ff1b7fff700 1 -- 172.21.15.53:0/2887872586 wait complete. 2023-07-09T21:50:38.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.562+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6f1c06adb0 msgr2=0x7f6f1c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.562+0000 7f6f3f9ff700 1 --2- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6f1c06adb0 0x7f6f1c06d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6f380669f0 tx=0x7f6f28008030 comp rx=0 tx=0).stop 2023-07-09T21:50:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.562+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f380b1e30 msgr2=0x7f6f380b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.562+0000 7f6f3f9ff700 1 --2- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f380b1e30 0x7f6f380b22b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000c7a0 tx=0x7f6f3000cb60 comp rx=0 tx=0).stop 2023-07-09T21:50:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.562+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/2099707062 shutdown_connections 2023-07-09T21:50:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.562+0000 7f6f3f9ff700 1 --2- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6f1c06adb0 0x7f6f1c06d260 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6f380669f0 tx=0x7f6f28008030 comp rx=0 tx=0).stop 2023-07-09T21:50:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.562+0000 7f6f3f9ff700 1 --2- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f380b1e30 0x7f6f380b22b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.562+0000 7f6f3f9ff700 1 --2- 172.21.15.53:0/2099707062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f380cdf40 0x7f6f3814fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.562+0000 7f6f3f9ff700 1 --2- 172.21.15.53:0/2099707062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f380ce3b0 0x7f6f380c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.562+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/2099707062 >> 172.21.15.53:0/2099707062 conn(0x7f6f380b05d0 msgr2=0x7f6f380b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.563+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/2099707062 shutdown_connections 2023-07-09T21:50:38.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.563+0000 7f6f3f9ff700 1 -- 172.21.15.53:0/2099707062 wait complete. 2023-07-09T21:50:38.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2023-07-09T21:50:38.571 DEBUG:teuthology.parallel:result is None 2023-07-09T21:50:38.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2023-07-09T21:50:38.573 DEBUG:teuthology.parallel:result is None 2023-07-09T21:50:38.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2023-07-09T21:50:38.584 DEBUG:teuthology.parallel:result is None 2023-07-09T21:50:38.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2023-07-09T21:50:38.588 DEBUG:teuthology.parallel:result is None 2023-07-09T21:50:38.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2023-07-09T21:50:38.589 DEBUG:teuthology.parallel:result is None 2023-07-09T21:50:38.589 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-09T21:50:38.590 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:50:38.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.827+0000 7f28937ff700 1 Processor -- start 2023-07-09T21:50:38.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.827+0000 7f28937ff700 1 -- start start 2023-07-09T21:50:38.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.828+0000 7f28937ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f288c0b1e00 0x7f288c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.828+0000 7f28937ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f288c0b2350 0x7f288c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.828+0000 7f28937ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288c0d1050 0x7f288c0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.828+0000 7f28937ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c0d14d0 con 0x7f288c0b1e00 2023-07-09T21:50:38.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.828+0000 7f28937ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c0d2ce0 con 0x7f288c0b2350 2023-07-09T21:50:38.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.828+0000 7f28937ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0b3350 con 0x7f288c0d1050 2023-07-09T21:50:38.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.828+0000 7f289159b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f288c0b1e00 0x7f288c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.829+0000 7f289159b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f288c0b1e00 0x7f288c0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53088/0 (socket says 172.21.15.53:53088) 2023-07-09T21:50:38.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.829+0000 7f289159b700 1 -- 172.21.15.53:0/2642854242 learned_addr learned my addr 172.21.15.53:0/2642854242 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.829+0000 7f2891d9c700 1 --2- 172.21.15.53:0/2642854242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288c0d1050 0x7f288c0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.829+0000 7f2890d9a700 1 --2- 172.21.15.53:0/2642854242 >> v2:172.21.15.184:3300/0 conn(0x7f288c0b2350 0x7f288c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.829+0000 7f289159b700 1 -- 172.21.15.53:0/2642854242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288c0d1050 msgr2=0x7f288c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:38.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.829+0000 7f289159b700 1 --2- 172.21.15.53:0/2642854242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288c0d1050 0x7f288c0afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.829+0000 7f289159b700 1 -- 172.21.15.53:0/2642854242 >> v2:172.21.15.184:3300/0 conn(0x7f288c0b2350 msgr2=0x7f288c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:38.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.829+0000 7f289159b700 1 --2- 172.21.15.53:0/2642854242 >> v2:172.21.15.184:3300/0 conn(0x7f288c0b2350 0x7f288c0d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.829+0000 7f289159b700 1 -- 172.21.15.53:0/2642854242 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c0b3630 con 0x7f288c0b1e00 2023-07-09T21:50:38.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.829+0000 7f289159b700 1 --2- 172.21.15.53:0/2642854242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288c0b1e00 0x7f288c0b43f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f288c072140 tx=0x7f2888009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92aabe81c4d9f991 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.829+0000 7f2883fff700 1 -- 172.21.15.53:0/2642854242 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800b8a0 con 0x7f288c0b1e00 2023-07-09T21:50:38.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.829+0000 7f2883fff700 1 -- 172.21.15.53:0/2642854242 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288800ba00 con 0x7f288c0b1e00 2023-07-09T21:50:38.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.829+0000 7f2883fff700 1 -- 172.21.15.53:0/2642854242 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800bdb0 con 0x7f288c0b1e00 2023-07-09T21:50:38.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.830+0000 7f28937ff700 1 -- 172.21.15.53:0/2642854242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288c0b1e00 msgr2=0x7f288c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.830+0000 7f28937ff700 1 --2- 172.21.15.53:0/2642854242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288c0b1e00 0x7f288c0b43f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f288c072140 tx=0x7f2888009bc0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.830+0000 7f28937ff700 1 -- 172.21.15.53:0/2642854242 shutdown_connections 2023-07-09T21:50:38.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.830+0000 7f28937ff700 1 --2- 172.21.15.53:0/2642854242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288c0d1050 0x7f288c0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.830+0000 7f28937ff700 1 --2- 172.21.15.53:0/2642854242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288c0b1e00 0x7f288c0b43f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.830+0000 7f28937ff700 1 --2- 172.21.15.53:0/2642854242 >> v2:172.21.15.184:3300/0 conn(0x7f288c0b2350 0x7f288c0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.830+0000 7f28937ff700 1 -- 172.21.15.53:0/2642854242 >> 172.21.15.53:0/2642854242 conn(0x7f288c09c1d0 msgr2=0x7f288c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:38.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.830+0000 7f28937ff700 1 -- 172.21.15.53:0/2642854242 shutdown_connections 2023-07-09T21:50:38.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.830+0000 7f28937ff700 1 -- 172.21.15.53:0/2642854242 wait complete. 2023-07-09T21:50:38.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.832+0000 7f28937ff700 1 Processor -- start 2023-07-09T21:50:38.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.832+0000 7f28937ff700 1 -- start start 2023-07-09T21:50:38.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.833+0000 7f28937ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288c0b1e00 0x7f288c0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.833+0000 7f28937ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288c0b2350 0x7f288c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.833+0000 7f28937ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f288c0d1050 0x7f288c15d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.833+0000 7f28937ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c1f1ea0 con 0x7f288c0b2350 2023-07-09T21:50:38.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.833+0000 7f28937ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c15ecb0 con 0x7f288c0d1050 2023-07-09T21:50:38.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.833+0000 7f28937ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c15cea0 con 0x7f288c0b1e00 2023-07-09T21:50:38.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.833+0000 7f2890d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288c0b2350 0x7f288c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.833+0000 7f2890d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288c0b2350 0x7f288c15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53090/0 (socket says 172.21.15.53:53090) 2023-07-09T21:50:38.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.833+0000 7f2890d9a700 1 -- 172.21.15.53:0/1866371018 learned_addr learned my addr 172.21.15.53:0/1866371018 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:38.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.833+0000 7f2891d9c700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f288c0d1050 0x7f288c15d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.833+0000 7f289159b700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288c0b1e00 0x7f288c0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.834+0000 7f2890d9a700 1 -- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288c0b1e00 msgr2=0x7f288c0c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.834+0000 7f2890d9a700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288c0b1e00 0x7f288c0c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.834+0000 7f2890d9a700 1 -- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f288c0d1050 msgr2=0x7f288c15d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:38.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.834+0000 7f2890d9a700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f288c0d1050 0x7f288c15d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:38.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.834+0000 7f2890d9a700 1 -- 172.21.15.53:0/1866371018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880094f0 con 0x7f288c0b2350 2023-07-09T21:50:38.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.834+0000 7f2890d9a700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288c0b2350 0x7f288c15e430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f287c00d800 tx=0x7f287c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.834+0000 7f2881ffb700 1 -- 172.21.15.53:0/1866371018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0125f0 con 0x7f288c0b2350 2023-07-09T21:50:38.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.834+0000 7f2881ffb700 1 -- 172.21.15.53:0/1866371018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c012750 con 0x7f288c0b2350 2023-07-09T21:50:38.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.834+0000 7f28937ff700 1 -- 172.21.15.53:0/1866371018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288c15d180 con 0x7f288c0b2350 2023-07-09T21:50:38.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.834+0000 7f2881ffb700 1 -- 172.21.15.53:0/1866371018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c012ae0 con 0x7f288c0b2350 2023-07-09T21:50:38.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.834+0000 7f28937ff700 1 -- 172.21.15.53:0/1866371018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288c15ef90 con 0x7f288c0b2350 2023-07-09T21:50:38.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.835+0000 7f28937ff700 1 -- 172.21.15.53:0/1866371018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288c15d7d0 con 0x7f288c0b2350 2023-07-09T21:50:38.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.836+0000 7f2881ffb700 1 -- 172.21.15.53:0/1866371018 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f287c012c40 con 0x7f288c0b2350 2023-07-09T21:50:38.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.837+0000 7f2881ffb700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f287006ace0 0x7f287006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:38.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.837+0000 7f2881ffb700 1 -- 172.21.15.53:0/1866371018 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f287c0894c0 con 0x7f288c0b2350 2023-07-09T21:50:38.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.838+0000 7f289159b700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f287006ace0 0x7f287006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:38.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.838+0000 7f289159b700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f287006ace0 0x7f287006d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2888009c00 tx=0x7f2888008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:38.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:38.842+0000 7f2881ffb700 1 -- 172.21.15.53:0/1866371018 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f287c054580 con 0x7f288c0b2350 2023-07-09T21:50:39.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.048+0000 7f28937ff700 1 -- 172.21.15.53:0/1866371018 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f288c15d010 con 0x7f287006ace0 2023-07-09T21:50:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.057+0000 7f2881ffb700 1 -- 172.21.15.53:0/1866371018 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286528 (secure 0 0 0) 0x7f288c15d010 con 0x7f287006ace0 2023-07-09T21:50:39.061 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.061+0000 7f28937ff700 1 -- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f287006ace0 msgr2=0x7f287006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.061+0000 7f28937ff700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f287006ace0 0x7f287006d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2888009c00 tx=0x7f2888008030 comp rx=0 tx=0).stop 2023-07-09T21:50:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.061+0000 7f28937ff700 1 -- 172.21.15.53:0/1866371018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288c0b2350 msgr2=0x7f288c15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.061+0000 7f28937ff700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288c0b2350 0x7f288c15e430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f287c00d800 tx=0x7f287c00db10 comp rx=0 tx=0).stop 2023-07-09T21:50:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.061+0000 7f28937ff700 1 -- 172.21.15.53:0/1866371018 shutdown_connections 2023-07-09T21:50:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.061+0000 7f28937ff700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f287006ace0 0x7f287006d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.061+0000 7f28937ff700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f288c0d1050 0x7f288c15d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.061+0000 7f28937ff700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288c0b1e00 0x7f288c0c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.061+0000 7f28937ff700 1 --2- 172.21.15.53:0/1866371018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288c0b2350 0x7f288c15e430 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.061+0000 7f28937ff700 1 -- 172.21.15.53:0/1866371018 >> 172.21.15.53:0/1866371018 conn(0x7f288c09c1d0 msgr2=0x7f288c0b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:39.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.061+0000 7f28937ff700 1 -- 172.21.15.53:0/1866371018 shutdown_connections 2023-07-09T21:50:39.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.062+0000 7f28937ff700 1 -- 172.21.15.53:0/1866371018 wait complete. 2023-07-09T21:50:39.065 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:50:39.081 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-07-09T21:50:38.854700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222952,"kb_used_data":3240,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751768,"statfs":{"total":773094113280,"available":772865810432,"internally_reserved":0,"allocated":3317760,"data_stored":1961500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003221"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401409+0000","last_change":"2023-07-09T21:50:23.789471+0000","last_active":"2023-07-09T21:50:25.401409+0000","last_peered":"2023-07-09T21:50:25.401409+0000","last_clean":"2023-07-09T21:50:25.401409+0000","last_became_active":"2023-07-09T21:50:23.789178+0000","last_became_peered":"2023-07-09T21:50:23.789178+0000","last_unstale":"2023-07-09T21:50:25.401409+0000","last_undegraded":"2023-07-09T21:50:25.401409+0000","last_fullsized":"2023-07-09T21:50:25.401409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:24.789777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771695+0000","last_change":"2023-07-09T21:50:23.789721+0000","last_active":"2023-07-09T21:50:24.771695+0000","last_peered":"2023-07-09T21:50:24.771695+0000","last_clean":"2023-07-09T21:50:24.771695+0000","last_became_active":"2023-07-09T21:50:23.789478+0000","last_became_peered":"2023-07-09T21:50:23.789478+0000","last_unstale":"2023-07-09T21:50:24.771695+0000","last_undegraded":"2023-07-09T21:50:24.771695+0000","last_fullsized":"2023-07-09T21:50:24.771695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778489+0000","last_change":"2023-07-09T21:50:23.792566+0000","last_active":"2023-07-09T21:50:24.778489+0000","last_peered":"2023-07-09T21:50:24.778489+0000","last_clean":"2023-07-09T21:50:24.778489+0000","last_became_active":"2023-07-09T21:50:23.792316+0000","last_became_peered":"2023-07-09T21:50:23.792316+0000","last_unstale":"2023-07-09T21:50:24.778489+0000","last_undegraded":"2023-07-09T21:50:24.778489+0000","last_fullsized":"2023-07-09T21:50:24.778489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:33.584119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401848+0000","last_change":"2023-07-09T21:50:23.790737+0000","last_active":"2023-07-09T21:50:25.401848+0000","last_peered":"2023-07-09T21:50:25.401848+0000","last_clean":"2023-07-09T21:50:25.401848+0000","last_became_active":"2023-07-09T21:50:23.790455+0000","last_became_peered":"2023-07-09T21:50:23.790455+0000","last_unstale":"2023-07-09T21:50:25.401848+0000","last_undegraded":"2023-07-09T21:50:25.401848+0000","last_fullsized":"2023-07-09T21:50:25.401848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:33:28.169248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771850+0000","last_change":"2023-07-09T21:50:23.799889+0000","last_active":"2023-07-09T21:50:24.771850+0000","last_peered":"2023-07-09T21:50:24.771850+0000","last_clean":"2023-07-09T21:50:24.771850+0000","last_became_active":"2023-07-09T21:50:23.798717+0000","last_became_peered":"2023-07-09T21:50:23.798717+0000","last_unstale":"2023-07-09T21:50:24.771850+0000","last_undegraded":"2023-07-09T21:50:24.771850+0000","last_fullsized":"2023-07-09T21:50:24.771850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:25.755232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778099+0000","last_change":"2023-07-09T21:50:23.798790+0000","last_active":"2023-07-09T21:50:24.778099+0000","last_peered":"2023-07-09T21:50:24.778099+0000","last_clean":"2023-07-09T21:50:24.778099+0000","last_became_active":"2023-07-09T21:50:23.798508+0000","last_became_peered":"2023-07-09T21:50:23.798508+0000","last_unstale":"2023-07-09T21:50:24.778099+0000","last_undegraded":"2023-07-09T21:50:24.778099+0000","last_fullsized":"2023-07-09T21:50:24.778099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:25.755232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094158+0000","last_change":"2023-07-09T21:50:23.791148+0000","last_active":"2023-07-09T21:50:25.094158+0000","last_peered":"2023-07-09T21:50:25.094158+0000","last_clean":"2023-07-09T21:50:25.094158+0000","last_became_active":"2023-07-09T21:50:23.790530+0000","last_became_peered":"2023-07-09T21:50:23.790530+0000","last_unstale":"2023-07-09T21:50:25.094158+0000","last_undegraded":"2023-07-09T21:50:25.094158+0000","last_fullsized":"2023-07-09T21:50:25.094158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771365+0000","last_change":"2023-07-09T21:50:23.786451+0000","last_active":"2023-07-09T21:50:24.771365+0000","last_peered":"2023-07-09T21:50:24.771365+0000","last_clean":"2023-07-09T21:50:24.771365+0000","last_became_active":"2023-07-09T21:50:23.786150+0000","last_became_peered":"2023-07-09T21:50:23.786150+0000","last_unstale":"2023-07-09T21:50:24.771365+0000","last_undegraded":"2023-07-09T21:50:24.771365+0000","last_fullsized":"2023-07-09T21:50:24.771365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773128+0000","last_change":"2023-07-09T21:50:23.799651+0000","last_active":"2023-07-09T21:50:24.773128+0000","last_peered":"2023-07-09T21:50:24.773128+0000","last_clean":"2023-07-09T21:50:24.773128+0000","last_became_active":"2023-07-09T21:50:23.799306+0000","last_became_peered":"2023-07-09T21:50:23.799306+0000","last_unstale":"2023-07-09T21:50:24.773128+0000","last_undegraded":"2023-07-09T21:50:24.773128+0000","last_fullsized":"2023-07-09T21:50:24.773128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:06.841347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772154+0000","last_change":"2023-07-09T21:50:23.807058+0000","last_active":"2023-07-09T21:50:24.772154+0000","last_peered":"2023-07-09T21:50:24.772154+0000","last_clean":"2023-07-09T21:50:24.772154+0000","last_became_active":"2023-07-09T21:50:23.805775+0000","last_became_peered":"2023-07-09T21:50:23.805775+0000","last_unstale":"2023-07-09T21:50:24.772154+0000","last_undegraded":"2023-07-09T21:50:24.772154+0000","last_fullsized":"2023-07-09T21:50:24.772154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:16.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778566+0000","last_change":"2023-07-09T21:50:23.787617+0000","last_active":"2023-07-09T21:50:24.778566+0000","last_peered":"2023-07-09T21:50:24.778566+0000","last_clean":"2023-07-09T21:50:24.778566+0000","last_became_active":"2023-07-09T21:50:23.787324+0000","last_became_peered":"2023-07-09T21:50:23.787324+0000","last_unstale":"2023-07-09T21:50:24.778566+0000","last_undegraded":"2023-07-09T21:50:24.778566+0000","last_fullsized":"2023-07-09T21:50:24.778566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:54.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401442+0000","last_change":"2023-07-09T21:50:23.786780+0000","last_active":"2023-07-09T21:50:25.401442+0000","last_peered":"2023-07-09T21:50:25.401442+0000","last_clean":"2023-07-09T21:50:25.401442+0000","last_became_active":"2023-07-09T21:50:23.786285+0000","last_became_peered":"2023-07-09T21:50:23.786285+0000","last_unstale":"2023-07-09T21:50:25.401442+0000","last_undegraded":"2023-07-09T21:50:25.401442+0000","last_fullsized":"2023-07-09T21:50:25.401442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:17:28.990837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401348+0000","last_change":"2023-07-09T21:50:23.779777+0000","last_active":"2023-07-09T21:50:25.401348+0000","last_peered":"2023-07-09T21:50:25.401348+0000","last_clean":"2023-07-09T21:50:25.401348+0000","last_became_active":"2023-07-09T21:50:23.779402+0000","last_became_peered":"2023-07-09T21:50:23.779402+0000","last_unstale":"2023-07-09T21:50:25.401348+0000","last_undegraded":"2023-07-09T21:50:25.401348+0000","last_fullsized":"2023-07-09T21:50:25.401348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:28.676168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771883+0000","last_change":"2023-07-09T21:50:23.785342+0000","last_active":"2023-07-09T21:50:24.771883+0000","last_peered":"2023-07-09T21:50:24.771883+0000","last_clean":"2023-07-09T21:50:24.771883+0000","last_became_active":"2023-07-09T21:50:23.785042+0000","last_became_peered":"2023-07-09T21:50:23.785042+0000","last_unstale":"2023-07-09T21:50:24.771883+0000","last_undegraded":"2023-07-09T21:50:24.771883+0000","last_fullsized":"2023-07-09T21:50:24.771883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:33.584119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094514+0000","last_change":"2023-07-09T21:50:23.791304+0000","last_active":"2023-07-09T21:50:25.094514+0000","last_peered":"2023-07-09T21:50:25.094514+0000","last_clean":"2023-07-09T21:50:25.094514+0000","last_became_active":"2023-07-09T21:50:23.790881+0000","last_became_peered":"2023-07-09T21:50:23.790881+0000","last_unstale":"2023-07-09T21:50:25.094514+0000","last_undegraded":"2023-07-09T21:50:25.094514+0000","last_fullsized":"2023-07-09T21:50:25.094514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:53:11.882162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778107+0000","last_change":"2023-07-09T21:50:23.792844+0000","last_active":"2023-07-09T21:50:24.778107+0000","last_peered":"2023-07-09T21:50:24.778107+0000","last_clean":"2023-07-09T21:50:24.778107+0000","last_became_active":"2023-07-09T21:50:23.792511+0000","last_became_peered":"2023-07-09T21:50:23.792511+0000","last_unstale":"2023-07-09T21:50:24.778107+0000","last_undegraded":"2023-07-09T21:50:24.778107+0000","last_fullsized":"2023-07-09T21:50:24.778107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:11.492653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773086+0000","last_change":"2023-07-09T21:50:23.801511+0000","last_active":"2023-07-09T21:50:24.773086+0000","last_peered":"2023-07-09T21:50:24.773086+0000","last_clean":"2023-07-09T21:50:24.773086+0000","last_became_active":"2023-07-09T21:50:23.799945+0000","last_became_peered":"2023-07-09T21:50:23.799945+0000","last_unstale":"2023-07-09T21:50:24.773086+0000","last_undegraded":"2023-07-09T21:50:24.773086+0000","last_fullsized":"2023-07-09T21:50:24.773086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:30.584499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778726+0000","last_change":"2023-07-09T21:50:23.791210+0000","last_active":"2023-07-09T21:50:24.778726+0000","last_peered":"2023-07-09T21:50:24.778726+0000","last_clean":"2023-07-09T21:50:24.778726+0000","last_became_active":"2023-07-09T21:50:23.790958+0000","last_became_peered":"2023-07-09T21:50:23.790958+0000","last_unstale":"2023-07-09T21:50:24.778726+0000","last_undegraded":"2023-07-09T21:50:24.778726+0000","last_fullsized":"2023-07-09T21:50:24.778726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:16.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401359+0000","last_change":"2023-07-09T21:50:23.781367+0000","last_active":"2023-07-09T21:50:25.401359+0000","last_peered":"2023-07-09T21:50:25.401359+0000","last_clean":"2023-07-09T21:50:25.401359+0000","last_became_active":"2023-07-09T21:50:23.781111+0000","last_became_peered":"2023-07-09T21:50:23.781111+0000","last_unstale":"2023-07-09T21:50:25.401359+0000","last_undegraded":"2023-07-09T21:50:25.401359+0000","last_fullsized":"2023-07-09T21:50:25.401359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:23.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778348+0000","last_change":"2023-07-09T21:50:23.788775+0000","last_active":"2023-07-09T21:50:24.778348+0000","last_peered":"2023-07-09T21:50:24.778348+0000","last_clean":"2023-07-09T21:50:24.778348+0000","last_became_active":"2023-07-09T21:50:23.788474+0000","last_became_peered":"2023-07-09T21:50:23.788474+0000","last_unstale":"2023-07-09T21:50:24.778348+0000","last_undegraded":"2023-07-09T21:50:24.778348+0000","last_fullsized":"2023-07-09T21:50:24.778348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094336+0000","last_change":"2023-07-09T21:50:23.782607+0000","last_active":"2023-07-09T21:50:25.094336+0000","last_peered":"2023-07-09T21:50:25.094336+0000","last_clean":"2023-07-09T21:50:25.094336+0000","last_became_active":"2023-07-09T21:50:23.782315+0000","last_became_peered":"2023-07-09T21:50:23.782315+0000","last_unstale":"2023-07-09T21:50:25.094336+0000","last_undegraded":"2023-07-09T21:50:25.094336+0000","last_fullsized":"2023-07-09T21:50:25.094336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:36.220738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771811+0000","last_change":"2023-07-09T21:50:23.796236+0000","last_active":"2023-07-09T21:50:24.771811+0000","last_peered":"2023-07-09T21:50:24.771811+0000","last_clean":"2023-07-09T21:50:24.771811+0000","last_became_active":"2023-07-09T21:50:23.795910+0000","last_became_peered":"2023-07-09T21:50:23.795910+0000","last_unstale":"2023-07-09T21:50:24.771811+0000","last_undegraded":"2023-07-09T21:50:24.771811+0000","last_fullsized":"2023-07-09T21:50:24.771811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770483+0000","last_change":"2023-07-09T21:50:23.795797+0000","last_active":"2023-07-09T21:50:24.770483+0000","last_peered":"2023-07-09T21:50:24.770483+0000","last_clean":"2023-07-09T21:50:24.770483+0000","last_became_active":"2023-07-09T21:50:23.795569+0000","last_became_peered":"2023-07-09T21:50:23.795569+0000","last_unstale":"2023-07-09T21:50:24.770483+0000","last_undegraded":"2023-07-09T21:50:24.770483+0000","last_fullsized":"2023-07-09T21:50:24.770483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094493+0000","last_change":"2023-07-09T21:50:23.782770+0000","last_active":"2023-07-09T21:50:25.094493+0000","last_peered":"2023-07-09T21:50:25.094493+0000","last_clean":"2023-07-09T21:50:25.094493+0000","last_became_active":"2023-07-09T21:50:23.782509+0000","last_became_peered":"2023-07-09T21:50:23.782509+0000","last_unstale":"2023-07-09T21:50:25.094493+0000","last_undegraded":"2023-07-09T21:50:25.094493+0000","last_fullsized":"2023-07-09T21:50:25.094493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:48:23.282646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832925+0000","last_change":"2023-07-09T21:50:23.785433+0000","last_active":"2023-07-09T21:50:24.832925+0000","last_peered":"2023-07-09T21:50:24.832925+0000","last_clean":"2023-07-09T21:50:24.832925+0000","last_became_active":"2023-07-09T21:50:23.785016+0000","last_became_peered":"2023-07-09T21:50:23.785016+0000","last_unstale":"2023-07-09T21:50:24.832925+0000","last_undegraded":"2023-07-09T21:50:24.832925+0000","last_fullsized":"2023-07-09T21:50:24.832925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:17:59.220999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833073+0000","last_change":"2023-07-09T21:50:23.781394+0000","last_active":"2023-07-09T21:50:24.833073+0000","last_peered":"2023-07-09T21:50:24.833073+0000","last_clean":"2023-07-09T21:50:24.833073+0000","last_became_active":"2023-07-09T21:50:23.781089+0000","last_became_peered":"2023-07-09T21:50:23.781089+0000","last_unstale":"2023-07-09T21:50:24.833073+0000","last_undegraded":"2023-07-09T21:50:24.833073+0000","last_fullsized":"2023-07-09T21:50:24.833073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:06:48.939947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771627+0000","last_change":"2023-07-09T21:50:23.783556+0000","last_active":"2023-07-09T21:50:24.771627+0000","last_peered":"2023-07-09T21:50:24.771627+0000","last_clean":"2023-07-09T21:50:24.771627+0000","last_became_active":"2023-07-09T21:50:23.783277+0000","last_became_peered":"2023-07-09T21:50:23.783277+0000","last_unstale":"2023-07-09T21:50:24.771627+0000","last_undegraded":"2023-07-09T21:50:24.771627+0000","last_fullsized":"2023-07-09T21:50:24.771627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.148959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778480+0000","last_change":"2023-07-09T21:50:22.774935+0000","last_active":"2023-07-09T21:50:24.778480+0000","last_peered":"2023-07-09T21:50:24.778480+0000","last_clean":"2023-07-09T21:50:24.778480+0000","last_became_active":"2023-07-09T21:50:22.774612+0000","last_became_peered":"2023-07-09T21:50:22.774612+0000","last_unstale":"2023-07-09T21:50:24.778480+0000","last_undegraded":"2023-07-09T21:50:24.778480+0000","last_fullsized":"2023-07-09T21:50:24.778480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:05.547490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770699+0000","last_change":"2023-07-09T21:50:23.777644+0000","last_active":"2023-07-09T21:50:24.770699+0000","last_peered":"2023-07-09T21:50:24.770699+0000","last_clean":"2023-07-09T21:50:24.770699+0000","last_became_active":"2023-07-09T21:50:23.777372+0000","last_became_peered":"2023-07-09T21:50:23.777372+0000","last_unstale":"2023-07-09T21:50:24.770699+0000","last_undegraded":"2023-07-09T21:50:24.770699+0000","last_fullsized":"2023-07-09T21:50:24.770699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:06.551761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832895+0000","last_change":"2023-07-09T21:50:22.772852+0000","last_active":"2023-07-09T21:50:24.832895+0000","last_peered":"2023-07-09T21:50:24.832895+0000","last_clean":"2023-07-09T21:50:24.832895+0000","last_became_active":"2023-07-09T21:50:22.772592+0000","last_became_peered":"2023-07-09T21:50:22.772592+0000","last_unstale":"2023-07-09T21:50:24.832895+0000","last_undegraded":"2023-07-09T21:50:24.832895+0000","last_fullsized":"2023-07-09T21:50:24.832895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:10:40.034217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773185+0000","last_change":"2023-07-09T21:50:23.802442+0000","last_active":"2023-07-09T21:50:24.773185+0000","last_peered":"2023-07-09T21:50:24.773185+0000","last_clean":"2023-07-09T21:50:24.773185+0000","last_became_active":"2023-07-09T21:50:23.801644+0000","last_became_peered":"2023-07-09T21:50:23.801644+0000","last_unstale":"2023-07-09T21:50:24.773185+0000","last_undegraded":"2023-07-09T21:50:24.773185+0000","last_fullsized":"2023-07-09T21:50:24.773185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:13.602484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770485+0000","last_change":"2023-07-09T21:50:22.771300+0000","last_active":"2023-07-09T21:50:24.770485+0000","last_peered":"2023-07-09T21:50:24.770485+0000","last_clean":"2023-07-09T21:50:24.770485+0000","last_became_active":"2023-07-09T21:50:22.770639+0000","last_became_peered":"2023-07-09T21:50:22.770639+0000","last_unstale":"2023-07-09T21:50:24.770485+0000","last_undegraded":"2023-07-09T21:50:24.770485+0000","last_fullsized":"2023-07-09T21:50:24.770485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:29.580228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401889+0000","last_change":"2023-07-09T21:50:23.783801+0000","last_active":"2023-07-09T21:50:25.401889+0000","last_peered":"2023-07-09T21:50:25.401889+0000","last_clean":"2023-07-09T21:50:25.401889+0000","last_became_active":"2023-07-09T21:50:23.783545+0000","last_became_peered":"2023-07-09T21:50:23.783545+0000","last_unstale":"2023-07-09T21:50:25.401889+0000","last_undegraded":"2023-07-09T21:50:25.401889+0000","last_fullsized":"2023-07-09T21:50:25.401889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:44:36.986572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773224+0000","last_change":"2023-07-09T21:50:22.781881+0000","last_active":"2023-07-09T21:50:24.773224+0000","last_peered":"2023-07-09T21:50:24.773224+0000","last_clean":"2023-07-09T21:50:24.773224+0000","last_became_active":"2023-07-09T21:50:22.781553+0000","last_became_peered":"2023-07-09T21:50:22.781553+0000","last_unstale":"2023-07-09T21:50:24.773224+0000","last_undegraded":"2023-07-09T21:50:24.773224+0000","last_fullsized":"2023-07-09T21:50:24.773224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:32.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770398+0000","last_change":"2023-07-09T21:50:23.782080+0000","last_active":"2023-07-09T21:50:24.770398+0000","last_peered":"2023-07-09T21:50:24.770398+0000","last_clean":"2023-07-09T21:50:24.770398+0000","last_became_active":"2023-07-09T21:50:23.781769+0000","last_became_peered":"2023-07-09T21:50:23.781769+0000","last_unstale":"2023-07-09T21:50:24.770398+0000","last_undegraded":"2023-07-09T21:50:24.770398+0000","last_fullsized":"2023-07-09T21:50:24.770398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.148959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771796+0000","last_change":"2023-07-09T21:50:22.775466+0000","last_active":"2023-07-09T21:50:24.771796+0000","last_peered":"2023-07-09T21:50:24.771796+0000","last_clean":"2023-07-09T21:50:24.771796+0000","last_became_active":"2023-07-09T21:50:22.775189+0000","last_became_peered":"2023-07-09T21:50:22.775189+0000","last_unstale":"2023-07-09T21:50:24.771796+0000","last_undegraded":"2023-07-09T21:50:24.771796+0000","last_fullsized":"2023-07-09T21:50:24.771796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:29.580228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771009+0000","last_change":"2023-07-09T21:50:23.776973+0000","last_active":"2023-07-09T21:50:24.771009+0000","last_peered":"2023-07-09T21:50:24.771009+0000","last_clean":"2023-07-09T21:50:24.771009+0000","last_became_active":"2023-07-09T21:50:23.776468+0000","last_became_peered":"2023-07-09T21:50:23.776468+0000","last_unstale":"2023-07-09T21:50:24.771009+0000","last_undegraded":"2023-07-09T21:50:24.771009+0000","last_fullsized":"2023-07-09T21:50:24.771009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:54.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094368+0000","last_change":"2023-07-09T21:50:22.776755+0000","last_active":"2023-07-09T21:50:25.094368+0000","last_peered":"2023-07-09T21:50:25.094368+0000","last_clean":"2023-07-09T21:50:25.094368+0000","last_became_active":"2023-07-09T21:50:22.776393+0000","last_became_peered":"2023-07-09T21:50:22.776393+0000","last_unstale":"2023-07-09T21:50:25.094368+0000","last_undegraded":"2023-07-09T21:50:25.094368+0000","last_fullsized":"2023-07-09T21:50:25.094368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:15.389440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832675+0000","last_change":"2023-07-09T21:50:23.781306+0000","last_active":"2023-07-09T21:50:24.832675+0000","last_peered":"2023-07-09T21:50:24.832675+0000","last_clean":"2023-07-09T21:50:24.832675+0000","last_became_active":"2023-07-09T21:50:23.781040+0000","last_became_peered":"2023-07-09T21:50:23.781040+0000","last_unstale":"2023-07-09T21:50:24.832675+0000","last_undegraded":"2023-07-09T21:50:24.832675+0000","last_fullsized":"2023-07-09T21:50:24.832675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:57:55.663222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778655+0000","last_change":"2023-07-09T21:50:22.778707+0000","last_active":"2023-07-09T21:50:24.778655+0000","last_peered":"2023-07-09T21:50:24.778655+0000","last_clean":"2023-07-09T21:50:24.778655+0000","last_became_active":"2023-07-09T21:50:22.778397+0000","last_became_peered":"2023-07-09T21:50:22.778397+0000","last_unstale":"2023-07-09T21:50:24.778655+0000","last_undegraded":"2023-07-09T21:50:24.778655+0000","last_fullsized":"2023-07-09T21:50:24.778655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:26.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778898+0000","last_change":"2023-07-09T21:50:23.793887+0000","last_active":"2023-07-09T21:50:24.778898+0000","last_peered":"2023-07-09T21:50:24.778898+0000","last_clean":"2023-07-09T21:50:24.778898+0000","last_became_active":"2023-07-09T21:50:23.793626+0000","last_became_peered":"2023-07-09T21:50:23.793626+0000","last_unstale":"2023-07-09T21:50:24.778898+0000","last_undegraded":"2023-07-09T21:50:24.778898+0000","last_fullsized":"2023-07-09T21:50:24.778898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:21:17.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094228+0000","last_change":"2023-07-09T21:50:22.781947+0000","last_active":"2023-07-09T21:50:25.094228+0000","last_peered":"2023-07-09T21:50:25.094228+0000","last_clean":"2023-07-09T21:50:25.094228+0000","last_became_active":"2023-07-09T21:50:22.780676+0000","last_became_peered":"2023-07-09T21:50:22.780676+0000","last_unstale":"2023-07-09T21:50:25.094228+0000","last_undegraded":"2023-07-09T21:50:25.094228+0000","last_fullsized":"2023-07-09T21:50:25.094228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:47:53.248634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770793+0000","last_change":"2023-07-09T21:50:23.788674+0000","last_active":"2023-07-09T21:50:24.770793+0000","last_peered":"2023-07-09T21:50:24.770793+0000","last_clean":"2023-07-09T21:50:24.770793+0000","last_became_active":"2023-07-09T21:50:23.788306+0000","last_became_peered":"2023-07-09T21:50:23.788306+0000","last_unstale":"2023-07-09T21:50:24.770793+0000","last_undegraded":"2023-07-09T21:50:24.770793+0000","last_fullsized":"2023-07-09T21:50:24.770793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771654+0000","last_change":"2023-07-09T21:50:22.777294+0000","last_active":"2023-07-09T21:50:24.771654+0000","last_peered":"2023-07-09T21:50:24.771654+0000","last_clean":"2023-07-09T21:50:24.771654+0000","last_became_active":"2023-07-09T21:50:22.776308+0000","last_became_peered":"2023-07-09T21:50:22.776308+0000","last_unstale":"2023-07-09T21:50:24.771654+0000","last_undegraded":"2023-07-09T21:50:24.771654+0000","last_fullsized":"2023-07-09T21:50:24.771654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:10.488382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771772+0000","last_change":"2023-07-09T21:50:23.782217+0000","last_active":"2023-07-09T21:50:24.771772+0000","last_peered":"2023-07-09T21:50:24.771772+0000","last_clean":"2023-07-09T21:50:24.771772+0000","last_became_active":"2023-07-09T21:50:23.781948+0000","last_became_peered":"2023-07-09T21:50:23.781948+0000","last_unstale":"2023-07-09T21:50:24.771772+0000","last_undegraded":"2023-07-09T21:50:24.771772+0000","last_fullsized":"2023-07-09T21:50:24.771772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094393+0000","last_change":"2023-07-09T21:50:22.780710+0000","last_active":"2023-07-09T21:50:25.094393+0000","last_peered":"2023-07-09T21:50:25.094393+0000","last_clean":"2023-07-09T21:50:25.094393+0000","last_became_active":"2023-07-09T21:50:22.780392+0000","last_became_peered":"2023-07-09T21:50:22.780392+0000","last_unstale":"2023-07-09T21:50:25.094393+0000","last_undegraded":"2023-07-09T21:50:25.094393+0000","last_fullsized":"2023-07-09T21:50:25.094393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:08.834959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773173+0000","last_change":"2023-07-09T21:50:23.803234+0000","last_active":"2023-07-09T21:50:24.773173+0000","last_peered":"2023-07-09T21:50:24.773173+0000","last_clean":"2023-07-09T21:50:24.773173+0000","last_became_active":"2023-07-09T21:50:23.802407+0000","last_became_peered":"2023-07-09T21:50:23.802407+0000","last_unstale":"2023-07-09T21:50:24.773173+0000","last_undegraded":"2023-07-09T21:50:24.773173+0000","last_fullsized":"2023-07-09T21:50:24.773173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:06.551761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401477+0000","last_change":"2023-07-09T21:50:22.770920+0000","last_active":"2023-07-09T21:50:25.401477+0000","last_peered":"2023-07-09T21:50:25.401477+0000","last_clean":"2023-07-09T21:50:25.401477+0000","last_became_active":"2023-07-09T21:50:22.770566+0000","last_became_peered":"2023-07-09T21:50:22.770566+0000","last_unstale":"2023-07-09T21:50:25.401477+0000","last_undegraded":"2023-07-09T21:50:25.401477+0000","last_fullsized":"2023-07-09T21:50:25.401477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:06.181402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771083+0000","last_change":"2023-07-09T21:50:23.786089+0000","last_active":"2023-07-09T21:50:24.771083+0000","last_peered":"2023-07-09T21:50:24.771083+0000","last_clean":"2023-07-09T21:50:24.771083+0000","last_became_active":"2023-07-09T21:50:23.785827+0000","last_became_peered":"2023-07-09T21:50:23.785827+0000","last_unstale":"2023-07-09T21:50:24.771083+0000","last_undegraded":"2023-07-09T21:50:24.771083+0000","last_fullsized":"2023-07-09T21:50:24.771083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:16.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094687+0000","last_change":"2023-07-09T21:50:22.781469+0000","last_active":"2023-07-09T21:50:25.094687+0000","last_peered":"2023-07-09T21:50:25.094687+0000","last_clean":"2023-07-09T21:50:25.094687+0000","last_became_active":"2023-07-09T21:50:22.781215+0000","last_became_peered":"2023-07-09T21:50:22.781215+0000","last_unstale":"2023-07-09T21:50:25.094687+0000","last_undegraded":"2023-07-09T21:50:25.094687+0000","last_fullsized":"2023-07-09T21:50:25.094687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:41:06.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771366+0000","last_change":"2023-07-09T21:50:23.781500+0000","last_active":"2023-07-09T21:50:24.771366+0000","last_peered":"2023-07-09T21:50:24.771366+0000","last_clean":"2023-07-09T21:50:24.771366+0000","last_became_active":"2023-07-09T21:50:23.781247+0000","last_became_peered":"2023-07-09T21:50:23.781247+0000","last_unstale":"2023-07-09T21:50:24.771366+0000","last_undegraded":"2023-07-09T21:50:24.771366+0000","last_fullsized":"2023-07-09T21:50:24.771366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:25.755232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094343+0000","last_change":"2023-07-09T21:50:22.780841+0000","last_active":"2023-07-09T21:50:25.094343+0000","last_peered":"2023-07-09T21:50:25.094343+0000","last_clean":"2023-07-09T21:50:25.094343+0000","last_became_active":"2023-07-09T21:50:22.780287+0000","last_became_peered":"2023-07-09T21:50:22.780287+0000","last_unstale":"2023-07-09T21:50:25.094343+0000","last_undegraded":"2023-07-09T21:50:25.094343+0000","last_fullsized":"2023-07-09T21:50:25.094343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:53.307790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778140+0000","last_change":"2023-07-09T21:50:23.794825+0000","last_active":"2023-07-09T21:50:24.778140+0000","last_peered":"2023-07-09T21:50:24.778140+0000","last_clean":"2023-07-09T21:50:24.778140+0000","last_became_active":"2023-07-09T21:50:23.794372+0000","last_became_peered":"2023-07-09T21:50:23.794372+0000","last_unstale":"2023-07-09T21:50:24.778140+0000","last_undegraded":"2023-07-09T21:50:24.778140+0000","last_fullsized":"2023-07-09T21:50:24.778140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094667+0000","last_change":"2023-07-09T21:50:22.782310+0000","last_active":"2023-07-09T21:50:25.094667+0000","last_peered":"2023-07-09T21:50:25.094667+0000","last_clean":"2023-07-09T21:50:25.094667+0000","last_became_active":"2023-07-09T21:50:22.782041+0000","last_became_peered":"2023-07-09T21:50:22.782041+0000","last_unstale":"2023-07-09T21:50:25.094667+0000","last_undegraded":"2023-07-09T21:50:25.094667+0000","last_fullsized":"2023-07-09T21:50:25.094667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:11:23.436562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401729+0000","last_change":"2023-07-09T21:50:23.789564+0000","last_active":"2023-07-09T21:50:25.401729+0000","last_peered":"2023-07-09T21:50:25.401729+0000","last_clean":"2023-07-09T21:50:25.401729+0000","last_became_active":"2023-07-09T21:50:23.789320+0000","last_became_peered":"2023-07-09T21:50:23.789320+0000","last_unstale":"2023-07-09T21:50:25.401729+0000","last_undegraded":"2023-07-09T21:50:25.401729+0000","last_fullsized":"2023-07-09T21:50:25.401729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:05.934271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771882+0000","last_change":"2023-07-09T21:50:22.769028+0000","last_active":"2023-07-09T21:50:24.771882+0000","last_peered":"2023-07-09T21:50:24.771882+0000","last_clean":"2023-07-09T21:50:24.771882+0000","last_became_active":"2023-07-09T21:50:22.768697+0000","last_became_peered":"2023-07-09T21:50:22.768697+0000","last_unstale":"2023-07-09T21:50:24.771882+0000","last_undegraded":"2023-07-09T21:50:24.771882+0000","last_fullsized":"2023-07-09T21:50:24.771882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:12.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773064+0000","last_change":"2023-07-09T21:50:23.792126+0000","last_active":"2023-07-09T21:50:24.773064+0000","last_peered":"2023-07-09T21:50:24.773064+0000","last_clean":"2023-07-09T21:50:24.773064+0000","last_became_active":"2023-07-09T21:50:23.790182+0000","last_became_peered":"2023-07-09T21:50:23.790182+0000","last_unstale":"2023-07-09T21:50:24.773064+0000","last_undegraded":"2023-07-09T21:50:24.773064+0000","last_fullsized":"2023-07-09T21:50:24.773064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770745+0000","last_change":"2023-07-09T21:50:22.769216+0000","last_active":"2023-07-09T21:50:24.770745+0000","last_peered":"2023-07-09T21:50:24.770745+0000","last_clean":"2023-07-09T21:50:24.770745+0000","last_became_active":"2023-07-09T21:50:22.768893+0000","last_became_peered":"2023-07-09T21:50:22.768893+0000","last_unstale":"2023-07-09T21:50:24.770745+0000","last_undegraded":"2023-07-09T21:50:24.770745+0000","last_fullsized":"2023-07-09T21:50:24.770745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:32.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778315+0000","last_change":"2023-07-09T21:50:23.790525+0000","last_active":"2023-07-09T21:50:24.778315+0000","last_peered":"2023-07-09T21:50:24.778315+0000","last_clean":"2023-07-09T21:50:24.778315+0000","last_became_active":"2023-07-09T21:50:23.790164+0000","last_became_peered":"2023-07-09T21:50:23.790164+0000","last_unstale":"2023-07-09T21:50:24.778315+0000","last_undegraded":"2023-07-09T21:50:24.778315+0000","last_fullsized":"2023-07-09T21:50:24.778315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.148959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401701+0000","last_change":"2023-07-09T21:50:22.779742+0000","last_active":"2023-07-09T21:50:25.401701+0000","last_peered":"2023-07-09T21:50:25.401701+0000","last_clean":"2023-07-09T21:50:25.401701+0000","last_became_active":"2023-07-09T21:50:22.779462+0000","last_became_peered":"2023-07-09T21:50:22.779462+0000","last_unstale":"2023-07-09T21:50:25.401701+0000","last_undegraded":"2023-07-09T21:50:25.401701+0000","last_fullsized":"2023-07-09T21:50:25.401701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:34.301244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778898+0000","last_change":"2023-07-09T21:50:23.793928+0000","last_active":"2023-07-09T21:50:24.778898+0000","last_peered":"2023-07-09T21:50:24.778898+0000","last_clean":"2023-07-09T21:50:24.778898+0000","last_became_active":"2023-07-09T21:50:23.793620+0000","last_became_peered":"2023-07-09T21:50:23.793620+0000","last_unstale":"2023-07-09T21:50:24.778898+0000","last_undegraded":"2023-07-09T21:50:24.778898+0000","last_fullsized":"2023-07-09T21:50:24.778898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:09.839230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778364+0000","last_change":"2023-07-09T21:50:22.772850+0000","last_active":"2023-07-09T21:50:24.778364+0000","last_peered":"2023-07-09T21:50:24.778364+0000","last_clean":"2023-07-09T21:50:24.778364+0000","last_became_active":"2023-07-09T21:50:22.772522+0000","last_became_peered":"2023-07-09T21:50:22.772522+0000","last_unstale":"2023-07-09T21:50:24.778364+0000","last_undegraded":"2023-07-09T21:50:24.778364+0000","last_fullsized":"2023-07-09T21:50:24.778364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:29.580228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778733+0000","last_change":"2023-07-09T21:50:23.787502+0000","last_active":"2023-07-09T21:50:24.778733+0000","last_peered":"2023-07-09T21:50:24.778733+0000","last_clean":"2023-07-09T21:50:24.778733+0000","last_became_active":"2023-07-09T21:50:23.786685+0000","last_became_peered":"2023-07-09T21:50:23.786685+0000","last_unstale":"2023-07-09T21:50:24.778733+0000","last_undegraded":"2023-07-09T21:50:24.778733+0000","last_fullsized":"2023-07-09T21:50:24.778733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:47:54.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770315+0000","last_change":"2023-07-09T21:50:22.769583+0000","last_active":"2023-07-09T21:50:24.770315+0000","last_peered":"2023-07-09T21:50:24.770315+0000","last_clean":"2023-07-09T21:50:24.770315+0000","last_became_active":"2023-07-09T21:50:22.768169+0000","last_became_peered":"2023-07-09T21:50:22.768169+0000","last_unstale":"2023-07-09T21:50:24.770315+0000","last_undegraded":"2023-07-09T21:50:24.770315+0000","last_fullsized":"2023-07-09T21:50:24.770315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:24.750960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833106+0000","last_change":"2023-07-09T21:50:23.784726+0000","last_active":"2023-07-09T21:50:24.833106+0000","last_peered":"2023-07-09T21:50:24.833106+0000","last_clean":"2023-07-09T21:50:24.833106+0000","last_became_active":"2023-07-09T21:50:23.777193+0000","last_became_peered":"2023-07-09T21:50:23.777193+0000","last_unstale":"2023-07-09T21:50:24.833106+0000","last_undegraded":"2023-07-09T21:50:24.833106+0000","last_fullsized":"2023-07-09T21:50:24.833106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:43:56.851579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833107+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:50:24.833107+0000","last_peered":"2023-07-09T21:50:24.833107+0000","last_clean":"2023-07-09T21:50:24.833107+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:50:24.833107+0000","last_undegraded":"2023-07-09T21:50:24.833107+0000","last_fullsized":"2023-07-09T21:50:24.833107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:30:59.285734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771985+0000","last_change":"2023-07-09T21:50:22.772281+0000","last_active":"2023-07-09T21:50:24.771985+0000","last_peered":"2023-07-09T21:50:24.771985+0000","last_clean":"2023-07-09T21:50:24.771985+0000","last_became_active":"2023-07-09T21:50:22.769167+0000","last_became_peered":"2023-07-09T21:50:22.769167+0000","last_unstale":"2023-07-09T21:50:24.771985+0000","last_undegraded":"2023-07-09T21:50:24.771985+0000","last_fullsized":"2023-07-09T21:50:24.771985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:05.547490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832719+0000","last_change":"2023-07-09T21:50:23.783723+0000","last_active":"2023-07-09T21:50:24.832719+0000","last_peered":"2023-07-09T21:50:24.832719+0000","last_clean":"2023-07-09T21:50:24.832719+0000","last_became_active":"2023-07-09T21:50:23.783453+0000","last_became_peered":"2023-07-09T21:50:23.783453+0000","last_unstale":"2023-07-09T21:50:24.832719+0000","last_undegraded":"2023-07-09T21:50:24.832719+0000","last_fullsized":"2023-07-09T21:50:24.832719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:19.725831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771999+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:50:24.771999+0000","last_peered":"2023-07-09T21:50:24.771999+0000","last_clean":"2023-07-09T21:50:24.771999+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:50:24.771999+0000","last_undegraded":"2023-07-09T21:50:24.771999+0000","last_fullsized":"2023-07-09T21:50:24.771999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:48.089970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778477+0000","last_change":"2023-07-09T21:50:22.778044+0000","last_active":"2023-07-09T21:50:24.778477+0000","last_peered":"2023-07-09T21:50:24.778477+0000","last_clean":"2023-07-09T21:50:24.778477+0000","last_became_active":"2023-07-09T21:50:22.777708+0000","last_became_peered":"2023-07-09T21:50:22.777708+0000","last_unstale":"2023-07-09T21:50:24.778477+0000","last_undegraded":"2023-07-09T21:50:24.778477+0000","last_fullsized":"2023-07-09T21:50:24.778477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:12.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833233+0000","last_change":"2023-07-09T21:50:23.780850+0000","last_active":"2023-07-09T21:50:24.833233+0000","last_peered":"2023-07-09T21:50:24.833233+0000","last_clean":"2023-07-09T21:50:24.833233+0000","last_became_active":"2023-07-09T21:50:23.780529+0000","last_became_peered":"2023-07-09T21:50:23.780529+0000","last_unstale":"2023-07-09T21:50:24.833233+0000","last_undegraded":"2023-07-09T21:50:24.833233+0000","last_fullsized":"2023-07-09T21:50:24.833233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:34:40.996681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401178+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:50:25.401178+0000","last_peered":"2023-07-09T21:50:25.401178+0000","last_clean":"2023-07-09T21:50:25.401178+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:50:25.401178+0000","last_undegraded":"2023-07-09T21:50:25.401178+0000","last_fullsized":"2023-07-09T21:50:25.401178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:57:32.051923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832617+0000","last_change":"2023-07-09T21:50:22.774908+0000","last_active":"2023-07-09T21:50:24.832617+0000","last_peered":"2023-07-09T21:50:24.832617+0000","last_clean":"2023-07-09T21:50:24.832617+0000","last_became_active":"2023-07-09T21:50:22.774600+0000","last_became_peered":"2023-07-09T21:50:22.774600+0000","last_unstale":"2023-07-09T21:50:24.832617+0000","last_undegraded":"2023-07-09T21:50:24.832617+0000","last_fullsized":"2023-07-09T21:50:24.832617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:14:37.334350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833092+0000","last_change":"2023-07-09T21:50:23.786034+0000","last_active":"2023-07-09T21:50:24.833092+0000","last_peered":"2023-07-09T21:50:24.833092+0000","last_clean":"2023-07-09T21:50:24.833092+0000","last_became_active":"2023-07-09T21:50:23.785763+0000","last_became_peered":"2023-07-09T21:50:23.785763+0000","last_unstale":"2023-07-09T21:50:24.833092+0000","last_undegraded":"2023-07-09T21:50:24.833092+0000","last_fullsized":"2023-07-09T21:50:24.833092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:29:47.157708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771488+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:50:24.771488+0000","last_peered":"2023-07-09T21:50:24.771488+0000","last_clean":"2023-07-09T21:50:24.771488+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:50:24.771488+0000","last_undegraded":"2023-07-09T21:50:24.771488+0000","last_fullsized":"2023-07-09T21:50:24.771488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:00.619257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094325+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:50:25.094325+0000","last_peered":"2023-07-09T21:50:25.094325+0000","last_clean":"2023-07-09T21:50:25.094325+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:50:25.094325+0000","last_undegraded":"2023-07-09T21:50:25.094325+0000","last_fullsized":"2023-07-09T21:50:25.094325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:21:03.421360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770620+0000","last_change":"2023-07-09T21:50:22.766454+0000","last_active":"2023-07-09T21:50:24.770620+0000","last_peered":"2023-07-09T21:50:24.770620+0000","last_clean":"2023-07-09T21:50:24.770620+0000","last_became_active":"2023-07-09T21:50:22.766057+0000","last_became_peered":"2023-07-09T21:50:22.766057+0000","last_unstale":"2023-07-09T21:50:24.770620+0000","last_undegraded":"2023-07-09T21:50:24.770620+0000","last_fullsized":"2023-07-09T21:50:24.770620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:05.837076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401812+0000","last_change":"2023-07-09T21:50:23.795134+0000","last_active":"2023-07-09T21:50:25.401812+0000","last_peered":"2023-07-09T21:50:25.401812+0000","last_clean":"2023-07-09T21:50:25.401812+0000","last_became_active":"2023-07-09T21:50:23.794914+0000","last_became_peered":"2023-07-09T21:50:23.794914+0000","last_unstale":"2023-07-09T21:50:25.401812+0000","last_undegraded":"2023-07-09T21:50:25.401812+0000","last_fullsized":"2023-07-09T21:50:25.401812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:50.693532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094581+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:50:25.094581+0000","last_peered":"2023-07-09T21:50:25.094581+0000","last_clean":"2023-07-09T21:50:25.094581+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:50:25.094581+0000","last_undegraded":"2023-07-09T21:50:25.094581+0000","last_fullsized":"2023-07-09T21:50:25.094581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:13.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771706+0000","last_change":"2023-07-09T21:50:22.777350+0000","last_active":"2023-07-09T21:50:24.771706+0000","last_peered":"2023-07-09T21:50:24.771706+0000","last_clean":"2023-07-09T21:50:24.771706+0000","last_became_active":"2023-07-09T21:50:22.776974+0000","last_became_peered":"2023-07-09T21:50:22.776974+0000","last_unstale":"2023-07-09T21:50:24.771706+0000","last_undegraded":"2023-07-09T21:50:24.771706+0000","last_fullsized":"2023-07-09T21:50:24.771706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:32.888530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773336+0000","last_change":"2023-07-09T21:50:23.801310+0000","last_active":"2023-07-09T21:50:24.773336+0000","last_peered":"2023-07-09T21:50:24.773336+0000","last_clean":"2023-07-09T21:50:24.773336+0000","last_became_active":"2023-07-09T21:50:23.798687+0000","last_became_peered":"2023-07-09T21:50:23.798687+0000","last_unstale":"2023-07-09T21:50:24.773336+0000","last_undegraded":"2023-07-09T21:50:24.773336+0000","last_fullsized":"2023-07-09T21:50:24.773336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:54.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094422+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:50:25.094422+0000","last_peered":"2023-07-09T21:50:25.094422+0000","last_clean":"2023-07-09T21:50:25.094422+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:50:25.094422+0000","last_undegraded":"2023-07-09T21:50:25.094422+0000","last_fullsized":"2023-07-09T21:50:25.094422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:19:53.960138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833243+0000","last_change":"2023-07-09T21:50:22.774621+0000","last_active":"2023-07-09T21:50:24.833243+0000","last_peered":"2023-07-09T21:50:24.833243+0000","last_clean":"2023-07-09T21:50:24.833243+0000","last_became_active":"2023-07-09T21:50:22.774322+0000","last_became_peered":"2023-07-09T21:50:22.774322+0000","last_unstale":"2023-07-09T21:50:24.833243+0000","last_undegraded":"2023-07-09T21:50:24.833243+0000","last_fullsized":"2023-07-09T21:50:24.833243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:38.364251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772919+0000","last_change":"2023-07-09T21:50:23.793311+0000","last_active":"2023-07-09T21:50:24.772919+0000","last_peered":"2023-07-09T21:50:24.772919+0000","last_clean":"2023-07-09T21:50:24.772919+0000","last_became_active":"2023-07-09T21:50:23.792913+0000","last_became_peered":"2023-07-09T21:50:23.792913+0000","last_unstale":"2023-07-09T21:50:24.772919+0000","last_undegraded":"2023-07-09T21:50:24.772919+0000","last_fullsized":"2023-07-09T21:50:24.772919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:36.978787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771232+0000","last_change":"2023-07-09T21:50:22.775713+0000","last_active":"2023-07-09T21:50:24.771232+0000","last_peered":"2023-07-09T21:50:24.771232+0000","last_clean":"2023-07-09T21:50:24.771232+0000","last_became_active":"2023-07-09T21:50:22.775420+0000","last_became_peered":"2023-07-09T21:50:22.775420+0000","last_unstale":"2023-07-09T21:50:24.771232+0000","last_undegraded":"2023-07-09T21:50:24.771232+0000","last_fullsized":"2023-07-09T21:50:24.771232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:47:53.248634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833113+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:50:24.833113+0000","last_peered":"2023-07-09T21:50:24.833113+0000","last_clean":"2023-07-09T21:50:24.833113+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:50:24.833113+0000","last_undegraded":"2023-07-09T21:50:24.833113+0000","last_fullsized":"2023-07-09T21:50:24.833113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:14:29.722207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770239+0000","last_change":"2023-07-09T21:50:23.787661+0000","last_active":"2023-07-09T21:50:24.770239+0000","last_peered":"2023-07-09T21:50:24.770239+0000","last_clean":"2023-07-09T21:50:24.770239+0000","last_became_active":"2023-07-09T21:50:23.787366+0000","last_became_peered":"2023-07-09T21:50:23.787366+0000","last_unstale":"2023-07-09T21:50:24.770239+0000","last_undegraded":"2023-07-09T21:50:24.770239+0000","last_fullsized":"2023-07-09T21:50:24.770239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:33.892801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401827+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:50:25.401827+0000","last_peered":"2023-07-09T21:50:25.401827+0000","last_clean":"2023-07-09T21:50:25.401827+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:50:25.401827+0000","last_undegraded":"2023-07-09T21:50:25.401827+0000","last_fullsized":"2023-07-09T21:50:25.401827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:32:01.823699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773325+0000","last_change":"2023-07-09T21:50:22.772687+0000","last_active":"2023-07-09T21:50:24.773325+0000","last_peered":"2023-07-09T21:50:24.773325+0000","last_clean":"2023-07-09T21:50:24.773325+0000","last_became_active":"2023-07-09T21:50:22.772342+0000","last_became_peered":"2023-07-09T21:50:22.772342+0000","last_unstale":"2023-07-09T21:50:24.773325+0000","last_undegraded":"2023-07-09T21:50:24.773325+0000","last_fullsized":"2023-07-09T21:50:24.773325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778250+0000","last_change":"2023-07-09T21:50:23.794661+0000","last_active":"2023-07-09T21:50:24.778250+0000","last_peered":"2023-07-09T21:50:24.778250+0000","last_clean":"2023-07-09T21:50:24.778250+0000","last_became_active":"2023-07-09T21:50:23.794107+0000","last_became_peered":"2023-07-09T21:50:23.794107+0000","last_unstale":"2023-07-09T21:50:24.778250+0000","last_undegraded":"2023-07-09T21:50:24.778250+0000","last_fullsized":"2023-07-09T21:50:24.778250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:36.978787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772952+0000","last_change":"2023-07-09T21:50:22.779822+0000","last_active":"2023-07-09T21:50:24.772952+0000","last_peered":"2023-07-09T21:50:24.772952+0000","last_clean":"2023-07-09T21:50:24.772952+0000","last_became_active":"2023-07-09T21:50:22.779595+0000","last_became_peered":"2023-07-09T21:50:22.779595+0000","last_unstale":"2023-07-09T21:50:24.772952+0000","last_undegraded":"2023-07-09T21:50:24.772952+0000","last_fullsized":"2023-07-09T21:50:24.772952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:37.144688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401494+0000","last_change":"2023-07-09T21:50:23.786609+0000","last_active":"2023-07-09T21:50:25.401494+0000","last_peered":"2023-07-09T21:50:25.401494+0000","last_clean":"2023-07-09T21:50:25.401494+0000","last_became_active":"2023-07-09T21:50:23.785938+0000","last_became_peered":"2023-07-09T21:50:23.785938+0000","last_unstale":"2023-07-09T21:50:25.401494+0000","last_undegraded":"2023-07-09T21:50:25.401494+0000","last_fullsized":"2023-07-09T21:50:25.401494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771497+0000","last_change":"2023-07-09T21:50:22.772154+0000","last_active":"2023-07-09T21:50:24.771497+0000","last_peered":"2023-07-09T21:50:24.771497+0000","last_clean":"2023-07-09T21:50:24.771497+0000","last_became_active":"2023-07-09T21:50:22.771882+0000","last_became_peered":"2023-07-09T21:50:22.771882+0000","last_unstale":"2023-07-09T21:50:24.771497+0000","last_undegraded":"2023-07-09T21:50:24.771497+0000","last_fullsized":"2023-07-09T21:50:24.771497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:35.974516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778410+0000","last_change":"2023-07-09T21:50:23.793009+0000","last_active":"2023-07-09T21:50:24.778410+0000","last_peered":"2023-07-09T21:50:24.778410+0000","last_clean":"2023-07-09T21:50:24.778410+0000","last_became_active":"2023-07-09T21:50:23.791995+0000","last_became_peered":"2023-07-09T21:50:23.791995+0000","last_unstale":"2023-07-09T21:50:24.778410+0000","last_undegraded":"2023-07-09T21:50:24.778410+0000","last_fullsized":"2023-07-09T21:50:24.778410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:06.841347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772036+0000","last_change":"2023-07-09T21:50:22.772972+0000","last_active":"2023-07-09T21:50:24.772036+0000","last_peered":"2023-07-09T21:50:24.772036+0000","last_clean":"2023-07-09T21:50:24.772036+0000","last_became_active":"2023-07-09T21:50:22.772647+0000","last_became_peered":"2023-07-09T21:50:22.772647+0000","last_unstale":"2023-07-09T21:50:24.772036+0000","last_undegraded":"2023-07-09T21:50:24.772036+0000","last_fullsized":"2023-07-09T21:50:24.772036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778686+0000","last_change":"2023-07-09T21:50:23.790945+0000","last_active":"2023-07-09T21:50:24.778686+0000","last_peered":"2023-07-09T21:50:24.778686+0000","last_clean":"2023-07-09T21:50:24.778686+0000","last_became_active":"2023-07-09T21:50:23.790660+0000","last_became_peered":"2023-07-09T21:50:23.790660+0000","last_unstale":"2023-07-09T21:50:24.778686+0000","last_undegraded":"2023-07-09T21:50:24.778686+0000","last_fullsized":"2023-07-09T21:50:24.778686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:36.220738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770852+0000","last_change":"2023-07-09T21:50:22.770573+0000","last_active":"2023-07-09T21:50:24.770852+0000","last_peered":"2023-07-09T21:50:24.770852+0000","last_clean":"2023-07-09T21:50:24.770852+0000","last_became_active":"2023-07-09T21:50:22.770263+0000","last_became_peered":"2023-07-09T21:50:22.770263+0000","last_unstale":"2023-07-09T21:50:24.770852+0000","last_undegraded":"2023-07-09T21:50:24.770852+0000","last_fullsized":"2023-07-09T21:50:24.770852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770370+0000","last_change":"2023-07-09T21:50:23.791092+0000","last_active":"2023-07-09T21:50:24.770370+0000","last_peered":"2023-07-09T21:50:24.770370+0000","last_clean":"2023-07-09T21:50:24.770370+0000","last_became_active":"2023-07-09T21:50:23.789631+0000","last_became_peered":"2023-07-09T21:50:23.789631+0000","last_unstale":"2023-07-09T21:50:24.770370+0000","last_undegraded":"2023-07-09T21:50:24.770370+0000","last_fullsized":"2023-07-09T21:50:24.770370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:36.978787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773272+0000","last_change":"2023-07-09T21:50:22.776290+0000","last_active":"2023-07-09T21:50:24.773272+0000","last_peered":"2023-07-09T21:50:24.773272+0000","last_clean":"2023-07-09T21:50:24.773272+0000","last_became_active":"2023-07-09T21:50:22.775873+0000","last_became_peered":"2023-07-09T21:50:22.775873+0000","last_unstale":"2023-07-09T21:50:24.773272+0000","last_undegraded":"2023-07-09T21:50:24.773272+0000","last_fullsized":"2023-07-09T21:50:24.773272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:26.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778003+0000","last_change":"2023-07-09T21:50:23.787350+0000","last_active":"2023-07-09T21:50:24.778003+0000","last_peered":"2023-07-09T21:50:24.778003+0000","last_clean":"2023-07-09T21:50:24.778003+0000","last_became_active":"2023-07-09T21:50:23.787079+0000","last_became_peered":"2023-07-09T21:50:23.787079+0000","last_unstale":"2023-07-09T21:50:24.778003+0000","last_undegraded":"2023-07-09T21:50:24.778003+0000","last_fullsized":"2023-07-09T21:50:24.778003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:57:30.199160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401659+0000","last_change":"2023-07-09T21:50:23.783603+0000","last_active":"2023-07-09T21:50:25.401659+0000","last_peered":"2023-07-09T21:50:25.401659+0000","last_clean":"2023-07-09T21:50:25.401659+0000","last_became_active":"2023-07-09T21:50:23.781930+0000","last_became_peered":"2023-07-09T21:50:23.781930+0000","last_unstale":"2023-07-09T21:50:25.401659+0000","last_undegraded":"2023-07-09T21:50:25.401659+0000","last_fullsized":"2023-07-09T21:50:25.401659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770323+0000","last_change":"2023-07-09T21:50:23.788879+0000","last_active":"2023-07-09T21:50:24.770323+0000","last_peered":"2023-07-09T21:50:24.770323+0000","last_clean":"2023-07-09T21:50:24.770323+0000","last_became_active":"2023-07-09T21:50:23.788458+0000","last_became_peered":"2023-07-09T21:50:23.788458+0000","last_unstale":"2023-07-09T21:50:24.770323+0000","last_undegraded":"2023-07-09T21:50:24.770323+0000","last_fullsized":"2023-07-09T21:50:24.770323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778113+0000","last_change":"2023-07-09T21:50:23.787304+0000","last_active":"2023-07-09T21:50:24.778113+0000","last_peered":"2023-07-09T21:50:24.778113+0000","last_clean":"2023-07-09T21:50:24.778113+0000","last_became_active":"2023-07-09T21:50:23.787022+0000","last_became_peered":"2023-07-09T21:50:23.787022+0000","last_unstale":"2023-07-09T21:50:24.778113+0000","last_undegraded":"2023-07-09T21:50:24.778113+0000","last_fullsized":"2023-07-09T21:50:24.778113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:33.892801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770719+0000","last_change":"2023-07-09T21:50:23.785978+0000","last_active":"2023-07-09T21:50:24.770719+0000","last_peered":"2023-07-09T21:50:24.770719+0000","last_clean":"2023-07-09T21:50:24.770719+0000","last_became_active":"2023-07-09T21:50:23.785694+0000","last_became_peered":"2023-07-09T21:50:23.785694+0000","last_unstale":"2023-07-09T21:50:24.770719+0000","last_undegraded":"2023-07-09T21:50:24.770719+0000","last_fullsized":"2023-07-09T21:50:24.770719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:13.602484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833070+0000","last_change":"2023-07-09T21:50:23.780066+0000","last_active":"2023-07-09T21:50:24.833070+0000","last_peered":"2023-07-09T21:50:24.833070+0000","last_clean":"2023-07-09T21:50:24.833070+0000","last_became_active":"2023-07-09T21:50:23.779691+0000","last_became_peered":"2023-07-09T21:50:23.779691+0000","last_unstale":"2023-07-09T21:50:24.833070+0000","last_undegraded":"2023-07-09T21:50:24.833070+0000","last_fullsized":"2023-07-09T21:50:24.833070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:41:54.434482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":98625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":258048,"data_stored":97005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":97005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0310000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.905}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":856064,"data_stored":687955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":880640,"data_stored":689153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":97095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":97657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":97005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:50:39.087 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:50:39.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.318+0000 7f8b8dfff700 1 Processor -- start 2023-07-09T21:50:39.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.319+0000 7f8b8dfff700 1 -- start start 2023-07-09T21:50:39.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.320+0000 7f8b8dfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8b880d1220 0x7f8b880b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:39.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.320+0000 7f8b8dfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b880b2350 0x7f8b880afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:39.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.321+0000 7f8b8dfff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b880d2ce0 con 0x7f8b880b1e00 2023-07-09T21:50:39.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.321+0000 7f8b8dfff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b880b3350 con 0x7f8b880d1220 2023-07-09T21:50:39.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.321+0000 7f8b8dfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b880b3630 con 0x7f8b880b2350 2023-07-09T21:50:39.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.321+0000 7f8b877fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8b880b1e00 0x7f8b880d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56336/0 (socket says 172.21.15.53:56336) 2023-07-09T21:50:39.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.321+0000 7f8b877fe700 1 -- 172.21.15.53:0/1408830270 learned_addr learned my addr 172.21.15.53:0/1408830270 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:39.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.321+0000 7f8b86ffd700 1 --2- 172.21.15.53:0/1408830270 >> v2:172.21.15.53:3300/0 conn(0x7f8b880d1220 0x7f8b880b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:39.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.321+0000 7f8b87fff700 1 --2- 172.21.15.53:0/1408830270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b880b2350 0x7f8b880afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:39.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.321+0000 7f8b867fc700 1 -- 172.21.15.53:0/1408830270 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287427603 0 0) 0x7f8b880d2ce0 con 0x7f8b880b1e00 2023-07-09T21:50:39.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.321+0000 7f8b867fc700 1 -- 172.21.15.53:0/1408830270 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b700035b0 con 0x7f8b880b1e00 2023-07-09T21:50:39.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.321+0000 7f8b86ffd700 1 -- 172.21.15.53:0/1408830270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b880b2350 msgr2=0x7f8b880afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:39.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.321+0000 7f8b86ffd700 1 --2- 172.21.15.53:0/1408830270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b880b2350 0x7f8b880afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.321+0000 7f8b86ffd700 1 -- 172.21.15.53:0/1408830270 >> v1:172.21.15.53:6789/0 conn(0x7f8b880b1e00 legacy=0x7f8b880d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:39.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.321+0000 7f8b86ffd700 1 -- 172.21.15.53:0/1408830270 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b880b3910 con 0x7f8b880d1220 2023-07-09T21:50:39.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.322+0000 7f8b86ffd700 1 --2- 172.21.15.53:0/1408830270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b880d1220 0x7f8b880b43f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009840 tx=0x7f8b7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f370d823207ddf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:39.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.322+0000 7f8b867fc700 1 -- 172.21.15.53:0/1408830270 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c011830 con 0x7f8b880d1220 2023-07-09T21:50:39.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.322+0000 7f8b867fc700 1 -- 172.21.15.53:0/1408830270 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c011990 con 0x7f8b880d1220 2023-07-09T21:50:39.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.322+0000 7f8b867fc700 1 -- 172.21.15.53:0/1408830270 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c011d20 con 0x7f8b880d1220 2023-07-09T21:50:39.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.322+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1408830270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b880d1220 msgr2=0x7f8b880b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:39.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.322+0000 7f8b8dfff700 1 --2- 172.21.15.53:0/1408830270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b880d1220 0x7f8b880b43f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009840 tx=0x7f8b7c009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:39.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.322+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1408830270 shutdown_connections 2023-07-09T21:50:39.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.322+0000 7f8b8dfff700 1 --2- 172.21.15.53:0/1408830270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b880b2350 0x7f8b880afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.322+0000 7f8b8dfff700 1 --2- 172.21.15.53:0/1408830270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b880d1220 0x7f8b880b43f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.322+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1408830270 >> 172.21.15.53:0/1408830270 conn(0x7f8b8809c1d0 msgr2=0x7f8b880d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:39.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.322+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1408830270 shutdown_connections 2023-07-09T21:50:39.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.323+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1408830270 wait complete. 2023-07-09T21:50:39.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.324+0000 7f8b8dfff700 1 Processor -- start 2023-07-09T21:50:39.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.324+0000 7f8b8dfff700 1 -- start start 2023-07-09T21:50:39.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.325+0000 7f8b8dfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b880b1e00 0x7f8b880b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:39.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.325+0000 7f8b8dfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b880b2350 0x7f8b880cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:39.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.325+0000 7f8b8dfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b880d1220 0x7f8b880cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:39.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.325+0000 7f8b8dfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b881580a0 con 0x7f8b880b1e00 2023-07-09T21:50:39.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.325+0000 7f8b8dfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b880b62b0 con 0x7f8b880b2350 2023-07-09T21:50:39.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.325+0000 7f8b8dfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b880ced30 con 0x7f8b880d1220 2023-07-09T21:50:39.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.325+0000 7f8b877fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b880b1e00 0x7f8b880b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:39.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.326+0000 7f8b877fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b880b1e00 0x7f8b880b5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53106/0 (socket says 172.21.15.53:53106) 2023-07-09T21:50:39.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.326+0000 7f8b877fe700 1 -- 172.21.15.53:0/1176463968 learned_addr learned my addr 172.21.15.53:0/1176463968 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:39.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.326+0000 7f8b877fe700 1 -- 172.21.15.53:0/1176463968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b880d1220 msgr2=0x7f8b880cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:39.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.326+0000 7f8b877fe700 1 --2- 172.21.15.53:0/1176463968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b880d1220 0x7f8b880cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.326+0000 7f8b877fe700 1 -- 172.21.15.53:0/1176463968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b880b2350 msgr2=0x7f8b880cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:39.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.326+0000 7f8b877fe700 1 --2- 172.21.15.53:0/1176463968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b880b2350 0x7f8b880cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.326+0000 7f8b877fe700 1 -- 172.21.15.53:0/1176463968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c0094a0 con 0x7f8b880b1e00 2023-07-09T21:50:39.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.326+0000 7f8b877fe700 1 --2- 172.21.15.53:0/1176463968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b880b1e00 0x7f8b880b5d70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8b78001260 tx=0x7f8b7800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:39.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.326+0000 7f8b6ffff700 1 -- 172.21.15.53:0/1176463968 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b780074e0 con 0x7f8b880b1e00 2023-07-09T21:50:39.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.326+0000 7f8b6ffff700 1 -- 172.21.15.53:0/1176463968 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b78007640 con 0x7f8b880b1e00 2023-07-09T21:50:39.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.326+0000 7f8b6ffff700 1 -- 172.21.15.53:0/1176463968 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b78005a50 con 0x7f8b880b1e00 2023-07-09T21:50:39.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.326+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1176463968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b880cf010 con 0x7f8b880b1e00 2023-07-09T21:50:39.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.327+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1176463968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b880cf5d0 con 0x7f8b880b1e00 2023-07-09T21:50:39.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.328+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1176463968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8804e280 con 0x7f8b880b1e00 2023-07-09T21:50:39.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.329+0000 7f8b6ffff700 1 -- 172.21.15.53:0/1176463968 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b78005bb0 con 0x7f8b880b1e00 2023-07-09T21:50:39.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.330+0000 7f8b6ffff700 1 --2- 172.21.15.53:0/1176463968 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8b7406ace0 0x7f8b7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:39.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.330+0000 7f8b6ffff700 1 -- 172.21.15.53:0/1176463968 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b78088a50 con 0x7f8b880b1e00 2023-07-09T21:50:39.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.330+0000 7f8b86ffd700 1 --2- 172.21.15.53:0/1176463968 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8b7406ace0 0x7f8b7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:39.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.331+0000 7f8b86ffd700 1 --2- 172.21.15.53:0/1176463968 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8b7406ace0 0x7f8b7406d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8b880d1610 tx=0x7f8b7c010000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:39.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.334+0000 7f8b6ffff700 1 -- 172.21.15.53:0/1176463968 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b78057590 con 0x7f8b880b1e00 2023-07-09T21:50:39.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.541+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1176463968 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b880b8a10 con 0x7f8b7406ace0 2023-07-09T21:50:39.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.550+0000 7f8b6ffff700 1 -- 172.21.15.53:0/1176463968 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286528 (secure 0 0 0) 0x7f8b880b8a10 con 0x7f8b7406ace0 2023-07-09T21:50:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:39.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.554+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1176463968 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8b7406ace0 msgr2=0x7f8b7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:39.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.554+0000 7f8b8dfff700 1 --2- 172.21.15.53:0/1176463968 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8b7406ace0 0x7f8b7406d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8b880d1610 tx=0x7f8b7c010000 comp rx=0 tx=0).stop 2023-07-09T21:50:39.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.554+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1176463968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b880b1e00 msgr2=0x7f8b880b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:39.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.554+0000 7f8b8dfff700 1 --2- 172.21.15.53:0/1176463968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b880b1e00 0x7f8b880b5d70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8b78001260 tx=0x7f8b7800ca90 comp rx=0 tx=0).stop 2023-07-09T21:50:39.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.554+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1176463968 shutdown_connections 2023-07-09T21:50:39.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.554+0000 7f8b8dfff700 1 --2- 172.21.15.53:0/1176463968 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8b7406ace0 0x7f8b7406d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.554+0000 7f8b8dfff700 1 --2- 172.21.15.53:0/1176463968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b880d1220 0x7f8b880cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.554+0000 7f8b8dfff700 1 --2- 172.21.15.53:0/1176463968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b880b1e00 0x7f8b880b5d70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.554+0000 7f8b8dfff700 1 --2- 172.21.15.53:0/1176463968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b880b2350 0x7f8b880cfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.554+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1176463968 >> 172.21.15.53:0/1176463968 conn(0x7f8b8809c1d0 msgr2=0x7f8b880d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:39.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.554+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1176463968 shutdown_connections 2023-07-09T21:50:39.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.555+0000 7f8b8dfff700 1 -- 172.21.15.53:0/1176463968 wait complete. 2023-07-09T21:50:39.558 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:50:39.574 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-07-09T21:50:38.854700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222952,"kb_used_data":3240,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751768,"statfs":{"total":773094113280,"available":772865810432,"internally_reserved":0,"allocated":3317760,"data_stored":1961500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003221"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401409+0000","last_change":"2023-07-09T21:50:23.789471+0000","last_active":"2023-07-09T21:50:25.401409+0000","last_peered":"2023-07-09T21:50:25.401409+0000","last_clean":"2023-07-09T21:50:25.401409+0000","last_became_active":"2023-07-09T21:50:23.789178+0000","last_became_peered":"2023-07-09T21:50:23.789178+0000","last_unstale":"2023-07-09T21:50:25.401409+0000","last_undegraded":"2023-07-09T21:50:25.401409+0000","last_fullsized":"2023-07-09T21:50:25.401409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:24.789777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771695+0000","last_change":"2023-07-09T21:50:23.789721+0000","last_active":"2023-07-09T21:50:24.771695+0000","last_peered":"2023-07-09T21:50:24.771695+0000","last_clean":"2023-07-09T21:50:24.771695+0000","last_became_active":"2023-07-09T21:50:23.789478+0000","last_became_peered":"2023-07-09T21:50:23.789478+0000","last_unstale":"2023-07-09T21:50:24.771695+0000","last_undegraded":"2023-07-09T21:50:24.771695+0000","last_fullsized":"2023-07-09T21:50:24.771695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778489+0000","last_change":"2023-07-09T21:50:23.792566+0000","last_active":"2023-07-09T21:50:24.778489+0000","last_peered":"2023-07-09T21:50:24.778489+0000","last_clean":"2023-07-09T21:50:24.778489+0000","last_became_active":"2023-07-09T21:50:23.792316+0000","last_became_peered":"2023-07-09T21:50:23.792316+0000","last_unstale":"2023-07-09T21:50:24.778489+0000","last_undegraded":"2023-07-09T21:50:24.778489+0000","last_fullsized":"2023-07-09T21:50:24.778489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:33.584119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401848+0000","last_change":"2023-07-09T21:50:23.790737+0000","last_active":"2023-07-09T21:50:25.401848+0000","last_peered":"2023-07-09T21:50:25.401848+0000","last_clean":"2023-07-09T21:50:25.401848+0000","last_became_active":"2023-07-09T21:50:23.790455+0000","last_became_peered":"2023-07-09T21:50:23.790455+0000","last_unstale":"2023-07-09T21:50:25.401848+0000","last_undegraded":"2023-07-09T21:50:25.401848+0000","last_fullsized":"2023-07-09T21:50:25.401848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:33:28.169248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771850+0000","last_change":"2023-07-09T21:50:23.799889+0000","last_active":"2023-07-09T21:50:24.771850+0000","last_peered":"2023-07-09T21:50:24.771850+0000","last_clean":"2023-07-09T21:50:24.771850+0000","last_became_active":"2023-07-09T21:50:23.798717+0000","last_became_peered":"2023-07-09T21:50:23.798717+0000","last_unstale":"2023-07-09T21:50:24.771850+0000","last_undegraded":"2023-07-09T21:50:24.771850+0000","last_fullsized":"2023-07-09T21:50:24.771850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:25.755232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778099+0000","last_change":"2023-07-09T21:50:23.798790+0000","last_active":"2023-07-09T21:50:24.778099+0000","last_peered":"2023-07-09T21:50:24.778099+0000","last_clean":"2023-07-09T21:50:24.778099+0000","last_became_active":"2023-07-09T21:50:23.798508+0000","last_became_peered":"2023-07-09T21:50:23.798508+0000","last_unstale":"2023-07-09T21:50:24.778099+0000","last_undegraded":"2023-07-09T21:50:24.778099+0000","last_fullsized":"2023-07-09T21:50:24.778099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:25.755232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094158+0000","last_change":"2023-07-09T21:50:23.791148+0000","last_active":"2023-07-09T21:50:25.094158+0000","last_peered":"2023-07-09T21:50:25.094158+0000","last_clean":"2023-07-09T21:50:25.094158+0000","last_became_active":"2023-07-09T21:50:23.790530+0000","last_became_peered":"2023-07-09T21:50:23.790530+0000","last_unstale":"2023-07-09T21:50:25.094158+0000","last_undegraded":"2023-07-09T21:50:25.094158+0000","last_fullsized":"2023-07-09T21:50:25.094158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771365+0000","last_change":"2023-07-09T21:50:23.786451+0000","last_active":"2023-07-09T21:50:24.771365+0000","last_peered":"2023-07-09T21:50:24.771365+0000","last_clean":"2023-07-09T21:50:24.771365+0000","last_became_active":"2023-07-09T21:50:23.786150+0000","last_became_peered":"2023-07-09T21:50:23.786150+0000","last_unstale":"2023-07-09T21:50:24.771365+0000","last_undegraded":"2023-07-09T21:50:24.771365+0000","last_fullsized":"2023-07-09T21:50:24.771365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773128+0000","last_change":"2023-07-09T21:50:23.799651+0000","last_active":"2023-07-09T21:50:24.773128+0000","last_peered":"2023-07-09T21:50:24.773128+0000","last_clean":"2023-07-09T21:50:24.773128+0000","last_became_active":"2023-07-09T21:50:23.799306+0000","last_became_peered":"2023-07-09T21:50:23.799306+0000","last_unstale":"2023-07-09T21:50:24.773128+0000","last_undegraded":"2023-07-09T21:50:24.773128+0000","last_fullsized":"2023-07-09T21:50:24.773128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:06.841347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772154+0000","last_change":"2023-07-09T21:50:23.807058+0000","last_active":"2023-07-09T21:50:24.772154+0000","last_peered":"2023-07-09T21:50:24.772154+0000","last_clean":"2023-07-09T21:50:24.772154+0000","last_became_active":"2023-07-09T21:50:23.805775+0000","last_became_peered":"2023-07-09T21:50:23.805775+0000","last_unstale":"2023-07-09T21:50:24.772154+0000","last_undegraded":"2023-07-09T21:50:24.772154+0000","last_fullsized":"2023-07-09T21:50:24.772154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:16.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778566+0000","last_change":"2023-07-09T21:50:23.787617+0000","last_active":"2023-07-09T21:50:24.778566+0000","last_peered":"2023-07-09T21:50:24.778566+0000","last_clean":"2023-07-09T21:50:24.778566+0000","last_became_active":"2023-07-09T21:50:23.787324+0000","last_became_peered":"2023-07-09T21:50:23.787324+0000","last_unstale":"2023-07-09T21:50:24.778566+0000","last_undegraded":"2023-07-09T21:50:24.778566+0000","last_fullsized":"2023-07-09T21:50:24.778566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:54.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401442+0000","last_change":"2023-07-09T21:50:23.786780+0000","last_active":"2023-07-09T21:50:25.401442+0000","last_peered":"2023-07-09T21:50:25.401442+0000","last_clean":"2023-07-09T21:50:25.401442+0000","last_became_active":"2023-07-09T21:50:23.786285+0000","last_became_peered":"2023-07-09T21:50:23.786285+0000","last_unstale":"2023-07-09T21:50:25.401442+0000","last_undegraded":"2023-07-09T21:50:25.401442+0000","last_fullsized":"2023-07-09T21:50:25.401442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:17:28.990837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401348+0000","last_change":"2023-07-09T21:50:23.779777+0000","last_active":"2023-07-09T21:50:25.401348+0000","last_peered":"2023-07-09T21:50:25.401348+0000","last_clean":"2023-07-09T21:50:25.401348+0000","last_became_active":"2023-07-09T21:50:23.779402+0000","last_became_peered":"2023-07-09T21:50:23.779402+0000","last_unstale":"2023-07-09T21:50:25.401348+0000","last_undegraded":"2023-07-09T21:50:25.401348+0000","last_fullsized":"2023-07-09T21:50:25.401348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:28.676168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771883+0000","last_change":"2023-07-09T21:50:23.785342+0000","last_active":"2023-07-09T21:50:24.771883+0000","last_peered":"2023-07-09T21:50:24.771883+0000","last_clean":"2023-07-09T21:50:24.771883+0000","last_became_active":"2023-07-09T21:50:23.785042+0000","last_became_peered":"2023-07-09T21:50:23.785042+0000","last_unstale":"2023-07-09T21:50:24.771883+0000","last_undegraded":"2023-07-09T21:50:24.771883+0000","last_fullsized":"2023-07-09T21:50:24.771883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:33.584119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094514+0000","last_change":"2023-07-09T21:50:23.791304+0000","last_active":"2023-07-09T21:50:25.094514+0000","last_peered":"2023-07-09T21:50:25.094514+0000","last_clean":"2023-07-09T21:50:25.094514+0000","last_became_active":"2023-07-09T21:50:23.790881+0000","last_became_peered":"2023-07-09T21:50:23.790881+0000","last_unstale":"2023-07-09T21:50:25.094514+0000","last_undegraded":"2023-07-09T21:50:25.094514+0000","last_fullsized":"2023-07-09T21:50:25.094514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:53:11.882162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778107+0000","last_change":"2023-07-09T21:50:23.792844+0000","last_active":"2023-07-09T21:50:24.778107+0000","last_peered":"2023-07-09T21:50:24.778107+0000","last_clean":"2023-07-09T21:50:24.778107+0000","last_became_active":"2023-07-09T21:50:23.792511+0000","last_became_peered":"2023-07-09T21:50:23.792511+0000","last_unstale":"2023-07-09T21:50:24.778107+0000","last_undegraded":"2023-07-09T21:50:24.778107+0000","last_fullsized":"2023-07-09T21:50:24.778107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:11.492653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773086+0000","last_change":"2023-07-09T21:50:23.801511+0000","last_active":"2023-07-09T21:50:24.773086+0000","last_peered":"2023-07-09T21:50:24.773086+0000","last_clean":"2023-07-09T21:50:24.773086+0000","last_became_active":"2023-07-09T21:50:23.799945+0000","last_became_peered":"2023-07-09T21:50:23.799945+0000","last_unstale":"2023-07-09T21:50:24.773086+0000","last_undegraded":"2023-07-09T21:50:24.773086+0000","last_fullsized":"2023-07-09T21:50:24.773086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:30.584499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778726+0000","last_change":"2023-07-09T21:50:23.791210+0000","last_active":"2023-07-09T21:50:24.778726+0000","last_peered":"2023-07-09T21:50:24.778726+0000","last_clean":"2023-07-09T21:50:24.778726+0000","last_became_active":"2023-07-09T21:50:23.790958+0000","last_became_peered":"2023-07-09T21:50:23.790958+0000","last_unstale":"2023-07-09T21:50:24.778726+0000","last_undegraded":"2023-07-09T21:50:24.778726+0000","last_fullsized":"2023-07-09T21:50:24.778726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:16.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401359+0000","last_change":"2023-07-09T21:50:23.781367+0000","last_active":"2023-07-09T21:50:25.401359+0000","last_peered":"2023-07-09T21:50:25.401359+0000","last_clean":"2023-07-09T21:50:25.401359+0000","last_became_active":"2023-07-09T21:50:23.781111+0000","last_became_peered":"2023-07-09T21:50:23.781111+0000","last_unstale":"2023-07-09T21:50:25.401359+0000","last_undegraded":"2023-07-09T21:50:25.401359+0000","last_fullsized":"2023-07-09T21:50:25.401359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:23.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778348+0000","last_change":"2023-07-09T21:50:23.788775+0000","last_active":"2023-07-09T21:50:24.778348+0000","last_peered":"2023-07-09T21:50:24.778348+0000","last_clean":"2023-07-09T21:50:24.778348+0000","last_became_active":"2023-07-09T21:50:23.788474+0000","last_became_peered":"2023-07-09T21:50:23.788474+0000","last_unstale":"2023-07-09T21:50:24.778348+0000","last_undegraded":"2023-07-09T21:50:24.778348+0000","last_fullsized":"2023-07-09T21:50:24.778348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094336+0000","last_change":"2023-07-09T21:50:23.782607+0000","last_active":"2023-07-09T21:50:25.094336+0000","last_peered":"2023-07-09T21:50:25.094336+0000","last_clean":"2023-07-09T21:50:25.094336+0000","last_became_active":"2023-07-09T21:50:23.782315+0000","last_became_peered":"2023-07-09T21:50:23.782315+0000","last_unstale":"2023-07-09T21:50:25.094336+0000","last_undegraded":"2023-07-09T21:50:25.094336+0000","last_fullsized":"2023-07-09T21:50:25.094336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:36.220738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771811+0000","last_change":"2023-07-09T21:50:23.796236+0000","last_active":"2023-07-09T21:50:24.771811+0000","last_peered":"2023-07-09T21:50:24.771811+0000","last_clean":"2023-07-09T21:50:24.771811+0000","last_became_active":"2023-07-09T21:50:23.795910+0000","last_became_peered":"2023-07-09T21:50:23.795910+0000","last_unstale":"2023-07-09T21:50:24.771811+0000","last_undegraded":"2023-07-09T21:50:24.771811+0000","last_fullsized":"2023-07-09T21:50:24.771811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770483+0000","last_change":"2023-07-09T21:50:23.795797+0000","last_active":"2023-07-09T21:50:24.770483+0000","last_peered":"2023-07-09T21:50:24.770483+0000","last_clean":"2023-07-09T21:50:24.770483+0000","last_became_active":"2023-07-09T21:50:23.795569+0000","last_became_peered":"2023-07-09T21:50:23.795569+0000","last_unstale":"2023-07-09T21:50:24.770483+0000","last_undegraded":"2023-07-09T21:50:24.770483+0000","last_fullsized":"2023-07-09T21:50:24.770483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094493+0000","last_change":"2023-07-09T21:50:23.782770+0000","last_active":"2023-07-09T21:50:25.094493+0000","last_peered":"2023-07-09T21:50:25.094493+0000","last_clean":"2023-07-09T21:50:25.094493+0000","last_became_active":"2023-07-09T21:50:23.782509+0000","last_became_peered":"2023-07-09T21:50:23.782509+0000","last_unstale":"2023-07-09T21:50:25.094493+0000","last_undegraded":"2023-07-09T21:50:25.094493+0000","last_fullsized":"2023-07-09T21:50:25.094493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:48:23.282646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832925+0000","last_change":"2023-07-09T21:50:23.785433+0000","last_active":"2023-07-09T21:50:24.832925+0000","last_peered":"2023-07-09T21:50:24.832925+0000","last_clean":"2023-07-09T21:50:24.832925+0000","last_became_active":"2023-07-09T21:50:23.785016+0000","last_became_peered":"2023-07-09T21:50:23.785016+0000","last_unstale":"2023-07-09T21:50:24.832925+0000","last_undegraded":"2023-07-09T21:50:24.832925+0000","last_fullsized":"2023-07-09T21:50:24.832925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:17:59.220999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833073+0000","last_change":"2023-07-09T21:50:23.781394+0000","last_active":"2023-07-09T21:50:24.833073+0000","last_peered":"2023-07-09T21:50:24.833073+0000","last_clean":"2023-07-09T21:50:24.833073+0000","last_became_active":"2023-07-09T21:50:23.781089+0000","last_became_peered":"2023-07-09T21:50:23.781089+0000","last_unstale":"2023-07-09T21:50:24.833073+0000","last_undegraded":"2023-07-09T21:50:24.833073+0000","last_fullsized":"2023-07-09T21:50:24.833073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:06:48.939947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771627+0000","last_change":"2023-07-09T21:50:23.783556+0000","last_active":"2023-07-09T21:50:24.771627+0000","last_peered":"2023-07-09T21:50:24.771627+0000","last_clean":"2023-07-09T21:50:24.771627+0000","last_became_active":"2023-07-09T21:50:23.783277+0000","last_became_peered":"2023-07-09T21:50:23.783277+0000","last_unstale":"2023-07-09T21:50:24.771627+0000","last_undegraded":"2023-07-09T21:50:24.771627+0000","last_fullsized":"2023-07-09T21:50:24.771627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.148959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778480+0000","last_change":"2023-07-09T21:50:22.774935+0000","last_active":"2023-07-09T21:50:24.778480+0000","last_peered":"2023-07-09T21:50:24.778480+0000","last_clean":"2023-07-09T21:50:24.778480+0000","last_became_active":"2023-07-09T21:50:22.774612+0000","last_became_peered":"2023-07-09T21:50:22.774612+0000","last_unstale":"2023-07-09T21:50:24.778480+0000","last_undegraded":"2023-07-09T21:50:24.778480+0000","last_fullsized":"2023-07-09T21:50:24.778480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:05.547490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770699+0000","last_change":"2023-07-09T21:50:23.777644+0000","last_active":"2023-07-09T21:50:24.770699+0000","last_peered":"2023-07-09T21:50:24.770699+0000","last_clean":"2023-07-09T21:50:24.770699+0000","last_became_active":"2023-07-09T21:50:23.777372+0000","last_became_peered":"2023-07-09T21:50:23.777372+0000","last_unstale":"2023-07-09T21:50:24.770699+0000","last_undegraded":"2023-07-09T21:50:24.770699+0000","last_fullsized":"2023-07-09T21:50:24.770699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:06.551761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832895+0000","last_change":"2023-07-09T21:50:22.772852+0000","last_active":"2023-07-09T21:50:24.832895+0000","last_peered":"2023-07-09T21:50:24.832895+0000","last_clean":"2023-07-09T21:50:24.832895+0000","last_became_active":"2023-07-09T21:50:22.772592+0000","last_became_peered":"2023-07-09T21:50:22.772592+0000","last_unstale":"2023-07-09T21:50:24.832895+0000","last_undegraded":"2023-07-09T21:50:24.832895+0000","last_fullsized":"2023-07-09T21:50:24.832895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:10:40.034217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773185+0000","last_change":"2023-07-09T21:50:23.802442+0000","last_active":"2023-07-09T21:50:24.773185+0000","last_peered":"2023-07-09T21:50:24.773185+0000","last_clean":"2023-07-09T21:50:24.773185+0000","last_became_active":"2023-07-09T21:50:23.801644+0000","last_became_peered":"2023-07-09T21:50:23.801644+0000","last_unstale":"2023-07-09T21:50:24.773185+0000","last_undegraded":"2023-07-09T21:50:24.773185+0000","last_fullsized":"2023-07-09T21:50:24.773185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:13.602484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770485+0000","last_change":"2023-07-09T21:50:22.771300+0000","last_active":"2023-07-09T21:50:24.770485+0000","last_peered":"2023-07-09T21:50:24.770485+0000","last_clean":"2023-07-09T21:50:24.770485+0000","last_became_active":"2023-07-09T21:50:22.770639+0000","last_became_peered":"2023-07-09T21:50:22.770639+0000","last_unstale":"2023-07-09T21:50:24.770485+0000","last_undegraded":"2023-07-09T21:50:24.770485+0000","last_fullsized":"2023-07-09T21:50:24.770485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:29.580228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401889+0000","last_change":"2023-07-09T21:50:23.783801+0000","last_active":"2023-07-09T21:50:25.401889+0000","last_peered":"2023-07-09T21:50:25.401889+0000","last_clean":"2023-07-09T21:50:25.401889+0000","last_became_active":"2023-07-09T21:50:23.783545+0000","last_became_peered":"2023-07-09T21:50:23.783545+0000","last_unstale":"2023-07-09T21:50:25.401889+0000","last_undegraded":"2023-07-09T21:50:25.401889+0000","last_fullsized":"2023-07-09T21:50:25.401889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:44:36.986572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773224+0000","last_change":"2023-07-09T21:50:22.781881+0000","last_active":"2023-07-09T21:50:24.773224+0000","last_peered":"2023-07-09T21:50:24.773224+0000","last_clean":"2023-07-09T21:50:24.773224+0000","last_became_active":"2023-07-09T21:50:22.781553+0000","last_became_peered":"2023-07-09T21:50:22.781553+0000","last_unstale":"2023-07-09T21:50:24.773224+0000","last_undegraded":"2023-07-09T21:50:24.773224+0000","last_fullsized":"2023-07-09T21:50:24.773224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:32.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770398+0000","last_change":"2023-07-09T21:50:23.782080+0000","last_active":"2023-07-09T21:50:24.770398+0000","last_peered":"2023-07-09T21:50:24.770398+0000","last_clean":"2023-07-09T21:50:24.770398+0000","last_became_active":"2023-07-09T21:50:23.781769+0000","last_became_peered":"2023-07-09T21:50:23.781769+0000","last_unstale":"2023-07-09T21:50:24.770398+0000","last_undegraded":"2023-07-09T21:50:24.770398+0000","last_fullsized":"2023-07-09T21:50:24.770398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.148959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771796+0000","last_change":"2023-07-09T21:50:22.775466+0000","last_active":"2023-07-09T21:50:24.771796+0000","last_peered":"2023-07-09T21:50:24.771796+0000","last_clean":"2023-07-09T21:50:24.771796+0000","last_became_active":"2023-07-09T21:50:22.775189+0000","last_became_peered":"2023-07-09T21:50:22.775189+0000","last_unstale":"2023-07-09T21:50:24.771796+0000","last_undegraded":"2023-07-09T21:50:24.771796+0000","last_fullsized":"2023-07-09T21:50:24.771796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:29.580228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771009+0000","last_change":"2023-07-09T21:50:23.776973+0000","last_active":"2023-07-09T21:50:24.771009+0000","last_peered":"2023-07-09T21:50:24.771009+0000","last_clean":"2023-07-09T21:50:24.771009+0000","last_became_active":"2023-07-09T21:50:23.776468+0000","last_became_peered":"2023-07-09T21:50:23.776468+0000","last_unstale":"2023-07-09T21:50:24.771009+0000","last_undegraded":"2023-07-09T21:50:24.771009+0000","last_fullsized":"2023-07-09T21:50:24.771009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:54.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094368+0000","last_change":"2023-07-09T21:50:22.776755+0000","last_active":"2023-07-09T21:50:25.094368+0000","last_peered":"2023-07-09T21:50:25.094368+0000","last_clean":"2023-07-09T21:50:25.094368+0000","last_became_active":"2023-07-09T21:50:22.776393+0000","last_became_peered":"2023-07-09T21:50:22.776393+0000","last_unstale":"2023-07-09T21:50:25.094368+0000","last_undegraded":"2023-07-09T21:50:25.094368+0000","last_fullsized":"2023-07-09T21:50:25.094368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:15.389440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832675+0000","last_change":"2023-07-09T21:50:23.781306+0000","last_active":"2023-07-09T21:50:24.832675+0000","last_peered":"2023-07-09T21:50:24.832675+0000","last_clean":"2023-07-09T21:50:24.832675+0000","last_became_active":"2023-07-09T21:50:23.781040+0000","last_became_peered":"2023-07-09T21:50:23.781040+0000","last_unstale":"2023-07-09T21:50:24.832675+0000","last_undegraded":"2023-07-09T21:50:24.832675+0000","last_fullsized":"2023-07-09T21:50:24.832675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:57:55.663222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778655+0000","last_change":"2023-07-09T21:50:22.778707+0000","last_active":"2023-07-09T21:50:24.778655+0000","last_peered":"2023-07-09T21:50:24.778655+0000","last_clean":"2023-07-09T21:50:24.778655+0000","last_became_active":"2023-07-09T21:50:22.778397+0000","last_became_peered":"2023-07-09T21:50:22.778397+0000","last_unstale":"2023-07-09T21:50:24.778655+0000","last_undegraded":"2023-07-09T21:50:24.778655+0000","last_fullsized":"2023-07-09T21:50:24.778655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:26.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778898+0000","last_change":"2023-07-09T21:50:23.793887+0000","last_active":"2023-07-09T21:50:24.778898+0000","last_peered":"2023-07-09T21:50:24.778898+0000","last_clean":"2023-07-09T21:50:24.778898+0000","last_became_active":"2023-07-09T21:50:23.793626+0000","last_became_peered":"2023-07-09T21:50:23.793626+0000","last_unstale":"2023-07-09T21:50:24.778898+0000","last_undegraded":"2023-07-09T21:50:24.778898+0000","last_fullsized":"2023-07-09T21:50:24.778898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:21:17.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094228+0000","last_change":"2023-07-09T21:50:22.781947+0000","last_active":"2023-07-09T21:50:25.094228+0000","last_peered":"2023-07-09T21:50:25.094228+0000","last_clean":"2023-07-09T21:50:25.094228+0000","last_became_active":"2023-07-09T21:50:22.780676+0000","last_became_peered":"2023-07-09T21:50:22.780676+0000","last_unstale":"2023-07-09T21:50:25.094228+0000","last_undegraded":"2023-07-09T21:50:25.094228+0000","last_fullsized":"2023-07-09T21:50:25.094228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:47:53.248634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770793+0000","last_change":"2023-07-09T21:50:23.788674+0000","last_active":"2023-07-09T21:50:24.770793+0000","last_peered":"2023-07-09T21:50:24.770793+0000","last_clean":"2023-07-09T21:50:24.770793+0000","last_became_active":"2023-07-09T21:50:23.788306+0000","last_became_peered":"2023-07-09T21:50:23.788306+0000","last_unstale":"2023-07-09T21:50:24.770793+0000","last_undegraded":"2023-07-09T21:50:24.770793+0000","last_fullsized":"2023-07-09T21:50:24.770793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:27.052426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771654+0000","last_change":"2023-07-09T21:50:22.777294+0000","last_active":"2023-07-09T21:50:24.771654+0000","last_peered":"2023-07-09T21:50:24.771654+0000","last_clean":"2023-07-09T21:50:24.771654+0000","last_became_active":"2023-07-09T21:50:22.776308+0000","last_became_peered":"2023-07-09T21:50:22.776308+0000","last_unstale":"2023-07-09T21:50:24.771654+0000","last_undegraded":"2023-07-09T21:50:24.771654+0000","last_fullsized":"2023-07-09T21:50:24.771654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:10.488382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771772+0000","last_change":"2023-07-09T21:50:23.782217+0000","last_active":"2023-07-09T21:50:24.771772+0000","last_peered":"2023-07-09T21:50:24.771772+0000","last_clean":"2023-07-09T21:50:24.771772+0000","last_became_active":"2023-07-09T21:50:23.781948+0000","last_became_peered":"2023-07-09T21:50:23.781948+0000","last_unstale":"2023-07-09T21:50:24.771772+0000","last_undegraded":"2023-07-09T21:50:24.771772+0000","last_fullsized":"2023-07-09T21:50:24.771772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094393+0000","last_change":"2023-07-09T21:50:22.780710+0000","last_active":"2023-07-09T21:50:25.094393+0000","last_peered":"2023-07-09T21:50:25.094393+0000","last_clean":"2023-07-09T21:50:25.094393+0000","last_became_active":"2023-07-09T21:50:22.780392+0000","last_became_peered":"2023-07-09T21:50:22.780392+0000","last_unstale":"2023-07-09T21:50:25.094393+0000","last_undegraded":"2023-07-09T21:50:25.094393+0000","last_fullsized":"2023-07-09T21:50:25.094393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:08.834959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773173+0000","last_change":"2023-07-09T21:50:23.803234+0000","last_active":"2023-07-09T21:50:24.773173+0000","last_peered":"2023-07-09T21:50:24.773173+0000","last_clean":"2023-07-09T21:50:24.773173+0000","last_became_active":"2023-07-09T21:50:23.802407+0000","last_became_peered":"2023-07-09T21:50:23.802407+0000","last_unstale":"2023-07-09T21:50:24.773173+0000","last_undegraded":"2023-07-09T21:50:24.773173+0000","last_fullsized":"2023-07-09T21:50:24.773173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:06.551761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401477+0000","last_change":"2023-07-09T21:50:22.770920+0000","last_active":"2023-07-09T21:50:25.401477+0000","last_peered":"2023-07-09T21:50:25.401477+0000","last_clean":"2023-07-09T21:50:25.401477+0000","last_became_active":"2023-07-09T21:50:22.770566+0000","last_became_peered":"2023-07-09T21:50:22.770566+0000","last_unstale":"2023-07-09T21:50:25.401477+0000","last_undegraded":"2023-07-09T21:50:25.401477+0000","last_fullsized":"2023-07-09T21:50:25.401477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:06.181402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771083+0000","last_change":"2023-07-09T21:50:23.786089+0000","last_active":"2023-07-09T21:50:24.771083+0000","last_peered":"2023-07-09T21:50:24.771083+0000","last_clean":"2023-07-09T21:50:24.771083+0000","last_became_active":"2023-07-09T21:50:23.785827+0000","last_became_peered":"2023-07-09T21:50:23.785827+0000","last_unstale":"2023-07-09T21:50:24.771083+0000","last_undegraded":"2023-07-09T21:50:24.771083+0000","last_fullsized":"2023-07-09T21:50:24.771083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:16.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094687+0000","last_change":"2023-07-09T21:50:22.781469+0000","last_active":"2023-07-09T21:50:25.094687+0000","last_peered":"2023-07-09T21:50:25.094687+0000","last_clean":"2023-07-09T21:50:25.094687+0000","last_became_active":"2023-07-09T21:50:22.781215+0000","last_became_peered":"2023-07-09T21:50:22.781215+0000","last_unstale":"2023-07-09T21:50:25.094687+0000","last_undegraded":"2023-07-09T21:50:25.094687+0000","last_fullsized":"2023-07-09T21:50:25.094687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:41:06.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771366+0000","last_change":"2023-07-09T21:50:23.781500+0000","last_active":"2023-07-09T21:50:24.771366+0000","last_peered":"2023-07-09T21:50:24.771366+0000","last_clean":"2023-07-09T21:50:24.771366+0000","last_became_active":"2023-07-09T21:50:23.781247+0000","last_became_peered":"2023-07-09T21:50:23.781247+0000","last_unstale":"2023-07-09T21:50:24.771366+0000","last_undegraded":"2023-07-09T21:50:24.771366+0000","last_fullsized":"2023-07-09T21:50:24.771366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:25.755232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094343+0000","last_change":"2023-07-09T21:50:22.780841+0000","last_active":"2023-07-09T21:50:25.094343+0000","last_peered":"2023-07-09T21:50:25.094343+0000","last_clean":"2023-07-09T21:50:25.094343+0000","last_became_active":"2023-07-09T21:50:22.780287+0000","last_became_peered":"2023-07-09T21:50:22.780287+0000","last_unstale":"2023-07-09T21:50:25.094343+0000","last_undegraded":"2023-07-09T21:50:25.094343+0000","last_fullsized":"2023-07-09T21:50:25.094343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:53.307790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778140+0000","last_change":"2023-07-09T21:50:23.794825+0000","last_active":"2023-07-09T21:50:24.778140+0000","last_peered":"2023-07-09T21:50:24.778140+0000","last_clean":"2023-07-09T21:50:24.778140+0000","last_became_active":"2023-07-09T21:50:23.794372+0000","last_became_peered":"2023-07-09T21:50:23.794372+0000","last_unstale":"2023-07-09T21:50:24.778140+0000","last_undegraded":"2023-07-09T21:50:24.778140+0000","last_fullsized":"2023-07-09T21:50:24.778140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094667+0000","last_change":"2023-07-09T21:50:22.782310+0000","last_active":"2023-07-09T21:50:25.094667+0000","last_peered":"2023-07-09T21:50:25.094667+0000","last_clean":"2023-07-09T21:50:25.094667+0000","last_became_active":"2023-07-09T21:50:22.782041+0000","last_became_peered":"2023-07-09T21:50:22.782041+0000","last_unstale":"2023-07-09T21:50:25.094667+0000","last_undegraded":"2023-07-09T21:50:25.094667+0000","last_fullsized":"2023-07-09T21:50:25.094667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:11:23.436562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401729+0000","last_change":"2023-07-09T21:50:23.789564+0000","last_active":"2023-07-09T21:50:25.401729+0000","last_peered":"2023-07-09T21:50:25.401729+0000","last_clean":"2023-07-09T21:50:25.401729+0000","last_became_active":"2023-07-09T21:50:23.789320+0000","last_became_peered":"2023-07-09T21:50:23.789320+0000","last_unstale":"2023-07-09T21:50:25.401729+0000","last_undegraded":"2023-07-09T21:50:25.401729+0000","last_fullsized":"2023-07-09T21:50:25.401729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:05.934271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771882+0000","last_change":"2023-07-09T21:50:22.769028+0000","last_active":"2023-07-09T21:50:24.771882+0000","last_peered":"2023-07-09T21:50:24.771882+0000","last_clean":"2023-07-09T21:50:24.771882+0000","last_became_active":"2023-07-09T21:50:22.768697+0000","last_became_peered":"2023-07-09T21:50:22.768697+0000","last_unstale":"2023-07-09T21:50:24.771882+0000","last_undegraded":"2023-07-09T21:50:24.771882+0000","last_fullsized":"2023-07-09T21:50:24.771882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:12.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773064+0000","last_change":"2023-07-09T21:50:23.792126+0000","last_active":"2023-07-09T21:50:24.773064+0000","last_peered":"2023-07-09T21:50:24.773064+0000","last_clean":"2023-07-09T21:50:24.773064+0000","last_became_active":"2023-07-09T21:50:23.790182+0000","last_became_peered":"2023-07-09T21:50:23.790182+0000","last_unstale":"2023-07-09T21:50:24.773064+0000","last_undegraded":"2023-07-09T21:50:24.773064+0000","last_fullsized":"2023-07-09T21:50:24.773064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:31:56.195686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770745+0000","last_change":"2023-07-09T21:50:22.769216+0000","last_active":"2023-07-09T21:50:24.770745+0000","last_peered":"2023-07-09T21:50:24.770745+0000","last_clean":"2023-07-09T21:50:24.770745+0000","last_became_active":"2023-07-09T21:50:22.768893+0000","last_became_peered":"2023-07-09T21:50:22.768893+0000","last_unstale":"2023-07-09T21:50:24.770745+0000","last_undegraded":"2023-07-09T21:50:24.770745+0000","last_fullsized":"2023-07-09T21:50:24.770745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:32.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778315+0000","last_change":"2023-07-09T21:50:23.790525+0000","last_active":"2023-07-09T21:50:24.778315+0000","last_peered":"2023-07-09T21:50:24.778315+0000","last_clean":"2023-07-09T21:50:24.778315+0000","last_became_active":"2023-07-09T21:50:23.790164+0000","last_became_peered":"2023-07-09T21:50:23.790164+0000","last_unstale":"2023-07-09T21:50:24.778315+0000","last_undegraded":"2023-07-09T21:50:24.778315+0000","last_fullsized":"2023-07-09T21:50:24.778315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.148959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401701+0000","last_change":"2023-07-09T21:50:22.779742+0000","last_active":"2023-07-09T21:50:25.401701+0000","last_peered":"2023-07-09T21:50:25.401701+0000","last_clean":"2023-07-09T21:50:25.401701+0000","last_became_active":"2023-07-09T21:50:22.779462+0000","last_became_peered":"2023-07-09T21:50:22.779462+0000","last_unstale":"2023-07-09T21:50:25.401701+0000","last_undegraded":"2023-07-09T21:50:25.401701+0000","last_fullsized":"2023-07-09T21:50:25.401701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:34.301244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778898+0000","last_change":"2023-07-09T21:50:23.793928+0000","last_active":"2023-07-09T21:50:24.778898+0000","last_peered":"2023-07-09T21:50:24.778898+0000","last_clean":"2023-07-09T21:50:24.778898+0000","last_became_active":"2023-07-09T21:50:23.793620+0000","last_became_peered":"2023-07-09T21:50:23.793620+0000","last_unstale":"2023-07-09T21:50:24.778898+0000","last_undegraded":"2023-07-09T21:50:24.778898+0000","last_fullsized":"2023-07-09T21:50:24.778898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:09.839230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778364+0000","last_change":"2023-07-09T21:50:22.772850+0000","last_active":"2023-07-09T21:50:24.778364+0000","last_peered":"2023-07-09T21:50:24.778364+0000","last_clean":"2023-07-09T21:50:24.778364+0000","last_became_active":"2023-07-09T21:50:22.772522+0000","last_became_peered":"2023-07-09T21:50:22.772522+0000","last_unstale":"2023-07-09T21:50:24.778364+0000","last_undegraded":"2023-07-09T21:50:24.778364+0000","last_fullsized":"2023-07-09T21:50:24.778364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:29.580228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778733+0000","last_change":"2023-07-09T21:50:23.787502+0000","last_active":"2023-07-09T21:50:24.778733+0000","last_peered":"2023-07-09T21:50:24.778733+0000","last_clean":"2023-07-09T21:50:24.778733+0000","last_became_active":"2023-07-09T21:50:23.786685+0000","last_became_peered":"2023-07-09T21:50:23.786685+0000","last_unstale":"2023-07-09T21:50:24.778733+0000","last_undegraded":"2023-07-09T21:50:24.778733+0000","last_fullsized":"2023-07-09T21:50:24.778733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:47:54.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770315+0000","last_change":"2023-07-09T21:50:22.769583+0000","last_active":"2023-07-09T21:50:24.770315+0000","last_peered":"2023-07-09T21:50:24.770315+0000","last_clean":"2023-07-09T21:50:24.770315+0000","last_became_active":"2023-07-09T21:50:22.768169+0000","last_became_peered":"2023-07-09T21:50:22.768169+0000","last_unstale":"2023-07-09T21:50:24.770315+0000","last_undegraded":"2023-07-09T21:50:24.770315+0000","last_fullsized":"2023-07-09T21:50:24.770315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:24.750960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833106+0000","last_change":"2023-07-09T21:50:23.784726+0000","last_active":"2023-07-09T21:50:24.833106+0000","last_peered":"2023-07-09T21:50:24.833106+0000","last_clean":"2023-07-09T21:50:24.833106+0000","last_became_active":"2023-07-09T21:50:23.777193+0000","last_became_peered":"2023-07-09T21:50:23.777193+0000","last_unstale":"2023-07-09T21:50:24.833106+0000","last_undegraded":"2023-07-09T21:50:24.833106+0000","last_fullsized":"2023-07-09T21:50:24.833106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:43:56.851579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833107+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:50:24.833107+0000","last_peered":"2023-07-09T21:50:24.833107+0000","last_clean":"2023-07-09T21:50:24.833107+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:50:24.833107+0000","last_undegraded":"2023-07-09T21:50:24.833107+0000","last_fullsized":"2023-07-09T21:50:24.833107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:30:59.285734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771985+0000","last_change":"2023-07-09T21:50:22.772281+0000","last_active":"2023-07-09T21:50:24.771985+0000","last_peered":"2023-07-09T21:50:24.771985+0000","last_clean":"2023-07-09T21:50:24.771985+0000","last_became_active":"2023-07-09T21:50:22.769167+0000","last_became_peered":"2023-07-09T21:50:22.769167+0000","last_unstale":"2023-07-09T21:50:24.771985+0000","last_undegraded":"2023-07-09T21:50:24.771985+0000","last_fullsized":"2023-07-09T21:50:24.771985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:05.547490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832719+0000","last_change":"2023-07-09T21:50:23.783723+0000","last_active":"2023-07-09T21:50:24.832719+0000","last_peered":"2023-07-09T21:50:24.832719+0000","last_clean":"2023-07-09T21:50:24.832719+0000","last_became_active":"2023-07-09T21:50:23.783453+0000","last_became_peered":"2023-07-09T21:50:23.783453+0000","last_unstale":"2023-07-09T21:50:24.832719+0000","last_undegraded":"2023-07-09T21:50:24.832719+0000","last_fullsized":"2023-07-09T21:50:24.832719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:19.725831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771999+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:50:24.771999+0000","last_peered":"2023-07-09T21:50:24.771999+0000","last_clean":"2023-07-09T21:50:24.771999+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:50:24.771999+0000","last_undegraded":"2023-07-09T21:50:24.771999+0000","last_fullsized":"2023-07-09T21:50:24.771999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:48.089970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778477+0000","last_change":"2023-07-09T21:50:22.778044+0000","last_active":"2023-07-09T21:50:24.778477+0000","last_peered":"2023-07-09T21:50:24.778477+0000","last_clean":"2023-07-09T21:50:24.778477+0000","last_became_active":"2023-07-09T21:50:22.777708+0000","last_became_peered":"2023-07-09T21:50:22.777708+0000","last_unstale":"2023-07-09T21:50:24.778477+0000","last_undegraded":"2023-07-09T21:50:24.778477+0000","last_fullsized":"2023-07-09T21:50:24.778477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:12.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833233+0000","last_change":"2023-07-09T21:50:23.780850+0000","last_active":"2023-07-09T21:50:24.833233+0000","last_peered":"2023-07-09T21:50:24.833233+0000","last_clean":"2023-07-09T21:50:24.833233+0000","last_became_active":"2023-07-09T21:50:23.780529+0000","last_became_peered":"2023-07-09T21:50:23.780529+0000","last_unstale":"2023-07-09T21:50:24.833233+0000","last_undegraded":"2023-07-09T21:50:24.833233+0000","last_fullsized":"2023-07-09T21:50:24.833233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:34:40.996681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401178+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:50:25.401178+0000","last_peered":"2023-07-09T21:50:25.401178+0000","last_clean":"2023-07-09T21:50:25.401178+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:50:25.401178+0000","last_undegraded":"2023-07-09T21:50:25.401178+0000","last_fullsized":"2023-07-09T21:50:25.401178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:57:32.051923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.832617+0000","last_change":"2023-07-09T21:50:22.774908+0000","last_active":"2023-07-09T21:50:24.832617+0000","last_peered":"2023-07-09T21:50:24.832617+0000","last_clean":"2023-07-09T21:50:24.832617+0000","last_became_active":"2023-07-09T21:50:22.774600+0000","last_became_peered":"2023-07-09T21:50:22.774600+0000","last_unstale":"2023-07-09T21:50:24.832617+0000","last_undegraded":"2023-07-09T21:50:24.832617+0000","last_fullsized":"2023-07-09T21:50:24.832617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:14:37.334350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833092+0000","last_change":"2023-07-09T21:50:23.786034+0000","last_active":"2023-07-09T21:50:24.833092+0000","last_peered":"2023-07-09T21:50:24.833092+0000","last_clean":"2023-07-09T21:50:24.833092+0000","last_became_active":"2023-07-09T21:50:23.785763+0000","last_became_peered":"2023-07-09T21:50:23.785763+0000","last_unstale":"2023-07-09T21:50:24.833092+0000","last_undegraded":"2023-07-09T21:50:24.833092+0000","last_fullsized":"2023-07-09T21:50:24.833092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:29:47.157708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771488+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:50:24.771488+0000","last_peered":"2023-07-09T21:50:24.771488+0000","last_clean":"2023-07-09T21:50:24.771488+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:50:24.771488+0000","last_undegraded":"2023-07-09T21:50:24.771488+0000","last_fullsized":"2023-07-09T21:50:24.771488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:00.619257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094325+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:50:25.094325+0000","last_peered":"2023-07-09T21:50:25.094325+0000","last_clean":"2023-07-09T21:50:25.094325+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:50:25.094325+0000","last_undegraded":"2023-07-09T21:50:25.094325+0000","last_fullsized":"2023-07-09T21:50:25.094325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:21:03.421360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770620+0000","last_change":"2023-07-09T21:50:22.766454+0000","last_active":"2023-07-09T21:50:24.770620+0000","last_peered":"2023-07-09T21:50:24.770620+0000","last_clean":"2023-07-09T21:50:24.770620+0000","last_became_active":"2023-07-09T21:50:22.766057+0000","last_became_peered":"2023-07-09T21:50:22.766057+0000","last_unstale":"2023-07-09T21:50:24.770620+0000","last_undegraded":"2023-07-09T21:50:24.770620+0000","last_fullsized":"2023-07-09T21:50:24.770620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:05.837076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401812+0000","last_change":"2023-07-09T21:50:23.795134+0000","last_active":"2023-07-09T21:50:25.401812+0000","last_peered":"2023-07-09T21:50:25.401812+0000","last_clean":"2023-07-09T21:50:25.401812+0000","last_became_active":"2023-07-09T21:50:23.794914+0000","last_became_peered":"2023-07-09T21:50:23.794914+0000","last_unstale":"2023-07-09T21:50:25.401812+0000","last_undegraded":"2023-07-09T21:50:25.401812+0000","last_fullsized":"2023-07-09T21:50:25.401812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:50.693532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094581+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:50:25.094581+0000","last_peered":"2023-07-09T21:50:25.094581+0000","last_clean":"2023-07-09T21:50:25.094581+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:50:25.094581+0000","last_undegraded":"2023-07-09T21:50:25.094581+0000","last_fullsized":"2023-07-09T21:50:25.094581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:13.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771706+0000","last_change":"2023-07-09T21:50:22.777350+0000","last_active":"2023-07-09T21:50:24.771706+0000","last_peered":"2023-07-09T21:50:24.771706+0000","last_clean":"2023-07-09T21:50:24.771706+0000","last_became_active":"2023-07-09T21:50:22.776974+0000","last_became_peered":"2023-07-09T21:50:22.776974+0000","last_unstale":"2023-07-09T21:50:24.771706+0000","last_undegraded":"2023-07-09T21:50:24.771706+0000","last_fullsized":"2023-07-09T21:50:24.771706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:32.888530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773336+0000","last_change":"2023-07-09T21:50:23.801310+0000","last_active":"2023-07-09T21:50:24.773336+0000","last_peered":"2023-07-09T21:50:24.773336+0000","last_clean":"2023-07-09T21:50:24.773336+0000","last_became_active":"2023-07-09T21:50:23.798687+0000","last_became_peered":"2023-07-09T21:50:23.798687+0000","last_unstale":"2023-07-09T21:50:24.773336+0000","last_undegraded":"2023-07-09T21:50:24.773336+0000","last_fullsized":"2023-07-09T21:50:24.773336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:54.312061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.094422+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:50:25.094422+0000","last_peered":"2023-07-09T21:50:25.094422+0000","last_clean":"2023-07-09T21:50:25.094422+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:50:25.094422+0000","last_undegraded":"2023-07-09T21:50:25.094422+0000","last_fullsized":"2023-07-09T21:50:25.094422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:19:53.960138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833243+0000","last_change":"2023-07-09T21:50:22.774621+0000","last_active":"2023-07-09T21:50:24.833243+0000","last_peered":"2023-07-09T21:50:24.833243+0000","last_clean":"2023-07-09T21:50:24.833243+0000","last_became_active":"2023-07-09T21:50:22.774322+0000","last_became_peered":"2023-07-09T21:50:22.774322+0000","last_unstale":"2023-07-09T21:50:24.833243+0000","last_undegraded":"2023-07-09T21:50:24.833243+0000","last_fullsized":"2023-07-09T21:50:24.833243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:38.364251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772919+0000","last_change":"2023-07-09T21:50:23.793311+0000","last_active":"2023-07-09T21:50:24.772919+0000","last_peered":"2023-07-09T21:50:24.772919+0000","last_clean":"2023-07-09T21:50:24.772919+0000","last_became_active":"2023-07-09T21:50:23.792913+0000","last_became_peered":"2023-07-09T21:50:23.792913+0000","last_unstale":"2023-07-09T21:50:24.772919+0000","last_undegraded":"2023-07-09T21:50:24.772919+0000","last_fullsized":"2023-07-09T21:50:24.772919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:36.978787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771232+0000","last_change":"2023-07-09T21:50:22.775713+0000","last_active":"2023-07-09T21:50:24.771232+0000","last_peered":"2023-07-09T21:50:24.771232+0000","last_clean":"2023-07-09T21:50:24.771232+0000","last_became_active":"2023-07-09T21:50:22.775420+0000","last_became_peered":"2023-07-09T21:50:22.775420+0000","last_unstale":"2023-07-09T21:50:24.771232+0000","last_undegraded":"2023-07-09T21:50:24.771232+0000","last_fullsized":"2023-07-09T21:50:24.771232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:47:53.248634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833113+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:50:24.833113+0000","last_peered":"2023-07-09T21:50:24.833113+0000","last_clean":"2023-07-09T21:50:24.833113+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:50:24.833113+0000","last_undegraded":"2023-07-09T21:50:24.833113+0000","last_fullsized":"2023-07-09T21:50:24.833113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:14:29.722207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770239+0000","last_change":"2023-07-09T21:50:23.787661+0000","last_active":"2023-07-09T21:50:24.770239+0000","last_peered":"2023-07-09T21:50:24.770239+0000","last_clean":"2023-07-09T21:50:24.770239+0000","last_became_active":"2023-07-09T21:50:23.787366+0000","last_became_peered":"2023-07-09T21:50:23.787366+0000","last_unstale":"2023-07-09T21:50:24.770239+0000","last_undegraded":"2023-07-09T21:50:24.770239+0000","last_fullsized":"2023-07-09T21:50:24.770239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:33.892801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401827+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:50:25.401827+0000","last_peered":"2023-07-09T21:50:25.401827+0000","last_clean":"2023-07-09T21:50:25.401827+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:50:25.401827+0000","last_undegraded":"2023-07-09T21:50:25.401827+0000","last_fullsized":"2023-07-09T21:50:25.401827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:32:01.823699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773325+0000","last_change":"2023-07-09T21:50:22.772687+0000","last_active":"2023-07-09T21:50:24.773325+0000","last_peered":"2023-07-09T21:50:24.773325+0000","last_clean":"2023-07-09T21:50:24.773325+0000","last_became_active":"2023-07-09T21:50:22.772342+0000","last_became_peered":"2023-07-09T21:50:22.772342+0000","last_unstale":"2023-07-09T21:50:24.773325+0000","last_undegraded":"2023-07-09T21:50:24.773325+0000","last_fullsized":"2023-07-09T21:50:24.773325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778250+0000","last_change":"2023-07-09T21:50:23.794661+0000","last_active":"2023-07-09T21:50:24.778250+0000","last_peered":"2023-07-09T21:50:24.778250+0000","last_clean":"2023-07-09T21:50:24.778250+0000","last_became_active":"2023-07-09T21:50:23.794107+0000","last_became_peered":"2023-07-09T21:50:23.794107+0000","last_unstale":"2023-07-09T21:50:24.778250+0000","last_undegraded":"2023-07-09T21:50:24.778250+0000","last_fullsized":"2023-07-09T21:50:24.778250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:36.978787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772952+0000","last_change":"2023-07-09T21:50:22.779822+0000","last_active":"2023-07-09T21:50:24.772952+0000","last_peered":"2023-07-09T21:50:24.772952+0000","last_clean":"2023-07-09T21:50:24.772952+0000","last_became_active":"2023-07-09T21:50:22.779595+0000","last_became_peered":"2023-07-09T21:50:22.779595+0000","last_unstale":"2023-07-09T21:50:24.772952+0000","last_undegraded":"2023-07-09T21:50:24.772952+0000","last_fullsized":"2023-07-09T21:50:24.772952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:37.144688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401494+0000","last_change":"2023-07-09T21:50:23.786609+0000","last_active":"2023-07-09T21:50:25.401494+0000","last_peered":"2023-07-09T21:50:25.401494+0000","last_clean":"2023-07-09T21:50:25.401494+0000","last_became_active":"2023-07-09T21:50:23.785938+0000","last_became_peered":"2023-07-09T21:50:23.785938+0000","last_unstale":"2023-07-09T21:50:25.401494+0000","last_undegraded":"2023-07-09T21:50:25.401494+0000","last_fullsized":"2023-07-09T21:50:25.401494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.771497+0000","last_change":"2023-07-09T21:50:22.772154+0000","last_active":"2023-07-09T21:50:24.771497+0000","last_peered":"2023-07-09T21:50:24.771497+0000","last_clean":"2023-07-09T21:50:24.771497+0000","last_became_active":"2023-07-09T21:50:22.771882+0000","last_became_peered":"2023-07-09T21:50:22.771882+0000","last_unstale":"2023-07-09T21:50:24.771497+0000","last_undegraded":"2023-07-09T21:50:24.771497+0000","last_fullsized":"2023-07-09T21:50:24.771497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:35.974516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778410+0000","last_change":"2023-07-09T21:50:23.793009+0000","last_active":"2023-07-09T21:50:24.778410+0000","last_peered":"2023-07-09T21:50:24.778410+0000","last_clean":"2023-07-09T21:50:24.778410+0000","last_became_active":"2023-07-09T21:50:23.791995+0000","last_became_peered":"2023-07-09T21:50:23.791995+0000","last_unstale":"2023-07-09T21:50:24.778410+0000","last_undegraded":"2023-07-09T21:50:24.778410+0000","last_fullsized":"2023-07-09T21:50:24.778410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:06.841347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.772036+0000","last_change":"2023-07-09T21:50:22.772972+0000","last_active":"2023-07-09T21:50:24.772036+0000","last_peered":"2023-07-09T21:50:24.772036+0000","last_clean":"2023-07-09T21:50:24.772036+0000","last_became_active":"2023-07-09T21:50:22.772647+0000","last_became_peered":"2023-07-09T21:50:22.772647+0000","last_unstale":"2023-07-09T21:50:24.772036+0000","last_undegraded":"2023-07-09T21:50:24.772036+0000","last_fullsized":"2023-07-09T21:50:24.772036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778686+0000","last_change":"2023-07-09T21:50:23.790945+0000","last_active":"2023-07-09T21:50:24.778686+0000","last_peered":"2023-07-09T21:50:24.778686+0000","last_clean":"2023-07-09T21:50:24.778686+0000","last_became_active":"2023-07-09T21:50:23.790660+0000","last_became_peered":"2023-07-09T21:50:23.790660+0000","last_unstale":"2023-07-09T21:50:24.778686+0000","last_undegraded":"2023-07-09T21:50:24.778686+0000","last_fullsized":"2023-07-09T21:50:24.778686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:36.220738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770852+0000","last_change":"2023-07-09T21:50:22.770573+0000","last_active":"2023-07-09T21:50:24.770852+0000","last_peered":"2023-07-09T21:50:24.770852+0000","last_clean":"2023-07-09T21:50:24.770852+0000","last_became_active":"2023-07-09T21:50:22.770263+0000","last_became_peered":"2023-07-09T21:50:22.770263+0000","last_unstale":"2023-07-09T21:50:24.770852+0000","last_undegraded":"2023-07-09T21:50:24.770852+0000","last_fullsized":"2023-07-09T21:50:24.770852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:35.216467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770370+0000","last_change":"2023-07-09T21:50:23.791092+0000","last_active":"2023-07-09T21:50:24.770370+0000","last_peered":"2023-07-09T21:50:24.770370+0000","last_clean":"2023-07-09T21:50:24.770370+0000","last_became_active":"2023-07-09T21:50:23.789631+0000","last_became_peered":"2023-07-09T21:50:23.789631+0000","last_unstale":"2023-07-09T21:50:24.770370+0000","last_undegraded":"2023-07-09T21:50:24.770370+0000","last_fullsized":"2023-07-09T21:50:24.770370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:36.978787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.773272+0000","last_change":"2023-07-09T21:50:22.776290+0000","last_active":"2023-07-09T21:50:24.773272+0000","last_peered":"2023-07-09T21:50:24.773272+0000","last_clean":"2023-07-09T21:50:24.773272+0000","last_became_active":"2023-07-09T21:50:22.775873+0000","last_became_peered":"2023-07-09T21:50:22.775873+0000","last_unstale":"2023-07-09T21:50:24.773272+0000","last_undegraded":"2023-07-09T21:50:24.773272+0000","last_fullsized":"2023-07-09T21:50:24.773272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:21.742573+0000","last_clean_scrub_stamp":"2023-07-09T21:50:21.742573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:26.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778003+0000","last_change":"2023-07-09T21:50:23.787350+0000","last_active":"2023-07-09T21:50:24.778003+0000","last_peered":"2023-07-09T21:50:24.778003+0000","last_clean":"2023-07-09T21:50:24.778003+0000","last_became_active":"2023-07-09T21:50:23.787079+0000","last_became_peered":"2023-07-09T21:50:23.787079+0000","last_unstale":"2023-07-09T21:50:24.778003+0000","last_undegraded":"2023-07-09T21:50:24.778003+0000","last_fullsized":"2023-07-09T21:50:24.778003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:57:30.199160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:25.401659+0000","last_change":"2023-07-09T21:50:23.783603+0000","last_active":"2023-07-09T21:50:25.401659+0000","last_peered":"2023-07-09T21:50:25.401659+0000","last_clean":"2023-07-09T21:50:25.401659+0000","last_became_active":"2023-07-09T21:50:23.781930+0000","last_became_peered":"2023-07-09T21:50:23.781930+0000","last_unstale":"2023-07-09T21:50:25.401659+0000","last_undegraded":"2023-07-09T21:50:25.401659+0000","last_fullsized":"2023-07-09T21:50:25.401659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:42.174544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770323+0000","last_change":"2023-07-09T21:50:23.788879+0000","last_active":"2023-07-09T21:50:24.770323+0000","last_peered":"2023-07-09T21:50:24.770323+0000","last_clean":"2023-07-09T21:50:24.770323+0000","last_became_active":"2023-07-09T21:50:23.788458+0000","last_became_peered":"2023-07-09T21:50:23.788458+0000","last_unstale":"2023-07-09T21:50:24.770323+0000","last_undegraded":"2023-07-09T21:50:24.770323+0000","last_fullsized":"2023-07-09T21:50:24.770323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:25.805124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.778113+0000","last_change":"2023-07-09T21:50:23.787304+0000","last_active":"2023-07-09T21:50:24.778113+0000","last_peered":"2023-07-09T21:50:24.778113+0000","last_clean":"2023-07-09T21:50:24.778113+0000","last_became_active":"2023-07-09T21:50:23.787022+0000","last_became_peered":"2023-07-09T21:50:23.787022+0000","last_unstale":"2023-07-09T21:50:24.778113+0000","last_undegraded":"2023-07-09T21:50:24.778113+0000","last_fullsized":"2023-07-09T21:50:24.778113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:33.892801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.770719+0000","last_change":"2023-07-09T21:50:23.785978+0000","last_active":"2023-07-09T21:50:24.770719+0000","last_peered":"2023-07-09T21:50:24.770719+0000","last_clean":"2023-07-09T21:50:24.770719+0000","last_became_active":"2023-07-09T21:50:23.785694+0000","last_became_peered":"2023-07-09T21:50:23.785694+0000","last_unstale":"2023-07-09T21:50:24.770719+0000","last_undegraded":"2023-07-09T21:50:24.770719+0000","last_fullsized":"2023-07-09T21:50:24.770719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:13.602484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-09T21:50:24.833070+0000","last_change":"2023-07-09T21:50:23.780066+0000","last_active":"2023-07-09T21:50:24.833070+0000","last_peered":"2023-07-09T21:50:24.833070+0000","last_clean":"2023-07-09T21:50:24.833070+0000","last_became_active":"2023-07-09T21:50:23.779691+0000","last_became_peered":"2023-07-09T21:50:23.779691+0000","last_unstale":"2023-07-09T21:50:24.833070+0000","last_undegraded":"2023-07-09T21:50:24.833070+0000","last_fullsized":"2023-07-09T21:50:24.833070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:22.746844+0000","last_clean_scrub_stamp":"2023-07-09T21:50:22.746844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:41:54.434482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":98625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":258048,"data_stored":97005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":97005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0310000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.905}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":856064,"data_stored":687955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":880640,"data_stored":689153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":97095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":97657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":97005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:50:39.580 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-09T21:50:39.580 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-09T21:50:39.581 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-09T21:50:39.581 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-09T21:50:39.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.815+0000 7f279c3ff700 1 Processor -- start 2023-07-09T21:50:39.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.816+0000 7f279c3ff700 1 -- start start 2023-07-09T21:50:39.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.817+0000 7f279c3ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f27940b1e00 0x7f27940b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.817+0000 7f279c3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27940d1220 0x7f27940afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.817+0000 7f279c3ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27940d2ce0 con 0x7f27940b2350 2023-07-09T21:50:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.818+0000 7f279c3ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27940b3350 con 0x7f27940b1e00 2023-07-09T21:50:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.818+0000 7f279c3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27940b3630 con 0x7f27940d1220 2023-07-09T21:50:39.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.818+0000 7f279999a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f27940b2350 0x7f27940d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56350/0 (socket says 172.21.15.53:56350) 2023-07-09T21:50:39.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.818+0000 7f279999a700 1 -- 172.21.15.53:0/3522448185 learned_addr learned my addr 172.21.15.53:0/3522448185 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:39.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.818+0000 7f279a19b700 1 --2- 172.21.15.53:0/3522448185 >> v2:172.21.15.184:3300/0 conn(0x7f27940b1e00 0x7f27940b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:39.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.818+0000 7f279a99c700 1 --2- 172.21.15.53:0/3522448185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27940d1220 0x7f27940afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:39.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.818+0000 7f2799199700 1 -- 172.21.15.53:0/3522448185 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546164651 0 0) 0x7f27940d2ce0 con 0x7f27940b2350 2023-07-09T21:50:39.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.818+0000 7f2799199700 1 -- 172.21.15.53:0/3522448185 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27800035b0 con 0x7f27940b2350 2023-07-09T21:50:39.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.818+0000 7f279a19b700 1 -- 172.21.15.53:0/3522448185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27940d1220 msgr2=0x7f27940afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:39.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.818+0000 7f279a19b700 1 --2- 172.21.15.53:0/3522448185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27940d1220 0x7f27940afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.818+0000 7f279a19b700 1 -- 172.21.15.53:0/3522448185 >> v1:172.21.15.53:6789/0 conn(0x7f27940b2350 legacy=0x7f27940d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:39.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.818+0000 7f279a19b700 1 -- 172.21.15.53:0/3522448185 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27940b3910 con 0x7f27940b1e00 2023-07-09T21:50:39.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.818+0000 7f279a99c700 1 --2- 172.21.15.53:0/3522448185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27940d1220 0x7f27940afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:50:39.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.819+0000 7f279a19b700 1 --2- 172.21.15.53:0/3522448185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27940b1e00 0x7f27940b43f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2790009820 tx=0x7f2790009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bccc9153419752 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:39.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.819+0000 7f2799199700 1 -- 172.21.15.53:0/3522448185 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790005e30 con 0x7f27940b1e00 2023-07-09T21:50:39.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.819+0000 7f2799199700 1 -- 172.21.15.53:0/3522448185 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2790006030 con 0x7f27940b1e00 2023-07-09T21:50:39.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.819+0000 7f2799199700 1 -- 172.21.15.53:0/3522448185 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27900063c0 con 0x7f27940b1e00 2023-07-09T21:50:39.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.819+0000 7f279c3ff700 1 -- 172.21.15.53:0/3522448185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27940b1e00 msgr2=0x7f27940b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:39.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.819+0000 7f279c3ff700 1 --2- 172.21.15.53:0/3522448185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27940b1e00 0x7f27940b43f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2790009820 tx=0x7f2790009b30 comp rx=0 tx=0).stop 2023-07-09T21:50:39.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.820+0000 7f279c3ff700 1 -- 172.21.15.53:0/3522448185 shutdown_connections 2023-07-09T21:50:39.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.820+0000 7f279c3ff700 1 --2- 172.21.15.53:0/3522448185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27940d1220 0x7f27940afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.820+0000 7f279c3ff700 1 --2- 172.21.15.53:0/3522448185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27940b1e00 0x7f27940b43f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.820+0000 7f279c3ff700 1 -- 172.21.15.53:0/3522448185 >> 172.21.15.53:0/3522448185 conn(0x7f279409c1d0 msgr2=0x7f27940d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:39.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.820+0000 7f279c3ff700 1 -- 172.21.15.53:0/3522448185 shutdown_connections 2023-07-09T21:50:39.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.820+0000 7f279c3ff700 1 -- 172.21.15.53:0/3522448185 wait complete. 2023-07-09T21:50:39.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.822+0000 7f279c3ff700 1 Processor -- start 2023-07-09T21:50:39.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.822+0000 7f279c3ff700 1 -- start start 2023-07-09T21:50:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.823+0000 7f279c3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27940b1e00 0x7f27940cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.823+0000 7f279c3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27940b2350 0x7f27940c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279c3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27940d1220 0x7f27940c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279c3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27940c9c20 con 0x7f27940b1e00 2023-07-09T21:50:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279c3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27941f1d10 con 0x7f27940d1220 2023-07-09T21:50:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279c3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27940c9380 con 0x7f27940b2350 2023-07-09T21:50:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279a19b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27940b1e00 0x7f27940cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279a19b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27940b1e00 0x7f27940cfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53122/0 (socket says 172.21.15.53:53122) 2023-07-09T21:50:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279a19b700 1 -- 172.21.15.53:0/924655923 learned_addr learned my addr 172.21.15.53:0/924655923 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279999a700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27940b2350 0x7f27940c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279a99c700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27940d1220 0x7f27940c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279a19b700 1 -- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27940b2350 msgr2=0x7f27940c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279a19b700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27940b2350 0x7f27940c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279a19b700 1 -- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27940d1220 msgr2=0x7f27940c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:39.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279a19b700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27940d1220 0x7f27940c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:39.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279a19b700 1 -- 172.21.15.53:0/924655923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c009a70 con 0x7f27940b1e00 2023-07-09T21:50:39.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279999a700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27940b2350 0x7f27940c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:39.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.824+0000 7f279a19b700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27940b1e00 0x7f27940cfff0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2790000c00 tx=0x7f2790004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:39.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.825+0000 7f278affd700 1 -- 172.21.15.53:0/924655923 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27900063a0 con 0x7f27940b1e00 2023-07-09T21:50:39.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.825+0000 7f278affd700 1 -- 172.21.15.53:0/924655923 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2790020070 con 0x7f27940b1e00 2023-07-09T21:50:39.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.825+0000 7f278affd700 1 -- 172.21.15.53:0/924655923 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790006760 con 0x7f27940b1e00 2023-07-09T21:50:39.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.825+0000 7f279c3ff700 1 -- 172.21.15.53:0/924655923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2790009430 con 0x7f27940b1e00 2023-07-09T21:50:39.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.825+0000 7f279c3ff700 1 -- 172.21.15.53:0/924655923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27940c9940 con 0x7f27940b1e00 2023-07-09T21:50:39.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.826+0000 7f279c3ff700 1 -- 172.21.15.53:0/924655923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279404e280 con 0x7f27940b1e00 2023-07-09T21:50:39.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.827+0000 7f278affd700 1 -- 172.21.15.53:0/924655923 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2790022030 con 0x7f27940b1e00 2023-07-09T21:50:39.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.828+0000 7f278affd700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f277806ace0 0x7f277806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:39.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.828+0000 7f278affd700 1 -- 172.21.15.53:0/924655923 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f279008a8f0 con 0x7f27940b1e00 2023-07-09T21:50:39.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.828+0000 7f279999a700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f277806ace0 0x7f277806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:39.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.829+0000 7f279999a700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f277806ace0 0x7f277806d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2794153cd0 tx=0x7f2784009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:39.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:39.832+0000 7f278affd700 1 -- 172.21.15.53:0/924655923 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2790055990 con 0x7f27940b1e00 2023-07-09T21:50:40.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.085+0000 7f279c3ff700 1 -- 172.21.15.53:0/924655923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f279408c5a0 con 0x7f27940b1e00 2023-07-09T21:50:40.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.086+0000 7f278affd700 1 -- 172.21.15.53:0/924655923 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2790058fb0 con 0x7f27940b1e00 2023-07-09T21:50:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:40.088 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-09T21:50:40.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.088+0000 7f279c3ff700 1 -- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f277806ace0 msgr2=0x7f277806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.088+0000 7f279c3ff700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f277806ace0 0x7f277806d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2794153cd0 tx=0x7f2784009040 comp rx=0 tx=0).stop 2023-07-09T21:50:40.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.088+0000 7f279c3ff700 1 -- 172.21.15.53:0/924655923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27940b1e00 msgr2=0x7f27940cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.088+0000 7f279c3ff700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27940b1e00 0x7f27940cfff0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2790000c00 tx=0x7f2790004750 comp rx=0 tx=0).stop 2023-07-09T21:50:40.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.088+0000 7f279c3ff700 1 -- 172.21.15.53:0/924655923 shutdown_connections 2023-07-09T21:50:40.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.088+0000 7f279c3ff700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f277806ace0 0x7f277806d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.088+0000 7f279c3ff700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27940d1220 0x7f27940c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.088+0000 7f279c3ff700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27940b1e00 0x7f27940cfff0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.088+0000 7f279c3ff700 1 --2- 172.21.15.53:0/924655923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27940b2350 0x7f27940c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.088+0000 7f279c3ff700 1 -- 172.21.15.53:0/924655923 >> 172.21.15.53:0/924655923 conn(0x7f279409c1d0 msgr2=0x7f279406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:40.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.088+0000 7f279c3ff700 1 -- 172.21.15.53:0/924655923 shutdown_connections 2023-07-09T21:50:40.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.088+0000 7f279c3ff700 1 -- 172.21.15.53:0/924655923 wait complete. 2023-07-09T21:50:40.107 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-09T21:50:40.108 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:50:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.306+0000 7f49099ff700 1 Processor -- start 2023-07-09T21:50:40.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.307+0000 7f49099ff700 1 -- start start 2023-07-09T21:50:40.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.308+0000 7f49099ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f49040b1e00 0x7f49040b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:40.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.308+0000 7f49099ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49040d2ce0 con 0x7f49040d1220 2023-07-09T21:50:40.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.308+0000 7f49099ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49040b3350 con 0x7f49040b2350 2023-07-09T21:50:40.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.308+0000 7f49099ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49040b3630 con 0x7f49040b1e00 2023-07-09T21:50:40.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.308+0000 7f49037fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f49040d1220 0x7f49040afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56362/0 (socket says 172.21.15.53:56362) 2023-07-09T21:50:40.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.308+0000 7f4902ffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f49040b1e00 0x7f49040b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:40.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.308+0000 7f49037fe700 1 -- 172.21.15.53:0/424088360 learned_addr learned my addr 172.21.15.53:0/424088360 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:40.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.308+0000 7f4902ffd700 1 -- 172.21.15.53:0/424088360 >> v1:172.21.15.184:6789/0 conn(0x7f49040b2350 legacy=0x7f49040d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.309+0000 7f4902ffd700 1 -- 172.21.15.53:0/424088360 >> v1:172.21.15.53:6789/0 conn(0x7f49040d1220 legacy=0x7f49040afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.309+0000 7f4902ffd700 1 -- 172.21.15.53:0/424088360 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49040b3910 con 0x7f49040b1e00 2023-07-09T21:50:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.309+0000 7f4901ffb700 1 -- 172.21.15.53:0/424088360 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151282378 0 0) 0x7f49040d2ce0 con 0x7f49040d1220 2023-07-09T21:50:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.309+0000 7f4902ffd700 1 --2- 172.21.15.53:0/424088360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49040b1e00 0x7f49040b43f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009820 tx=0x7f48f4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb39a3923d605f26 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.309+0000 7f4901ffb700 1 -- 172.21.15.53:0/424088360 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4005e30 con 0x7f49040b1e00 2023-07-09T21:50:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.309+0000 7f4901ffb700 1 -- 172.21.15.53:0/424088360 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4006030 con 0x7f49040b1e00 2023-07-09T21:50:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.309+0000 7f4901ffb700 1 -- 172.21.15.53:0/424088360 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f40063e0 con 0x7f49040b1e00 2023-07-09T21:50:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.310+0000 7f49099ff700 1 -- 172.21.15.53:0/424088360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49040b1e00 msgr2=0x7f49040b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.310+0000 7f49099ff700 1 --2- 172.21.15.53:0/424088360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49040b1e00 0x7f49040b43f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009820 tx=0x7f48f4009b30 comp rx=0 tx=0).stop 2023-07-09T21:50:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.310+0000 7f49099ff700 1 -- 172.21.15.53:0/424088360 shutdown_connections 2023-07-09T21:50:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.310+0000 7f49099ff700 1 --2- 172.21.15.53:0/424088360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49040b1e00 0x7f49040b43f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.310+0000 7f49099ff700 1 -- 172.21.15.53:0/424088360 >> 172.21.15.53:0/424088360 conn(0x7f490409c1d0 msgr2=0x7f49040d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:40.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.310+0000 7f49099ff700 1 -- 172.21.15.53:0/424088360 shutdown_connections 2023-07-09T21:50:40.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.310+0000 7f49099ff700 1 -- 172.21.15.53:0/424088360 wait complete. 2023-07-09T21:50:40.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.311+0000 7f49099ff700 1 Processor -- start 2023-07-09T21:50:40.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.312+0000 7f49099ff700 1 -- start start 2023-07-09T21:50:40.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.312+0000 7f49099ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49040b1e00 0x7f490415f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:40.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.312+0000 7f49099ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49040b2350 0x7f49040cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.312+0000 7f49099ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49040d1220 0x7f49040ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.312+0000 7f49099ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49040cffa0 con 0x7f49040b1e00 2023-07-09T21:50:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.312+0000 7f49099ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49040c6c10 con 0x7f49040b2350 2023-07-09T21:50:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.313+0000 7f49099ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49040c6ef0 con 0x7f49040d1220 2023-07-09T21:50:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.313+0000 7f4902ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49040b1e00 0x7f490415f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.313+0000 7f4902ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49040b1e00 0x7f490415f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53142/0 (socket says 172.21.15.53:53142) 2023-07-09T21:50:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.313+0000 7f4902ffd700 1 -- 172.21.15.53:0/2879582342 learned_addr learned my addr 172.21.15.53:0/2879582342 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:40.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.313+0000 7f49027fc700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49040b2350 0x7f49040cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:40.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.313+0000 7f49037fe700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49040d1220 0x7f49040ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:40.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.313+0000 7f4902ffd700 1 -- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49040d1220 msgr2=0x7f49040ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.313+0000 7f4902ffd700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49040d1220 0x7f49040ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.313+0000 7f4902ffd700 1 -- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49040b2350 msgr2=0x7f49040cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.313+0000 7f4902ffd700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49040b2350 0x7f49040cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.313+0000 7f4902ffd700 1 -- 172.21.15.53:0/2879582342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f4009430 con 0x7f49040b1e00 2023-07-09T21:50:40.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.313+0000 7f49027fc700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49040b2350 0x7f49040cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:40.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.313+0000 7f4902ffd700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49040b1e00 0x7f490415f640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f48f4013040 tx=0x7f48f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:40.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.314+0000 7f48ebfff700 1 -- 172.21.15.53:0/2879582342 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4025430 con 0x7f49040b1e00 2023-07-09T21:50:40.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.314+0000 7f48ebfff700 1 -- 172.21.15.53:0/2879582342 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4020070 con 0x7f49040b1e00 2023-07-09T21:50:40.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.314+0000 7f49099ff700 1 -- 172.21.15.53:0/2879582342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49040c71d0 con 0x7f49040b1e00 2023-07-09T21:50:40.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.314+0000 7f48ebfff700 1 -- 172.21.15.53:0/2879582342 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f40257d0 con 0x7f49040b1e00 2023-07-09T21:50:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.314+0000 7f49099ff700 1 -- 172.21.15.53:0/2879582342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49040ce850 con 0x7f49040b1e00 2023-07-09T21:50:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.315+0000 7f49099ff700 1 -- 172.21.15.53:0/2879582342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49040c76f0 con 0x7f49040b1e00 2023-07-09T21:50:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.316+0000 7f48ebfff700 1 -- 172.21.15.53:0/2879582342 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f48f4022030 con 0x7f49040b1e00 2023-07-09T21:50:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.317+0000 7f48ebfff700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f48f006ace0 0x7f48f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.317+0000 7f48ebfff700 1 -- 172.21.15.53:0/2879582342 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f48f408ac40 con 0x7f49040b1e00 2023-07-09T21:50:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.317+0000 7f49027fc700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f48f006ace0 0x7f48f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.318+0000 7f49027fc700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f48f006ace0 0x7f48f006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f49041f59f0 tx=0x7f48f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:40.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.321+0000 7f48ebfff700 1 -- 172.21.15.53:0/2879582342 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49040c76f0 con 0x7f49040b1e00 2023-07-09T21:50:40.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.529+0000 7f49099ff700 1 -- 172.21.15.53:0/2879582342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f490404e280 con 0x7f49040b1e00 2023-07-09T21:50:40.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.531+0000 7f48ebfff700 1 -- 172.21.15.53:0/2879582342 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f48f4055ce0 con 0x7f49040b1e00 2023-07-09T21:50:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:40.533 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:24.766288+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:50:40.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.534+0000 7f49099ff700 1 -- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f48f006ace0 msgr2=0x7f48f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.534+0000 7f49099ff700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f48f006ace0 0x7f48f006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f49041f59f0 tx=0x7f48f8009040 comp rx=0 tx=0).stop 2023-07-09T21:50:40.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.534+0000 7f49099ff700 1 -- 172.21.15.53:0/2879582342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49040b1e00 msgr2=0x7f490415f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.534+0000 7f49099ff700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49040b1e00 0x7f490415f640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f48f4013040 tx=0x7f48f4004750 comp rx=0 tx=0).stop 2023-07-09T21:50:40.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.534+0000 7f49099ff700 1 -- 172.21.15.53:0/2879582342 shutdown_connections 2023-07-09T21:50:40.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.534+0000 7f49099ff700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f48f006ace0 0x7f48f006d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.534+0000 7f49099ff700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49040d1220 0x7f49040ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.534+0000 7f49099ff700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49040b1e00 0x7f490415f640 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.534+0000 7f49099ff700 1 --2- 172.21.15.53:0/2879582342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49040b2350 0x7f49040cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.534+0000 7f49099ff700 1 -- 172.21.15.53:0/2879582342 >> 172.21.15.53:0/2879582342 conn(0x7f490409c1d0 msgr2=0x7f49040afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:40.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.534+0000 7f49099ff700 1 -- 172.21.15.53:0/2879582342 shutdown_connections 2023-07-09T21:50:40.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.534+0000 7f49099ff700 1 -- 172.21.15.53:0/2879582342 wait complete. 2023-07-09T21:50:40.553 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:50:21.703759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:50:22.243698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:50:40.554 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:50:40.597 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:50:40.604 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:50:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.760+0000 7f12a99ff700 1 Processor -- start 2023-07-09T21:50:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.760+0000 7f12a99ff700 1 -- start start 2023-07-09T21:50:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.761+0000 7f12a99ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f12a40d1220 0x7f12a40b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.761+0000 7f12a99ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12a40b0e20 0x7f12a40b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.761+0000 7f12a99ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a40b8e80 con 0x7f12a40b3ff0 2023-07-09T21:50:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.761+0000 7f12a99ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a40afaa0 con 0x7f12a40d1220 2023-07-09T21:50:40.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.761+0000 7f12a99ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40afd80 con 0x7f12a40b0e20 2023-07-09T21:50:40.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.761+0000 7f12a2ffd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f12a40b3ff0 0x7f12a40d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56370/0 (socket says 172.21.15.53:56370) 2023-07-09T21:50:40.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.761+0000 7f12a2ffd700 1 -- 172.21.15.53:0/2306282995 learned_addr learned my addr 172.21.15.53:0/2306282995 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:40.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.761+0000 7f12a37fe700 1 --2- 172.21.15.53:0/2306282995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12a40b0e20 0x7f12a40b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:40.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.761+0000 7f12a27fc700 1 --2- 172.21.15.53:0/2306282995 >> v2:172.21.15.184:3300/0 conn(0x7f12a40d1220 0x7f12a40b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:40.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.762+0000 7f12a1ffb700 1 -- 172.21.15.53:0/2306282995 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761986857 0 0) 0x7f1294001110 con 0x7f12a40b3ff0 2023-07-09T21:50:40.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.762+0000 7f12a1ffb700 1 -- 172.21.15.53:0/2306282995 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f128c0035b0 con 0x7f12a40b3ff0 2023-07-09T21:50:40.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.762+0000 7f12a37fe700 1 -- 172.21.15.53:0/2306282995 >> v2:172.21.15.184:3300/0 conn(0x7f12a40d1220 msgr2=0x7f12a40b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:40.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.762+0000 7f12a37fe700 1 --2- 172.21.15.53:0/2306282995 >> v2:172.21.15.184:3300/0 conn(0x7f12a40d1220 0x7f12a40b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.762+0000 7f12a1ffb700 1 -- 172.21.15.53:0/2306282995 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1090345070 0 0) 0x7f128c0035b0 con 0x7f12a40b3ff0 2023-07-09T21:50:40.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.762+0000 7f12a37fe700 1 -- 172.21.15.53:0/2306282995 >> v1:172.21.15.53:6789/0 conn(0x7f12a40b3ff0 legacy=0x7f12a40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.762+0000 7f12a37fe700 1 -- 172.21.15.53:0/2306282995 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a40b0060 con 0x7f12a40b0e20 2023-07-09T21:50:40.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.762+0000 7f12a27fc700 1 --2- 172.21.15.53:0/2306282995 >> v2:172.21.15.184:3300/0 conn(0x7f12a40d1220 0x7f12a40b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:50:40.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.762+0000 7f12a37fe700 1 --2- 172.21.15.53:0/2306282995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12a40b0e20 0x7f12a40b1240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f129c009d90 tx=0x7f129c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acc3b3dd959f14ee server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:40.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.762+0000 7f12a1ffb700 1 -- 172.21.15.53:0/2306282995 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c00e070 con 0x7f12a40b0e20 2023-07-09T21:50:40.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.762+0000 7f12a1ffb700 1 -- 172.21.15.53:0/2306282995 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c003a20 con 0x7f12a40b0e20 2023-07-09T21:50:40.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.762+0000 7f12a1ffb700 1 -- 172.21.15.53:0/2306282995 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294001800 con 0x7f12a40b0e20 2023-07-09T21:50:40.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.763+0000 7f12a99ff700 1 -- 172.21.15.53:0/2306282995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12a40b0e20 msgr2=0x7f12a40b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.763+0000 7f12a99ff700 1 --2- 172.21.15.53:0/2306282995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12a40b0e20 0x7f12a40b1240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f129c009d90 tx=0x7f129c00b330 comp rx=0 tx=0).stop 2023-07-09T21:50:40.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.763+0000 7f12a99ff700 1 -- 172.21.15.53:0/2306282995 shutdown_connections 2023-07-09T21:50:40.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.763+0000 7f12a99ff700 1 --2- 172.21.15.53:0/2306282995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12a40b0e20 0x7f12a40b1240 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.763+0000 7f12a99ff700 1 --2- 172.21.15.53:0/2306282995 >> v2:172.21.15.184:3300/0 conn(0x7f12a40d1220 0x7f12a40b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.763+0000 7f12a99ff700 1 -- 172.21.15.53:0/2306282995 >> 172.21.15.53:0/2306282995 conn(0x7f12a409c1b0 msgr2=0x7f12a40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:40.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.763+0000 7f12a99ff700 1 -- 172.21.15.53:0/2306282995 shutdown_connections 2023-07-09T21:50:40.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.763+0000 7f12a99ff700 1 -- 172.21.15.53:0/2306282995 wait complete. 2023-07-09T21:50:40.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.765+0000 7f12a99ff700 1 Processor -- start 2023-07-09T21:50:40.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.765+0000 7f12a99ff700 1 -- start start 2023-07-09T21:50:40.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.766+0000 7f12a99ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a40b0e20 0x7f12a40c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:40.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.766+0000 7f12a99ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12a40b3ff0 0x7f12a41f3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:40.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.766+0000 7f12a99ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12a40d1220 0x7f12a41f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:40.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.766+0000 7f12a99ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a414cb70 con 0x7f12a40b0e20 2023-07-09T21:50:40.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.766+0000 7f12a99ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40c8f90 con 0x7f12a40b3ff0 2023-07-09T21:50:40.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.766+0000 7f12a99ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40c8380 con 0x7f12a40d1220 2023-07-09T21:50:40.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.766+0000 7f12a2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a40b0e20 0x7f12a40c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:40.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.766+0000 7f12a2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a40b0e20 0x7f12a40c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53156/0 (socket says 172.21.15.53:53156) 2023-07-09T21:50:40.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.766+0000 7f12a2ffd700 1 -- 172.21.15.53:0/2144671659 learned_addr learned my addr 172.21.15.53:0/2144671659 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:40.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.766+0000 7f12a27fc700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12a40b3ff0 0x7f12a41f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:40.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.767+0000 7f12a37fe700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12a40d1220 0x7f12a41f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:40.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.767+0000 7f12a2ffd700 1 -- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12a40d1220 msgr2=0x7f12a41f3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.767+0000 7f12a2ffd700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12a40d1220 0x7f12a41f3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.767+0000 7f12a2ffd700 1 -- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12a40b3ff0 msgr2=0x7f12a41f3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.767+0000 7f12a2ffd700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12a40b3ff0 0x7f12a41f3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.767+0000 7f12a2ffd700 1 -- 172.21.15.53:0/2144671659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12980094a0 con 0x7f12a40b0e20 2023-07-09T21:50:40.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.767+0000 7f12a37fe700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12a40d1220 0x7f12a41f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:40.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.767+0000 7f12a2ffd700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a40b0e20 0x7f12a40c9420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f129400c750 tx=0x7f129400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:40.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.767+0000 7f128bfff700 1 -- 172.21.15.53:0/2144671659 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294004c80 con 0x7f12a40b0e20 2023-07-09T21:50:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.767+0000 7f128bfff700 1 -- 172.21.15.53:0/2144671659 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1294004de0 con 0x7f12a40b0e20 2023-07-09T21:50:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.767+0000 7f12a99ff700 1 -- 172.21.15.53:0/2144671659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c009a70 con 0x7f12a40b0e20 2023-07-09T21:50:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.767+0000 7f128bfff700 1 -- 172.21.15.53:0/2144671659 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12940072f0 con 0x7f12a40b0e20 2023-07-09T21:50:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.767+0000 7f12a99ff700 1 -- 172.21.15.53:0/2144671659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a40c8940 con 0x7f12a40b0e20 2023-07-09T21:50:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.768+0000 7f12a99ff700 1 -- 172.21.15.53:0/2144671659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a40b7750 con 0x7f12a40b0e20 2023-07-09T21:50:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.769+0000 7f128bfff700 1 -- 172.21.15.53:0/2144671659 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1294007450 con 0x7f12a40b0e20 2023-07-09T21:50:40.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.770+0000 7f128bfff700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f129006ace0 0x7f129006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:40.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.770+0000 7f128bfff700 1 -- 172.21.15.53:0/2144671659 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f12940890e0 con 0x7f12a40b0e20 2023-07-09T21:50:40.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.771+0000 7f12a27fc700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f129006ace0 0x7f129006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:40.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.771+0000 7f12a27fc700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f129006ace0 0x7f129006d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12a415fdb0 tx=0x7f1298008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:40.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.775+0000 7f128bfff700 1 -- 172.21.15.53:0/2144671659 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1294054180 con 0x7f12a40b0e20 2023-07-09T21:50:40.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.980+0000 7f12a99ff700 1 -- 172.21.15.53:0/2144671659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12a40b8e80 con 0x7f12a40b0e20 2023-07-09T21:50:40.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.981+0000 7f128bfff700 1 -- 172.21.15.53:0/2144671659 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12a40b8e80 con 0x7f12a40b0e20 2023-07-09T21:50:40.983 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:50:40.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.983+0000 7f12a99ff700 1 -- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f129006ace0 msgr2=0x7f129006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.983+0000 7f12a99ff700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f129006ace0 0x7f129006d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12a415fdb0 tx=0x7f1298008040 comp rx=0 tx=0).stop 2023-07-09T21:50:40.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.983+0000 7f12a99ff700 1 -- 172.21.15.53:0/2144671659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a40b0e20 msgr2=0x7f12a40c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:40.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.983+0000 7f12a99ff700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a40b0e20 0x7f12a40c9420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f129400c750 tx=0x7f129400cb10 comp rx=0 tx=0).stop 2023-07-09T21:50:40.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.983+0000 7f12a99ff700 1 -- 172.21.15.53:0/2144671659 shutdown_connections 2023-07-09T21:50:40.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.983+0000 7f12a99ff700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f129006ace0 0x7f129006d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.983+0000 7f12a99ff700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12a40d1220 0x7f12a41f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.983+0000 7f12a99ff700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a40b0e20 0x7f12a40c9420 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.983+0000 7f12a99ff700 1 --2- 172.21.15.53:0/2144671659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12a40b3ff0 0x7f12a41f3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:40.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.983+0000 7f12a99ff700 1 -- 172.21.15.53:0/2144671659 >> 172.21.15.53:0/2144671659 conn(0x7f12a409c1b0 msgr2=0x7f12a406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:40.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.983+0000 7f12a99ff700 1 -- 172.21.15.53:0/2144671659 shutdown_connections 2023-07-09T21:50:40.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:40.983+0000 7f12a99ff700 1 -- 172.21.15.53:0/2144671659 wait complete. 2023-07-09T21:50:41.002 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:50:41.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.203+0000 7f8df8bff700 1 Processor -- start 2023-07-09T21:50:41.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.203+0000 7f8df8bff700 1 -- start start 2023-07-09T21:50:41.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.204+0000 7f8df8bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8df40b3ff0 0x7f8df40b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:41.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.204+0000 7f8df8bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8df40d0b10 0x7f8df40d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:41.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.204+0000 7f8df8bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df40b8e80 con 0x7f8df40b25d0 2023-07-09T21:50:41.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.204+0000 7f8df8bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df40d14a0 con 0x7f8df40b3ff0 2023-07-09T21:50:41.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.204+0000 7f8df8bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40b1e30 con 0x7f8df40d0b10 2023-07-09T21:50:41.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.205+0000 7f8debfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8df40d0b10 0x7f8df40d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:41.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.205+0000 7f8df259c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8df40b3ff0 0x7f8df40b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:41.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.205+0000 7f8df259c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8df40b3ff0 0x7f8df40b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57730/0 (socket says 172.21.15.53:57730) 2023-07-09T21:50:41.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.205+0000 7f8debfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8df40d0b10 0x7f8df40d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58700/0 (socket says 172.21.15.53:58700) 2023-07-09T21:50:41.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.205+0000 7f8df259c700 1 -- 172.21.15.53:0/3330937133 learned_addr learned my addr 172.21.15.53:0/3330937133 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:41.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.206+0000 7f8debfff700 1 -- 172.21.15.53:0/3330937133 >> v2:172.21.15.184:3300/0 conn(0x7f8df40b3ff0 msgr2=0x7f8df40b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:41.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.206+0000 7f8debfff700 1 --2- 172.21.15.53:0/3330937133 >> v2:172.21.15.184:3300/0 conn(0x7f8df40b3ff0 0x7f8df40b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.206+0000 7f8debfff700 1 -- 172.21.15.53:0/3330937133 >> v1:172.21.15.184:6789/0 conn(0x7f8df40b25d0 legacy=0x7f8df40b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:41.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.206+0000 7f8debfff700 1 -- 172.21.15.53:0/3330937133 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df40afaa0 con 0x7f8df40d0b10 2023-07-09T21:50:41.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.206+0000 7f8df259c700 1 --2- 172.21.15.53:0/3330937133 >> v2:172.21.15.184:3300/0 conn(0x7f8df40b3ff0 0x7f8df40b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:50:41.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.206+0000 7f8debfff700 1 --2- 172.21.15.53:0/3330937133 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8df40d0b10 0x7f8df40d0f60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009840 tx=0x7f8ddc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e10f41efdd32083 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:41.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.206+0000 7f8df1d9b700 1 -- 172.21.15.53:0/3330937133 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc011830 con 0x7f8df40d0b10 2023-07-09T21:50:41.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.206+0000 7f8df1d9b700 1 -- 172.21.15.53:0/3330937133 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc011990 con 0x7f8df40d0b10 2023-07-09T21:50:41.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.206+0000 7f8df1d9b700 1 -- 172.21.15.53:0/3330937133 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc011d20 con 0x7f8df40d0b10 2023-07-09T21:50:41.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.207+0000 7f8df8bff700 1 -- 172.21.15.53:0/3330937133 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8df40d0b10 msgr2=0x7f8df40d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:41.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.207+0000 7f8df8bff700 1 --2- 172.21.15.53:0/3330937133 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8df40d0b10 0x7f8df40d0f60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009840 tx=0x7f8ddc009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:41.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.207+0000 7f8df8bff700 1 -- 172.21.15.53:0/3330937133 shutdown_connections 2023-07-09T21:50:41.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.207+0000 7f8df8bff700 1 --2- 172.21.15.53:0/3330937133 >> v2:172.21.15.184:3300/0 conn(0x7f8df40b3ff0 0x7f8df40b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.207+0000 7f8df8bff700 1 --2- 172.21.15.53:0/3330937133 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8df40d0b10 0x7f8df40d0f60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.207+0000 7f8df8bff700 1 -- 172.21.15.53:0/3330937133 >> 172.21.15.53:0/3330937133 conn(0x7f8df409c1b0 msgr2=0x7f8df40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:41.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.207+0000 7f8df8bff700 1 -- 172.21.15.53:0/3330937133 shutdown_connections 2023-07-09T21:50:41.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.207+0000 7f8df8bff700 1 -- 172.21.15.53:0/3330937133 wait complete. 2023-07-09T21:50:41.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.209+0000 7f8df8bff700 1 Processor -- start 2023-07-09T21:50:41.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.209+0000 7f8df8bff700 1 -- start start 2023-07-09T21:50:41.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.210+0000 7f8df8bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8df40b25d0 0x7f8df40cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:41.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.210+0000 7f8df8bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8df40b3ff0 0x7f8df40cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:41.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.210+0000 7f8df8bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df40d0b10 0x7f8df41f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:41.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.210+0000 7f8df8bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df415bcb0 con 0x7f8df40d0b10 2023-07-09T21:50:41.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.210+0000 7f8df8bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df415ae30 con 0x7f8df40b25d0 2023-07-09T21:50:41.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.210+0000 7f8df8bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40ccf80 con 0x7f8df40b3ff0 2023-07-09T21:50:41.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.210+0000 7f8df259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8df40b25d0 0x7f8df40cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:41.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.210+0000 7f8df2d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df40d0b10 0x7f8df41f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:41.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.210+0000 7f8debfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8df40b3ff0 0x7f8df40cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:41.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.210+0000 7f8df259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8df40b25d0 0x7f8df40cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:57732/0 (socket says 172.21.15.53:57732) 2023-07-09T21:50:41.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.210+0000 7f8df259c700 1 -- 172.21.15.53:0/28756391 learned_addr learned my addr 172.21.15.53:0/28756391 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:41.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.211+0000 7f8debfff700 1 -- 172.21.15.53:0/28756391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8df40b25d0 msgr2=0x7f8df40cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:41.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.211+0000 7f8debfff700 1 --2- 172.21.15.53:0/28756391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8df40b25d0 0x7f8df40cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.211+0000 7f8debfff700 1 -- 172.21.15.53:0/28756391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df40d0b10 msgr2=0x7f8df41f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:41.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.211+0000 7f8debfff700 1 --2- 172.21.15.53:0/28756391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df40d0b10 0x7f8df41f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.211+0000 7f8debfff700 1 -- 172.21.15.53:0/28756391 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4009550 con 0x7f8df40b3ff0 2023-07-09T21:50:41.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.211+0000 7f8df2d9d700 1 --2- 172.21.15.53:0/28756391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df40d0b10 0x7f8df41f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:50:41.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.211+0000 7f8debfff700 1 --2- 172.21.15.53:0/28756391 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8df40b3ff0 0x7f8df40cfbe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc016000 tx=0x7f8ddc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:41.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.211+0000 7f8deaffd700 1 -- 172.21.15.53:0/28756391 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0036a0 con 0x7f8df40b3ff0 2023-07-09T21:50:41.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.211+0000 7f8deaffd700 1 -- 172.21.15.53:0/28756391 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc01e070 con 0x7f8df40b3ff0 2023-07-09T21:50:41.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.211+0000 7f8df8bff700 1 -- 172.21.15.53:0/28756391 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc0094a0 con 0x7f8df40b3ff0 2023-07-09T21:50:41.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.211+0000 7f8deaffd700 1 -- 172.21.15.53:0/28756391 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc003a20 con 0x7f8df40b3ff0 2023-07-09T21:50:41.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.211+0000 7f8df8bff700 1 -- 172.21.15.53:0/28756391 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df415b310 con 0x7f8df40b3ff0 2023-07-09T21:50:41.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.212+0000 7f8df8bff700 1 -- 172.21.15.53:0/28756391 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df4074350 con 0x7f8df40b3ff0 2023-07-09T21:50:41.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.214+0000 7f8deaffd700 1 -- 172.21.15.53:0/28756391 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ddc003b80 con 0x7f8df40b3ff0 2023-07-09T21:50:41.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.214+0000 7f8deaffd700 1 --2- 172.21.15.53:0/28756391 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8dd406ace0 0x7f8dd406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:41.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.215+0000 7f8deaffd700 1 -- 172.21.15.53:0/28756391 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ddc08a550 con 0x7f8df40b3ff0 2023-07-09T21:50:41.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.215+0000 7f8df259c700 1 --2- 172.21.15.53:0/28756391 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8dd406ace0 0x7f8dd406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:41.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.216+0000 7f8df259c700 1 --2- 172.21.15.53:0/28756391 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8dd406ace0 0x7f8dd406d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8df415df20 tx=0x7f8de40092c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:41.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.220+0000 7f8deaffd700 1 -- 172.21.15.53:0/28756391 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8ddc055570 con 0x7f8df40b3ff0 2023-07-09T21:50:41.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.426+0000 7f8df8bff700 1 -- 172.21.15.53:0/28756391 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8df408b870 con 0x7f8df40b3ff0 2023-07-09T21:50:41.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.427+0000 7f8deaffd700 1 -- 172.21.15.53:0/28756391 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8ddc058b90 con 0x7f8df40b3ff0 2023-07-09T21:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:50:41.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.429+0000 7f8df8bff700 1 -- 172.21.15.53:0/28756391 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8dd406ace0 msgr2=0x7f8dd406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:41.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.429+0000 7f8df8bff700 1 --2- 172.21.15.53:0/28756391 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8dd406ace0 0x7f8dd406d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8df415df20 tx=0x7f8de40092c0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.429+0000 7f8df8bff700 1 -- 172.21.15.53:0/28756391 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8df40b3ff0 msgr2=0x7f8df40cfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:41.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.429+0000 7f8df8bff700 1 --2- 172.21.15.53:0/28756391 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8df40b3ff0 0x7f8df40cfbe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc016000 tx=0x7f8ddc004750 comp rx=0 tx=0).stop 2023-07-09T21:50:41.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.429+0000 7f8df8bff700 1 -- 172.21.15.53:0/28756391 shutdown_connections 2023-07-09T21:50:41.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.429+0000 7f8df8bff700 1 --2- 172.21.15.53:0/28756391 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8dd406ace0 0x7f8dd406d190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.429+0000 7f8df8bff700 1 --2- 172.21.15.53:0/28756391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df40d0b10 0x7f8df41f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.429+0000 7f8df8bff700 1 --2- 172.21.15.53:0/28756391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8df40b25d0 0x7f8df40cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.429+0000 7f8df8bff700 1 --2- 172.21.15.53:0/28756391 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8df40b3ff0 0x7f8df40cfbe0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.429+0000 7f8df8bff700 1 -- 172.21.15.53:0/28756391 >> 172.21.15.53:0/28756391 conn(0x7f8df409c1b0 msgr2=0x7f8df40d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:41.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.429+0000 7f8df8bff700 1 -- 172.21.15.53:0/28756391 shutdown_connections 2023-07-09T21:50:41.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.429+0000 7f8df8bff700 1 -- 172.21.15.53:0/28756391 wait complete. 2023-07-09T21:50:41.448 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:50:41.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.651+0000 7fd83c1ff700 1 Processor -- start 2023-07-09T21:50:41.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.652+0000 7fd83c1ff700 1 -- start start 2023-07-09T21:50:41.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.653+0000 7fd83c1ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd8340d1220 0x7fd8340b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:41.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.653+0000 7fd83c1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd8340b0e20 0x7fd8340b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:41.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.653+0000 7fd83c1ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340b8e80 con 0x7fd8340b3ff0 2023-07-09T21:50:41.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.653+0000 7fd83c1ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8340afaa0 con 0x7fd8340d1220 2023-07-09T21:50:41.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.653+0000 7fd83c1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8340afd80 con 0x7fd8340b0e20 2023-07-09T21:50:41.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.653+0000 7fd83979a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd8340d1220 0x7fd8340b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:41.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.653+0000 7fd839f9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd8340b3ff0 0x7fd8340d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56376/0 (socket says 172.21.15.53:56376) 2023-07-09T21:50:41.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.653+0000 7fd839f9b700 1 -- 172.21.15.53:0/3037261998 learned_addr learned my addr 172.21.15.53:0/3037261998 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:41.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.653+0000 7fd83a79c700 1 --2- 172.21.15.53:0/3037261998 >> v2:172.21.15.184:3300/0 conn(0x7fd8340b0e20 0x7fd8340b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:41.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.654+0000 7fd83979a700 1 -- 172.21.15.53:0/3037261998 >> v2:172.21.15.184:3300/0 conn(0x7fd8340b0e20 msgr2=0x7fd8340b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:41.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.654+0000 7fd83979a700 1 --2- 172.21.15.53:0/3037261998 >> v2:172.21.15.184:3300/0 conn(0x7fd8340b0e20 0x7fd8340b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.654+0000 7fd83979a700 1 -- 172.21.15.53:0/3037261998 >> v1:172.21.15.53:6789/0 conn(0x7fd8340b3ff0 legacy=0x7fd8340d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:41.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.654+0000 7fd83979a700 1 -- 172.21.15.53:0/3037261998 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340b0060 con 0x7fd8340d1220 2023-07-09T21:50:41.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.654+0000 7fd838f99700 1 -- 172.21.15.53:0/3037261998 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149104282 0 0) 0x7fd830001110 con 0x7fd8340b3ff0 2023-07-09T21:50:41.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.654+0000 7fd83979a700 1 --2- 172.21.15.53:0/3037261998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8340d1220 0x7fd8340b43c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8340d3ce0 tx=0x7fd824009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa46266e9df4634a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:41.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.654+0000 7fd838f99700 1 -- 172.21.15.53:0/3037261998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824011830 con 0x7fd8340d1220 2023-07-09T21:50:41.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.654+0000 7fd838f99700 1 -- 172.21.15.53:0/3037261998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd824011990 con 0x7fd8340d1220 2023-07-09T21:50:41.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.654+0000 7fd838f99700 1 -- 172.21.15.53:0/3037261998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824011d20 con 0x7fd8340d1220 2023-07-09T21:50:41.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.655+0000 7fd83c1ff700 1 -- 172.21.15.53:0/3037261998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8340d1220 msgr2=0x7fd8340b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:41.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.655+0000 7fd83c1ff700 1 --2- 172.21.15.53:0/3037261998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8340d1220 0x7fd8340b43c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8340d3ce0 tx=0x7fd824009b20 comp rx=0 tx=0).stop 2023-07-09T21:50:41.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.655+0000 7fd83c1ff700 1 -- 172.21.15.53:0/3037261998 shutdown_connections 2023-07-09T21:50:41.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.655+0000 7fd83c1ff700 1 --2- 172.21.15.53:0/3037261998 >> v2:172.21.15.184:3300/0 conn(0x7fd8340b0e20 0x7fd8340b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.655+0000 7fd83c1ff700 1 --2- 172.21.15.53:0/3037261998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8340d1220 0x7fd8340b43c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.655+0000 7fd83c1ff700 1 -- 172.21.15.53:0/3037261998 >> 172.21.15.53:0/3037261998 conn(0x7fd83409c1b0 msgr2=0x7fd8340d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:41.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.655+0000 7fd83c1ff700 1 -- 172.21.15.53:0/3037261998 shutdown_connections 2023-07-09T21:50:41.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.655+0000 7fd83c1ff700 1 -- 172.21.15.53:0/3037261998 wait complete. 2023-07-09T21:50:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.657+0000 7fd83c1ff700 1 Processor -- start 2023-07-09T21:50:41.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.657+0000 7fd83c1ff700 1 -- start start 2023-07-09T21:50:41.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd83c1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8340b0e20 0x7fd834159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:41.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd83c1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8340b3ff0 0x7fd8340c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:41.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd83c1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8340d1220 0x7fd8341f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:41.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd83c1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8341f2220 con 0x7fd8340b0e20 2023-07-09T21:50:41.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd83c1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8341f2500 con 0x7fd8340b3ff0 2023-07-09T21:50:41.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd83c1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8341f27e0 con 0x7fd8340d1220 2023-07-09T21:50:41.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd839f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8340b0e20 0x7fd834159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:41.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd839f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8340b0e20 0x7fd834159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53180/0 (socket says 172.21.15.53:53180) 2023-07-09T21:50:41.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd839f9b700 1 -- 172.21.15.53:0/548554372 learned_addr learned my addr 172.21.15.53:0/548554372 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:41.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd83979a700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8340b3ff0 0x7fd8340c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:41.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd83a79c700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8340d1220 0x7fd8341f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd839f9b700 1 -- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8340d1220 msgr2=0x7fd8341f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd839f9b700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8340d1220 0x7fd8341f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd839f9b700 1 -- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8340b3ff0 msgr2=0x7fd8340c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd839f9b700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8340b3ff0 0x7fd8340c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.658+0000 7fd839f9b700 1 -- 172.21.15.53:0/548554372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8240094a0 con 0x7fd8340b0e20 2023-07-09T21:50:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.659+0000 7fd839f9b700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8340b0e20 0x7fd834159470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd83000c730 tx=0x7fd83000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.659+0000 7fd82a7fc700 1 -- 172.21.15.53:0/548554372 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830004c80 con 0x7fd8340b0e20 2023-07-09T21:50:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.659+0000 7fd82a7fc700 1 -- 172.21.15.53:0/548554372 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd830004e00 con 0x7fd8340b0e20 2023-07-09T21:50:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.659+0000 7fd82a7fc700 1 -- 172.21.15.53:0/548554372 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830007310 con 0x7fd8340b0e20 2023-07-09T21:50:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.659+0000 7fd83c1ff700 1 -- 172.21.15.53:0/548554372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8341f2ac0 con 0x7fd8340b0e20 2023-07-09T21:50:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.659+0000 7fd83c1ff700 1 -- 172.21.15.53:0/548554372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8340c9ae0 con 0x7fd8340b0e20 2023-07-09T21:50:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.660+0000 7fd83c1ff700 1 -- 172.21.15.53:0/548554372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd834157c40 con 0x7fd8340b0e20 2023-07-09T21:50:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.661+0000 7fd82a7fc700 1 -- 172.21.15.53:0/548554372 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd830007470 con 0x7fd8340b0e20 2023-07-09T21:50:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.662+0000 7fd82a7fc700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd81806ace0 0x7fd81806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.662+0000 7fd82a7fc700 1 -- 172.21.15.53:0/548554372 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd830088f90 con 0x7fd8340b0e20 2023-07-09T21:50:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.663+0000 7fd83979a700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd81806ace0 0x7fd81806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.663+0000 7fd83979a700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd81806ace0 0x7fd81806d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd8240090b0 tx=0x7fd824008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.666+0000 7fd82a7fc700 1 -- 172.21.15.53:0/548554372 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd834157c40 con 0x7fd8340b0e20 2023-07-09T21:50:41.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.872+0000 7fd83c1ff700 1 -- 172.21.15.53:0/548554372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8340b8e80 con 0x7fd8340b0e20 2023-07-09T21:50:41.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.872+0000 7fd82a7fc700 1 -- 172.21.15.53:0/548554372 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8340b8e80 con 0x7fd8340b0e20 2023-07-09T21:50:41.874 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:50:41.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.875+0000 7fd83c1ff700 1 -- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd81806ace0 msgr2=0x7fd81806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:41.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.875+0000 7fd83c1ff700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd81806ace0 0x7fd81806d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd8240090b0 tx=0x7fd824008030 comp rx=0 tx=0).stop 2023-07-09T21:50:41.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.875+0000 7fd83c1ff700 1 -- 172.21.15.53:0/548554372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8340b0e20 msgr2=0x7fd834159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:41.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.875+0000 7fd83c1ff700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8340b0e20 0x7fd834159470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd83000c730 tx=0x7fd83000ca40 comp rx=0 tx=0).stop 2023-07-09T21:50:41.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.875+0000 7fd83c1ff700 1 -- 172.21.15.53:0/548554372 shutdown_connections 2023-07-09T21:50:41.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.875+0000 7fd83c1ff700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd81806ace0 0x7fd81806d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.875+0000 7fd83c1ff700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8340d1220 0x7fd8341f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.875+0000 7fd83c1ff700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8340b0e20 0x7fd834159470 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.875+0000 7fd83c1ff700 1 --2- 172.21.15.53:0/548554372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8340b3ff0 0x7fd8340c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:41.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.875+0000 7fd83c1ff700 1 -- 172.21.15.53:0/548554372 >> 172.21.15.53:0/548554372 conn(0x7fd83409c1b0 msgr2=0x7fd8340d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:41.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.875+0000 7fd83c1ff700 1 -- 172.21.15.53:0/548554372 shutdown_connections 2023-07-09T21:50:41.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:41.875+0000 7fd83c1ff700 1 -- 172.21.15.53:0/548554372 wait complete. 2023-07-09T21:50:41.894 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:50:42.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.095+0000 7f02085ff700 1 Processor -- start 2023-07-09T21:50:42.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.095+0000 7f02085ff700 1 -- start start 2023-07-09T21:50:42.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.096+0000 7f02085ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f02000b3ff0 0x7f02000b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:42.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.097+0000 7f02085ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02000b8e80 con 0x7f02000d0b10 2023-07-09T21:50:42.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.097+0000 7f02085ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02000b33f0 con 0x7f02000d0f90 2023-07-09T21:50:42.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.097+0000 7f02085ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02000b1e30 con 0x7f02000b3ff0 2023-07-09T21:50:42.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.097+0000 7f0205b9a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f02000d0b10 0x7f02000b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56386/0 (socket says 172.21.15.53:56386) 2023-07-09T21:50:42.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.097+0000 7f0205b9a700 1 -- 172.21.15.53:0/3464685954 learned_addr learned my addr 172.21.15.53:0/3464685954 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:42.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.097+0000 7f020639b700 1 --2- 172.21.15.53:0/3464685954 >> v2:172.21.15.184:3300/0 conn(0x7f02000b3ff0 0x7f02000b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:42.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.097+0000 7f0205399700 1 -- 172.21.15.53:0/3464685954 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73931740 0 0) 0x7f01f0001110 con 0x7f02000d0b10 2023-07-09T21:50:42.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.097+0000 7f0205399700 1 -- 172.21.15.53:0/3464685954 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01ec0035b0 con 0x7f02000d0b10 2023-07-09T21:50:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.098+0000 7f0205399700 1 -- 172.21.15.53:0/3464685954 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217922137 0 0) 0x7f02000b33f0 con 0x7f02000d0f90 2023-07-09T21:50:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.098+0000 7f0205399700 1 -- 172.21.15.53:0/3464685954 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01f0001110 con 0x7f02000d0f90 2023-07-09T21:50:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.098+0000 7f0205399700 1 -- 172.21.15.53:0/3464685954 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2261165082 0 0) 0x7f01ec0035b0 con 0x7f02000d0b10 2023-07-09T21:50:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.098+0000 7f020639b700 1 -- 172.21.15.53:0/3464685954 >> v1:172.21.15.184:6789/0 conn(0x7f02000d0f90 legacy=0x7f02000b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:42.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.098+0000 7f020639b700 1 -- 172.21.15.53:0/3464685954 >> v1:172.21.15.53:6789/0 conn(0x7f02000d0b10 legacy=0x7f02000b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:42.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.098+0000 7f020639b700 1 -- 172.21.15.53:0/3464685954 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02000afaa0 con 0x7f02000b3ff0 2023-07-09T21:50:42.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.098+0000 7f020639b700 1 --2- 172.21.15.53:0/3464685954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02000b3ff0 0x7f02000b43c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009840 tx=0x7f01fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5bb9e3faa39982b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.098+0000 7f0205399700 1 -- 172.21.15.53:0/3464685954 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0001800 con 0x7f02000b3ff0 2023-07-09T21:50:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.098+0000 7f0205399700 1 -- 172.21.15.53:0/3464685954 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc004030 con 0x7f02000b3ff0 2023-07-09T21:50:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.098+0000 7f0205399700 1 -- 172.21.15.53:0/3464685954 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0043c0 con 0x7f02000b3ff0 2023-07-09T21:50:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.099+0000 7f02085ff700 1 -- 172.21.15.53:0/3464685954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02000b3ff0 msgr2=0x7f02000b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.099+0000 7f02085ff700 1 --2- 172.21.15.53:0/3464685954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02000b3ff0 0x7f02000b43c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009840 tx=0x7f01fc009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.099+0000 7f02085ff700 1 -- 172.21.15.53:0/3464685954 shutdown_connections 2023-07-09T21:50:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.099+0000 7f02085ff700 1 --2- 172.21.15.53:0/3464685954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02000b3ff0 0x7f02000b43c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.099+0000 7f02085ff700 1 -- 172.21.15.53:0/3464685954 >> 172.21.15.53:0/3464685954 conn(0x7f020009c1b0 msgr2=0x7f02000d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:42.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.099+0000 7f02085ff700 1 -- 172.21.15.53:0/3464685954 shutdown_connections 2023-07-09T21:50:42.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.099+0000 7f02085ff700 1 -- 172.21.15.53:0/3464685954 wait complete. 2023-07-09T21:50:42.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.101+0000 7f02085ff700 1 Processor -- start 2023-07-09T21:50:42.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.101+0000 7f02085ff700 1 -- start start 2023-07-09T21:50:42.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f02085ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02000b3ff0 0x7f02000cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:42.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f02085ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02000d0b10 0x7f02000d0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f02085ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02000d0f90 0x7f02000cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f02085ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02000cffc0 con 0x7f02000b3ff0 2023-07-09T21:50:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f02085ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02000d0760 con 0x7f02000d0f90 2023-07-09T21:50:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f02085ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020015b7a0 con 0x7f02000d0b10 2023-07-09T21:50:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f020639b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02000b3ff0 0x7f02000cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f020639b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02000b3ff0 0x7f02000cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53194/0 (socket says 172.21.15.53:53194) 2023-07-09T21:50:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f020639b700 1 -- 172.21.15.53:0/757817769 learned_addr learned my addr 172.21.15.53:0/757817769 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f0206b9c700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02000d0f90 0x7f02000cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f0205b9a700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02000d0b10 0x7f02000d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f020639b700 1 -- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02000d0b10 msgr2=0x7f02000d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f020639b700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02000d0b10 0x7f02000d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f020639b700 1 -- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02000d0f90 msgr2=0x7f02000cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f020639b700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02000d0f90 0x7f02000cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f020639b700 1 -- 172.21.15.53:0/757817769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc0094a0 con 0x7f02000b3ff0 2023-07-09T21:50:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f0206b9c700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02000d0f90 0x7f02000cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.102+0000 7f0205b9a700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02000d0b10 0x7f02000d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.103+0000 7f020639b700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02000b3ff0 0x7f02000cfa80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0090b0 tx=0x7f01fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.103+0000 7f01f6ffd700 1 -- 172.21.15.53:0/757817769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc011830 con 0x7f02000b3ff0 2023-07-09T21:50:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.103+0000 7f01f6ffd700 1 -- 172.21.15.53:0/757817769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc01f070 con 0x7f02000b3ff0 2023-07-09T21:50:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.103+0000 7f02085ff700 1 -- 172.21.15.53:0/757817769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020015ba80 con 0x7f02000b3ff0 2023-07-09T21:50:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.103+0000 7f01f6ffd700 1 -- 172.21.15.53:0/757817769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc011bf0 con 0x7f02000b3ff0 2023-07-09T21:50:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.103+0000 7f02085ff700 1 -- 172.21.15.53:0/757817769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02000cd570 con 0x7f02000b3ff0 2023-07-09T21:50:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.104+0000 7f02085ff700 1 -- 172.21.15.53:0/757817769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0200074350 con 0x7f02000b3ff0 2023-07-09T21:50:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.105+0000 7f01f6ffd700 1 -- 172.21.15.53:0/757817769 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f01fc011d50 con 0x7f02000b3ff0 2023-07-09T21:50:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.106+0000 7f01f6ffd700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f01e406ace0 0x7f01e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.106+0000 7f01f6ffd700 1 -- 172.21.15.53:0/757817769 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01fc021070 con 0x7f02000b3ff0 2023-07-09T21:50:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.106+0000 7f0205b9a700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f01e406ace0 0x7f01e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.107+0000 7f0205b9a700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f01e406ace0 0x7f01e406d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f01f0001370 tx=0x7f01f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.110+0000 7f01f6ffd700 1 -- 172.21.15.53:0/757817769 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f01fc0599a0 con 0x7f02000b3ff0 2023-07-09T21:50:42.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.316+0000 7f02085ff700 1 -- 172.21.15.53:0/757817769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02000c9740 con 0x7f02000b3ff0 2023-07-09T21:50:42.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.316+0000 7f01f6ffd700 1 -- 172.21.15.53:0/757817769 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01fc059530 con 0x7f02000b3ff0 2023-07-09T21:50:42.318 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:50:42.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.318+0000 7f02085ff700 1 -- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f01e406ace0 msgr2=0x7f01e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:42.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.318+0000 7f02085ff700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f01e406ace0 0x7f01e406d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f01f0001370 tx=0x7f01f0009040 comp rx=0 tx=0).stop 2023-07-09T21:50:42.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.318+0000 7f02085ff700 1 -- 172.21.15.53:0/757817769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02000b3ff0 msgr2=0x7f02000cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:42.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.319+0000 7f02085ff700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02000b3ff0 0x7f02000cfa80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0090b0 tx=0x7f01fc004750 comp rx=0 tx=0).stop 2023-07-09T21:50:42.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.319+0000 7f02085ff700 1 -- 172.21.15.53:0/757817769 shutdown_connections 2023-07-09T21:50:42.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.319+0000 7f02085ff700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f01e406ace0 0x7f01e406d190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.319+0000 7f02085ff700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02000d0f90 0x7f02000cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.319+0000 7f02085ff700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02000b3ff0 0x7f02000cfa80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.319+0000 7f02085ff700 1 --2- 172.21.15.53:0/757817769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02000d0b10 0x7f02000d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.319+0000 7f02085ff700 1 -- 172.21.15.53:0/757817769 >> 172.21.15.53:0/757817769 conn(0x7f020009c1b0 msgr2=0x7f02000b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:42.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.319+0000 7f02085ff700 1 -- 172.21.15.53:0/757817769 shutdown_connections 2023-07-09T21:50:42.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.319+0000 7f02085ff700 1 -- 172.21.15.53:0/757817769 wait complete. 2023-07-09T21:50:42.338 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:50:42.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.537+0000 7f3488dff700 1 Processor -- start 2023-07-09T21:50:42.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.537+0000 7f3488dff700 1 -- start start 2023-07-09T21:50:42.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.538+0000 7f3488dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34840d1220 0x7f34840b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:42.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.538+0000 7f3488dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840b2350 0x7f34840afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:42.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.538+0000 7f3488dff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34840d2ce0 con 0x7f34840b1e00 2023-07-09T21:50:42.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.538+0000 7f3488dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34840b3350 con 0x7f34840d1220 2023-07-09T21:50:42.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.538+0000 7f3488dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34840b3630 con 0x7f34840b2350 2023-07-09T21:50:42.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.539+0000 7f348259c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f34840b1e00 0x7f34840d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56392/0 (socket says 172.21.15.53:56392) 2023-07-09T21:50:42.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.539+0000 7f348259c700 1 -- 172.21.15.53:0/977331007 learned_addr learned my addr 172.21.15.53:0/977331007 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:42.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.539+0000 7f347bfff700 1 --2- 172.21.15.53:0/977331007 >> v2:172.21.15.53:3300/0 conn(0x7f34840d1220 0x7f34840b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:42.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.539+0000 7f3482d9d700 1 --2- 172.21.15.53:0/977331007 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840b2350 0x7f34840afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:42.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.539+0000 7f3481d9b700 1 -- 172.21.15.53:0/977331007 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80747238 0 0) 0x7f34840d2ce0 con 0x7f34840b1e00 2023-07-09T21:50:42.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.539+0000 7f347bfff700 1 -- 172.21.15.53:0/977331007 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840b2350 msgr2=0x7f34840afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:42.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.539+0000 7f347bfff700 1 --2- 172.21.15.53:0/977331007 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840b2350 0x7f34840afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.539+0000 7f347bfff700 1 -- 172.21.15.53:0/977331007 >> v1:172.21.15.53:6789/0 conn(0x7f34840b1e00 legacy=0x7f34840d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:42.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.539+0000 7f347bfff700 1 -- 172.21.15.53:0/977331007 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840b3910 con 0x7f34840d1220 2023-07-09T21:50:42.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.539+0000 7f347bfff700 1 --2- 172.21.15.53:0/977331007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34840d1220 0x7f34840b43f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f346c009840 tx=0x7f346c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f2d9c171a4855 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:42.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.540+0000 7f3481d9b700 1 -- 172.21.15.53:0/977331007 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c011830 con 0x7f34840d1220 2023-07-09T21:50:42.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.540+0000 7f3481d9b700 1 -- 172.21.15.53:0/977331007 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c011990 con 0x7f34840d1220 2023-07-09T21:50:42.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.540+0000 7f3481d9b700 1 -- 172.21.15.53:0/977331007 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c011d20 con 0x7f34840d1220 2023-07-09T21:50:42.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.540+0000 7f3488dff700 1 -- 172.21.15.53:0/977331007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34840d1220 msgr2=0x7f34840b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:42.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.540+0000 7f3488dff700 1 --2- 172.21.15.53:0/977331007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34840d1220 0x7f34840b43f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f346c009840 tx=0x7f346c009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:42.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.540+0000 7f3488dff700 1 -- 172.21.15.53:0/977331007 shutdown_connections 2023-07-09T21:50:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.540+0000 7f3488dff700 1 --2- 172.21.15.53:0/977331007 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840b2350 0x7f34840afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.540+0000 7f3488dff700 1 --2- 172.21.15.53:0/977331007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34840d1220 0x7f34840b43f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.540+0000 7f3488dff700 1 -- 172.21.15.53:0/977331007 >> 172.21.15.53:0/977331007 conn(0x7f348409c1d0 msgr2=0x7f34840d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.540+0000 7f3488dff700 1 -- 172.21.15.53:0/977331007 shutdown_connections 2023-07-09T21:50:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.540+0000 7f3488dff700 1 -- 172.21.15.53:0/977331007 wait complete. 2023-07-09T21:50:42.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.542+0000 7f3488dff700 1 Processor -- start 2023-07-09T21:50:42.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.542+0000 7f3488dff700 1 -- start start 2023-07-09T21:50:42.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.543+0000 7f3488dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34840b1e00 0x7f34840cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:42.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.543+0000 7f3488dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34840b2350 0x7f34840b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:42.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.543+0000 7f3488dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840d1220 0x7f34840b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:42.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.543+0000 7f3488dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34840d0300 con 0x7f34840b1e00 2023-07-09T21:50:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.543+0000 7f3488dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34840b7620 con 0x7f34840b2350 2023-07-09T21:50:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.543+0000 7f3488dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34840b7900 con 0x7f34840d1220 2023-07-09T21:50:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.543+0000 7f348259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34840b1e00 0x7f34840cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.543+0000 7f348259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34840b1e00 0x7f34840cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53206/0 (socket says 172.21.15.53:53206) 2023-07-09T21:50:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.543+0000 7f348259c700 1 -- 172.21.15.53:0/313949274 learned_addr learned my addr 172.21.15.53:0/313949274 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f347bfff700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34840b2350 0x7f34840b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f3482d9d700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840d1220 0x7f34840b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f348259c700 1 -- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840d1220 msgr2=0x7f34840b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:42.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f348259c700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840d1220 0x7f34840b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f348259c700 1 -- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34840b2350 msgr2=0x7f34840b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:42.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f348259c700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34840b2350 0x7f34840b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f348259c700 1 -- 172.21.15.53:0/313949274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c0094a0 con 0x7f34840b1e00 2023-07-09T21:50:42.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f347bfff700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34840b2350 0x7f34840b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:42.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f3482d9d700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840d1220 0x7f34840b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:42.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f348259c700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34840b1e00 0x7f34840cc920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f34740010e0 tx=0x7f347400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f347affd700 1 -- 172.21.15.53:0/313949274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34740074e0 con 0x7f34840b1e00 2023-07-09T21:50:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f347affd700 1 -- 172.21.15.53:0/313949274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3474007640 con 0x7f34840b1e00 2023-07-09T21:50:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f3488dff700 1 -- 172.21.15.53:0/313949274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34840b7be0 con 0x7f34840b1e00 2023-07-09T21:50:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f347affd700 1 -- 172.21.15.53:0/313949274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474005a70 con 0x7f34840b1e00 2023-07-09T21:50:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.544+0000 7f3488dff700 1 -- 172.21.15.53:0/313949274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34840b81a0 con 0x7f34840b1e00 2023-07-09T21:50:42.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.545+0000 7f3488dff700 1 -- 172.21.15.53:0/313949274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348404e280 con 0x7f34840b1e00 2023-07-09T21:50:42.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.546+0000 7f347affd700 1 -- 172.21.15.53:0/313949274 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3474005bd0 con 0x7f34840b1e00 2023-07-09T21:50:42.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.547+0000 7f347affd700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f346406ace0 0x7f346406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:42.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.547+0000 7f347affd700 1 -- 172.21.15.53:0/313949274 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3474088ab0 con 0x7f34840b1e00 2023-07-09T21:50:42.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.548+0000 7f347bfff700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f346406ace0 0x7f346406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:42.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.548+0000 7f347bfff700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f346406ace0 0x7f346406d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f34840d1610 tx=0x7f346c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:42.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.551+0000 7f347affd700 1 -- 172.21.15.53:0/313949274 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3474053ac0 con 0x7f34840b1e00 2023-07-09T21:50:42.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.805+0000 7f3488dff700 1 -- 172.21.15.53:0/313949274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3484071a70 con 0x7f34840b1e00 2023-07-09T21:50:42.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.806+0000 7f347affd700 1 -- 172.21.15.53:0/313949274 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7f3474017020 con 0x7f34840b1e00 2023-07-09T21:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3421374491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3421374491},{"type":"v1","addr":"172.21.15.53:6835","nonce":3421374491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1569539203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":1569539203},{"type":"v1","addr":"172.21.15.184:6837","nonce":1569539203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3569510065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3569510065},{"type":"v1","addr":"172.21.15.53:6834","nonce":3569510065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:50:23.272725+0000","modified":"2023-07-09T21:50:26.798670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/3002520227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3002520227},{"type":"v1","addr":"172.21.15.184:6836","nonce":3002520227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:50:42.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.808+0000 7f3488dff700 1 -- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f346406ace0 msgr2=0x7f346406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.808+0000 7f3488dff700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f346406ace0 0x7f346406d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f34840d1610 tx=0x7f346c008030 comp rx=0 tx=0).stop 2023-07-09T21:50:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.808+0000 7f3488dff700 1 -- 172.21.15.53:0/313949274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34840b1e00 msgr2=0x7f34840cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.808+0000 7f3488dff700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34840b1e00 0x7f34840cc920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f34740010e0 tx=0x7f347400cae0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.808+0000 7f3488dff700 1 -- 172.21.15.53:0/313949274 shutdown_connections 2023-07-09T21:50:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.808+0000 7f3488dff700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f346406ace0 0x7f346406d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.808+0000 7f3488dff700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840d1220 0x7f34840b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.808+0000 7f3488dff700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34840b1e00 0x7f34840cc920 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.808+0000 7f3488dff700 1 --2- 172.21.15.53:0/313949274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34840b2350 0x7f34840b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:42.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.808+0000 7f3488dff700 1 -- 172.21.15.53:0/313949274 >> 172.21.15.53:0/313949274 conn(0x7f348409c1d0 msgr2=0x7f34840d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:42.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.808+0000 7f3488dff700 1 -- 172.21.15.53:0/313949274 shutdown_connections 2023-07-09T21:50:42.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:42.808+0000 7f3488dff700 1 -- 172.21.15.53:0/313949274 wait complete. 2023-07-09T21:50:42.812 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 8 2023-07-09T21:50:42.830 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:50:43.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.029+0000 7f98d1dff700 1 Processor -- start 2023-07-09T21:50:43.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.029+0000 7f98d1dff700 1 -- start start 2023-07-09T21:50:43.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.030+0000 7f98d1dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f98cc0b1e00 0x7f98cc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.030+0000 7f98d1dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98cc0b2350 0x7f98cc0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.030+0000 7f98d1dff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98cc0d2ce0 con 0x7f98cc0d1050 2023-07-09T21:50:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.030+0000 7f98d1dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc0d14d0 con 0x7f98cc0b2350 2023-07-09T21:50:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.030+0000 7f98d1dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc0b3350 con 0x7f98cc0b1e00 2023-07-09T21:50:43.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.031+0000 7f98cbfff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f98cc0d1050 0x7f98cc0afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53476/0 (socket says 172.21.15.53:53476) 2023-07-09T21:50:43.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.031+0000 7f98caffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98cc0b2350 0x7f98cc0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.031+0000 7f98cbfff700 1 -- 172.21.15.53:0/962120255 learned_addr learned my addr 172.21.15.53:0/962120255 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:43.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.031+0000 7f98cb7fe700 1 --2- 172.21.15.53:0/962120255 >> v2:172.21.15.184:3300/0 conn(0x7f98cc0b1e00 0x7f98cc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.031+0000 7f98caffd700 1 -- 172.21.15.53:0/962120255 >> v2:172.21.15.184:3300/0 conn(0x7f98cc0b1e00 msgr2=0x7f98cc0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:43.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.031+0000 7f98caffd700 1 --2- 172.21.15.53:0/962120255 >> v2:172.21.15.184:3300/0 conn(0x7f98cc0b1e00 0x7f98cc0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.031+0000 7f98caffd700 1 -- 172.21.15.53:0/962120255 >> v1:172.21.15.53:6789/0 conn(0x7f98cc0d1050 legacy=0x7f98cc0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.031+0000 7f98caffd700 1 -- 172.21.15.53:0/962120255 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc0b3630 con 0x7f98cc0b2350 2023-07-09T21:50:43.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.031+0000 7f98ca7fc700 1 -- 172.21.15.53:0/962120255 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990197771 0 0) 0x7f98cc0d2ce0 con 0x7f98cc0d1050 2023-07-09T21:50:43.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.031+0000 7f98caffd700 1 --2- 172.21.15.53:0/962120255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98cc0b2350 0x7f98cc0d0b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f98cc08d170 tx=0x7f98c0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679c2b38dd441a5a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:43.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.032+0000 7f98ca7fc700 1 -- 172.21.15.53:0/962120255 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c0011830 con 0x7f98cc0b2350 2023-07-09T21:50:43.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.032+0000 7f98ca7fc700 1 -- 172.21.15.53:0/962120255 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c0011990 con 0x7f98cc0b2350 2023-07-09T21:50:43.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.032+0000 7f98ca7fc700 1 -- 172.21.15.53:0/962120255 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c0011d20 con 0x7f98cc0b2350 2023-07-09T21:50:43.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.032+0000 7f98d1dff700 1 -- 172.21.15.53:0/962120255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98cc0b2350 msgr2=0x7f98cc0d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.032+0000 7f98d1dff700 1 --2- 172.21.15.53:0/962120255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98cc0b2350 0x7f98cc0d0b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f98cc08d170 tx=0x7f98c0009b20 comp rx=0 tx=0).stop 2023-07-09T21:50:43.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.032+0000 7f98d1dff700 1 -- 172.21.15.53:0/962120255 shutdown_connections 2023-07-09T21:50:43.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.032+0000 7f98d1dff700 1 --2- 172.21.15.53:0/962120255 >> v2:172.21.15.184:3300/0 conn(0x7f98cc0b1e00 0x7f98cc0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.032+0000 7f98d1dff700 1 --2- 172.21.15.53:0/962120255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98cc0b2350 0x7f98cc0d0b10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.032+0000 7f98d1dff700 1 -- 172.21.15.53:0/962120255 >> 172.21.15.53:0/962120255 conn(0x7f98cc09c1d0 msgr2=0x7f98cc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:43.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.032+0000 7f98d1dff700 1 -- 172.21.15.53:0/962120255 shutdown_connections 2023-07-09T21:50:43.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.032+0000 7f98d1dff700 1 -- 172.21.15.53:0/962120255 wait complete. 2023-07-09T21:50:43.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.034+0000 7f98d1dff700 1 Processor -- start 2023-07-09T21:50:43.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.034+0000 7f98d1dff700 1 -- start start 2023-07-09T21:50:43.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.035+0000 7f98d1dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98cc0b1e00 0x7f98cc15d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.035+0000 7f98d1dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98cc0b2350 0x7f98cc151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.035+0000 7f98d1dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98cc0d1050 0x7f98cc15f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.035+0000 7f98d1dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc152290 con 0x7f98cc0d1050 2023-07-09T21:50:43.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.035+0000 7f98d1dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc15ee00 con 0x7f98cc0b2350 2023-07-09T21:50:43.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.035+0000 7f98d1dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc15dd60 con 0x7f98cc0b1e00 2023-07-09T21:50:43.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.035+0000 7f98cbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98cc0d1050 0x7f98cc15f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98cbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98cc0d1050 0x7f98cc15f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42184/0 (socket says 172.21.15.53:42184) 2023-07-09T21:50:43.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98cb7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98cc0b1e00 0x7f98cc15d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98cbfff700 1 -- 172.21.15.53:0/3826546470 learned_addr learned my addr 172.21.15.53:0/3826546470 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:43.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98caffd700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98cc0b2350 0x7f98cc151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98cbfff700 1 -- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98cc0b1e00 msgr2=0x7f98cc15d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98cbfff700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98cc0b1e00 0x7f98cc15d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98cbfff700 1 -- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98cc0b2350 msgr2=0x7f98cc151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98cbfff700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98cc0b2350 0x7f98cc151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98cbfff700 1 -- 172.21.15.53:0/3826546470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c00094a0 con 0x7f98cc0d1050 2023-07-09T21:50:43.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98caffd700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98cc0b2350 0x7f98cc151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:50:43.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98cbfff700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98cc0d1050 0x7f98cc15f5e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f98c400cb60 tx=0x7f98c400ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:43.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98b3fff700 1 -- 172.21.15.53:0/3826546470 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c400a9e0 con 0x7f98cc0d1050 2023-07-09T21:50:43.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98b3fff700 1 -- 172.21.15.53:0/3826546470 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c400ab40 con 0x7f98cc0d1050 2023-07-09T21:50:43.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98b3fff700 1 -- 172.21.15.53:0/3826546470 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c40070d0 con 0x7f98cc0d1050 2023-07-09T21:50:43.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.036+0000 7f98d1dff700 1 -- 172.21.15.53:0/3826546470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc15e040 con 0x7f98cc0d1050 2023-07-09T21:50:43.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.037+0000 7f98d1dff700 1 -- 172.21.15.53:0/3826546470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc15e600 con 0x7f98cc0d1050 2023-07-09T21:50:43.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.038+0000 7f98d1dff700 1 -- 172.21.15.53:0/3826546470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98cc04e280 con 0x7f98cc0d1050 2023-07-09T21:50:43.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.039+0000 7f98b3fff700 1 -- 172.21.15.53:0/3826546470 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f98c4007230 con 0x7f98cc0d1050 2023-07-09T21:50:43.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.040+0000 7f98b3fff700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f98b806ace0 0x7f98b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.040+0000 7f98b3fff700 1 -- 172.21.15.53:0/3826546470 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98c4088f90 con 0x7f98cc0d1050 2023-07-09T21:50:43.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.040+0000 7f98cb7fe700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f98b806ace0 0x7f98b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.041+0000 7f98cb7fe700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f98b806ace0 0x7f98b806d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009b20 tx=0x7f98bc0091c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:43.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.044+0000 7f98b3fff700 1 -- 172.21.15.53:0/3826546470 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f98c4053fa0 con 0x7f98cc0d1050 2023-07-09T21:50:43.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.251+0000 7f98d1dff700 1 -- 172.21.15.53:0/3826546470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98cc08c5a0 con 0x7f98cc0d1050 2023-07-09T21:50:43.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.252+0000 7f98b3fff700 1 -- 172.21.15.53:0/3826546470 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f98c40575c0 con 0x7f98cc0d1050 2023-07-09T21:50:43.254 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:43.254 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:24.766288+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:50:43.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.255+0000 7f98d1dff700 1 -- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f98b806ace0 msgr2=0x7f98b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.255+0000 7f98d1dff700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f98b806ace0 0x7f98b806d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009b20 tx=0x7f98bc0091c0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.255+0000 7f98d1dff700 1 -- 172.21.15.53:0/3826546470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98cc0d1050 msgr2=0x7f98cc15f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.255+0000 7f98d1dff700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98cc0d1050 0x7f98cc15f5e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f98c400cb60 tx=0x7f98c400ce70 comp rx=0 tx=0).stop 2023-07-09T21:50:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.255+0000 7f98d1dff700 1 -- 172.21.15.53:0/3826546470 shutdown_connections 2023-07-09T21:50:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.255+0000 7f98d1dff700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f98b806ace0 0x7f98b806d190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.255+0000 7f98d1dff700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98cc0d1050 0x7f98cc15f5e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.255+0000 7f98d1dff700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98cc0b1e00 0x7f98cc15d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.255+0000 7f98d1dff700 1 --2- 172.21.15.53:0/3826546470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98cc0b2350 0x7f98cc151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.255+0000 7f98d1dff700 1 -- 172.21.15.53:0/3826546470 >> 172.21.15.53:0/3826546470 conn(0x7f98cc09c1d0 msgr2=0x7f98cc06bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:43.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.255+0000 7f98d1dff700 1 -- 172.21.15.53:0/3826546470 shutdown_connections 2023-07-09T21:50:43.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.255+0000 7f98d1dff700 1 -- 172.21.15.53:0/3826546470 wait complete. 2023-07-09T21:50:43.274 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:50:21.703759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:50:22.243698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:50:43.275 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:50:43.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.476+0000 7f4f34fff700 1 Processor -- start 2023-07-09T21:50:43.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.476+0000 7f4f34fff700 1 -- start start 2023-07-09T21:50:43.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f34fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4f300b3ff0 0x7f4f300b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f34fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4f300d0f90 0x7f4f300b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f34fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f300b8e80 con 0x7f4f300d0b10 2023-07-09T21:50:43.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f34fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f300b1e30 con 0x7f4f300d0f90 2023-07-09T21:50:43.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f34fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f300afaa0 con 0x7f4f300b3ff0 2023-07-09T21:50:43.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f27fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4f300d0b10 0x7f4f300b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53486/0 (socket says 172.21.15.53:53486) 2023-07-09T21:50:43.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f27fff700 1 -- 172.21.15.53:0/1401812551 learned_addr learned my addr 172.21.15.53:0/1401812551 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:43.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f2ed9d700 1 --2- 172.21.15.53:0/1401812551 >> v2:172.21.15.53:3300/0 conn(0x7f4f300d0f90 0x7f4f300b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f2e59c700 1 --2- 172.21.15.53:0/1401812551 >> v2:172.21.15.184:3300/0 conn(0x7f4f300b3ff0 0x7f4f300b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f2dd9b700 1 -- 172.21.15.53:0/1401812551 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276327227 0 0) 0x7f4f18001110 con 0x7f4f300d0b10 2023-07-09T21:50:43.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f2dd9b700 1 -- 172.21.15.53:0/1401812551 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f1c0035b0 con 0x7f4f300d0b10 2023-07-09T21:50:43.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f2ed9d700 1 -- 172.21.15.53:0/1401812551 >> v2:172.21.15.184:3300/0 conn(0x7f4f300b3ff0 msgr2=0x7f4f300b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f2ed9d700 1 --2- 172.21.15.53:0/1401812551 >> v2:172.21.15.184:3300/0 conn(0x7f4f300b3ff0 0x7f4f300b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f2ed9d700 1 -- 172.21.15.53:0/1401812551 >> v1:172.21.15.53:6789/0 conn(0x7f4f300d0b10 legacy=0x7f4f300b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.478+0000 7f4f2ed9d700 1 -- 172.21.15.53:0/1401812551 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f300afd80 con 0x7f4f300d0f90 2023-07-09T21:50:43.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.479+0000 7f4f2ed9d700 1 --2- 172.21.15.53:0/1401812551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f300d0f90 0x7f4f300b2ce0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f300b5b00 tx=0x7f4f2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5f744d6a1caf54 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:43.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.479+0000 7f4f2dd9b700 1 -- 172.21.15.53:0/1401812551 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800e070 con 0x7f4f300d0f90 2023-07-09T21:50:43.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.479+0000 7f4f2dd9b700 1 -- 172.21.15.53:0/1401812551 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2800bb20 con 0x7f4f300d0f90 2023-07-09T21:50:43.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.479+0000 7f4f2dd9b700 1 -- 172.21.15.53:0/1401812551 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28012430 con 0x7f4f300d0f90 2023-07-09T21:50:43.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.479+0000 7f4f34fff700 1 -- 172.21.15.53:0/1401812551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f300d0f90 msgr2=0x7f4f300b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.479+0000 7f4f34fff700 1 --2- 172.21.15.53:0/1401812551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f300d0f90 0x7f4f300b2ce0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f300b5b00 tx=0x7f4f2800b330 comp rx=0 tx=0).stop 2023-07-09T21:50:43.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.480+0000 7f4f34fff700 1 -- 172.21.15.53:0/1401812551 shutdown_connections 2023-07-09T21:50:43.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.480+0000 7f4f34fff700 1 --2- 172.21.15.53:0/1401812551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f300d0f90 0x7f4f300b2ce0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.480+0000 7f4f34fff700 1 --2- 172.21.15.53:0/1401812551 >> v2:172.21.15.184:3300/0 conn(0x7f4f300b3ff0 0x7f4f300b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.480+0000 7f4f34fff700 1 -- 172.21.15.53:0/1401812551 >> 172.21.15.53:0/1401812551 conn(0x7f4f3009c1b0 msgr2=0x7f4f300d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:43.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.480+0000 7f4f34fff700 1 -- 172.21.15.53:0/1401812551 shutdown_connections 2023-07-09T21:50:43.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.480+0000 7f4f34fff700 1 -- 172.21.15.53:0/1401812551 wait complete. 2023-07-09T21:50:43.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.481+0000 7f4f34fff700 1 Processor -- start 2023-07-09T21:50:43.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.482+0000 7f4f34fff700 1 -- start start 2023-07-09T21:50:43.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.482+0000 7f4f34fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f300b3ff0 0x7f4f3014b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f34fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f300d0b10 0x7f4f300ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f34fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f300d0f90 0x7f4f3014be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f34fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f300c9c60 con 0x7f4f300d0b10 2023-07-09T21:50:43.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f34fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f300c97d0 con 0x7f4f300d0f90 2023-07-09T21:50:43.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f34fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f300c8bc0 con 0x7f4f300b3ff0 2023-07-09T21:50:43.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f27fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f300d0b10 0x7f4f300ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f27fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f300d0b10 0x7f4f300ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42200/0 (socket says 172.21.15.53:42200) 2023-07-09T21:50:43.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f27fff700 1 -- 172.21.15.53:0/4125996022 learned_addr learned my addr 172.21.15.53:0/4125996022 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:43.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f2e59c700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f300b3ff0 0x7f4f3014b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f2ed9d700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f300d0f90 0x7f4f3014be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f27fff700 1 -- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f300b3ff0 msgr2=0x7f4f3014b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f27fff700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f300b3ff0 0x7f4f3014b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f27fff700 1 -- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f300d0f90 msgr2=0x7f4f3014be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f27fff700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f300d0f90 0x7f4f3014be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f27fff700 1 -- 172.21.15.53:0/4125996022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28009a70 con 0x7f4f300d0b10 2023-07-09T21:50:43.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.483+0000 7f4f27fff700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f300d0b10 0x7f4f300ccae0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f18007fd0 tx=0x7f4f1800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:43.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.484+0000 7f4f26ffd700 1 -- 172.21.15.53:0/4125996022 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18005d70 con 0x7f4f300d0b10 2023-07-09T21:50:43.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.484+0000 7f4f26ffd700 1 -- 172.21.15.53:0/4125996022 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f180070d0 con 0x7f4f300d0b10 2023-07-09T21:50:43.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.484+0000 7f4f26ffd700 1 -- 172.21.15.53:0/4125996022 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18007460 con 0x7f4f300d0b10 2023-07-09T21:50:43.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.484+0000 7f4f34fff700 1 -- 172.21.15.53:0/4125996022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f300c8ea0 con 0x7f4f300d0b10 2023-07-09T21:50:43.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.484+0000 7f4f34fff700 1 -- 172.21.15.53:0/4125996022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f300c9460 con 0x7f4f300d0b10 2023-07-09T21:50:43.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.485+0000 7f4f34fff700 1 -- 172.21.15.53:0/4125996022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f300b8450 con 0x7f4f300d0b10 2023-07-09T21:50:43.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.486+0000 7f4f26ffd700 1 -- 172.21.15.53:0/4125996022 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f180075c0 con 0x7f4f300d0b10 2023-07-09T21:50:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.487+0000 7f4f26ffd700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4f1006ad10 0x7f4f1006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.487+0000 7f4f26ffd700 1 -- 172.21.15.53:0/4125996022 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4f180887d0 con 0x7f4f300d0b10 2023-07-09T21:50:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.487+0000 7f4f2e59c700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4f1006ad10 0x7f4f1006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.488+0000 7f4f2e59c700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4f1006ad10 0x7f4f1006d1c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009be0 tx=0x7f4f20009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.491+0000 7f4f26ffd700 1 -- 172.21.15.53:0/4125996022 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f180537e0 con 0x7f4f300d0b10 2023-07-09T21:50:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.699+0000 7f4f34fff700 1 -- 172.21.15.53:0/4125996022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f300b8e80 con 0x7f4f300d0b10 2023-07-09T21:50:43.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.699+0000 7f4f26ffd700 1 -- 172.21.15.53:0/4125996022 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f300b8e80 con 0x7f4f300d0b10 2023-07-09T21:50:43.701 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:50:43.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.702+0000 7f4f34fff700 1 -- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4f1006ad10 msgr2=0x7f4f1006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.702+0000 7f4f34fff700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4f1006ad10 0x7f4f1006d1c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009be0 tx=0x7f4f20009210 comp rx=0 tx=0).stop 2023-07-09T21:50:43.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.702+0000 7f4f34fff700 1 -- 172.21.15.53:0/4125996022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f300d0b10 msgr2=0x7f4f300ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.702+0000 7f4f34fff700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f300d0b10 0x7f4f300ccae0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f18007fd0 tx=0x7f4f1800c9e0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.702+0000 7f4f34fff700 1 -- 172.21.15.53:0/4125996022 shutdown_connections 2023-07-09T21:50:43.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.702+0000 7f4f34fff700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4f1006ad10 0x7f4f1006d1c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.702+0000 7f4f34fff700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f300d0f90 0x7f4f3014be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.702+0000 7f4f34fff700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f300b3ff0 0x7f4f3014b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.702+0000 7f4f34fff700 1 --2- 172.21.15.53:0/4125996022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f300d0b10 0x7f4f300ccae0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.702+0000 7f4f34fff700 1 -- 172.21.15.53:0/4125996022 >> 172.21.15.53:0/4125996022 conn(0x7f4f3009c1b0 msgr2=0x7f4f3006bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:43.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.702+0000 7f4f34fff700 1 -- 172.21.15.53:0/4125996022 shutdown_connections 2023-07-09T21:50:43.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.702+0000 7f4f34fff700 1 -- 172.21.15.53:0/4125996022 wait complete. 2023-07-09T21:50:43.721 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:50:43.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.922+0000 7f98e1bff700 1 Processor -- start 2023-07-09T21:50:43.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.922+0000 7f98e1bff700 1 -- start start 2023-07-09T21:50:43.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.923+0000 7f98e1bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98dc0b3ff0 0x7f98dc0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.923+0000 7f98e1bff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98dc0b8e80 con 0x7f98dc0d0f90 2023-07-09T21:50:43.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.923+0000 7f98e1bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98dc0b33f0 con 0x7f98dc0d0b10 2023-07-09T21:50:43.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.923+0000 7f98e1bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc0b1e30 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.924+0000 7f98db7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98dc0b3ff0 0x7f98dc0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.924+0000 7f98dbfff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f98dc0d0f90 0x7f98dc0b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53496/0 (socket says 172.21.15.53:53496) 2023-07-09T21:50:43.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.924+0000 7f98dbfff700 1 -- 172.21.15.53:0/1428786203 learned_addr learned my addr 172.21.15.53:0/1428786203 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:43.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.924+0000 7f98db7fe700 1 -- 172.21.15.53:0/1428786203 >> v1:172.21.15.184:6789/0 conn(0x7f98dc0d0b10 legacy=0x7f98dc0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.924+0000 7f98db7fe700 1 -- 172.21.15.53:0/1428786203 >> v1:172.21.15.53:6789/0 conn(0x7f98dc0d0f90 legacy=0x7f98dc0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.924+0000 7f98db7fe700 1 -- 172.21.15.53:0/1428786203 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc0afaa0 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.924+0000 7f98da7fc700 1 -- 172.21.15.53:0/1428786203 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349137734 0 0) 0x7f98d4001490 con 0x7f98dc0d0f90 2023-07-09T21:50:43.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.924+0000 7f98db7fe700 1 --2- 172.21.15.53:0/1428786203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98dc0b3ff0 0x7f98dc0b43c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009840 tx=0x7f98cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30ac5ba244e0a32 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:43.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.925+0000 7f98da7fc700 1 -- 172.21.15.53:0/1428786203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc011830 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.925+0000 7f98da7fc700 1 -- 172.21.15.53:0/1428786203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc011990 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.925+0000 7f98da7fc700 1 -- 172.21.15.53:0/1428786203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc011d20 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.925+0000 7f98e1bff700 1 -- 172.21.15.53:0/1428786203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98dc0b3ff0 msgr2=0x7f98dc0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.925+0000 7f98e1bff700 1 --2- 172.21.15.53:0/1428786203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98dc0b3ff0 0x7f98dc0b43c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009840 tx=0x7f98cc009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:43.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.925+0000 7f98e1bff700 1 -- 172.21.15.53:0/1428786203 shutdown_connections 2023-07-09T21:50:43.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.925+0000 7f98e1bff700 1 --2- 172.21.15.53:0/1428786203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98dc0b3ff0 0x7f98dc0b43c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.925+0000 7f98e1bff700 1 -- 172.21.15.53:0/1428786203 >> 172.21.15.53:0/1428786203 conn(0x7f98dc09c1b0 msgr2=0x7f98dc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:43.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.925+0000 7f98e1bff700 1 -- 172.21.15.53:0/1428786203 shutdown_connections 2023-07-09T21:50:43.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.925+0000 7f98e1bff700 1 -- 172.21.15.53:0/1428786203 wait complete. 2023-07-09T21:50:43.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.927+0000 7f98e1bff700 1 Processor -- start 2023-07-09T21:50:43.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.927+0000 7f98e1bff700 1 -- start start 2023-07-09T21:50:43.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.928+0000 7f98e1bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98dc0b3ff0 0x7f98dc0ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.928+0000 7f98e1bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98dc0d0b10 0x7f98dc0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.928+0000 7f98e1bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98dc0d0f90 0x7f98dc0cf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.928+0000 7f98e1bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0cdac0 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.928+0000 7f98e1bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0cdda0 con 0x7f98dc0d0b10 2023-07-09T21:50:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.928+0000 7f98e1bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0ce080 con 0x7f98dc0d0f90 2023-07-09T21:50:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.928+0000 7f98db7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98dc0b3ff0 0x7f98dc0ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.928+0000 7f98db7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98dc0b3ff0 0x7f98dc0ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42208/0 (socket says 172.21.15.53:42208) 2023-07-09T21:50:43.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.928+0000 7f98db7fe700 1 -- 172.21.15.53:0/3352429470 learned_addr learned my addr 172.21.15.53:0/3352429470 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:43.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.929+0000 7f98db7fe700 1 -- 172.21.15.53:0/3352429470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98dc0d0f90 msgr2=0x7f98dc0cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.929+0000 7f98db7fe700 1 --2- 172.21.15.53:0/3352429470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98dc0d0f90 0x7f98dc0cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.929+0000 7f98db7fe700 1 -- 172.21.15.53:0/3352429470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98dc0d0b10 msgr2=0x7f98dc0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:43.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.929+0000 7f98db7fe700 1 --2- 172.21.15.53:0/3352429470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98dc0d0b10 0x7f98dc0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:43.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.929+0000 7f98db7fe700 1 -- 172.21.15.53:0/3352429470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc0094a0 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.929+0000 7f98db7fe700 1 --2- 172.21.15.53:0/3352429470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98dc0b3ff0 0x7f98dc0ceb60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0090b0 tx=0x7f98cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:43.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.929+0000 7f98c3fff700 1 -- 172.21.15.53:0/3352429470 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc01a900 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.929+0000 7f98c3fff700 1 -- 172.21.15.53:0/3352429470 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc01aa60 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.929+0000 7f98e1bff700 1 -- 172.21.15.53:0/3352429470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98dc0ce360 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.929+0000 7f98c3fff700 1 -- 172.21.15.53:0/3352429470 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc01add0 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.929+0000 7f98e1bff700 1 -- 172.21.15.53:0/3352429470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc0cf0a0 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.930+0000 7f98e1bff700 1 -- 172.21.15.53:0/3352429470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc074350 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.931+0000 7f98c3fff700 1 -- 172.21.15.53:0/3352429470 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f98cc022070 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.932+0000 7f98c3fff700 1 --2- 172.21.15.53:0/3352429470 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f98c806ace0 0x7f98c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:43.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.932+0000 7f98c3fff700 1 -- 172.21.15.53:0/3352429470 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98cc08a7b0 con 0x7f98dc0b3ff0 2023-07-09T21:50:43.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.933+0000 7f98daffd700 1 --2- 172.21.15.53:0/3352429470 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f98c806ace0 0x7f98c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:43.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.933+0000 7f98daffd700 1 --2- 172.21.15.53:0/3352429470 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f98c806ace0 0x7f98c806d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f98dc15bee0 tx=0x7f98d0007a00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:43.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:43.936+0000 7f98c3fff700 1 -- 172.21.15.53:0/3352429470 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f98cc055990 con 0x7f98dc0b3ff0 2023-07-09T21:50:44.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.143+0000 7f98e1bff700 1 -- 172.21.15.53:0/3352429470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f98dc0b0310 con 0x7f98dc0b3ff0 2023-07-09T21:50:44.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.144+0000 7f98c3fff700 1 -- 172.21.15.53:0/3352429470 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f98cc058fb0 con 0x7f98dc0b3ff0 2023-07-09T21:50:44.145 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:50:44.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.146+0000 7f98e1bff700 1 -- 172.21.15.53:0/3352429470 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f98c806ace0 msgr2=0x7f98c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.146+0000 7f98e1bff700 1 --2- 172.21.15.53:0/3352429470 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f98c806ace0 0x7f98c806d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f98dc15bee0 tx=0x7f98d0007a00 comp rx=0 tx=0).stop 2023-07-09T21:50:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.146+0000 7f98e1bff700 1 -- 172.21.15.53:0/3352429470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98dc0b3ff0 msgr2=0x7f98dc0ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.146+0000 7f98e1bff700 1 --2- 172.21.15.53:0/3352429470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98dc0b3ff0 0x7f98dc0ceb60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0090b0 tx=0x7f98cc004750 comp rx=0 tx=0).stop 2023-07-09T21:50:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.146+0000 7f98e1bff700 1 -- 172.21.15.53:0/3352429470 shutdown_connections 2023-07-09T21:50:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.146+0000 7f98e1bff700 1 --2- 172.21.15.53:0/3352429470 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f98c806ace0 0x7f98c806d190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.146+0000 7f98e1bff700 1 --2- 172.21.15.53:0/3352429470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98dc0d0f90 0x7f98dc0cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.146+0000 7f98e1bff700 1 --2- 172.21.15.53:0/3352429470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98dc0b3ff0 0x7f98dc0ceb60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.146+0000 7f98e1bff700 1 --2- 172.21.15.53:0/3352429470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98dc0d0b10 0x7f98dc0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.146+0000 7f98e1bff700 1 -- 172.21.15.53:0/3352429470 >> 172.21.15.53:0/3352429470 conn(0x7f98dc09c1b0 msgr2=0x7f98dc0d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.146+0000 7f98e1bff700 1 -- 172.21.15.53:0/3352429470 shutdown_connections 2023-07-09T21:50:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.147+0000 7f98e1bff700 1 -- 172.21.15.53:0/3352429470 wait complete. 2023-07-09T21:50:44.166 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:50:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.368+0000 7f29a9fff700 1 Processor -- start 2023-07-09T21:50:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.368+0000 7f29a9fff700 1 -- start start 2023-07-09T21:50:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.369+0000 7f29a9fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29a415c6c0 0x7f29a40b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.369+0000 7f29a9fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29a406c8b0 0x7f29a40b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.369+0000 7f29a9fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a415ca90 con 0x7f29a40b2b70 2023-07-09T21:50:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.369+0000 7f29a9fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a406b0e0 con 0x7f29a415c6c0 2023-07-09T21:50:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.369+0000 7f29a9fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a40d0370 con 0x7f29a406c8b0 2023-07-09T21:50:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.369+0000 7f29a37fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29a415c6c0 0x7f29a40b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.369+0000 7f29a2ffd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f29a40b2b70 0x7f29a4160150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53506/0 (socket says 172.21.15.53:53506) 2023-07-09T21:50:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.369+0000 7f29a2ffd700 1 -- 172.21.15.53:0/1728289217 learned_addr learned my addr 172.21.15.53:0/1728289217 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.370+0000 7f29a3fff700 1 --2- 172.21.15.53:0/1728289217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29a406c8b0 0x7f29a40b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.370+0000 7f29a37fe700 1 -- 172.21.15.53:0/1728289217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29a406c8b0 msgr2=0x7f29a40b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.370+0000 7f29a37fe700 1 --2- 172.21.15.53:0/1728289217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29a406c8b0 0x7f29a40b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.370+0000 7f29a37fe700 1 -- 172.21.15.53:0/1728289217 >> v1:172.21.15.53:6789/0 conn(0x7f29a40b2b70 legacy=0x7f29a4160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.370+0000 7f29a37fe700 1 -- 172.21.15.53:0/1728289217 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a40d0650 con 0x7f29a415c6c0 2023-07-09T21:50:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.370+0000 7f29a3fff700 1 --2- 172.21.15.53:0/1728289217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29a406c8b0 0x7f29a40b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.370+0000 7f29a37fe700 1 --2- 172.21.15.53:0/1728289217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29a415c6c0 0x7f29a40b2630 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2994009840 tx=0x7f2994009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9714cab94fc1eca3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.370+0000 7f29a27fc700 1 -- 172.21.15.53:0/1728289217 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994011830 con 0x7f29a415c6c0 2023-07-09T21:50:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.370+0000 7f29a27fc700 1 -- 172.21.15.53:0/1728289217 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2994011990 con 0x7f29a415c6c0 2023-07-09T21:50:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.370+0000 7f29a27fc700 1 -- 172.21.15.53:0/1728289217 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994011d20 con 0x7f29a415c6c0 2023-07-09T21:50:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.371+0000 7f29a9fff700 1 -- 172.21.15.53:0/1728289217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29a415c6c0 msgr2=0x7f29a40b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.371+0000 7f29a9fff700 1 --2- 172.21.15.53:0/1728289217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29a415c6c0 0x7f29a40b2630 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2994009840 tx=0x7f2994009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.371+0000 7f29a9fff700 1 -- 172.21.15.53:0/1728289217 shutdown_connections 2023-07-09T21:50:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.371+0000 7f29a9fff700 1 --2- 172.21.15.53:0/1728289217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29a406c8b0 0x7f29a40b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.371+0000 7f29a9fff700 1 --2- 172.21.15.53:0/1728289217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29a415c6c0 0x7f29a40b2630 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.371+0000 7f29a9fff700 1 -- 172.21.15.53:0/1728289217 >> 172.21.15.53:0/1728289217 conn(0x7f29a406d980 msgr2=0x7f29a406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.371+0000 7f29a9fff700 1 -- 172.21.15.53:0/1728289217 shutdown_connections 2023-07-09T21:50:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.371+0000 7f29a9fff700 1 -- 172.21.15.53:0/1728289217 wait complete. 2023-07-09T21:50:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.373+0000 7f29a9fff700 1 Processor -- start 2023-07-09T21:50:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.373+0000 7f29a9fff700 1 -- start start 2023-07-09T21:50:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a9fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29a406c8b0 0x7f29a414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a9fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29a40b2b70 0x7f29a40c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a9fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29a415c6c0 0x7f29a40ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a9fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a40ca630 con 0x7f29a415c6c0 2023-07-09T21:50:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a9fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a414d6e0 con 0x7f29a40b2b70 2023-07-09T21:50:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a9fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a40c9750 con 0x7f29a406c8b0 2023-07-09T21:50:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29a415c6c0 0x7f29a40ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29a415c6c0 0x7f29a40ac860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42238/0 (socket says 172.21.15.53:42238) 2023-07-09T21:50:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a3fff700 1 -- 172.21.15.53:0/2841994607 learned_addr learned my addr 172.21.15.53:0/2841994607 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a37fe700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29a406c8b0 0x7f29a414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a2ffd700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29a40b2b70 0x7f29a40c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a3fff700 1 -- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29a406c8b0 msgr2=0x7f29a414d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a3fff700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29a406c8b0 0x7f29a414d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a3fff700 1 -- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29a40b2b70 msgr2=0x7f29a40c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a3fff700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29a40b2b70 0x7f29a40c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.374+0000 7f29a3fff700 1 -- 172.21.15.53:0/2841994607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940094a0 con 0x7f29a415c6c0 2023-07-09T21:50:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.375+0000 7f29a3fff700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29a415c6c0 0x7f29a40ac860 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f299c007df0 tx=0x7f299c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.375+0000 7f298bfff700 1 -- 172.21.15.53:0/2841994607 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c00dd20 con 0x7f29a415c6c0 2023-07-09T21:50:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.375+0000 7f298bfff700 1 -- 172.21.15.53:0/2841994607 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c00f040 con 0x7f29a415c6c0 2023-07-09T21:50:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.375+0000 7f298bfff700 1 -- 172.21.15.53:0/2841994607 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c003c60 con 0x7f29a415c6c0 2023-07-09T21:50:44.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.375+0000 7f29a9fff700 1 -- 172.21.15.53:0/2841994607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a40c9a20 con 0x7f29a415c6c0 2023-07-09T21:50:44.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.375+0000 7f29a9fff700 1 -- 172.21.15.53:0/2841994607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a40c9fe0 con 0x7f29a415c6c0 2023-07-09T21:50:44.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.376+0000 7f29a9fff700 1 -- 172.21.15.53:0/2841994607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a40ca7e0 con 0x7f29a415c6c0 2023-07-09T21:50:44.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.377+0000 7f298bfff700 1 -- 172.21.15.53:0/2841994607 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f299c004030 con 0x7f29a415c6c0 2023-07-09T21:50:44.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.378+0000 7f298bfff700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f299006ace0 0x7f299006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:44.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.378+0000 7f298bfff700 1 -- 172.21.15.53:0/2841994607 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f299c089530 con 0x7f29a415c6c0 2023-07-09T21:50:44.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.379+0000 7f29a37fe700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f299006ace0 0x7f299006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:44.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.379+0000 7f29a37fe700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f299006ace0 0x7f299006d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f29940090b0 tx=0x7f2994008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:44.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.382+0000 7f298bfff700 1 -- 172.21.15.53:0/2841994607 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f299c054600 con 0x7f29a415c6c0 2023-07-09T21:50:44.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.590+0000 7f29a9fff700 1 -- 172.21.15.53:0/2841994607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29a4074350 con 0x7f29a415c6c0 2023-07-09T21:50:44.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.590+0000 7f298bfff700 1 -- 172.21.15.53:0/2841994607 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f299c057c20 con 0x7f29a415c6c0 2023-07-09T21:50:44.591 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:50:44.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.592+0000 7f29a9fff700 1 -- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f299006ace0 msgr2=0x7f299006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:44.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.592+0000 7f29a9fff700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f299006ace0 0x7f299006d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f29940090b0 tx=0x7f2994008030 comp rx=0 tx=0).stop 2023-07-09T21:50:44.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.592+0000 7f29a9fff700 1 -- 172.21.15.53:0/2841994607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29a415c6c0 msgr2=0x7f29a40ac860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:44.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.592+0000 7f29a9fff700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29a415c6c0 0x7f29a40ac860 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f299c007df0 tx=0x7f299c00d3b0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.592+0000 7f29a9fff700 1 -- 172.21.15.53:0/2841994607 shutdown_connections 2023-07-09T21:50:44.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.592+0000 7f29a9fff700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f299006ace0 0x7f299006d190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.592+0000 7f29a9fff700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29a415c6c0 0x7f29a40ac860 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.592+0000 7f29a9fff700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29a406c8b0 0x7f29a414d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.592+0000 7f29a9fff700 1 --2- 172.21.15.53:0/2841994607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29a40b2b70 0x7f29a40c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.592+0000 7f29a9fff700 1 -- 172.21.15.53:0/2841994607 >> 172.21.15.53:0/2841994607 conn(0x7f29a406d980 msgr2=0x7f29a40b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.593+0000 7f29a9fff700 1 -- 172.21.15.53:0/2841994607 shutdown_connections 2023-07-09T21:50:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.593+0000 7f29a9fff700 1 -- 172.21.15.53:0/2841994607 wait complete. 2023-07-09T21:50:44.612 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:50:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.813+0000 7f31613ff700 1 Processor -- start 2023-07-09T21:50:44.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.813+0000 7f31613ff700 1 -- start start 2023-07-09T21:50:44.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f31613ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f315c0d1220 0x7f315c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:44.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f31613ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0b0e20 0x7f315c0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:44.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f31613ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c0b8e80 con 0x7f315c0b3ff0 2023-07-09T21:50:44.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f31613ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c0afaa0 con 0x7f315c0d1220 2023-07-09T21:50:44.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f31613ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0afd80 con 0x7f315c0b0e20 2023-07-09T21:50:44.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f315a7fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f315c0d1220 0x7f315c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:44.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f315affd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f315c0b3ff0 0x7f315c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53520/0 (socket says 172.21.15.53:53520) 2023-07-09T21:50:44.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f315affd700 1 -- 172.21.15.53:0/1728484359 learned_addr learned my addr 172.21.15.53:0/1728484359 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:44.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f315a7fc700 1 -- 172.21.15.53:0/1728484359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0b0e20 msgr2=0x7f315c0b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:44.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f315b7fe700 1 --2- 172.21.15.53:0/1728484359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0b0e20 0x7f315c0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:44.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f315a7fc700 1 --2- 172.21.15.53:0/1728484359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0b0e20 0x7f315c0b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f315a7fc700 1 -- 172.21.15.53:0/1728484359 >> v1:172.21.15.53:6789/0 conn(0x7f315c0b3ff0 legacy=0x7f315c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f315a7fc700 1 -- 172.21.15.53:0/1728484359 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c0b0060 con 0x7f315c0d1220 2023-07-09T21:50:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f3159ffb700 1 -- 172.21.15.53:0/1728484359 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701274683 0 0) 0x7f314c001110 con 0x7f315c0b3ff0 2023-07-09T21:50:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.815+0000 7f315b7fe700 1 --2- 172.21.15.53:0/1728484359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0b0e20 0x7f315c0b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.816+0000 7f315a7fc700 1 --2- 172.21.15.53:0/1728484359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f315c0d1220 0x7f315c0b43c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3150009840 tx=0x7f3150009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82356c9cfa33e76 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.816+0000 7f3159ffb700 1 -- 172.21.15.53:0/1728484359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150011830 con 0x7f315c0d1220 2023-07-09T21:50:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.816+0000 7f3159ffb700 1 -- 172.21.15.53:0/1728484359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3150011990 con 0x7f315c0d1220 2023-07-09T21:50:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.816+0000 7f3159ffb700 1 -- 172.21.15.53:0/1728484359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150011d20 con 0x7f315c0d1220 2023-07-09T21:50:44.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.816+0000 7f31613ff700 1 -- 172.21.15.53:0/1728484359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f315c0d1220 msgr2=0x7f315c0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.816+0000 7f31613ff700 1 --2- 172.21.15.53:0/1728484359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f315c0d1220 0x7f315c0b43c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3150009840 tx=0x7f3150009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.817+0000 7f31613ff700 1 -- 172.21.15.53:0/1728484359 shutdown_connections 2023-07-09T21:50:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.817+0000 7f31613ff700 1 --2- 172.21.15.53:0/1728484359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0b0e20 0x7f315c0b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.817+0000 7f31613ff700 1 --2- 172.21.15.53:0/1728484359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f315c0d1220 0x7f315c0b43c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.817+0000 7f31613ff700 1 -- 172.21.15.53:0/1728484359 >> 172.21.15.53:0/1728484359 conn(0x7f315c09c1b0 msgr2=0x7f315c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.817+0000 7f31613ff700 1 -- 172.21.15.53:0/1728484359 shutdown_connections 2023-07-09T21:50:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.817+0000 7f31613ff700 1 -- 172.21.15.53:0/1728484359 wait complete. 2023-07-09T21:50:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.818+0000 7f31613ff700 1 Processor -- start 2023-07-09T21:50:44.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.818+0000 7f31613ff700 1 -- start start 2023-07-09T21:50:44.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.819+0000 7f31613ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0b0e20 0x7f315c0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:44.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.819+0000 7f31613ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315c0b3ff0 0x7f315c1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:44.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.819+0000 7f31613ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f315c0d1220 0x7f315c0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:44.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.819+0000 7f31613ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c15cdb0 con 0x7f315c0d1220 2023-07-09T21:50:44.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.819+0000 7f31613ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0c7ed0 con 0x7f315c0b3ff0 2023-07-09T21:50:44.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.819+0000 7f31613ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0ce7d0 con 0x7f315c0b0e20 2023-07-09T21:50:44.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.820+0000 7f315b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f315c0d1220 0x7f315c0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:44.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.820+0000 7f315b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f315c0d1220 0x7f315c0cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42246/0 (socket says 172.21.15.53:42246) 2023-07-09T21:50:44.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.820+0000 7f315b7fe700 1 -- 172.21.15.53:0/1507604876 learned_addr learned my addr 172.21.15.53:0/1507604876 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:44.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.820+0000 7f315affd700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0b0e20 0x7f315c0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.820+0000 7f315a7fc700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315c0b3ff0 0x7f315c1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.820+0000 7f315b7fe700 1 -- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0b0e20 msgr2=0x7f315c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.820+0000 7f315b7fe700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0b0e20 0x7f315c0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.820+0000 7f315b7fe700 1 -- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315c0b3ff0 msgr2=0x7f315c1596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.820+0000 7f315b7fe700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315c0b3ff0 0x7f315c1596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.820+0000 7f315b7fe700 1 -- 172.21.15.53:0/1507604876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31500094a0 con 0x7f315c0d1220 2023-07-09T21:50:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.820+0000 7f315a7fc700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315c0b3ff0 0x7f315c1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:44.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.821+0000 7f315b7fe700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f315c0d1220 0x7f315c0cdf80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f315400cef0 tx=0x7f315400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:44.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.821+0000 7f31437fe700 1 -- 172.21.15.53:0/1507604876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315400adb0 con 0x7f315c0d1220 2023-07-09T21:50:44.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.821+0000 7f31437fe700 1 -- 172.21.15.53:0/1507604876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3154015440 con 0x7f315c0d1220 2023-07-09T21:50:44.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.821+0000 7f31437fe700 1 -- 172.21.15.53:0/1507604876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31540157f0 con 0x7f315c0d1220 2023-07-09T21:50:44.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.821+0000 7f31613ff700 1 -- 172.21.15.53:0/1507604876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c15cfc0 con 0x7f315c0d1220 2023-07-09T21:50:44.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.821+0000 7f31613ff700 1 -- 172.21.15.53:0/1507604876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c15d580 con 0x7f315c0d1220 2023-07-09T21:50:44.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.822+0000 7f31613ff700 1 -- 172.21.15.53:0/1507604876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c0d0960 con 0x7f315c0d1220 2023-07-09T21:50:44.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.823+0000 7f31437fe700 1 -- 172.21.15.53:0/1507604876 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f315400d430 con 0x7f315c0d1220 2023-07-09T21:50:44.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.825+0000 7f31437fe700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f314806ace0 0x7f314806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:44.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.825+0000 7f31437fe700 1 -- 172.21.15.53:0/1507604876 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3154089a00 con 0x7f315c0d1220 2023-07-09T21:50:44.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.825+0000 7f315affd700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f314806ace0 0x7f314806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:44.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.826+0000 7f315affd700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f314806ace0 0x7f314806d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f314c000f60 tx=0x7f314c007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:44.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:44.829+0000 7f31437fe700 1 -- 172.21.15.53:0/1507604876 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3154054aa0 con 0x7f315c0d1220 2023-07-09T21:50:45.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.037+0000 7f31613ff700 1 -- 172.21.15.53:0/1507604876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f315c15d770 con 0x7f315c0d1220 2023-07-09T21:50:45.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.038+0000 7f31437fe700 1 -- 172.21.15.53:0/1507604876 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f315401a0a0 con 0x7f315c0d1220 2023-07-09T21:50:45.039 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:50:45.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.040+0000 7f31613ff700 1 -- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f314806ace0 msgr2=0x7f314806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.040+0000 7f31613ff700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f314806ace0 0x7f314806d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f314c000f60 tx=0x7f314c007c20 comp rx=0 tx=0).stop 2023-07-09T21:50:45.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.040+0000 7f31613ff700 1 -- 172.21.15.53:0/1507604876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f315c0d1220 msgr2=0x7f315c0cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.040+0000 7f31613ff700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f315c0d1220 0x7f315c0cdf80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f315400cef0 tx=0x7f315400cf20 comp rx=0 tx=0).stop 2023-07-09T21:50:45.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.040+0000 7f31613ff700 1 -- 172.21.15.53:0/1507604876 shutdown_connections 2023-07-09T21:50:45.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.040+0000 7f31613ff700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f314806ace0 0x7f314806d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.040+0000 7f31613ff700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f315c0d1220 0x7f315c0cdf80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.040+0000 7f31613ff700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0b0e20 0x7f315c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.040+0000 7f31613ff700 1 --2- 172.21.15.53:0/1507604876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315c0b3ff0 0x7f315c1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.040+0000 7f31613ff700 1 -- 172.21.15.53:0/1507604876 >> 172.21.15.53:0/1507604876 conn(0x7f315c09c1b0 msgr2=0x7f315c0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:45.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.040+0000 7f31613ff700 1 -- 172.21.15.53:0/1507604876 shutdown_connections 2023-07-09T21:50:45.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.040+0000 7f31613ff700 1 -- 172.21.15.53:0/1507604876 wait complete. 2023-07-09T21:50:45.059 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:50:45.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.260+0000 7f71625ff700 1 Processor -- start 2023-07-09T21:50:45.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.260+0000 7f71625ff700 1 -- start start 2023-07-09T21:50:45.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.261+0000 7f71625ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715c0b1e00 0x7f715c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:45.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.261+0000 7f71625ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f715c0b2350 0x7f715c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:45.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.261+0000 7f71625ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f715c0d1050 0x7f715c0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:45.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.261+0000 7f71625ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715c0d14a0 con 0x7f715c0d1050 2023-07-09T21:50:45.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.261+0000 7f71625ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715c0d2ce0 con 0x7f715c0b2350 2023-07-09T21:50:45.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.261+0000 7f71625ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0b3350 con 0x7f715c0b1e00 2023-07-09T21:50:45.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.261+0000 7f7160b9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f715c0d1050 0x7f715c0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:45.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.261+0000 7f7160b9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f715c0d1050 0x7f715c0afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42254/0 (socket says 172.21.15.53:42254) 2023-07-09T21:50:45.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.261+0000 7f7160b9c700 1 -- 172.21.15.53:0/2304689435 learned_addr learned my addr 172.21.15.53:0/2304689435 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:45.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.262+0000 7f715b7fe700 1 --2- 172.21.15.53:0/2304689435 >> v2:172.21.15.184:3300/0 conn(0x7f715c0b2350 0x7f715c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:45.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.262+0000 7f715bfff700 1 --2- 172.21.15.53:0/2304689435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715c0b1e00 0x7f715c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:45.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.262+0000 7f7160b9c700 1 -- 172.21.15.53:0/2304689435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715c0b1e00 msgr2=0x7f715c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:45.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.262+0000 7f7160b9c700 1 --2- 172.21.15.53:0/2304689435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715c0b1e00 0x7f715c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.262+0000 7f7160b9c700 1 -- 172.21.15.53:0/2304689435 >> v2:172.21.15.184:3300/0 conn(0x7f715c0b2350 msgr2=0x7f715c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.262+0000 7f7160b9c700 1 --2- 172.21.15.53:0/2304689435 >> v2:172.21.15.184:3300/0 conn(0x7f715c0b2350 0x7f715c0d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.262+0000 7f7160b9c700 1 -- 172.21.15.53:0/2304689435 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c0b3630 con 0x7f715c0d1050 2023-07-09T21:50:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.262+0000 7f7160b9c700 1 --2- 172.21.15.53:0/2304689435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f715c0d1050 0x7f715c0afac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f715c08baa0 tx=0x7f715400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1c73fa39968bad server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.262+0000 7f715affd700 1 -- 172.21.15.53:0/2304689435 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715400e070 con 0x7f715c0d1050 2023-07-09T21:50:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.262+0000 7f715affd700 1 -- 172.21.15.53:0/2304689435 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715400b9c0 con 0x7f715c0d1050 2023-07-09T21:50:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.262+0000 7f715affd700 1 -- 172.21.15.53:0/2304689435 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715400bd70 con 0x7f715c0d1050 2023-07-09T21:50:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.263+0000 7f71625ff700 1 -- 172.21.15.53:0/2304689435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f715c0d1050 msgr2=0x7f715c0afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.263+0000 7f71625ff700 1 --2- 172.21.15.53:0/2304689435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f715c0d1050 0x7f715c0afac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f715c08baa0 tx=0x7f715400b330 comp rx=0 tx=0).stop 2023-07-09T21:50:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.263+0000 7f71625ff700 1 -- 172.21.15.53:0/2304689435 shutdown_connections 2023-07-09T21:50:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.263+0000 7f71625ff700 1 --2- 172.21.15.53:0/2304689435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f715c0d1050 0x7f715c0afac0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.263+0000 7f71625ff700 1 --2- 172.21.15.53:0/2304689435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715c0b1e00 0x7f715c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.263+0000 7f71625ff700 1 --2- 172.21.15.53:0/2304689435 >> v2:172.21.15.184:3300/0 conn(0x7f715c0b2350 0x7f715c0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.263+0000 7f71625ff700 1 -- 172.21.15.53:0/2304689435 >> 172.21.15.53:0/2304689435 conn(0x7f715c09c1d0 msgr2=0x7f715c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.263+0000 7f71625ff700 1 -- 172.21.15.53:0/2304689435 shutdown_connections 2023-07-09T21:50:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.263+0000 7f71625ff700 1 -- 172.21.15.53:0/2304689435 wait complete. 2023-07-09T21:50:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.265+0000 7f71625ff700 1 Processor -- start 2023-07-09T21:50:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.266+0000 7f71625ff700 1 -- start start 2023-07-09T21:50:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.267+0000 7f71625ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f715c0b1e00 0x7f715c14af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.267+0000 7f71625ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715c0b2350 0x7f715c0b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.267+0000 7f71625ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f715c0d1050 0x7f715c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.267+0000 7f71625ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0cc0a0 con 0x7f715c0d1050 2023-07-09T21:50:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.267+0000 7f71625ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c14b730 con 0x7f715c0b1e00 2023-07-09T21:50:45.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.267+0000 7f71625ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c14ba10 con 0x7f715c0b2350 2023-07-09T21:50:45.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.267+0000 7f7160b9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f715c0d1050 0x7f715c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:45.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.267+0000 7f7160b9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f715c0d1050 0x7f715c0cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42270/0 (socket says 172.21.15.53:42270) 2023-07-09T21:50:45.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.267+0000 7f7160b9c700 1 -- 172.21.15.53:0/3609679868 learned_addr learned my addr 172.21.15.53:0/3609679868 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:45.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.267+0000 7f715bfff700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f715c0b1e00 0x7f715c14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:45.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.267+0000 7f715b7fe700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715c0b2350 0x7f715c0b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:45.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.268+0000 7f7160b9c700 1 -- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715c0b2350 msgr2=0x7f715c0b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.268+0000 7f7160b9c700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715c0b2350 0x7f715c0b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.268+0000 7f7160b9c700 1 -- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f715c0b1e00 msgr2=0x7f715c14af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.268+0000 7f7160b9c700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f715c0b1e00 0x7f715c14af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.268+0000 7f7160b9c700 1 -- 172.21.15.53:0/3609679868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7154009b30 con 0x7f715c0d1050 2023-07-09T21:50:45.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.268+0000 7f7160b9c700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f715c0d1050 0x7f715c0cd570 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f715400b370 tx=0x7f7154004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:45.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.268+0000 7f7158ff9700 1 -- 172.21.15.53:0/3609679868 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71540099b0 con 0x7f715c0d1050 2023-07-09T21:50:45.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.268+0000 7f7158ff9700 1 -- 172.21.15.53:0/3609679868 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7154004250 con 0x7f715c0d1050 2023-07-09T21:50:45.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.268+0000 7f71625ff700 1 -- 172.21.15.53:0/3609679868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715c14bcf0 con 0x7f715c0d1050 2023-07-09T21:50:45.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.268+0000 7f7158ff9700 1 -- 172.21.15.53:0/3609679868 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71540045e0 con 0x7f715c0d1050 2023-07-09T21:50:45.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.268+0000 7f71625ff700 1 -- 172.21.15.53:0/3609679868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c14c2b0 con 0x7f715c0d1050 2023-07-09T21:50:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.269+0000 7f71625ff700 1 -- 172.21.15.53:0/3609679868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715c04e280 con 0x7f715c0d1050 2023-07-09T21:50:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.270+0000 7f7158ff9700 1 -- 172.21.15.53:0/3609679868 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7154004740 con 0x7f715c0d1050 2023-07-09T21:50:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.271+0000 7f7158ff9700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f714806ad10 0x7f714806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.271+0000 7f7158ff9700 1 -- 172.21.15.53:0/3609679868 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f715408a860 con 0x7f715c0d1050 2023-07-09T21:50:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.272+0000 7f715bfff700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f714806ad10 0x7f714806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.272+0000 7f715bfff700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f714806ad10 0x7f714806d1c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f714c006fd0 tx=0x7f714c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.276+0000 7f7158ff9700 1 -- 172.21.15.53:0/3609679868 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f71540559b0 con 0x7f715c0d1050 2023-07-09T21:50:45.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.529+0000 7f71625ff700 1 -- 172.21.15.53:0/3609679868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f715c08c5a0 con 0x7f715c0d1050 2023-07-09T21:50:45.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.529+0000 7f7158ff9700 1 -- 172.21.15.53:0/3609679868 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7f7154058fd0 con 0x7f715c0d1050 2023-07-09T21:50:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:45.531 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3421374491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3421374491},{"type":"v1","addr":"172.21.15.53:6835","nonce":3421374491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1569539203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":1569539203},{"type":"v1","addr":"172.21.15.184:6837","nonce":1569539203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3569510065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3569510065},{"type":"v1","addr":"172.21.15.53:6834","nonce":3569510065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:50:23.272725+0000","modified":"2023-07-09T21:50:26.798670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/3002520227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3002520227},{"type":"v1","addr":"172.21.15.184:6836","nonce":3002520227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:50:45.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.532+0000 7f71625ff700 1 -- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f714806ad10 msgr2=0x7f714806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.532+0000 7f71625ff700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f714806ad10 0x7f714806d1c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f714c006fd0 tx=0x7f714c008040 comp rx=0 tx=0).stop 2023-07-09T21:50:45.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.532+0000 7f71625ff700 1 -- 172.21.15.53:0/3609679868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f715c0d1050 msgr2=0x7f715c0cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.532+0000 7f71625ff700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f715c0d1050 0x7f715c0cd570 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f715400b370 tx=0x7f7154004ad0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.532+0000 7f71625ff700 1 -- 172.21.15.53:0/3609679868 shutdown_connections 2023-07-09T21:50:45.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.532+0000 7f71625ff700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f714806ad10 0x7f714806d1c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.532+0000 7f71625ff700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f715c0d1050 0x7f715c0cd570 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.532+0000 7f71625ff700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f715c0b1e00 0x7f715c14af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.532+0000 7f71625ff700 1 --2- 172.21.15.53:0/3609679868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715c0b2350 0x7f715c0b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.532+0000 7f71625ff700 1 -- 172.21.15.53:0/3609679868 >> 172.21.15.53:0/3609679868 conn(0x7f715c09c1d0 msgr2=0x7f715c0afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:45.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.532+0000 7f71625ff700 1 -- 172.21.15.53:0/3609679868 shutdown_connections 2023-07-09T21:50:45.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.532+0000 7f71625ff700 1 -- 172.21.15.53:0/3609679868 wait complete. 2023-07-09T21:50:45.535 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 8 2023-07-09T21:50:45.552 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:50:45.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.751+0000 7fed96fff700 1 Processor -- start 2023-07-09T21:50:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.751+0000 7fed96fff700 1 -- start start 2023-07-09T21:50:45.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.753+0000 7fed96fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fed9006ae40 0x7fed90160860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:45.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.753+0000 7fed96fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed900cd4e0 con 0x7fed900d0e20 2023-07-09T21:50:45.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.753+0000 7fed96fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed900cdcf0 con 0x7fed900cfc60 2023-07-09T21:50:45.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.753+0000 7fed96fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed900d00d0 con 0x7fed9006ae40 2023-07-09T21:50:45.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.753+0000 7fed9559c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fed900d0e20 0x7fed900d12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53528/0 (socket says 172.21.15.53:53528) 2023-07-09T21:50:45.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.753+0000 7fed9559c700 1 -- 172.21.15.53:0/3119684307 learned_addr learned my addr 172.21.15.53:0/3119684307 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:45.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.753+0000 7fed8ffff700 1 --2- 172.21.15.53:0/3119684307 >> v2:172.21.15.184:3300/0 conn(0x7fed9006ae40 0x7fed90160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:45.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.753+0000 7fed8f7fe700 1 -- 172.21.15.53:0/3119684307 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962216790 0 0) 0x7fed900cd4e0 con 0x7fed900d0e20 2023-07-09T21:50:45.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.753+0000 7fed8f7fe700 1 -- 172.21.15.53:0/3119684307 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed800035b0 con 0x7fed900d0e20 2023-07-09T21:50:45.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.753+0000 7fed8f7fe700 1 -- 172.21.15.53:0/3119684307 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763303074 0 0) 0x7fed900cdcf0 con 0x7fed900cfc60 2023-07-09T21:50:45.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.753+0000 7fed8f7fe700 1 -- 172.21.15.53:0/3119684307 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed900cd4e0 con 0x7fed900cfc60 2023-07-09T21:50:45.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.754+0000 7fed8ffff700 1 -- 172.21.15.53:0/3119684307 >> v1:172.21.15.184:6789/0 conn(0x7fed900cfc60 legacy=0x7fed90160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.754+0000 7fed8ffff700 1 -- 172.21.15.53:0/3119684307 >> v1:172.21.15.53:6789/0 conn(0x7fed900d0e20 legacy=0x7fed900d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.754+0000 7fed8ffff700 1 -- 172.21.15.53:0/3119684307 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed900cd730 con 0x7fed9006ae40 2023-07-09T21:50:45.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.754+0000 7fed8ffff700 1 --2- 172.21.15.53:0/3119684307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed9006ae40 0x7fed90160860 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009840 tx=0x7fed7c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a32e588ee2b93943 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:45.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.754+0000 7fed8f7fe700 1 -- 172.21.15.53:0/3119684307 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c011830 con 0x7fed9006ae40 2023-07-09T21:50:45.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.754+0000 7fed8f7fe700 1 -- 172.21.15.53:0/3119684307 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c011990 con 0x7fed9006ae40 2023-07-09T21:50:45.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.754+0000 7fed8f7fe700 1 -- 172.21.15.53:0/3119684307 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c011d20 con 0x7fed9006ae40 2023-07-09T21:50:45.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.755+0000 7fed96fff700 1 -- 172.21.15.53:0/3119684307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed9006ae40 msgr2=0x7fed90160860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.755+0000 7fed96fff700 1 --2- 172.21.15.53:0/3119684307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed9006ae40 0x7fed90160860 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009840 tx=0x7fed7c009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:45.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.755+0000 7fed96fff700 1 -- 172.21.15.53:0/3119684307 shutdown_connections 2023-07-09T21:50:45.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.755+0000 7fed96fff700 1 --2- 172.21.15.53:0/3119684307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed9006ae40 0x7fed90160860 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.755+0000 7fed96fff700 1 -- 172.21.15.53:0/3119684307 >> 172.21.15.53:0/3119684307 conn(0x7fed9006c140 msgr2=0x7fed9006c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:45.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.755+0000 7fed96fff700 1 -- 172.21.15.53:0/3119684307 shutdown_connections 2023-07-09T21:50:45.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.755+0000 7fed96fff700 1 -- 172.21.15.53:0/3119684307 wait complete. 2023-07-09T21:50:45.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.757+0000 7fed96fff700 1 Processor -- start 2023-07-09T21:50:45.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.757+0000 7fed96fff700 1 -- start start 2023-07-09T21:50:45.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed96fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed900cfc60 0x7fed900cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:45.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed96fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed900d0e20 0x7fed900c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:45.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed96fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed900cafd0 0x7fed900c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:45.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed96fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed900cc1d0 con 0x7fed900d0e20 2023-07-09T21:50:45.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed96fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed900cb550 con 0x7fed900cfc60 2023-07-09T21:50:45.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed96fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed900cb830 con 0x7fed900cafd0 2023-07-09T21:50:45.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed8ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed900d0e20 0x7fed900c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:45.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed8ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed900d0e20 0x7fed900c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42272/0 (socket says 172.21.15.53:42272) 2023-07-09T21:50:45.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed8ffff700 1 -- 172.21.15.53:0/3968203607 learned_addr learned my addr 172.21.15.53:0/3968203607 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:45.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed94d9b700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed900cfc60 0x7fed900cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:45.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed9559c700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed900cafd0 0x7fed900c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:45.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed8ffff700 1 -- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed900cafd0 msgr2=0x7fed900c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed8ffff700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed900cafd0 0x7fed900c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed8ffff700 1 -- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed900cfc60 msgr2=0x7fed900cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed8ffff700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed900cfc60 0x7fed900cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed8ffff700 1 -- 172.21.15.53:0/3968203607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c0094a0 con 0x7fed900d0e20 2023-07-09T21:50:45.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.758+0000 7fed9559c700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed900cafd0 0x7fed900c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:45.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.759+0000 7fed8ffff700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed900d0e20 0x7fed900c65a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0090b0 tx=0x7fed7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:45.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.759+0000 7fed8d7fa700 1 -- 172.21.15.53:0/3968203607 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c01a860 con 0x7fed900d0e20 2023-07-09T21:50:45.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.759+0000 7fed8d7fa700 1 -- 172.21.15.53:0/3968203607 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c01a9c0 con 0x7fed900d0e20 2023-07-09T21:50:45.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.759+0000 7fed96fff700 1 -- 172.21.15.53:0/3968203607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed900cbb10 con 0x7fed900d0e20 2023-07-09T21:50:45.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.759+0000 7fed8d7fa700 1 -- 172.21.15.53:0/3968203607 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c01ad30 con 0x7fed900d0e20 2023-07-09T21:50:45.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.759+0000 7fed96fff700 1 -- 172.21.15.53:0/3968203607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed900c8f00 con 0x7fed900d0e20 2023-07-09T21:50:45.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.760+0000 7fed96fff700 1 -- 172.21.15.53:0/3968203607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed900cc310 con 0x7fed900d0e20 2023-07-09T21:50:45.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.761+0000 7fed8d7fa700 1 -- 172.21.15.53:0/3968203607 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed7c022070 con 0x7fed900d0e20 2023-07-09T21:50:45.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.762+0000 7fed8d7fa700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fed7406ace0 0x7fed7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:45.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.762+0000 7fed8d7fa700 1 -- 172.21.15.53:0/3968203607 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed7c08a4a0 con 0x7fed900d0e20 2023-07-09T21:50:45.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.763+0000 7fed94d9b700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fed7406ace0 0x7fed7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:45.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.763+0000 7fed94d9b700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fed7406ace0 0x7fed7406d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed840011e0 tx=0x7fed84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:45.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.766+0000 7fed8d7fa700 1 -- 172.21.15.53:0/3968203607 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fed900cc310 con 0x7fed900d0e20 2023-07-09T21:50:45.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.975+0000 7fed96fff700 1 -- 172.21.15.53:0/3968203607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed9004e280 con 0x7fed900d0e20 2023-07-09T21:50:45.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.976+0000 7fed8d7fa700 1 -- 172.21.15.53:0/3968203607 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fed7c0555f0 con 0x7fed900d0e20 2023-07-09T21:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:24.766288+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:50:45.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.978+0000 7fed96fff700 1 -- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fed7406ace0 msgr2=0x7fed7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.978+0000 7fed96fff700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fed7406ace0 0x7fed7406d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed840011e0 tx=0x7fed84009040 comp rx=0 tx=0).stop 2023-07-09T21:50:45.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.978+0000 7fed96fff700 1 -- 172.21.15.53:0/3968203607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed900d0e20 msgr2=0x7fed900c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:45.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.978+0000 7fed96fff700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed900d0e20 0x7fed900c65a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0090b0 tx=0x7fed7c004750 comp rx=0 tx=0).stop 2023-07-09T21:50:45.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.978+0000 7fed96fff700 1 -- 172.21.15.53:0/3968203607 shutdown_connections 2023-07-09T21:50:45.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.978+0000 7fed96fff700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fed7406ace0 0x7fed7406d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.978+0000 7fed96fff700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed900cafd0 0x7fed900c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.978+0000 7fed96fff700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed900cfc60 0x7fed900cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.978+0000 7fed96fff700 1 --2- 172.21.15.53:0/3968203607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed900d0e20 0x7fed900c65a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:45.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.978+0000 7fed96fff700 1 -- 172.21.15.53:0/3968203607 >> 172.21.15.53:0/3968203607 conn(0x7fed9006c140 msgr2=0x7fed900cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:45.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.978+0000 7fed96fff700 1 -- 172.21.15.53:0/3968203607 shutdown_connections 2023-07-09T21:50:45.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:45.978+0000 7fed96fff700 1 -- 172.21.15.53:0/3968203607 wait complete. 2023-07-09T21:50:45.998 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:50:46.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.196+0000 7fac487ff700 1 Processor -- start 2023-07-09T21:50:46.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.196+0000 7fac487ff700 1 -- start start 2023-07-09T21:50:46.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.197+0000 7fac487ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fac400d1220 0x7fac400b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:46.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.197+0000 7fac487ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac400d2ce0 con 0x7fac400b2350 2023-07-09T21:50:46.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.198+0000 7fac487ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac400b3350 con 0x7fac400b1e00 2023-07-09T21:50:46.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.198+0000 7fac487ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac400b3630 con 0x7fac400d1220 2023-07-09T21:50:46.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.198+0000 7fac46d9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fac400b2350 0x7fac400afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53532/0 (socket says 172.21.15.53:53532) 2023-07-09T21:50:46.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.198+0000 7fac46d9c700 1 -- 172.21.15.53:0/1925277233 learned_addr learned my addr 172.21.15.53:0/1925277233 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:46.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.198+0000 7fac45d9a700 1 --2- 172.21.15.53:0/1925277233 >> v2:172.21.15.184:3300/0 conn(0x7fac400d1220 0x7fac400b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:46.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.198+0000 7fac45599700 1 -- 172.21.15.53:0/1925277233 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351711147 0 0) 0x7fac400d2ce0 con 0x7fac400b2350 2023-07-09T21:50:46.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.198+0000 7fac45599700 1 -- 172.21.15.53:0/1925277233 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac2c0035b0 con 0x7fac400b2350 2023-07-09T21:50:46.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.198+0000 7fac45599700 1 -- 172.21.15.53:0/1925277233 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165589812 0 0) 0x7fac400b3350 con 0x7fac400b1e00 2023-07-09T21:50:46.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.198+0000 7fac45599700 1 -- 172.21.15.53:0/1925277233 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac400d2ce0 con 0x7fac400b1e00 2023-07-09T21:50:46.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.198+0000 7fac45d9a700 1 -- 172.21.15.53:0/1925277233 >> v1:172.21.15.184:6789/0 conn(0x7fac400b1e00 legacy=0x7fac400d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:46.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.198+0000 7fac45d9a700 1 -- 172.21.15.53:0/1925277233 >> v1:172.21.15.53:6789/0 conn(0x7fac400b2350 legacy=0x7fac400afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:46.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.198+0000 7fac45d9a700 1 -- 172.21.15.53:0/1925277233 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac400b3910 con 0x7fac400d1220 2023-07-09T21:50:46.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.199+0000 7fac45d9a700 1 --2- 172.21.15.53:0/1925277233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac400d1220 0x7fac400b43f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fac30009840 tx=0x7fac30009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f30538bbebb394d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:46.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.199+0000 7fac45599700 1 -- 172.21.15.53:0/1925277233 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac30011830 con 0x7fac400d1220 2023-07-09T21:50:46.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.199+0000 7fac45599700 1 -- 172.21.15.53:0/1925277233 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac30011990 con 0x7fac400d1220 2023-07-09T21:50:46.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.199+0000 7fac45599700 1 -- 172.21.15.53:0/1925277233 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac30011d20 con 0x7fac400d1220 2023-07-09T21:50:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.199+0000 7fac487ff700 1 -- 172.21.15.53:0/1925277233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac400d1220 msgr2=0x7fac400b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.199+0000 7fac487ff700 1 --2- 172.21.15.53:0/1925277233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac400d1220 0x7fac400b43f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fac30009840 tx=0x7fac30009b50 comp rx=0 tx=0).stop 2023-07-09T21:50:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.200+0000 7fac487ff700 1 -- 172.21.15.53:0/1925277233 shutdown_connections 2023-07-09T21:50:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.200+0000 7fac487ff700 1 --2- 172.21.15.53:0/1925277233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac400d1220 0x7fac400b43f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.200+0000 7fac487ff700 1 -- 172.21.15.53:0/1925277233 >> 172.21.15.53:0/1925277233 conn(0x7fac4009c1d0 msgr2=0x7fac400d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.200+0000 7fac487ff700 1 -- 172.21.15.53:0/1925277233 shutdown_connections 2023-07-09T21:50:46.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.200+0000 7fac487ff700 1 -- 172.21.15.53:0/1925277233 wait complete. 2023-07-09T21:50:46.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.201+0000 7fac487ff700 1 Processor -- start 2023-07-09T21:50:46.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.202+0000 7fac487ff700 1 -- start start 2023-07-09T21:50:46.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.202+0000 7fac487ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac400b1e00 0x7fac4006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:46.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.202+0000 7fac487ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac400b2350 0x7fac4006b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:46.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac487ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac400d1220 0x7fac401f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:46.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac487ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac400ca590 con 0x7fac400b2350 2023-07-09T21:50:46.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac487ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac400ca010 con 0x7fac400b1e00 2023-07-09T21:50:46.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac487ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac400ca2b0 con 0x7fac400d1220 2023-07-09T21:50:46.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac45d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac400b2350 0x7fac4006b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:46.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac45d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac400b2350 0x7fac4006b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42282/0 (socket says 172.21.15.53:42282) 2023-07-09T21:50:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac4659b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac400b1e00 0x7fac4006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac45d9a700 1 -- 172.21.15.53:0/3102075379 learned_addr learned my addr 172.21.15.53:0/3102075379 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac46d9c700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac400d1220 0x7fac401f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac45d9a700 1 -- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac400d1220 msgr2=0x7fac401f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac45d9a700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac400d1220 0x7fac401f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac45d9a700 1 -- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac400b1e00 msgr2=0x7fac4006b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac45d9a700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac400b1e00 0x7fac4006b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac45d9a700 1 -- 172.21.15.53:0/3102075379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300094a0 con 0x7fac400b2350 2023-07-09T21:50:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.203+0000 7fac4659b700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac400b1e00 0x7fac4006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:50:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.204+0000 7fac45d9a700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac400b2350 0x7fac4006b570 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fac30009b90 tx=0x7fac30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.204+0000 7fac36ffd700 1 -- 172.21.15.53:0/3102075379 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3001a6e0 con 0x7fac400b2350 2023-07-09T21:50:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.204+0000 7fac36ffd700 1 -- 172.21.15.53:0/3102075379 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3001a840 con 0x7fac400b2350 2023-07-09T21:50:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.204+0000 7fac487ff700 1 -- 172.21.15.53:0/3102075379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac401f54b0 con 0x7fac400b2350 2023-07-09T21:50:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.204+0000 7fac36ffd700 1 -- 172.21.15.53:0/3102075379 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3001abf0 con 0x7fac400b2350 2023-07-09T21:50:46.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.204+0000 7fac487ff700 1 -- 172.21.15.53:0/3102075379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac401f5a70 con 0x7fac400b2350 2023-07-09T21:50:46.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.205+0000 7fac487ff700 1 -- 172.21.15.53:0/3102075379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4004e280 con 0x7fac400b2350 2023-07-09T21:50:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.206+0000 7fac36ffd700 1 -- 172.21.15.53:0/3102075379 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac30022070 con 0x7fac400b2350 2023-07-09T21:50:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.208+0000 7fac36ffd700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fac2406ace0 0x7fac2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.208+0000 7fac36ffd700 1 -- 172.21.15.53:0/3102075379 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac3008a2b0 con 0x7fac400b2350 2023-07-09T21:50:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.208+0000 7fac4659b700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fac2406ace0 0x7fac2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.209+0000 7fac4659b700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fac2406ace0 0x7fac2406d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fac3c007fd0 tx=0x7fac3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:46.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.212+0000 7fac36ffd700 1 -- 172.21.15.53:0/3102075379 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fac30055350 con 0x7fac400b2350 2023-07-09T21:50:46.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.466+0000 7fac487ff700 1 -- 172.21.15.53:0/3102075379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac4008c5a0 con 0x7fac400b2350 2023-07-09T21:50:46.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.467+0000 7fac36ffd700 1 -- 172.21.15.53:0/3102075379 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7fac30058970 con 0x7fac400b2350 2023-07-09T21:50:46.468 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:50:46.469 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3421374491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3421374491},{"type":"v1","addr":"172.21.15.53:6835","nonce":3421374491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1569539203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":1569539203},{"type":"v1","addr":"172.21.15.184:6837","nonce":1569539203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3569510065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3569510065},{"type":"v1","addr":"172.21.15.53:6834","nonce":3569510065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:50:23.272725+0000","modified":"2023-07-09T21:50:26.798670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/3002520227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3002520227},{"type":"v1","addr":"172.21.15.184:6836","nonce":3002520227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:50:46.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.469+0000 7fac487ff700 1 -- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fac2406ace0 msgr2=0x7fac2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:46.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.469+0000 7fac487ff700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fac2406ace0 0x7fac2406d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fac3c007fd0 tx=0x7fac3c009040 comp rx=0 tx=0).stop 2023-07-09T21:50:46.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.469+0000 7fac487ff700 1 -- 172.21.15.53:0/3102075379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac400b2350 msgr2=0x7fac4006b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:46.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.469+0000 7fac487ff700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac400b2350 0x7fac4006b570 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fac30009b90 tx=0x7fac30004750 comp rx=0 tx=0).stop 2023-07-09T21:50:46.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.469+0000 7fac487ff700 1 -- 172.21.15.53:0/3102075379 shutdown_connections 2023-07-09T21:50:46.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.469+0000 7fac487ff700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fac2406ace0 0x7fac2406d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:46.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.469+0000 7fac487ff700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac400d1220 0x7fac401f0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:46.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.469+0000 7fac487ff700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac400b1e00 0x7fac4006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:46.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.469+0000 7fac487ff700 1 --2- 172.21.15.53:0/3102075379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac400b2350 0x7fac4006b570 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:46.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.469+0000 7fac487ff700 1 -- 172.21.15.53:0/3102075379 >> 172.21.15.53:0/3102075379 conn(0x7fac4009c1d0 msgr2=0x7fac400b7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:46.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.469+0000 7fac487ff700 1 -- 172.21.15.53:0/3102075379 shutdown_connections 2023-07-09T21:50:46.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:46.469+0000 7fac487ff700 1 -- 172.21.15.53:0/3102075379 wait complete. 2023-07-09T21:50:46.473 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 8 2023-07-09T21:50:46.891 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T21:50:23.272725+0000', 'modified': '2023-07-09T21:50:26.798670+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6836/3002520227', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 3002520227}, {'type': 'v1', 'addr': '172.21.15.184:6836', 'nonce': 3002520227}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T21:50:46.891 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T21:50:46.891 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-09T21:50:47.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.093+0000 7fed49dff700 1 Processor -- start 2023-07-09T21:50:47.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.093+0000 7fed49dff700 1 -- start start 2023-07-09T21:50:47.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.094+0000 7fed49dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed440b3ff0 0x7fed440b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.094+0000 7fed49dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed440d0b10 0x7fed440d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.094+0000 7fed49dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fed440b25d0 0x7fed440b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.094+0000 7fed49dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed440b8e80 con 0x7fed440d0b10 2023-07-09T21:50:47.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.094+0000 7fed49dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed440d14a0 con 0x7fed440b25d0 2023-07-09T21:50:47.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.094+0000 7fed49dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed440afaa0 con 0x7fed440b3ff0 2023-07-09T21:50:47.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.094+0000 7fed42ffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed440d0b10 0x7fed440d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.094+0000 7fed42ffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed440d0b10 0x7fed440d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42292/0 (socket says 172.21.15.53:42292) 2023-07-09T21:50:47.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.094+0000 7fed42ffd700 1 -- 172.21.15.53:0/1312666373 learned_addr learned my addr 172.21.15.53:0/1312666373 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:47.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.094+0000 7fed437fe700 1 --2- 172.21.15.53:0/1312666373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed440b3ff0 0x7fed440b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.095+0000 7fed43fff700 1 --2- 172.21.15.53:0/1312666373 >> v2:172.21.15.184:3300/0 conn(0x7fed440b25d0 0x7fed440b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.095+0000 7fed42ffd700 1 -- 172.21.15.53:0/1312666373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed440b3ff0 msgr2=0x7fed440b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:47.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.095+0000 7fed42ffd700 1 --2- 172.21.15.53:0/1312666373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed440b3ff0 0x7fed440b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.095+0000 7fed42ffd700 1 -- 172.21.15.53:0/1312666373 >> v2:172.21.15.184:3300/0 conn(0x7fed440b25d0 msgr2=0x7fed440b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:47.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.095+0000 7fed42ffd700 1 --2- 172.21.15.53:0/1312666373 >> v2:172.21.15.184:3300/0 conn(0x7fed440b25d0 0x7fed440b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.095+0000 7fed42ffd700 1 -- 172.21.15.53:0/1312666373 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed440afd80 con 0x7fed440d0b10 2023-07-09T21:50:47.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.095+0000 7fed42ffd700 1 --2- 172.21.15.53:0/1312666373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed440d0b10 0x7fed440d0f60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed4408c2e0 tx=0x7fed38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3035d5837c0ae05 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:47.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.095+0000 7fed427fc700 1 -- 172.21.15.53:0/1312666373 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38011830 con 0x7fed440d0b10 2023-07-09T21:50:47.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.095+0000 7fed427fc700 1 -- 172.21.15.53:0/1312666373 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed38011990 con 0x7fed440d0b10 2023-07-09T21:50:47.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.095+0000 7fed427fc700 1 -- 172.21.15.53:0/1312666373 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38011d20 con 0x7fed440d0b10 2023-07-09T21:50:47.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.096+0000 7fed49dff700 1 -- 172.21.15.53:0/1312666373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed440d0b10 msgr2=0x7fed440d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:47.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.096+0000 7fed49dff700 1 --2- 172.21.15.53:0/1312666373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed440d0b10 0x7fed440d0f60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed4408c2e0 tx=0x7fed38009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.096+0000 7fed49dff700 1 -- 172.21.15.53:0/1312666373 shutdown_connections 2023-07-09T21:50:47.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.096+0000 7fed49dff700 1 --2- 172.21.15.53:0/1312666373 >> v2:172.21.15.184:3300/0 conn(0x7fed440b25d0 0x7fed440b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.096+0000 7fed49dff700 1 --2- 172.21.15.53:0/1312666373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed440b3ff0 0x7fed440b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.096+0000 7fed49dff700 1 --2- 172.21.15.53:0/1312666373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed440d0b10 0x7fed440d0f60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.096+0000 7fed49dff700 1 -- 172.21.15.53:0/1312666373 >> 172.21.15.53:0/1312666373 conn(0x7fed4409c1b0 msgr2=0x7fed440d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:47.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.096+0000 7fed49dff700 1 -- 172.21.15.53:0/1312666373 shutdown_connections 2023-07-09T21:50:47.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.096+0000 7fed49dff700 1 -- 172.21.15.53:0/1312666373 wait complete. 2023-07-09T21:50:47.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.098+0000 7fed49dff700 1 Processor -- start 2023-07-09T21:50:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.099+0000 7fed49dff700 1 -- start start 2023-07-09T21:50:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.100+0000 7fed49dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed440b25d0 0x7fed44157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.100+0000 7fed49dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed440b3ff0 0x7fed4415d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.100+0000 7fed49dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed440d0b10 0x7fed4415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.100+0000 7fed49dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed441f9630 con 0x7fed440b3ff0 2023-07-09T21:50:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.100+0000 7fed49dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4415db30 con 0x7fed440d0b10 2023-07-09T21:50:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.100+0000 7fed49dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed441f9880 con 0x7fed440b25d0 2023-07-09T21:50:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.100+0000 7fed42ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed440b3ff0 0x7fed4415d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.100+0000 7fed42ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed440b3ff0 0x7fed4415d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42306/0 (socket says 172.21.15.53:42306) 2023-07-09T21:50:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.100+0000 7fed42ffd700 1 -- 172.21.15.53:0/893382009 learned_addr learned my addr 172.21.15.53:0/893382009 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.100+0000 7fed437fe700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed440b25d0 0x7fed44157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.100+0000 7fed43fff700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed440d0b10 0x7fed4415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.101+0000 7fed42ffd700 1 -- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed440b25d0 msgr2=0x7fed44157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.101+0000 7fed42ffd700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed440b25d0 0x7fed44157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.101+0000 7fed42ffd700 1 -- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed440d0b10 msgr2=0x7fed4415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.101+0000 7fed42ffd700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed440d0b10 0x7fed4415f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.101+0000 7fed42ffd700 1 -- 172.21.15.53:0/893382009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed38009550 con 0x7fed440b3ff0 2023-07-09T21:50:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.101+0000 7fed42ffd700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed440b3ff0 0x7fed4415d0e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fed38009c10 tx=0x7fed38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.101+0000 7fed2bfff700 1 -- 172.21.15.53:0/893382009 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38004510 con 0x7fed440b3ff0 2023-07-09T21:50:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.101+0000 7fed2bfff700 1 -- 172.21.15.53:0/893382009 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3801e070 con 0x7fed440b3ff0 2023-07-09T21:50:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.101+0000 7fed2bfff700 1 -- 172.21.15.53:0/893382009 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380038e0 con 0x7fed440b3ff0 2023-07-09T21:50:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.101+0000 7fed49dff700 1 -- 172.21.15.53:0/893382009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed441f9b60 con 0x7fed440b3ff0 2023-07-09T21:50:47.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.101+0000 7fed49dff700 1 -- 172.21.15.53:0/893382009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed441fa360 con 0x7fed440b3ff0 2023-07-09T21:50:47.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.103+0000 7fed2bfff700 1 -- 172.21.15.53:0/893382009 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed38003a40 con 0x7fed440b3ff0 2023-07-09T21:50:47.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.104+0000 7fed2bfff700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fed3006ace0 0x7fed3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.104+0000 7fed2bfff700 1 -- 172.21.15.53:0/893382009 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed3808a3f0 con 0x7fed440b3ff0 2023-07-09T21:50:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.105+0000 7fed437fe700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fed3006ace0 0x7fed3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.105+0000 7fed437fe700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fed3006ace0 0x7fed3006d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fed440b1560 tx=0x7fed34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.106+0000 7fed5d711b80 1 Processor -- start 2023-07-09T21:50:47.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.106+0000 7fed5d711b80 1 -- start start 2023-07-09T21:50:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.107+0000 7fed5d711b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de76430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.107+0000 7fed5d711b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 0x55e51de798e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.107+0000 7fed5d711b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 0x55e51de4d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.107+0000 7fed5d711b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e51dd53c60 con 0x55e51de76060 2023-07-09T21:50:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.107+0000 7fed5d711b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e51dda69f0 con 0x55e51de79390 2023-07-09T21:50:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.107+0000 7fed5d711b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e51dd9fe80 con 0x55e51de79e20 2023-07-09T21:50:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.107+0000 7fed437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de76430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.107+0000 7fed437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de76430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42322/0 (socket says 172.21.15.53:42322) 2023-07-09T21:50:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.108+0000 7fed437fe700 1 -- 172.21.15.53:0/4231089361 learned_addr learned my addr 172.21.15.53:0/4231089361 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.108+0000 7fed42ffd700 1 --2- 172.21.15.53:0/4231089361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 0x55e51de798e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.108+0000 7fed43fff700 1 --2- 172.21.15.53:0/4231089361 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 0x55e51de4d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.108+0000 7fed437fe700 1 -- 172.21.15.53:0/4231089361 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 msgr2=0x55e51de4d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:47.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.108+0000 7fed437fe700 1 --2- 172.21.15.53:0/4231089361 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 0x55e51de4d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.108+0000 7fed437fe700 1 -- 172.21.15.53:0/4231089361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 msgr2=0x55e51de798e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:47.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.108+0000 7fed437fe700 1 --2- 172.21.15.53:0/4231089361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 0x55e51de798e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.108+0000 7fed437fe700 1 -- 172.21.15.53:0/4231089361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e51dbcdd90 con 0x55e51de76060 2023-07-09T21:50:47.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.108+0000 7fed42ffd700 1 --2- 172.21.15.53:0/4231089361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 0x55e51de798e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:47.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.108+0000 7fed437fe700 1 --2- 172.21.15.53:0/4231089361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de76430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fed34011ba0 tx=0x7fed34014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abc12c697f9b003 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:47.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.108+0000 7fed297fa700 1 -- 172.21.15.53:0/4231089361 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34025070 con 0x55e51de76060 2023-07-09T21:50:47.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.108+0000 7fed297fa700 1 -- 172.21.15.53:0/4231089361 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed34004020 con 0x55e51de76060 2023-07-09T21:50:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.108+0000 7fed297fa700 1 -- 172.21.15.53:0/4231089361 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34004190 con 0x55e51de76060 2023-07-09T21:50:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.109+0000 7fed5d711b80 1 -- 172.21.15.53:0/4231089361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 msgr2=0x55e51de76430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.109+0000 7fed5d711b80 1 --2- 172.21.15.53:0/4231089361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de76430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fed34011ba0 tx=0x7fed34014000 comp rx=0 tx=0).stop 2023-07-09T21:50:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.109+0000 7fed5d711b80 1 -- 172.21.15.53:0/4231089361 shutdown_connections 2023-07-09T21:50:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.109+0000 7fed5d711b80 1 --2- 172.21.15.53:0/4231089361 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 0x55e51de4d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.109+0000 7fed5d711b80 1 --2- 172.21.15.53:0/4231089361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de76430 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.109+0000 7fed5d711b80 1 --2- 172.21.15.53:0/4231089361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 0x55e51de798e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.109+0000 7fed5d711b80 1 -- 172.21.15.53:0/4231089361 >> 172.21.15.53:0/4231089361 conn(0x55e51de43a90 msgr2=0x55e51de49030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:47.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.109+0000 7fed5d711b80 1 -- 172.21.15.53:0/4231089361 shutdown_connections 2023-07-09T21:50:47.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.109+0000 7fed5d711b80 1 -- 172.21.15.53:0/4231089361 wait complete. 2023-07-09T21:50:47.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.110+0000 7fed5d711b80 1 -- start start 2023-07-09T21:50:47.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.110+0000 7fed5d711b80 1 Processor -- start 2023-07-09T21:50:47.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.111+0000 7fed5d711b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de6d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.111+0000 7fed5d711b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 0x55e51dea68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.111+0000 7fed5d711b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 0x55e51de6db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.111+0000 7fed5d711b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e51dd3fa70 con 0x55e51de76060 2023-07-09T21:50:47.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.111+0000 7fed5d711b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e51dd3f770 con 0x55e51de79390 2023-07-09T21:50:47.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.111+0000 7fed5d711b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e51dc238d0 con 0x55e51de79e20 2023-07-09T21:50:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.111+0000 7fed5d711b80 10 client.0 _ll_register_callbacks cb 0x55e51dd3d710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:50:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.111+0000 7fed437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de6d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.112+0000 7fed437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de6d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42332/0 (socket says 172.21.15.53:42332) 2023-07-09T21:50:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.112+0000 7fed437fe700 1 -- 172.21.15.53:0/3312973951 learned_addr learned my addr 172.21.15.53:0/3312973951 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.112+0000 7fed437fe700 1 -- 172.21.15.53:0/3312973951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 msgr2=0x55e51de6db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.112+0000 7fed437fe700 1 --2- 172.21.15.53:0/3312973951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 0x55e51de6db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.112+0000 7fed437fe700 1 -- 172.21.15.53:0/3312973951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 msgr2=0x55e51dea68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.112+0000 7fed437fe700 1 --2- 172.21.15.53:0/3312973951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 0x55e51dea68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.112+0000 7fed437fe700 1 -- 172.21.15.53:0/3312973951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed34011850 con 0x55e51de76060 2023-07-09T21:50:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.112+0000 7fed437fe700 1 --2- 172.21.15.53:0/3312973951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de6d470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fed34009f90 tx=0x7fed34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f4fcd100316735 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.112+0000 7fed227fc700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-07-09T21:50:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.112+0000 7fed227fc700 1 -- 172.21.15.53:0/3312973951 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34025040 con 0x55e51de76060 2023-07-09T21:50:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.112+0000 7fed227fc700 1 -- 172.21.15.53:0/3312973951 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed34015ba0 con 0x55e51de76060 2023-07-09T21:50:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.112+0000 7fed5d711b80 1 -- 172.21.15.53:0/3312973951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e51de410a0 con 0x55e51de76060 2023-07-09T21:50:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.113+0000 7fed227fc700 1 -- 172.21.15.53:0/3312973951 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed34015d60 con 0x55e51de76060 2023-07-09T21:50:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.113+0000 7fed5d711b80 10 client.4665 fetch_fsmap learned FSMap version 8 2023-07-09T21:50:47.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.113+0000 7fed5d711b80 1 -- 172.21.15.53:0/3312973951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e51dbb6c10 con 0x55e51de76060 2023-07-09T21:50:47.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.113+0000 7fed227fc700 1 -- 172.21.15.53:0/3312973951 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e51de410a0 con 0x55e51de76060 2023-07-09T21:50:47.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.113+0000 7fed227fc700 1 -- 172.21.15.53:0/3312973951 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fed340036a0 con 0x55e51de76060 2023-07-09T21:50:47.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.113+0000 7fed5d711b80 10 client.4665 fetch_fsmap finished waiting for FSMap version 8 2023-07-09T21:50:47.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.113+0000 7fed5d711b80 10 client.4665 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-09T21:50:47.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.113+0000 7fed5d711b80 20 client.4665 populate_metadata read hostname 'smithi053' 2023-07-09T21:50:47.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.113+0000 7fed5d711b80 1 --2- 172.21.15.53:0/3312973951 >> [v2:172.21.15.184:6834/3002520227,v1:172.21.15.184:6836/3002520227] conn(0x55e51de4afc0 0x55e51de4b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.113+0000 7fed5d711b80 4 client.4665 mds_command: new command op to 4306 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T21:50:47.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.113+0000 7fed5d711b80 1 -- 172.21.15.53:0/3312973951 --> [v2:172.21.15.184:6834/3002520227,v1:172.21.15.184:6836/3002520227] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e51dd98e60 con 0x55e51de4afc0 2023-07-09T21:50:47.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.113+0000 7fed42ffd700 1 --2- 172.21.15.53:0/3312973951 >> [v2:172.21.15.184:6834/3002520227,v1:172.21.15.184:6836/3002520227] conn(0x55e51de4afc0 0x55e51de4b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.114+0000 7fed42ffd700 1 --2- 172.21.15.53:0/3312973951 >> [v2:172.21.15.184:6834/3002520227,v1:172.21.15.184:6836/3002520227] conn(0x55e51de4afc0 0x55e51de4b3b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d11a0f4dc760bd86 server_cookie=57f63291690c7362 in_seq=0 out_seq=0 2023-07-09T21:50:47.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.114+0000 7fed227fc700 10 client.4665 ms_handle_connect on v2:172.21.15.184:6834/3002520227 2023-07-09T21:50:47.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed227fc700 1 -- 172.21.15.53:0/3312973951 <== mds.0 v2:172.21.15.184:6834/3002520227 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e51dd98e60 con 0x55e51de4afc0 2023-07-09T21:50:47.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed227fc700 10 client.4665 handle_command_reply: tid=0 2023-07-09T21:50:47.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed5d711b80 1 client.4665 shutdown 2023-07-09T21:50:47.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed5d711b80 1 -- 172.21.15.53:0/3312973951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 msgr2=0x55e51de6d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:47.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed5d711b80 1 --2- 172.21.15.53:0/3312973951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de6d470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fed34009f90 tx=0x7fed34004750 comp rx=0 tx=0).stop 2023-07-09T21:50:47.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed5d711b80 1 -- 172.21.15.53:0/3312973951 shutdown_connections 2023-07-09T21:50:47.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed5d711b80 1 --2- 172.21.15.53:0/3312973951 >> [v2:172.21.15.184:6834/3002520227,v1:172.21.15.184:6836/3002520227] conn(0x55e51de4afc0 0x55e51de4b3b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed5d711b80 1 --2- 172.21.15.53:0/3312973951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 0x55e51de6db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed5d711b80 1 --2- 172.21.15.53:0/3312973951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de6d470 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed5d711b80 1 --2- 172.21.15.53:0/3312973951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 0x55e51dea68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed227fc700 0 client.4665 ms_handle_reset on v2:172.21.15.184:6834/3002520227 2023-07-09T21:50:47.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed5d711b80 1 -- 172.21.15.53:0/3312973951 >> 172.21.15.53:0/3312973951 conn(0x55e51de43a90 msgr2=0x55e51de72df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:47.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed5d711b80 1 -- 172.21.15.53:0/3312973951 shutdown_connections 2023-07-09T21:50:47.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.115+0000 7fed5d711b80 1 -- 172.21.15.53:0/3312973951 wait complete. 2023-07-09T21:50:47.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.116+0000 7fed5d711b80 20 client.4665 trim_cache size 0 max 16384 2023-07-09T21:50:47.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.134+0000 7fed5d711b80 1 Processor -- start 2023-07-09T21:50:47.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.134+0000 7fed5d711b80 1 -- start start 2023-07-09T21:50:47.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed5d711b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de76060 0x55e51de90b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed5d711b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de79390 0x55e51deb5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed5d711b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79e20 0x55e51de6dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed5d711b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e51de4bea0 con 0x55e51de79390 2023-07-09T21:50:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed5d711b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e51de48d30 con 0x55e51de79e20 2023-07-09T21:50:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed5d711b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e51de4e2b0 con 0x55e51de76060 2023-07-09T21:50:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed42ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de79390 0x55e51deb5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed42ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de79390 0x55e51deb5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42340/0 (socket says 172.21.15.53:42340) 2023-07-09T21:50:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed42ffd700 1 -- 172.21.15.53:0/1357874683 learned_addr learned my addr 172.21.15.53:0/1357874683 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed437fe700 1 --2- 172.21.15.53:0/1357874683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de76060 0x55e51de90b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed42ffd700 1 -- 172.21.15.53:0/1357874683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de76060 msgr2=0x55e51de90b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed43fff700 1 --2- 172.21.15.53:0/1357874683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79e20 0x55e51de6dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed42ffd700 1 --2- 172.21.15.53:0/1357874683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de76060 0x55e51de90b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed42ffd700 1 -- 172.21.15.53:0/1357874683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79e20 msgr2=0x55e51de6dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed42ffd700 1 --2- 172.21.15.53:0/1357874683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79e20 0x55e51de6dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed42ffd700 1 -- 172.21.15.53:0/1357874683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e51dbf4200 con 0x55e51de79390 2023-07-09T21:50:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.135+0000 7fed437fe700 1 --2- 172.21.15.53:0/1357874683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de76060 0x55e51de90b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.136+0000 7fed43fff700 1 --2- 172.21.15.53:0/1357874683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79e20 0x55e51de6dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:50:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.136+0000 7fed42ffd700 1 --2- 172.21.15.53:0/1357874683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de79390 0x55e51deb5ec0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fed38058dc0 tx=0x7fed38055530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c797ca92de8ce311 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.136+0000 7fed29ffb700 1 -- 172.21.15.53:0/1357874683 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38061410 con 0x55e51de79390 2023-07-09T21:50:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.136+0000 7fed29ffb700 1 -- 172.21.15.53:0/1357874683 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed38088830 con 0x55e51de79390 2023-07-09T21:50:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.136+0000 7fed29ffb700 1 -- 172.21.15.53:0/1357874683 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380557d0 con 0x55e51de79390 2023-07-09T21:50:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.136+0000 7fed5d711b80 1 -- 172.21.15.53:0/1357874683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de79390 msgr2=0x55e51deb5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.136+0000 7fed5d711b80 1 --2- 172.21.15.53:0/1357874683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de79390 0x55e51deb5ec0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fed38058dc0 tx=0x7fed38055530 comp rx=0 tx=0).stop 2023-07-09T21:50:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.136+0000 7fed5d711b80 1 -- 172.21.15.53:0/1357874683 shutdown_connections 2023-07-09T21:50:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.136+0000 7fed5d711b80 1 --2- 172.21.15.53:0/1357874683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79e20 0x55e51de6dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.136+0000 7fed5d711b80 1 --2- 172.21.15.53:0/1357874683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de76060 0x55e51de90b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.136+0000 7fed5d711b80 1 --2- 172.21.15.53:0/1357874683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de79390 0x55e51deb5ec0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.136+0000 7fed5d711b80 1 -- 172.21.15.53:0/1357874683 >> 172.21.15.53:0/1357874683 conn(0x55e51de43a90 msgr2=0x55e51de50180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.137+0000 7fed5d711b80 1 -- 172.21.15.53:0/1357874683 shutdown_connections 2023-07-09T21:50:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.137+0000 7fed5d711b80 1 -- 172.21.15.53:0/1357874683 wait complete. 2023-07-09T21:50:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.137+0000 7fed5d711b80 1 -- start start 2023-07-09T21:50:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.137+0000 7fed5d711b80 1 Processor -- start 2023-07-09T21:50:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.138+0000 7fed5d711b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de6e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.138+0000 7fed5d711b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 0x55e51de6e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.138+0000 7fed5d711b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 0x55e51de4d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.138+0000 7fed5d711b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e51de94070 con 0x55e51de76060 2023-07-09T21:50:47.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.138+0000 7fed5d711b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e51deaab20 con 0x55e51de79390 2023-07-09T21:50:47.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.138+0000 7fed5d711b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e51de48980 con 0x55e51de79e20 2023-07-09T21:50:47.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.138+0000 7fed5d711b80 10 client.0 _ll_register_callbacks cb 0x7fed34011a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:50:47.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de6e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de6e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42354/0 (socket says 172.21.15.53:42354) 2023-07-09T21:50:47.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed437fe700 1 -- 172.21.15.53:0/1654032921 learned_addr learned my addr 172.21.15.53:0/1654032921 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:47.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed43fff700 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 0x55e51de4d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed42ffd700 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 0x55e51de6e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed437fe700 1 -- 172.21.15.53:0/1654032921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 msgr2=0x55e51de4d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:47.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed437fe700 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 0x55e51de4d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed437fe700 1 -- 172.21.15.53:0/1654032921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 msgr2=0x55e51de6e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:47.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed437fe700 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 0x55e51de6e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed437fe700 1 -- 172.21.15.53:0/1654032921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed441fa360 con 0x55e51de76060 2023-07-09T21:50:47.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed42ffd700 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 0x55e51de6e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:50:47.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed437fe700 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de6e3e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fed3400b010 tx=0x7fed34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ad723c479b73fe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:47.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed227fc700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-07-09T21:50:47.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed227fc700 1 -- 172.21.15.53:0/1654032921 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34025030 con 0x55e51de76060 2023-07-09T21:50:47.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed227fc700 1 -- 172.21.15.53:0/1654032921 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed340036a0 con 0x55e51de76060 2023-07-09T21:50:47.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.139+0000 7fed5d711b80 1 -- 172.21.15.53:0/1654032921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fed34004020 con 0x55e51de76060 2023-07-09T21:50:47.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.140+0000 7fed227fc700 1 -- 172.21.15.53:0/1654032921 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed34015720 con 0x55e51de76060 2023-07-09T21:50:47.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.140+0000 7fed5d711b80 10 client.4671 fetch_fsmap learned FSMap version 8 2023-07-09T21:50:47.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.140+0000 7fed5d711b80 1 -- 172.21.15.53:0/1654032921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e51dbcc260 con 0x55e51de76060 2023-07-09T21:50:47.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.140+0000 7fed227fc700 1 -- 172.21.15.53:0/1654032921 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed34004020 con 0x55e51de76060 2023-07-09T21:50:47.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.140+0000 7fed227fc700 1 -- 172.21.15.53:0/1654032921 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fed3403f480 con 0x55e51de76060 2023-07-09T21:50:47.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.140+0000 7fed5d711b80 10 client.4671 fetch_fsmap finished waiting for FSMap version 8 2023-07-09T21:50:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.140+0000 7fed5d711b80 10 client.4671 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-09T21:50:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.140+0000 7fed5d711b80 20 client.4671 populate_metadata read hostname 'smithi053' 2023-07-09T21:50:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.140+0000 7fed5d711b80 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.184:6834/3002520227,v1:172.21.15.184:6836/3002520227] conn(0x55e51defe3f0 0x55e51de4d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.140+0000 7fed5d711b80 4 client.4671 mds_command: new command op to 4306 tid=0[{"prefix": "status"}] 2023-07-09T21:50:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.140+0000 7fed5d711b80 1 -- 172.21.15.53:0/1654032921 --> [v2:172.21.15.184:6834/3002520227,v1:172.21.15.184:6836/3002520227] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e51dd5b000 con 0x55e51defe3f0 2023-07-09T21:50:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.141+0000 7fed42ffd700 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.184:6834/3002520227,v1:172.21.15.184:6836/3002520227] conn(0x55e51defe3f0 0x55e51de4d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.141+0000 7fed227fc700 10 client.4671 ms_handle_connect on v2:172.21.15.184:6834/3002520227 2023-07-09T21:50:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.141+0000 7fed42ffd700 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.184:6834/3002520227,v1:172.21.15.184:6836/3002520227] conn(0x55e51defe3f0 0x55e51de4d5d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3cd7512bc4fe9e server_cookie=b39357b54e7c005b in_seq=0 out_seq=0 2023-07-09T21:50:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.141+0000 7fed227fc700 1 -- 172.21.15.53:0/1654032921 <== mds.0 v2:172.21.15.184:6834/3002520227 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x55e51dd5b000 con 0x55e51defe3f0 2023-07-09T21:50:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.141+0000 7fed227fc700 10 client.4671 handle_command_reply: tid=0 2023-07-09T21:50:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.141+0000 7fed5d711b80 1 client.4671 shutdown 2023-07-09T21:50:47.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed5d711b80 1 -- 172.21.15.53:0/1654032921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 msgr2=0x55e51de6e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:47.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed5d711b80 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de6e3e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fed3400b010 tx=0x7fed34017000 comp rx=0 tx=0).stop 2023-07-09T21:50:47.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed5d711b80 1 -- 172.21.15.53:0/1654032921 shutdown_connections 2023-07-09T21:50:47.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed5d711b80 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.184:6834/3002520227,v1:172.21.15.184:6836/3002520227] conn(0x55e51defe3f0 0x55e51de4d5d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed5d711b80 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e51de79e20 0x55e51de4d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed5d711b80 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e51de76060 0x55e51de6e3e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed5d711b80 1 --2- 172.21.15.53:0/1654032921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e51de79390 0x55e51de6e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed5d711b80 1 -- 172.21.15.53:0/1654032921 >> 172.21.15.53:0/1654032921 conn(0x55e51de43a90 msgr2=0x55e51deb5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:47.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed227fc700 0 client.4671 ms_handle_reset on v2:172.21.15.184:6834/3002520227 2023-07-09T21:50:47.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed5d711b80 1 -- 172.21.15.53:0/1654032921 shutdown_connections 2023-07-09T21:50:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed5d711b80 1 -- 172.21.15.53:0/1654032921 wait complete. 2023-07-09T21:50:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed5d711b80 20 client.4671 trim_cache size 0 max 16384 2023-07-09T21:50:47.160 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-07-09T21:50:47.160 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "25d21351-dc09-4310-b56b-79a331e4aa31", 2023-07-09T21:50:47.160 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-07-09T21:50:47.160 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4306, 2023-07-09T21:50:47.161 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-07-09T21:50:47.161 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-07-09T21:50:47.161 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-07-09T21:50:47.161 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 23.35512319, 2023-07-09T21:50:47.161 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 8, 2023-07-09T21:50:47.161 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 25, 2023-07-09T21:50:47.161 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 25, 2023-07-09T21:50:47.161 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 29.411158509 2023-07-09T21:50:47.162 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-07-09T21:50:47.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed49dff700 1 -- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fed3006ace0 msgr2=0x7fed3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:47.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed49dff700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fed3006ace0 0x7fed3006d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fed440b1560 tx=0x7fed34008040 comp rx=0 tx=0).stop 2023-07-09T21:50:47.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed49dff700 1 -- 172.21.15.53:0/893382009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed440b3ff0 msgr2=0x7fed4415d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:47.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.142+0000 7fed49dff700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed440b3ff0 0x7fed4415d0e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fed38009c10 tx=0x7fed38004750 comp rx=0 tx=0).stop 2023-07-09T21:50:47.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.143+0000 7fed49dff700 1 -- 172.21.15.53:0/893382009 shutdown_connections 2023-07-09T21:50:47.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.143+0000 7fed49dff700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fed3006ace0 0x7fed3006d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.143+0000 7fed49dff700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed440d0b10 0x7fed4415f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.143+0000 7fed49dff700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed440b25d0 0x7fed44157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.143+0000 7fed49dff700 1 --2- 172.21.15.53:0/893382009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed440b3ff0 0x7fed4415d0e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:47.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.143+0000 7fed49dff700 1 -- 172.21.15.53:0/893382009 >> 172.21.15.53:0/893382009 conn(0x7fed4409c1b0 msgr2=0x7fed4406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:47.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.143+0000 7fed49dff700 1 -- 172.21.15.53:0/893382009 shutdown_connections 2023-07-09T21:50:47.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.143+0000 7fed49dff700 1 -- 172.21.15.53:0/893382009 wait complete. 2023-07-09T21:50:47.165 INFO:teuthology.run_tasks:Running task kclient... 2023-07-09T21:50:47.196 INFO:tasks.kclient:Mounting kernel clients... 2023-07-09T21:50:47.197 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-09T21:50:47.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:47.198 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-07-09T21:50:47.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:47.242 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2023-07-09T21:50:47.352 INFO:teuthology.orchestra.run.smithi053.stderr:Cannot find device "ceph-brx" 2023-07-09T21:50:47.354 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:50:47.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:47.355 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-07-09T21:50:47.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:47.399 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2023-07-09T21:50:47.509 INFO:teuthology.orchestra.run.smithi053.stderr:Cannot find device "ceph-brx" 2023-07-09T21:50:47.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:50:47.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:47.512 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-07-09T21:50:47.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:47.560 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-07-09T21:50:47.633 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-07-09T21:50:47.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:50:47.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:47.637 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-07-09T21:50:47.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:47.681 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-07-09T21:50:47.791 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-07-09T21:50:47.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:50:47.795 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-09T21:50:47.795 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-09T21:50:47.795 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:50:47.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:50:47.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.995+0000 7f0aa41ff700 1 Processor -- start 2023-07-09T21:50:47.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.995+0000 7f0aa41ff700 1 -- start start 2023-07-09T21:50:47.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.997+0000 7f0aa41ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a9c15e890 0x7f0a9c0b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.997+0000 7f0aa41ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0a9c15afd0 0x7f0a9c150c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:47.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.997+0000 7f0aa41ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9c0ce110 con 0x7f0a9c0b3cc0 2023-07-09T21:50:47.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.997+0000 7f0aa41ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c15b450 con 0x7f0a9c15afd0 2023-07-09T21:50:47.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.997+0000 7f0aa41ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c0b4130 con 0x7f0a9c15e890 2023-07-09T21:50:47.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.997+0000 7f0aa279c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0a9c15afd0 0x7f0a9c150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:47.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.997+0000 7f0aa279c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0a9c15afd0 0x7f0a9c150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42362/0 (socket says 172.21.15.53:42362) 2023-07-09T21:50:47.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.997+0000 7f0aa279c700 1 -- 172.21.15.53:0/2346535158 learned_addr learned my addr 172.21.15.53:0/2346535158 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:48.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.997+0000 7f0aa1f9b700 1 --2- 172.21.15.53:0/2346535158 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a9c15e890 0x7f0a9c0b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:48.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.997+0000 7f0aa279c700 1 -- 172.21.15.53:0/2346535158 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a9c15e890 msgr2=0x7f0a9c0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:48.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.997+0000 7f0aa279c700 1 --2- 172.21.15.53:0/2346535158 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a9c15e890 0x7f0a9c0b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:48.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.997+0000 7f0aa279c700 1 -- 172.21.15.53:0/2346535158 >> v1:172.21.15.184:6789/0 conn(0x7f0a9c0b3cc0 legacy=0x7f0a9c15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:48.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.998+0000 7f0aa279c700 1 -- 172.21.15.53:0/2346535158 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c15b660 con 0x7f0a9c15afd0 2023-07-09T21:50:48.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.998+0000 7f0aa279c700 1 --2- 172.21.15.53:0/2346535158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a9c15afd0 0x7f0a9c150c40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009e50 tx=0x7f0a9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288d9b62af72fede server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:48.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.998+0000 7f0aa0f99700 1 -- 172.21.15.53:0/2346535158 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400e070 con 0x7f0a9c15afd0 2023-07-09T21:50:48.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.998+0000 7f0aa0f99700 1 -- 172.21.15.53:0/2346535158 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9400b9c0 con 0x7f0a9c15afd0 2023-07-09T21:50:48.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.998+0000 7f0aa0f99700 1 -- 172.21.15.53:0/2346535158 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400bd70 con 0x7f0a9c15afd0 2023-07-09T21:50:48.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.998+0000 7f0aa41ff700 1 -- 172.21.15.53:0/2346535158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a9c15afd0 msgr2=0x7f0a9c150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:48.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.998+0000 7f0aa41ff700 1 --2- 172.21.15.53:0/2346535158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a9c15afd0 0x7f0a9c150c40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009e50 tx=0x7f0a9400b330 comp rx=0 tx=0).stop 2023-07-09T21:50:48.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.999+0000 7f0aa41ff700 1 -- 172.21.15.53:0/2346535158 shutdown_connections 2023-07-09T21:50:48.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.999+0000 7f0aa41ff700 1 --2- 172.21.15.53:0/2346535158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a9c15afd0 0x7f0a9c150c40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:48.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.999+0000 7f0aa41ff700 1 --2- 172.21.15.53:0/2346535158 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a9c15e890 0x7f0a9c0b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:48.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.999+0000 7f0aa41ff700 1 -- 172.21.15.53:0/2346535158 >> 172.21.15.53:0/2346535158 conn(0x7f0a9c069f30 msgr2=0x7f0a9c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:48.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.999+0000 7f0aa41ff700 1 -- 172.21.15.53:0/2346535158 shutdown_connections 2023-07-09T21:50:48.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:47.999+0000 7f0aa41ff700 1 -- 172.21.15.53:0/2346535158 wait complete. 2023-07-09T21:50:48.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.001+0000 7f0aa41ff700 1 Processor -- start 2023-07-09T21:50:48.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.001+0000 7f0aa41ff700 1 -- start start 2023-07-09T21:50:48.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa41ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a9c0b3cc0 0x7f0a9c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:48.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa41ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a9c15afd0 0x7f0a9c0af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:48.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa41ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a9c15e890 0x7f0a9c14f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:48.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa41ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c1e4fa0 con 0x7f0a9c15afd0 2023-07-09T21:50:48.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa41ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c1e5280 con 0x7f0a9c0b3cc0 2023-07-09T21:50:48.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa41ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c1e5560 con 0x7f0a9c15e890 2023-07-09T21:50:48.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa179a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a9c15afd0 0x7f0a9c0af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:48.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa179a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a9c15afd0 0x7f0a9c0af9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42372/0 (socket says 172.21.15.53:42372) 2023-07-09T21:50:48.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa179a700 1 -- 172.21.15.53:0/3052829667 learned_addr learned my addr 172.21.15.53:0/3052829667 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:48.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa1f9b700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a9c0b3cc0 0x7f0a9c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:48.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa279c700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a9c15e890 0x7f0a9c14f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:48.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa179a700 1 -- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a9c15e890 msgr2=0x7f0a9c14f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:48.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa179a700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a9c15e890 0x7f0a9c14f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:48.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa179a700 1 -- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a9c0b3cc0 msgr2=0x7f0a9c0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:48.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa179a700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a9c0b3cc0 0x7f0a9c0b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:48.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.002+0000 7f0aa179a700 1 -- 172.21.15.53:0/3052829667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a94009b30 con 0x7f0a9c15afd0 2023-07-09T21:50:48.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.003+0000 7f0aa179a700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a9c15afd0 0x7f0a9c0af9a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00c450 tx=0x7f0a8c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:48.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.003+0000 7f0a927fc700 1 -- 172.21.15.53:0/3052829667 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0052d0 con 0x7f0a9c15afd0 2023-07-09T21:50:48.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.003+0000 7f0a927fc700 1 -- 172.21.15.53:0/3052829667 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c005430 con 0x7f0a9c15afd0 2023-07-09T21:50:48.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.003+0000 7f0a927fc700 1 -- 172.21.15.53:0/3052829667 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0038c0 con 0x7f0a9c15afd0 2023-07-09T21:50:48.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.003+0000 7f0aa41ff700 1 -- 172.21.15.53:0/3052829667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c1e5840 con 0x7f0a9c15afd0 2023-07-09T21:50:48.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.003+0000 7f0aa41ff700 1 -- 172.21.15.53:0/3052829667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c0afee0 con 0x7f0a9c15afd0 2023-07-09T21:50:48.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.004+0000 7f0aa41ff700 1 -- 172.21.15.53:0/3052829667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c1e5a30 con 0x7f0a9c15afd0 2023-07-09T21:50:48.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.005+0000 7f0a927fc700 1 -- 172.21.15.53:0/3052829667 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a8c003a20 con 0x7f0a9c15afd0 2023-07-09T21:50:48.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.006+0000 7f0a927fc700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0a8006ace0 0x7f0a8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:48.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.006+0000 7f0a927fc700 1 -- 172.21.15.53:0/3052829667 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a8c088840 con 0x7f0a9c15afd0 2023-07-09T21:50:48.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.007+0000 7f0aa1f9b700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0a8006ace0 0x7f0a8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:48.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.007+0000 7f0aa1f9b700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0a8006ace0 0x7f0a8006d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0a98006b20 tx=0x7f0a98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:48.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.010+0000 7f0a927fc700 1 -- 172.21.15.53:0/3052829667 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0a8c053850 con 0x7f0a9c15afd0 2023-07-09T21:50:48.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.262+0000 7f0aa41ff700 1 -- 172.21.15.53:0/3052829667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0a9c1e50e0 con 0x7f0a9c15afd0 2023-07-09T21:50:48.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.263+0000 7f0a927fc700 1 -- 172.21.15.53:0/3052829667 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0a9c1e50e0 con 0x7f0a9c15afd0 2023-07-09T21:50:48.265 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:50:48.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.265+0000 7f0aa41ff700 1 -- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0a8006ace0 msgr2=0x7f0a8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.265+0000 7f0aa41ff700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0a8006ace0 0x7f0a8006d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0a98006b20 tx=0x7f0a98008040 comp rx=0 tx=0).stop 2023-07-09T21:50:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.265+0000 7f0aa41ff700 1 -- 172.21.15.53:0/3052829667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a9c15afd0 msgr2=0x7f0a9c0af9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.265+0000 7f0aa41ff700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a9c15afd0 0x7f0a9c0af9a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00c450 tx=0x7f0a8c00c760 comp rx=0 tx=0).stop 2023-07-09T21:50:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.265+0000 7f0aa41ff700 1 -- 172.21.15.53:0/3052829667 shutdown_connections 2023-07-09T21:50:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.265+0000 7f0aa41ff700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0a8006ace0 0x7f0a8006d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:48.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.265+0000 7f0aa41ff700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a9c15e890 0x7f0a9c14f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:48.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.265+0000 7f0aa41ff700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a9c0b3cc0 0x7f0a9c0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:48.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.265+0000 7f0aa41ff700 1 --2- 172.21.15.53:0/3052829667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a9c15afd0 0x7f0a9c0af9a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:48.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.265+0000 7f0aa41ff700 1 -- 172.21.15.53:0/3052829667 >> 172.21.15.53:0/3052829667 conn(0x7f0a9c069f30 msgr2=0x7f0a9c153670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:48.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.265+0000 7f0aa41ff700 1 -- 172.21.15.53:0/3052829667 shutdown_connections 2023-07-09T21:50:48.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:48.265+0000 7f0aa41ff700 1 -- 172.21.15.53:0/3052829667 wait complete. 2023-07-09T21:50:48.284 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:50:48.285 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:50:48.285 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-07-09T21:50:48.285 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T21:50:48.285 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:50:48.286 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:50:48.286 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:50:48.286 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:50:48.286 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:50:48.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:48.287 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-07-09T21:50:48.331 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:50:48.331 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:50:48.331 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:50:48.331 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:48.331 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-07-09T21:50:48.332 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:48.332 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:50:48.332 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:48.332 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-07-09T21:50:48.332 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:50:48.332 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:48.332 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-07-09T21:50:48.333 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:50:48.333 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:48.333 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-07-09T21:50:48.333 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-09T21:50:48.333 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42103sec preferred_lft 42103sec 2023-07-09T21:50:48.333 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-07-09T21:50:48.333 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:48.334 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:50:48.334 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:48.334 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-07-09T21:50:48.334 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-09T21:50:48.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:48.335 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-07-09T21:50:48.335 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-07-09T21:50:48.335 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add name ceph-brx type bridge 2023-07-09T21:50:48.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr flush dev ceph-brx 2023-07-09T21:50:48.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set ceph-brx up 2023-07-09T21:50:48.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-09T21:50:48.336 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-07-09T21:50:48.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:48.797 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:50:48.869 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-07-09T21:50:48.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:48.873 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-07-09T21:50:48.931 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-07-09T21:50:48.931 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:50:48.931 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-09T21:50:48.932 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-09T21:50:48.932 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:50:48.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:48.932 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-07-09T21:50:48.933 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-07-09T21:50:48.933 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:50:48.933 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:50:48.933 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:50:48.934 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-07-09T21:50:49.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:49.625 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-07-09T21:50:49.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:49.669 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2023-07-09T21:50:49.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:49.752 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-07-09T21:50:49.752 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-07-09T21:50:49.753 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:50:49.753 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-09T21:50:49.753 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-07-09T21:50:49.933 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-09T21:50:49.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:49.934 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-07-09T21:50:49.934 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-07-09T21:50:49.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-09T21:50:49.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-09T21:50:49.935 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-09T21:50:49.935 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-09T21:50:49.935 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-09T21:50:49.936 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-07-09T21:50:50.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:50.207 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-07-09T21:50:50.207 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-07-09T21:50:50.208 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-07-09T21:50:50.208 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.0 master ceph-brx 2023-07-09T21:50:50.208 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-07-09T21:50:50.388 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:50:50.389 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T21:50:50.431 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:50:50.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:50:50.432 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:50:50.514 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-09T21:50:50.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:50.514 DEBUG:teuthology.orchestra.run.smithi053:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-09T21:50:50.666 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-09T21:50:50.666 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-09T21:50:50.666 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2023-07-09T21:50:51.104 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-09T21:50:51.104 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-09T21:50:51.105 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2023-07-09T21:50:51.105 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:50:51.105 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:50:51.130 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-09T21:50:51.131 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-09T21:50:51.131 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2023-07-09T21:50:51.131 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:50:51.131 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:50:51.131 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-07-09T21:50:51.131 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-07-09T21:50:51.132 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=25d21351-dc09-4310-b56b-79a331e4aa31" will pass to kernel 2023-07-09T21:50:51.137 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T21:50:51.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:51.137 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:50:51.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:51.207 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:50:51.324 INFO:teuthology.orchestra.run.smithi053.stdout:client4511 2023-07-09T21:50:51.324 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:50:51.325 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:50:51.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:51.368 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:50:51.514 INFO:teuthology.orchestra.run.smithi053.stdout:client4511 2023-07-09T21:50:51.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:51.515 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout:client4511 2023-07-09T21:50:51.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:51.628 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/25d21351-dc09-4310-b56b-79a331e4aa31.client4511/status') 2023-07-09T21:50:51.756 INFO:teuthology.orchestra.run.smithi053.stdout:instance: client.4511 (3)172.21.15.53:0/128465740 2023-07-09T21:50:51.756 INFO:teuthology.orchestra.run.smithi053.stdout:blocklisted: false 2023-07-09T21:50:51.757 INFO:teuthology.orchestra.run.smithi053.stderr:0+1 records in 2023-07-09T21:50:51.757 INFO:teuthology.orchestra.run.smithi053.stderr:0+1 records out 2023-07-09T21:50:51.757 INFO:teuthology.orchestra.run.smithi053.stderr:69 bytes copied, 6.2319e-05 s, 1.1 MB/s 2023-07-09T21:50:51.759 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-07-09T21:50:51.759 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-09T21:50:51.759 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-09T21:50:51.759 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:50:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.957+0000 7f9a9f9ff700 1 Processor -- start 2023-07-09T21:50:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.958+0000 7f9a9f9ff700 1 -- start start 2023-07-09T21:50:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.959+0000 7f9a9f9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9a9815e890 0x7f9a980b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.959+0000 7f9a9f9ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9a980b3cc0 0x7f9a9815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.959+0000 7f9a9f9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a9815ae00 0x7f9a98150c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.959+0000 7f9a9f9ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a980b4130 con 0x7f9a980b3cc0 2023-07-09T21:50:51.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.959+0000 7f9a9f9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a980ce110 con 0x7f9a9815e890 2023-07-09T21:50:51.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.959+0000 7f9a9f9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9815b660 con 0x7f9a9815ae00 2023-07-09T21:50:51.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.959+0000 7f9a9cf9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9a980b3cc0 0x7f9a9815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:51.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.959+0000 7f9a9cf9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9a980b3cc0 0x7f9a9815a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42382/0 (socket says 172.21.15.53:42382) 2023-07-09T21:50:51.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.959+0000 7f9a9cf9a700 1 -- 172.21.15.53:0/1461654716 learned_addr learned my addr 172.21.15.53:0/1461654716 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:51.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.960+0000 7f9a9d79b700 1 --2- 172.21.15.53:0/1461654716 >> v2:172.21.15.184:3300/0 conn(0x7f9a9815e890 0x7f9a980b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:51.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.960+0000 7f9a9df9c700 1 --2- 172.21.15.53:0/1461654716 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a9815ae00 0x7f9a98150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:51.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.960+0000 7f9a9cf9a700 1 -- 172.21.15.53:0/1461654716 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a9815ae00 msgr2=0x7f9a98150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:51.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.960+0000 7f9a9cf9a700 1 --2- 172.21.15.53:0/1461654716 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a9815ae00 0x7f9a98150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:51.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.960+0000 7f9a9cf9a700 1 -- 172.21.15.53:0/1461654716 >> v2:172.21.15.184:3300/0 conn(0x7f9a9815e890 msgr2=0x7f9a980b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:51.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.960+0000 7f9a9cf9a700 1 --2- 172.21.15.53:0/1461654716 >> v2:172.21.15.184:3300/0 conn(0x7f9a9815e890 0x7f9a980b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:51.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.960+0000 7f9a9cf9a700 1 -- 172.21.15.53:0/1461654716 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a980ce360 con 0x7f9a980b3cc0 2023-07-09T21:50:51.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.960+0000 7f9a9cf9a700 1 --2- 172.21.15.53:0/1461654716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a980b3cc0 0x7f9a9815a8c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9a9806f670 tx=0x7f9a88009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3416d024bb595e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:51.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.960+0000 7f9a8ffff700 1 -- 172.21.15.53:0/1461654716 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8800b870 con 0x7f9a980b3cc0 2023-07-09T21:50:51.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.960+0000 7f9a8ffff700 1 -- 172.21.15.53:0/1461654716 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8800b9d0 con 0x7f9a980b3cc0 2023-07-09T21:50:51.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.960+0000 7f9a8ffff700 1 -- 172.21.15.53:0/1461654716 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8800bd60 con 0x7f9a980b3cc0 2023-07-09T21:50:51.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.961+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/1461654716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a980b3cc0 msgr2=0x7f9a9815a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:51.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.961+0000 7f9a9f9ff700 1 --2- 172.21.15.53:0/1461654716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a980b3cc0 0x7f9a9815a8c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9a9806f670 tx=0x7f9a88009bd0 comp rx=0 tx=0).stop 2023-07-09T21:50:51.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.961+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/1461654716 shutdown_connections 2023-07-09T21:50:51.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.961+0000 7f9a9f9ff700 1 --2- 172.21.15.53:0/1461654716 >> v2:172.21.15.184:3300/0 conn(0x7f9a9815e890 0x7f9a980b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:51.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.961+0000 7f9a9f9ff700 1 --2- 172.21.15.53:0/1461654716 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a9815ae00 0x7f9a98150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:51.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.961+0000 7f9a9f9ff700 1 --2- 172.21.15.53:0/1461654716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a980b3cc0 0x7f9a9815a8c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:51.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.961+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/1461654716 >> 172.21.15.53:0/1461654716 conn(0x7f9a98069f30 msgr2=0x7f9a9806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:51.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.961+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/1461654716 shutdown_connections 2023-07-09T21:50:51.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.961+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/1461654716 wait complete. 2023-07-09T21:50:51.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.963+0000 7f9a9f9ff700 1 Processor -- start 2023-07-09T21:50:51.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.963+0000 7f9a9f9ff700 1 -- start start 2023-07-09T21:50:51.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.964+0000 7f9a9f9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a980b3cc0 0x7f9a98149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:51.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.964+0000 7f9a9f9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a9815ae00 0x7f9a98149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:51.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.964+0000 7f9a9f9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a9815e890 0x7f9a9814a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:51.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.964+0000 7f9a9f9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98149a60 con 0x7f9a980b3cc0 2023-07-09T21:50:51.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.964+0000 7f9a9f9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a981f2450 con 0x7f9a9815e890 2023-07-09T21:50:51.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.964+0000 7f9a9f9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9814b450 con 0x7f9a9815ae00 2023-07-09T21:50:51.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.964+0000 7f9a9d79b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a980b3cc0 0x7f9a98149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:51.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.964+0000 7f9a9d79b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a980b3cc0 0x7f9a98149520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42386/0 (socket says 172.21.15.53:42386) 2023-07-09T21:50:51.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.964+0000 7f9a9d79b700 1 -- 172.21.15.53:0/616306250 learned_addr learned my addr 172.21.15.53:0/616306250 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:51.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.964+0000 7f9a9df9c700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a9815e890 0x7f9a9814a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:51.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.964+0000 7f9a9cf9a700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a9815ae00 0x7f9a98149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:51.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.965+0000 7f9a9d79b700 1 -- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a9815ae00 msgr2=0x7f9a98149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:51.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.965+0000 7f9a9d79b700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a9815ae00 0x7f9a98149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:51.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.965+0000 7f9a9d79b700 1 -- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a9815e890 msgr2=0x7f9a9814a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:51.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.965+0000 7f9a9d79b700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a9815e890 0x7f9a9814a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:51.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.965+0000 7f9a9d79b700 1 -- 172.21.15.53:0/616306250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a88009550 con 0x7f9a980b3cc0 2023-07-09T21:50:51.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.965+0000 7f9a9d79b700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a980b3cc0 0x7f9a98149520 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400e840 tx=0x7f9a9400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:51.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.965+0000 7f9a8dffb700 1 -- 172.21.15.53:0/616306250 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a94013610 con 0x7f9a980b3cc0 2023-07-09T21:50:51.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.965+0000 7f9a8dffb700 1 -- 172.21.15.53:0/616306250 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a94013770 con 0x7f9a980b3cc0 2023-07-09T21:50:51.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.965+0000 7f9a8dffb700 1 -- 172.21.15.53:0/616306250 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a94013b20 con 0x7f9a980b3cc0 2023-07-09T21:50:51.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.965+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/616306250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9814a840 con 0x7f9a980b3cc0 2023-07-09T21:50:51.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.965+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/616306250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9814ae00 con 0x7f9a980b3cc0 2023-07-09T21:50:51.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.966+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/616306250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9804e280 con 0x7f9a980b3cc0 2023-07-09T21:50:51.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.967+0000 7f9a8dffb700 1 -- 172.21.15.53:0/616306250 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a94013c80 con 0x7f9a980b3cc0 2023-07-09T21:50:51.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.968+0000 7f9a8dffb700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9a7c06ad10 0x7f9a7c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:51.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.968+0000 7f9a8dffb700 1 -- 172.21.15.53:0/616306250 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a94088fe0 con 0x7f9a980b3cc0 2023-07-09T21:50:51.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.969+0000 7f9a9cf9a700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9a7c06ad10 0x7f9a7c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:51.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.970+0000 7f9a9cf9a700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9a7c06ad10 0x7f9a7c06d1c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9a88014040 tx=0x7f9a88008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:51.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:51.973+0000 7f9a8dffb700 1 -- 172.21.15.53:0/616306250 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9a94053fb0 con 0x7f9a980b3cc0 2023-07-09T21:50:52.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.226+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/616306250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9a9815a190 con 0x7f9a980b3cc0 2023-07-09T21:50:52.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.226+0000 7f9a8dffb700 1 -- 172.21.15.53:0/616306250 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9a940575d0 con 0x7f9a980b3cc0 2023-07-09T21:50:52.228 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:50:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.229+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9a7c06ad10 msgr2=0x7f9a7c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.229+0000 7f9a9f9ff700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9a7c06ad10 0x7f9a7c06d1c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9a88014040 tx=0x7f9a88008030 comp rx=0 tx=0).stop 2023-07-09T21:50:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.229+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/616306250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a980b3cc0 msgr2=0x7f9a98149520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:52.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.229+0000 7f9a9f9ff700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a980b3cc0 0x7f9a98149520 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400e840 tx=0x7f9a9400eb50 comp rx=0 tx=0).stop 2023-07-09T21:50:52.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.229+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/616306250 shutdown_connections 2023-07-09T21:50:52.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.229+0000 7f9a9f9ff700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9a7c06ad10 0x7f9a7c06d1c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:52.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.229+0000 7f9a9f9ff700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a9815e890 0x7f9a9814a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:52.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.229+0000 7f9a9f9ff700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a980b3cc0 0x7f9a98149520 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:52.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.229+0000 7f9a9f9ff700 1 --2- 172.21.15.53:0/616306250 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a9815ae00 0x7f9a98149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:52.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.229+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/616306250 >> 172.21.15.53:0/616306250 conn(0x7f9a98069f30 msgr2=0x7f9a98071170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:52.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.229+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/616306250 shutdown_connections 2023-07-09T21:50:52.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:52.229+0000 7f9a9f9ff700 1 -- 172.21.15.53:0/616306250 wait complete. 2023-07-09T21:50:52.249 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:50:52.249 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:50:52.249 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-07-09T21:50:52.250 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-09T21:50:52.250 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-09T21:50:52.250 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:50:52.250 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:50:52.251 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:50:52.251 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-09T21:50:52.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:52.252 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-07-09T21:50:52.294 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:50:52.294 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:50:52.295 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:50:52.295 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:52.295 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-07-09T21:50:52.295 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:52.295 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:50:52.295 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:52.296 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-07-09T21:50:52.296 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:50:52.296 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:52.296 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-07-09T21:50:52.296 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:50:52.296 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:52.296 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-07-09T21:50:52.296 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-09T21:50:52.297 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42099sec preferred_lft 42099sec 2023-07-09T21:50:52.297 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-07-09T21:50:52.297 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:52.297 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:50:52.297 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:52.297 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-07-09T21:50:52.297 INFO:teuthology.orchestra.run.smithi053.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:50:52.298 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 4e:2d:4a:aa:2a:16 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:52.298 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:50:52.298 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:52.298 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::7d:bbff:fed2:eee3/64 scope link 2023-07-09T21:50:52.298 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:52.298 INFO:teuthology.orchestra.run.smithi053.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:50:52.298 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 4e:2d:4a:aa:2a:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:50:52.298 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::4c2d:4aff:feaa:2a16/64 scope link 2023-07-09T21:50:52.299 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:52.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:52.300 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:50:52.405 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-07-09T21:50:52.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:52.408 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-07-09T21:50:52.454 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-07-09T21:50:52.454 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:50:52.454 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-09T21:50:52.454 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-09T21:50:52.454 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:50:52.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:52.456 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-07-09T21:50:52.456 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-07-09T21:50:52.456 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:50:52.456 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:50:52.457 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:50:52.458 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-07-09T21:50:52.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:52.666 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-07-09T21:50:52.709 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:50:52.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:52.710 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2023-07-09T21:50:52.792 INFO:teuthology.orchestra.run.smithi053.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-09T21:50:52.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:52.794 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-07-09T21:50:52.794 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-07-09T21:50:52.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:50:52.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-09T21:50:52.795 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-07-09T21:50:52.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:52.975 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-09T21:50:53.044 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:50:53.045 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:50:53.045 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:50:53.046 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:53.046 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-07-09T21:50:53.046 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:53.046 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:50:53.047 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:80:87:60:31:98 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-09T21:50:53.047 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-09T21:50:53.047 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:53.047 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c80:87ff:fe60:3198/64 scope link 2023-07-09T21:50:53.047 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:53.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:53.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-09T21:50:53.117 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:50:53.118 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:50:53.118 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:50:53.118 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:53.118 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-07-09T21:50:53.118 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:53.118 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:50:53.118 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:80:87:60:31:98 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-09T21:50:53.119 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-09T21:50:53.119 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:53.119 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c80:87ff:fe60:3198/64 scope link 2023-07-09T21:50:53.119 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:53.120 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-09T21:50:53.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:53.121 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-07-09T21:50:53.121 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-07-09T21:50:53.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-09T21:50:53.122 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-09T21:50:53.122 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-09T21:50:53.122 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-09T21:50:53.122 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-09T21:50:53.122 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-07-09T21:50:53.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:53.377 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-07-09T21:50:53.377 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-07-09T21:50:53.377 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.1 up 2023-07-09T21:50:53.377 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.1 master ceph-brx 2023-07-09T21:50:53.378 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-07-09T21:50:53.557 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:50:53.558 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-09T21:50:53.600 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-09T21:50:53.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:50:53.601 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-09T21:50:53.683 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-09T21:50:53.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:53.683 DEBUG:teuthology.orchestra.run.smithi053:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-09T21:50:53.829 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-09T21:50:53.830 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-09T21:50:53.830 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2023-07-09T21:50:53.848 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-09T21:50:53.848 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-09T21:50:53.848 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2023-07-09T21:50:53.848 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:50:53.848 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:50:53.871 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-09T21:50:53.871 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-09T21:50:53.871 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2023-07-09T21:50:53.871 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:50:53.871 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:50:53.872 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-07-09T21:50:53.872 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-07-09T21:50:53.872 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=25d21351-dc09-4310-b56b-79a331e4aa31" will pass to kernel 2023-07-09T21:50:53.877 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T21:50:53.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:53.877 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-09T21:50:53.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:53.947 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:50:54.032 INFO:teuthology.orchestra.run.smithi053.stdout:client4693 2023-07-09T21:50:54.033 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:50:54.033 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:50:54.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:54.076 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:50:54.200 INFO:teuthology.orchestra.run.smithi053.stdout:client4693 2023-07-09T21:50:54.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:54.200 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:50:54.285 INFO:teuthology.orchestra.run.smithi053.stdout:client4693 2023-07-09T21:50:54.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:54.286 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/25d21351-dc09-4310-b56b-79a331e4aa31.client4693/status') 2023-07-09T21:50:54.393 INFO:teuthology.orchestra.run.smithi053.stdout:instance: client.4693 (3)172.21.15.53:0/4229043459 2023-07-09T21:50:54.393 INFO:teuthology.orchestra.run.smithi053.stdout:blocklisted: false 2023-07-09T21:50:54.394 INFO:teuthology.orchestra.run.smithi053.stderr:0+1 records in 2023-07-09T21:50:54.394 INFO:teuthology.orchestra.run.smithi053.stderr:0+1 records out 2023-07-09T21:50:54.394 INFO:teuthology.orchestra.run.smithi053.stderr:70 bytes copied, 5.4396e-05 s, 1.3 MB/s 2023-07-09T21:50:54.395 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-07-09T21:50:54.396 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-09T21:50:54.396 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T21:50:54.397 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:50:54.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.596+0000 7f2d1ddff700 1 Processor -- start 2023-07-09T21:50:54.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.597+0000 7f2d1ddff700 1 -- start start 2023-07-09T21:50:54.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.598+0000 7f2d1ddff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2d180d1220 0x7f2d180b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:54.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.598+0000 7f2d1ddff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d180b2350 0x7f2d180afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:54.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.598+0000 7f2d1ddff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d180d2ce0 con 0x7f2d180b1e00 2023-07-09T21:50:54.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.598+0000 7f2d1ddff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d180b3350 con 0x7f2d180b2350 2023-07-09T21:50:54.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.598+0000 7f2d1ddff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d180b3630 con 0x7f2d180d1220 2023-07-09T21:50:54.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.598+0000 7f2d17fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d180b2350 0x7f2d180afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:54.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.598+0000 7f2d17fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d180b2350 0x7f2d180afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57930/0 (socket says 172.21.15.53:57930) 2023-07-09T21:50:54.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.598+0000 7f2d17fff700 1 -- 172.21.15.53:0/211502656 learned_addr learned my addr 172.21.15.53:0/211502656 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:54.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.598+0000 7f2d16ffd700 1 --2- 172.21.15.53:0/211502656 >> v2:172.21.15.184:3300/0 conn(0x7f2d180d1220 0x7f2d180b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:54.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.598+0000 7f2d17fff700 1 -- 172.21.15.53:0/211502656 >> v2:172.21.15.184:3300/0 conn(0x7f2d180d1220 msgr2=0x7f2d180b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:54.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.598+0000 7f2d17fff700 1 --2- 172.21.15.53:0/211502656 >> v2:172.21.15.184:3300/0 conn(0x7f2d180d1220 0x7f2d180b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:54.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.598+0000 7f2d17fff700 1 -- 172.21.15.53:0/211502656 >> v1:172.21.15.184:6789/0 conn(0x7f2d180b1e00 legacy=0x7f2d180d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:54.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.599+0000 7f2d17fff700 1 -- 172.21.15.53:0/211502656 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180b3910 con 0x7f2d180b2350 2023-07-09T21:50:54.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.599+0000 7f2d17fff700 1 --2- 172.21.15.53:0/211502656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180b2350 0x7f2d180afac0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d18072140 tx=0x7f2d1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e0fd9eaad1c262 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:54.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.599+0000 7f2d167fc700 1 -- 172.21.15.53:0/211502656 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1000e070 con 0x7f2d180b2350 2023-07-09T21:50:54.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.599+0000 7f2d167fc700 1 -- 172.21.15.53:0/211502656 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d10003a20 con 0x7f2d180b2350 2023-07-09T21:50:54.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.599+0000 7f2d167fc700 1 -- 172.21.15.53:0/211502656 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10003dd0 con 0x7f2d180b2350 2023-07-09T21:50:54.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.599+0000 7f2d1ddff700 1 -- 172.21.15.53:0/211502656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180b2350 msgr2=0x7f2d180afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:54.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.599+0000 7f2d1ddff700 1 --2- 172.21.15.53:0/211502656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180b2350 0x7f2d180afac0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d18072140 tx=0x7f2d1000b330 comp rx=0 tx=0).stop 2023-07-09T21:50:54.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.600+0000 7f2d1ddff700 1 -- 172.21.15.53:0/211502656 shutdown_connections 2023-07-09T21:50:54.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.600+0000 7f2d1ddff700 1 --2- 172.21.15.53:0/211502656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180b2350 0x7f2d180afac0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:54.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.600+0000 7f2d1ddff700 1 --2- 172.21.15.53:0/211502656 >> v2:172.21.15.184:3300/0 conn(0x7f2d180d1220 0x7f2d180b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:54.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.600+0000 7f2d1ddff700 1 -- 172.21.15.53:0/211502656 >> 172.21.15.53:0/211502656 conn(0x7f2d1809c1d0 msgr2=0x7f2d180d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:54.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.600+0000 7f2d1ddff700 1 -- 172.21.15.53:0/211502656 shutdown_connections 2023-07-09T21:50:54.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.600+0000 7f2d1ddff700 1 -- 172.21.15.53:0/211502656 wait complete. 2023-07-09T21:50:54.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.601+0000 7f2d1ddff700 1 Processor -- start 2023-07-09T21:50:54.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.602+0000 7f2d1ddff700 1 -- start start 2023-07-09T21:50:54.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d1ddff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d180b1e00 0x7f2d180c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:54.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d1ddff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d180b2350 0x7f2d181548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d1ddff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180d1220 0x7f2d180ce310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d1ddff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18155920 con 0x7f2d180d1220 2023-07-09T21:50:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d1ddff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180cde80 con 0x7f2d180b2350 2023-07-09T21:50:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d1ddff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18154e10 con 0x7f2d180b1e00 2023-07-09T21:50:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d17fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180d1220 0x7f2d180ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d17fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180d1220 0x7f2d180ce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57940/0 (socket says 172.21.15.53:57940) 2023-07-09T21:50:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d17fff700 1 -- 172.21.15.53:0/44613199 learned_addr learned my addr 172.21.15.53:0/44613199 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d16ffd700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d180b2350 0x7f2d181548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d177fe700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d180b1e00 0x7f2d180c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d17fff700 1 -- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d180b1e00 msgr2=0x7f2d180c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d17fff700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d180b1e00 0x7f2d180c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d17fff700 1 -- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d180b2350 msgr2=0x7f2d181548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d17fff700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d180b2350 0x7f2d181548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.603+0000 7f2d17fff700 1 -- 172.21.15.53:0/44613199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d10009b30 con 0x7f2d180d1220 2023-07-09T21:50:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.604+0000 7f2d17fff700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180d1220 0x7f2d180ce310 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2d10015040 tx=0x7f2d10004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:54.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.604+0000 7f2cfffff700 1 -- 172.21.15.53:0/44613199 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10004440 con 0x7f2d180d1220 2023-07-09T21:50:54.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.604+0000 7f2cfffff700 1 -- 172.21.15.53:0/44613199 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d100045c0 con 0x7f2d180d1220 2023-07-09T21:50:54.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.604+0000 7f2d1ddff700 1 -- 172.21.15.53:0/44613199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d180ce850 con 0x7f2d180d1220 2023-07-09T21:50:54.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.604+0000 7f2cfffff700 1 -- 172.21.15.53:0/44613199 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10004970 con 0x7f2d180d1220 2023-07-09T21:50:54.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.604+0000 7f2d1ddff700 1 -- 172.21.15.53:0/44613199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d180cd550 con 0x7f2d180d1220 2023-07-09T21:50:54.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.605+0000 7f2d1ddff700 1 -- 172.21.15.53:0/44613199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d180cdff0 con 0x7f2d180d1220 2023-07-09T21:50:54.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.606+0000 7f2cfffff700 1 -- 172.21.15.53:0/44613199 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d10012430 con 0x7f2d180d1220 2023-07-09T21:50:54.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.607+0000 7f2cfffff700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2d0406ace0 0x7f2d0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:54.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.607+0000 7f2cfffff700 1 -- 172.21.15.53:0/44613199 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d1008a7c0 con 0x7f2d180d1220 2023-07-09T21:50:54.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.608+0000 7f2d177fe700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2d0406ace0 0x7f2d0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:54.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.608+0000 7f2d177fe700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2d0406ace0 0x7f2d0406d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d080050c0 tx=0x7f2d08007f10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:54.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.611+0000 7f2cfffff700 1 -- 172.21.15.53:0/44613199 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2d10055860 con 0x7f2d180d1220 2023-07-09T21:50:54.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.869+0000 7f2d1ddff700 1 -- 172.21.15.53:0/44613199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2d1804e280 con 0x7f2d180d1220 2023-07-09T21:50:54.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.870+0000 7f2cfffff700 1 -- 172.21.15.53:0/44613199 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2d10058e80 con 0x7f2d180d1220 2023-07-09T21:50:54.871 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:50:54.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.872+0000 7f2d1ddff700 1 -- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2d0406ace0 msgr2=0x7f2d0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:54.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.872+0000 7f2d1ddff700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2d0406ace0 0x7f2d0406d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d080050c0 tx=0x7f2d08007f10 comp rx=0 tx=0).stop 2023-07-09T21:50:54.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.872+0000 7f2d1ddff700 1 -- 172.21.15.53:0/44613199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180d1220 msgr2=0x7f2d180ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:54.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.872+0000 7f2d1ddff700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180d1220 0x7f2d180ce310 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2d10015040 tx=0x7f2d10004ad0 comp rx=0 tx=0).stop 2023-07-09T21:50:54.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.872+0000 7f2d1ddff700 1 -- 172.21.15.53:0/44613199 shutdown_connections 2023-07-09T21:50:54.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.872+0000 7f2d1ddff700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2d0406ace0 0x7f2d0406d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:54.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.872+0000 7f2d1ddff700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180d1220 0x7f2d180ce310 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:54.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.872+0000 7f2d1ddff700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d180b1e00 0x7f2d180c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:54.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.872+0000 7f2d1ddff700 1 --2- 172.21.15.53:0/44613199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d180b2350 0x7f2d181548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:54.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.872+0000 7f2d1ddff700 1 -- 172.21.15.53:0/44613199 >> 172.21.15.53:0/44613199 conn(0x7f2d1809c1d0 msgr2=0x7f2d18159550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:54.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.872+0000 7f2d1ddff700 1 -- 172.21.15.53:0/44613199 shutdown_connections 2023-07-09T21:50:54.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:54.872+0000 7f2d1ddff700 1 -- 172.21.15.53:0/44613199 wait complete. 2023-07-09T21:50:54.891 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:50:54.892 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:50:54.892 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-07-09T21:50:54.892 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T21:50:54.892 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T21:50:54.892 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:50:54.893 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:50:54.893 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:50:54.893 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T21:50:54.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:54.894 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-07-09T21:50:54.940 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:50:54.941 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:50:54.941 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:50:54.941 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:54.941 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-07-09T21:50:54.941 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:54.941 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:50:54.942 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:54.942 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-07-09T21:50:54.942 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:50:54.942 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:54.942 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-07-09T21:50:54.942 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:50:54.942 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:54.942 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:50:54.943 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:54.943 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-09T21:50:54.943 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42096sec preferred_lft 42096sec 2023-07-09T21:50:54.943 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c7b:9bae:bb6f:ebac/64 scope link noprefixroute 2023-07-09T21:50:54.943 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:54.944 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-09T21:50:54.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:54.945 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-09T21:50:54.945 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-09T21:50:54.945 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add name ceph-brx type bridge 2023-07-09T21:50:54.945 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr flush dev ceph-brx 2023-07-09T21:50:54.946 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set ceph-brx up 2023-07-09T21:50:54.946 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-09T21:50:54.946 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-09T21:50:55.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:55.435 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:50:55.504 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-07-09T21:50:55.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:55.507 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-07-09T21:50:55.571 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-07-09T21:50:55.571 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:50:55.571 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T21:50:55.571 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T21:50:55.572 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:50:55.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:55.572 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-09T21:50:55.572 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-09T21:50:55.573 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T21:50:55.573 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T21:50:55.573 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T21:50:55.573 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-09T21:50:56.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:56.267 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-07-09T21:50:56.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:56.311 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-07-09T21:50:56.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:56.393 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-09T21:50:56.393 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-09T21:50:56.393 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T21:50:56.393 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-09T21:50:56.394 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-09T21:50:56.573 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-09T21:50:56.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:56.574 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-09T21:50:56.575 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-09T21:50:56.575 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-09T21:50:56.575 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-09T21:50:56.575 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-09T21:50:56.575 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-09T21:50:56.576 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-09T21:50:56.576 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-09T21:50:56.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:56.842 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-09T21:50:56.842 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-09T21:50:56.843 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-07-09T21:50:56.843 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.0 master ceph-brx 2023-07-09T21:50:56.843 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-09T21:50:57.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:50:57.021 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T21:50:57.063 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T21:50:57.064 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:50:57.064 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T21:50:57.145 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-09T21:50:57.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:57.146 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-09T21:50:57.303 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-09T21:50:57.303 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-09T21:50:57.303 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-09T21:50:57.735 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-09T21:50:57.735 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-09T21:50:57.735 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-09T21:50:57.735 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:50:57.735 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:50:57.759 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-09T21:50:57.759 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-09T21:50:57.759 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-09T21:50:57.759 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:50:57.760 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:50:57.760 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-07-09T21:50:57.760 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-07-09T21:50:57.760 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=25d21351-dc09-4310-b56b-79a331e4aa31" will pass to kernel 2023-07-09T21:50:57.764 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T21:50:57.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:57.765 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T21:50:57.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:57.833 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:50:57.929 INFO:teuthology.orchestra.run.smithi184.stdout:client4523 2023-07-09T21:50:57.930 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:50:57.930 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:50:57.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:57.972 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:50:58.094 INFO:teuthology.orchestra.run.smithi184.stdout:client4523 2023-07-09T21:50:58.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:58.095 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:50:58.178 INFO:teuthology.orchestra.run.smithi184.stdout:client4523 2023-07-09T21:50:58.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:58.179 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/25d21351-dc09-4310-b56b-79a331e4aa31.client4523/status') 2023-07-09T21:50:58.283 INFO:teuthology.orchestra.run.smithi184.stdout:instance: client.4523 (3)192.168.0.1:0/229313840 2023-07-09T21:50:58.284 INFO:teuthology.orchestra.run.smithi184.stdout:blocklisted: false 2023-07-09T21:50:58.284 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records in 2023-07-09T21:50:58.285 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records out 2023-07-09T21:50:58.285 INFO:teuthology.orchestra.run.smithi184.stderr:68 bytes copied, 5.1305e-05 s, 1.3 MB/s 2023-07-09T21:50:58.286 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-07-09T21:50:58.287 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-09T21:50:58.287 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-09T21:50:58.287 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:50:58.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.497+0000 7f084bbff700 1 Processor -- start 2023-07-09T21:50:58.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.497+0000 7f084bbff700 1 -- start start 2023-07-09T21:50:58.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.499+0000 7f084bbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08440b1e00 0x7f08440b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:58.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.499+0000 7f084bbff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08440d2ce0 con 0x7f08440d1220 2023-07-09T21:50:58.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.499+0000 7f084bbff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08440b3350 con 0x7f08440b2350 2023-07-09T21:50:58.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.499+0000 7f084bbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08440b3630 con 0x7f08440b1e00 2023-07-09T21:50:58.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.499+0000 7f084a19c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f08440d1220 0x7f08440afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54522/0 (socket says 172.21.15.53:54522) 2023-07-09T21:50:58.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.499+0000 7f084a19c700 1 -- 172.21.15.53:0/860738025 learned_addr learned my addr 172.21.15.53:0/860738025 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:50:58.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.499+0000 7f084999b700 1 --2- 172.21.15.53:0/860738025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08440b1e00 0x7f08440b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:58.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.499+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588695084 0 0) 0x7f08440d2ce0 con 0x7f08440d1220 2023-07-09T21:50:58.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.499+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08300035b0 con 0x7f08440d1220 2023-07-09T21:50:58.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402664719 0 0) 0x7f08440b3350 con 0x7f08440b2350 2023-07-09T21:50:58.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08440d2ce0 con 0x7f08440b2350 2023-07-09T21:50:58.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1482781360 0 0) 0x7f08300035b0 con 0x7f08440d1220 2023-07-09T21:50:58.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08440b1e00 msgr2=0x7f08440b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:58.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 --2- 172.21.15.53:0/860738025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08440b1e00 0x7f08440b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:58.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 >> v1:172.21.15.184:6789/0 conn(0x7f08440b2350 legacy=0x7f08440d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:58.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08440b3910 con 0x7f08440d1220 2023-07-09T21:50:58.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f083c0019f0 con 0x7f08440d1220 2023-07-09T21:50:58.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 >> v1:172.21.15.53:6789/0 conn(0x7f08440d1220 legacy=0x7f08440afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 --2- 172.21.15.53:0/860738025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08440b1e00 0x7f0830003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 --2- 172.21.15.53:0/860738025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0830004170 0x7f0830004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 --2- 172.21.15.53:0/860738025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0830004d90 0x7f0830005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08440b3630 con 0x7f0830004170 2023-07-09T21:50:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083000bba0 con 0x7f0830004d90 2023-07-09T21:50:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083000bd60 con 0x7f08440b1e00 2023-07-09T21:50:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f084999b700 1 --2- 172.21.15.53:0/860738025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08440b1e00 0x7f0830003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:58.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f084919a700 1 --2- 172.21.15.53:0/860738025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0830004170 0x7f0830004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:58.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.500+0000 7f084a19c700 1 --2- 172.21.15.53:0/860738025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0830004d90 0x7f0830005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:58.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.501+0000 7f084999b700 1 -- 172.21.15.53:0/860738025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0830004d90 msgr2=0x7f0830005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:58.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.501+0000 7f084999b700 1 --2- 172.21.15.53:0/860738025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0830004d90 0x7f0830005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:58.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.501+0000 7f084999b700 1 -- 172.21.15.53:0/860738025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0830004170 msgr2=0x7f0830004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:50:58.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.501+0000 7f084999b700 1 --2- 172.21.15.53:0/860738025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0830004170 0x7f0830004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:58.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.501+0000 7f084999b700 1 -- 172.21.15.53:0/860738025 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08300035b0 con 0x7f08440b1e00 2023-07-09T21:50:58.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.501+0000 7f084999b700 1 --2- 172.21.15.53:0/860738025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08440b1e00 0x7f0830003bc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0840009b40 tx=0x7f0830005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a7c58594929c061 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:58.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.501+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840005a20 con 0x7f08440b1e00 2023-07-09T21:50:58.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.501+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0840005b80 con 0x7f08440b1e00 2023-07-09T21:50:58.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.501+0000 7f0848999700 1 -- 172.21.15.53:0/860738025 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084000e6c0 con 0x7f08440b1e00 2023-07-09T21:50:58.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.502+0000 7f084bbff700 1 -- 172.21.15.53:0/860738025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08440b1e00 msgr2=0x7f0830003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:58.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.502+0000 7f084bbff700 1 --2- 172.21.15.53:0/860738025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08440b1e00 0x7f0830003bc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0840009b40 tx=0x7f0830005880 comp rx=0 tx=0).stop 2023-07-09T21:50:58.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.502+0000 7f084a19c700 1 -- 172.21.15.53:0/860738025 reap_dead start 2023-07-09T21:50:58.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.502+0000 7f084bbff700 1 -- 172.21.15.53:0/860738025 shutdown_connections 2023-07-09T21:50:58.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.502+0000 7f084bbff700 1 -- 172.21.15.53:0/860738025 >> 172.21.15.53:0/860738025 conn(0x7f084409c1d0 msgr2=0x7f08440d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:58.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.502+0000 7f084bbff700 1 -- 172.21.15.53:0/860738025 shutdown_connections 2023-07-09T21:50:58.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.502+0000 7f084bbff700 1 -- 172.21.15.53:0/860738025 wait complete. 2023-07-09T21:50:58.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.504+0000 7f084bbff700 1 Processor -- start 2023-07-09T21:50:58.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.504+0000 7f084bbff700 1 -- start start 2023-07-09T21:50:58.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084bbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08440b1e00 0x7f08441f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:58.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084bbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08441f2540 0x7f08440afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:58.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084bbff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f084415a000 0x7f08440b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:58.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084bbff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0844158d10 con 0x7f084415a000 2023-07-09T21:50:58.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084bbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0844158f60 con 0x7f08440b1e00 2023-07-09T21:50:58.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084bbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0844159240 con 0x7f08441f2540 2023-07-09T21:50:58.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084a19c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f084415a000 0x7f08440b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:58.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084a19c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f084415a000 0x7f08440b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57954/0 (socket says 172.21.15.53:57954) 2023-07-09T21:50:58.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084a19c700 1 -- 172.21.15.53:0/3841596057 learned_addr learned my addr 172.21.15.53:0/3841596057 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:50:58.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084999b700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08440b1e00 0x7f08441f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:58.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084919a700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08441f2540 0x7f08440afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:58.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084a19c700 1 -- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08441f2540 msgr2=0x7f08440afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:58.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084a19c700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08441f2540 0x7f08440afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:58.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084a19c700 1 -- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08440b1e00 msgr2=0x7f08441f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:58.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084a19c700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08440b1e00 0x7f08441f2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:58.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.505+0000 7f084a19c700 1 -- 172.21.15.53:0/3841596057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0844159520 con 0x7f084415a000 2023-07-09T21:50:58.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.506+0000 7f084a19c700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f084415a000 0x7f08440b0000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f083c002230 tx=0x7f083c00a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:58.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.506+0000 7f083a7fc700 1 -- 172.21.15.53:0/3841596057 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c00ab70 con 0x7f084415a000 2023-07-09T21:50:58.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.506+0000 7f083a7fc700 1 -- 172.21.15.53:0/3841596057 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c00acd0 con 0x7f084415a000 2023-07-09T21:50:58.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.506+0000 7f083a7fc700 1 -- 172.21.15.53:0/3841596057 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c013630 con 0x7f084415a000 2023-07-09T21:50:58.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.506+0000 7f084bbff700 1 -- 172.21.15.53:0/3841596057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0844159800 con 0x7f084415a000 2023-07-09T21:50:58.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.506+0000 7f084bbff700 1 -- 172.21.15.53:0/3841596057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084415a920 con 0x7f084415a000 2023-07-09T21:50:58.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.507+0000 7f084bbff700 1 -- 172.21.15.53:0/3841596057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0844159d20 con 0x7f084415a000 2023-07-09T21:50:58.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.508+0000 7f083a7fc700 1 -- 172.21.15.53:0/3841596057 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f083c013790 con 0x7f084415a000 2023-07-09T21:50:58.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.509+0000 7f083a7fc700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f082806ad10 0x7f082806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:50:58.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.509+0000 7f083a7fc700 1 -- 172.21.15.53:0/3841596057 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f083c089c50 con 0x7f084415a000 2023-07-09T21:50:58.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.509+0000 7f084999b700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f082806ad10 0x7f082806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:50:58.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.510+0000 7f084999b700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f082806ad10 0x7f082806d1c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f084000a010 tx=0x7f0840008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:50:58.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.513+0000 7f083a7fc700 1 -- 172.21.15.53:0/3841596057 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0844159d20 con 0x7f084415a000 2023-07-09T21:50:58.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.767+0000 7f084bbff700 1 -- 172.21.15.53:0/3841596057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0844159d20 con 0x7f084415a000 2023-07-09T21:50:58.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.767+0000 7f083a7fc700 1 -- 172.21.15.53:0/3841596057 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0844159d20 con 0x7f084415a000 2023-07-09T21:50:58.769 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:50:58.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.770+0000 7f084bbff700 1 -- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f082806ad10 msgr2=0x7f082806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:58.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.770+0000 7f084bbff700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f082806ad10 0x7f082806d1c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f084000a010 tx=0x7f0840008030 comp rx=0 tx=0).stop 2023-07-09T21:50:58.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.770+0000 7f084bbff700 1 -- 172.21.15.53:0/3841596057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f084415a000 msgr2=0x7f08440b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:50:58.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.770+0000 7f084bbff700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f084415a000 0x7f08440b0000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f083c002230 tx=0x7f083c00a510 comp rx=0 tx=0).stop 2023-07-09T21:50:58.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.770+0000 7f084bbff700 1 -- 172.21.15.53:0/3841596057 shutdown_connections 2023-07-09T21:50:58.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.770+0000 7f084bbff700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f082806ad10 0x7f082806d1c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:58.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.770+0000 7f084bbff700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f084415a000 0x7f08440b0000 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:58.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.770+0000 7f084bbff700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08440b1e00 0x7f08441f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:58.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.770+0000 7f084bbff700 1 --2- 172.21.15.53:0/3841596057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08441f2540 0x7f08440afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:50:58.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.770+0000 7f084bbff700 1 -- 172.21.15.53:0/3841596057 >> 172.21.15.53:0/3841596057 conn(0x7f084409c1d0 msgr2=0x7f084406bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:50:58.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.770+0000 7f084bbff700 1 -- 172.21.15.53:0/3841596057 shutdown_connections 2023-07-09T21:50:58.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:50:58.770+0000 7f084bbff700 1 -- 172.21.15.53:0/3841596057 wait complete. 2023-07-09T21:50:58.790 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:50:58.790 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:50:58.790 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-07-09T21:50:58.790 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-09T21:50:58.791 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-09T21:50:58.791 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:50:58.791 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:50:58.791 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:50:58.791 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-09T21:50:58.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:58.792 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-07-09T21:50:58.836 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:50:58.837 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:50:58.837 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:50:58.837 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:58.837 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-07-09T21:50:58.837 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:58.837 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:50:58.838 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:58.838 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-07-09T21:50:58.838 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:50:58.838 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:58.838 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-07-09T21:50:58.838 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:50:58.839 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:58.839 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:50:58.839 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:58.839 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-09T21:50:58.839 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42092sec preferred_lft 42092sec 2023-07-09T21:50:58.839 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c7b:9bae:bb6f:ebac/64 scope link noprefixroute 2023-07-09T21:50:58.839 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:58.840 INFO:teuthology.orchestra.run.smithi184.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:50:58.840 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether a6:56:97:e0:ed:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:50:58.840 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:50:58.840 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:58.840 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::e4ec:4fff:feff:3b5b/64 scope link 2023-07-09T21:50:58.840 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:58.840 INFO:teuthology.orchestra.run.smithi184.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:50:58.841 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether a6:56:97:e0:ed:a7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T21:50:58.841 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::a456:97ff:fee0:eda7/64 scope link 2023-07-09T21:50:58.841 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:58.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:58.841 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:50:58.943 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-07-09T21:50:58.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:58.946 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-07-09T21:50:58.991 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-07-09T21:50:58.991 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:50:58.991 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T21:50:58.991 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T21:50:58.991 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:50:58.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:58.993 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-09T21:50:58.993 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-09T21:50:58.993 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T21:50:58.993 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T21:50:58.994 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T21:50:58.994 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-09T21:50:59.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:59.201 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-07-09T21:50:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T21:50:59.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:59.244 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-07-09T21:50:59.324 INFO:teuthology.orchestra.run.smithi184.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-09T21:50:59.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:59.325 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-09T21:50:59.326 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-09T21:50:59.326 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T21:50:59.326 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-09T21:50:59.326 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-09T21:50:59.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:59.503 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-09T21:50:59.569 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:50:59.570 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:50:59.570 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:50:59.570 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:59.570 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-07-09T21:50:59.570 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:59.570 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:50:59.570 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether a2:88:71:73:2b:61 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-09T21:50:59.571 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-09T21:50:59.571 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:59.571 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::a088:71ff:fe73:2b61/64 scope link 2023-07-09T21:50:59.571 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:59.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:59.573 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-09T21:50:59.641 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:50:59.641 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:50:59.642 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:50:59.642 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:59.642 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-07-09T21:50:59.642 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:59.642 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:50:59.642 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether a2:88:71:73:2b:61 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-09T21:50:59.643 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-09T21:50:59.643 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:59.643 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::a088:71ff:fe73:2b61/64 scope link 2023-07-09T21:50:59.643 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:50:59.644 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-09T21:50:59.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:59.645 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-09T21:50:59.645 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-09T21:50:59.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-09T21:50:59.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-09T21:50:59.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-09T21:50:59.647 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-09T21:50:59.647 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-09T21:50:59.647 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-09T21:50:59.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:50:59.893 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-09T21:50:59.893 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-09T21:50:59.894 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.1 up 2023-07-09T21:50:59.894 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.1 master ceph-brx 2023-07-09T21:50:59.894 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-09T21:51:00.071 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:51:00.071 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-09T21:51:00.114 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-09T21:51:00.114 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:51:00.114 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-09T21:51:00.195 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-09T21:51:00.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:00.196 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-09T21:51:00.336 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-09T21:51:00.337 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-09T21:51:00.337 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-09T21:51:00.355 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-09T21:51:00.355 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-09T21:51:00.355 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-09T21:51:00.355 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:51:00.355 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:51:00.377 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-09T21:51:00.377 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-09T21:51:00.378 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-09T21:51:00.378 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:51:00.378 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:51:00.378 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-07-09T21:51:00.378 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-07-09T21:51:00.378 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=25d21351-dc09-4310-b56b-79a331e4aa31" will pass to kernel 2023-07-09T21:51:00.383 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T21:51:00.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:00.383 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-09T21:51:00.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:00.451 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:51:00.533 INFO:teuthology.orchestra.run.smithi184.stdout:client4698 2023-07-09T21:51:00.533 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:51:00.534 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:00.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:00.577 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:51:00.700 INFO:teuthology.orchestra.run.smithi184.stdout:client4698 2023-07-09T21:51:00.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:00.701 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:51:00.784 INFO:teuthology.orchestra.run.smithi184.stdout:client4698 2023-07-09T21:51:00.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:00.785 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/25d21351-dc09-4310-b56b-79a331e4aa31.client4698/status') 2023-07-09T21:51:00.891 INFO:teuthology.orchestra.run.smithi184.stdout:instance: client.4698 (3)172.21.15.184:0/3722802147 2023-07-09T21:51:00.892 INFO:teuthology.orchestra.run.smithi184.stdout:blocklisted: false 2023-07-09T21:51:00.892 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records in 2023-07-09T21:51:00.892 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records out 2023-07-09T21:51:00.892 INFO:teuthology.orchestra.run.smithi184.stderr:71 bytes copied, 5.0387e-05 s, 1.4 MB/s 2023-07-09T21:51:00.894 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-09T21:51:00.920 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:01.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.132+0000 7fbede9ff700 1 Processor -- start 2023-07-09T21:51:01.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.132+0000 7fbede9ff700 1 -- start start 2023-07-09T21:51:01.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.134+0000 7fbede9ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbed80b2350 0x7fbed80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:01.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.134+0000 7fbede9ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed80d2ce0 con 0x7fbed80d1220 2023-07-09T21:51:01.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.134+0000 7fbede9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed80b3350 con 0x7fbed80b1e00 2023-07-09T21:51:01.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.134+0000 7fbede9ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed80b3630 con 0x7fbed80b2350 2023-07-09T21:51:01.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.134+0000 7fbed77fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbed80d1220 0x7fbed80afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54524/0 (socket says 172.21.15.53:54524) 2023-07-09T21:51:01.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.134+0000 7fbed77fe700 1 -- 172.21.15.53:0/1262509758 learned_addr learned my addr 172.21.15.53:0/1262509758 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:01.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.134+0000 7fbedcf9c700 1 --2- 172.21.15.53:0/1262509758 >> v2:172.21.15.53:3300/0 conn(0x7fbed80b2350 0x7fbed80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:01.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.134+0000 7fbed6ffd700 1 -- 172.21.15.53:0/1262509758 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096804060 0 0) 0x7fbed80d2ce0 con 0x7fbed80d1220 2023-07-09T21:51:01.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.134+0000 7fbed6ffd700 1 -- 172.21.15.53:0/1262509758 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec00035b0 con 0x7fbed80d1220 2023-07-09T21:51:01.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.134+0000 7fbed6ffd700 1 -- 172.21.15.53:0/1262509758 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768479638 0 0) 0x7fbed80b3350 con 0x7fbed80b1e00 2023-07-09T21:51:01.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.134+0000 7fbedcf9c700 1 -- 172.21.15.53:0/1262509758 >> v1:172.21.15.184:6789/0 conn(0x7fbed80b1e00 legacy=0x7fbed80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:01.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.134+0000 7fbedcf9c700 1 -- 172.21.15.53:0/1262509758 >> v1:172.21.15.53:6789/0 conn(0x7fbed80d1220 legacy=0x7fbed80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:01.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.134+0000 7fbedcf9c700 1 -- 172.21.15.53:0/1262509758 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed80b3910 con 0x7fbed80b2350 2023-07-09T21:51:01.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.135+0000 7fbedcf9c700 1 --2- 172.21.15.53:0/1262509758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed80b2350 0x7fbed80b43f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009d90 tx=0x7fbed000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d1bbd8ffc3c69e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:01.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.135+0000 7fbed6ffd700 1 -- 172.21.15.53:0/1262509758 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed000e070 con 0x7fbed80b2350 2023-07-09T21:51:01.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.135+0000 7fbed6ffd700 1 -- 172.21.15.53:0/1262509758 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed000bb20 con 0x7fbed80b2350 2023-07-09T21:51:01.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.135+0000 7fbed6ffd700 1 -- 172.21.15.53:0/1262509758 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed000bed0 con 0x7fbed80b2350 2023-07-09T21:51:01.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.135+0000 7fbede9ff700 1 -- 172.21.15.53:0/1262509758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed80b2350 msgr2=0x7fbed80b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:01.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.135+0000 7fbede9ff700 1 --2- 172.21.15.53:0/1262509758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed80b2350 0x7fbed80b43f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009d90 tx=0x7fbed000b330 comp rx=0 tx=0).stop 2023-07-09T21:51:01.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.136+0000 7fbede9ff700 1 -- 172.21.15.53:0/1262509758 shutdown_connections 2023-07-09T21:51:01.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.136+0000 7fbede9ff700 1 --2- 172.21.15.53:0/1262509758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed80b2350 0x7fbed80b43f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.136+0000 7fbede9ff700 1 -- 172.21.15.53:0/1262509758 >> 172.21.15.53:0/1262509758 conn(0x7fbed809c1d0 msgr2=0x7fbed80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:01.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.136+0000 7fbede9ff700 1 -- 172.21.15.53:0/1262509758 shutdown_connections 2023-07-09T21:51:01.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.136+0000 7fbede9ff700 1 -- 172.21.15.53:0/1262509758 wait complete. 2023-07-09T21:51:01.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.137+0000 7fbede9ff700 1 Processor -- start 2023-07-09T21:51:01.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.138+0000 7fbede9ff700 1 -- start start 2023-07-09T21:51:01.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.138+0000 7fbede9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbed80b1e00 0x7fbed81f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:01.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbede9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed80b2350 0x7fbed80b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:01.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbede9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbed80d1220 0x7fbed80b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:01.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbede9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80cd960 con 0x7fbed80b2350 2023-07-09T21:51:01.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbede9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed81f67a0 con 0x7fbed80d1220 2023-07-09T21:51:01.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbede9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed81f61e0 con 0x7fbed80b1e00 2023-07-09T21:51:01.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbed77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed80b2350 0x7fbed80b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:01.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbed77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed80b2350 0x7fbed80b6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57972/0 (socket says 172.21.15.53:57972) 2023-07-09T21:51:01.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbed77fe700 1 -- 172.21.15.53:0/2113247923 learned_addr learned my addr 172.21.15.53:0/2113247923 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:01.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbed7fff700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbed80b1e00 0x7fbed81f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:01.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbedcf9c700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbed80d1220 0x7fbed80b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:01.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbed77fe700 1 -- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbed80b1e00 msgr2=0x7fbed81f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:01.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbed77fe700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbed80b1e00 0x7fbed81f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbed77fe700 1 -- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbed80d1220 msgr2=0x7fbed80b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:01.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbed77fe700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbed80d1220 0x7fbed80b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.139+0000 7fbed77fe700 1 -- 172.21.15.53:0/2113247923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed0009a70 con 0x7fbed80b2350 2023-07-09T21:51:01.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.140+0000 7fbed77fe700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed80b2350 0x7fbed80b6470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00c400 tx=0x7fbecc00c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:01.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.140+0000 7fbed4ff9700 1 -- 172.21.15.53:0/2113247923 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc005d70 con 0x7fbed80b2350 2023-07-09T21:51:01.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.140+0000 7fbed4ff9700 1 -- 172.21.15.53:0/2113247923 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc00ce10 con 0x7fbed80b2350 2023-07-09T21:51:01.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.140+0000 7fbede9ff700 1 -- 172.21.15.53:0/2113247923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed81f64c0 con 0x7fbed80b2350 2023-07-09T21:51:01.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.140+0000 7fbed4ff9700 1 -- 172.21.15.53:0/2113247923 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc007310 con 0x7fbed80b2350 2023-07-09T21:51:01.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.140+0000 7fbede9ff700 1 -- 172.21.15.53:0/2113247923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed81f5e10 con 0x7fbed80b2350 2023-07-09T21:51:01.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.141+0000 7fbede9ff700 1 -- 172.21.15.53:0/2113247923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed81f5fa0 con 0x7fbed80b2350 2023-07-09T21:51:01.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.142+0000 7fbed4ff9700 1 -- 172.21.15.53:0/2113247923 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbecc007470 con 0x7fbed80b2350 2023-07-09T21:51:01.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.143+0000 7fbed4ff9700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbec406ace0 0x7fbec406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:01.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.143+0000 7fbed4ff9700 1 -- 172.21.15.53:0/2113247923 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbecc088820 con 0x7fbed80b2350 2023-07-09T21:51:01.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.144+0000 7fbed7fff700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbec406ace0 0x7fbec406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:01.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.144+0000 7fbed7fff700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbec406ace0 0x7fbec406d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbec8007fd0 tx=0x7fbec8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:01.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.148+0000 7fbed4ff9700 1 -- 172.21.15.53:0/2113247923 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbed81f5fa0 con 0x7fbed80b2350 2023-07-09T21:51:01.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.357+0000 7fbede9ff700 1 -- 172.21.15.53:0/2113247923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbed81f5fa0 con 0x7fbed80b2350 2023-07-09T21:51:01.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.359+0000 7fbed4ff9700 1 -- 172.21.15.53:0/2113247923 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fbed81f5fa0 con 0x7fbed80b2350 2023-07-09T21:51:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:01.361 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:24.766288+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:01.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.361+0000 7fbede9ff700 1 -- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbec406ace0 msgr2=0x7fbec406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:01.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.361+0000 7fbede9ff700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbec406ace0 0x7fbec406d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbec8007fd0 tx=0x7fbec8009040 comp rx=0 tx=0).stop 2023-07-09T21:51:01.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.361+0000 7fbede9ff700 1 -- 172.21.15.53:0/2113247923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed80b2350 msgr2=0x7fbed80b6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:01.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.361+0000 7fbede9ff700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed80b2350 0x7fbed80b6470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00c400 tx=0x7fbecc00c710 comp rx=0 tx=0).stop 2023-07-09T21:51:01.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.361+0000 7fbede9ff700 1 -- 172.21.15.53:0/2113247923 shutdown_connections 2023-07-09T21:51:01.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.361+0000 7fbede9ff700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbec406ace0 0x7fbec406d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.361+0000 7fbede9ff700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbed80d1220 0x7fbed80b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.361+0000 7fbede9ff700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbed80b1e00 0x7fbed81f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.361+0000 7fbede9ff700 1 --2- 172.21.15.53:0/2113247923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed80b2350 0x7fbed80b6470 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.361+0000 7fbede9ff700 1 -- 172.21.15.53:0/2113247923 >> 172.21.15.53:0/2113247923 conn(0x7fbed809c1d0 msgr2=0x7fbed80afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:01.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.361+0000 7fbede9ff700 1 -- 172.21.15.53:0/2113247923 shutdown_connections 2023-07-09T21:51:01.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.361+0000 7fbede9ff700 1 -- 172.21.15.53:0/2113247923 wait complete. 2023-07-09T21:51:01.381 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:50:21.703759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:50:22.243698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:51:01.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:51:01.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.584+0000 7fb9fd5ff700 1 Processor -- start 2023-07-09T21:51:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.584+0000 7fb9fd5ff700 1 -- start start 2023-07-09T21:51:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9fd5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb9f80b3ff0 0x7fb9f80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9fd5ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb9f80d0b10 0x7fb9f80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9fd5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9f80b25d0 0x7fb9f80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9fd5ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f80d14d0 con 0x7fb9f80d0b10 2023-07-09T21:51:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9fd5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f80b8e80 con 0x7fb9f80b3ff0 2023-07-09T21:51:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9fd5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80afaa0 con 0x7fb9f80b25d0 2023-07-09T21:51:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9f67fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb9f80d0b10 0x7fb9f80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9f67fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb9f80d0b10 0x7fb9f80d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57988/0 (socket says 172.21.15.53:57988) 2023-07-09T21:51:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9f67fc700 1 -- 172.21.15.53:0/1071338766 learned_addr learned my addr 172.21.15.53:0/1071338766 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:01.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9f6ffd700 1 --2- 172.21.15.53:0/1071338766 >> v2:172.21.15.184:3300/0 conn(0x7fb9f80b3ff0 0x7fb9f80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:01.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9f77fe700 1 --2- 172.21.15.53:0/1071338766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9f80b25d0 0x7fb9f80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:01.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9f67fc700 1 -- 172.21.15.53:0/1071338766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9f80b25d0 msgr2=0x7fb9f80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:01.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9f67fc700 1 --2- 172.21.15.53:0/1071338766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9f80b25d0 0x7fb9f80b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9f67fc700 1 -- 172.21.15.53:0/1071338766 >> v2:172.21.15.184:3300/0 conn(0x7fb9f80b3ff0 msgr2=0x7fb9f80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:01.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9f67fc700 1 --2- 172.21.15.53:0/1071338766 >> v2:172.21.15.184:3300/0 conn(0x7fb9f80b3ff0 0x7fb9f80b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9f67fc700 1 -- 172.21.15.53:0/1071338766 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f80afd80 con 0x7fb9f80d0b10 2023-07-09T21:51:01.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9f6ffd700 1 --2- 172.21.15.53:0/1071338766 >> v2:172.21.15.184:3300/0 conn(0x7fb9f80b3ff0 0x7fb9f80b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:01.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.586+0000 7fb9f77fe700 1 --2- 172.21.15.53:0/1071338766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9f80b25d0 0x7fb9f80b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:01.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.587+0000 7fb9f67fc700 1 --2- 172.21.15.53:0/1071338766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f80d0b10 0x7fb9f80d0f90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80b5b00 tx=0x7fb9ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df74aa114ac4584 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:01.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.587+0000 7fb9f5ffb700 1 -- 172.21.15.53:0/1071338766 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00b870 con 0x7fb9f80d0b10 2023-07-09T21:51:01.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.587+0000 7fb9f5ffb700 1 -- 172.21.15.53:0/1071338766 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec00b9d0 con 0x7fb9f80d0b10 2023-07-09T21:51:01.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.587+0000 7fb9f5ffb700 1 -- 172.21.15.53:0/1071338766 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00bd60 con 0x7fb9f80d0b10 2023-07-09T21:51:01.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.587+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/1071338766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f80d0b10 msgr2=0x7fb9f80d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:01.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.587+0000 7fb9fd5ff700 1 --2- 172.21.15.53:0/1071338766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f80d0b10 0x7fb9f80d0f90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80b5b00 tx=0x7fb9ec009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.588+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/1071338766 shutdown_connections 2023-07-09T21:51:01.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.588+0000 7fb9fd5ff700 1 --2- 172.21.15.53:0/1071338766 >> v2:172.21.15.184:3300/0 conn(0x7fb9f80b3ff0 0x7fb9f80b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.588+0000 7fb9fd5ff700 1 --2- 172.21.15.53:0/1071338766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9f80b25d0 0x7fb9f80b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.588+0000 7fb9fd5ff700 1 --2- 172.21.15.53:0/1071338766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f80d0b10 0x7fb9f80d0f90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.588+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/1071338766 >> 172.21.15.53:0/1071338766 conn(0x7fb9f809c1b0 msgr2=0x7fb9f80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:01.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.588+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/1071338766 shutdown_connections 2023-07-09T21:51:01.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.588+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/1071338766 wait complete. 2023-07-09T21:51:01.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.589+0000 7fb9fd5ff700 1 Processor -- start 2023-07-09T21:51:01.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.590+0000 7fb9fd5ff700 1 -- start start 2023-07-09T21:51:01.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9fd5ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f80b25d0 0x7fb9f80cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:01.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9fd5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9f80b3ff0 0x7fb9f80b7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:01.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9fd5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9f80d0b10 0x7fb9f81f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:01.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9fd5ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80b7d40 con 0x7fb9f80b25d0 2023-07-09T21:51:01.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9fd5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f81f1a70 con 0x7fb9f80b3ff0 2023-07-09T21:51:01.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9fd5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f81f2b30 con 0x7fb9f80d0b10 2023-07-09T21:51:01.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9f6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f80b25d0 0x7fb9f80cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:01.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9f6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f80b25d0 0x7fb9f80cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58002/0 (socket says 172.21.15.53:58002) 2023-07-09T21:51:01.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9f6ffd700 1 -- 172.21.15.53:0/4096123388 learned_addr learned my addr 172.21.15.53:0/4096123388 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:01.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9f67fc700 1 --2- 172.21.15.53:0/4096123388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9f80b3ff0 0x7fb9f80b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:01.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9f6ffd700 1 -- 172.21.15.53:0/4096123388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9f80d0b10 msgr2=0x7fb9f81f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:01.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9f6ffd700 1 --2- 172.21.15.53:0/4096123388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9f80d0b10 0x7fb9f81f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9f6ffd700 1 -- 172.21.15.53:0/4096123388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9f80b3ff0 msgr2=0x7fb9f80b7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:01.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9f6ffd700 1 --2- 172.21.15.53:0/4096123388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9f80b3ff0 0x7fb9f80b7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9f6ffd700 1 -- 172.21.15.53:0/4096123388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec009550 con 0x7fb9f80b25d0 2023-07-09T21:51:01.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.591+0000 7fb9f6ffd700 1 --2- 172.21.15.53:0/4096123388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f80b25d0 0x7fb9f80cba90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800c750 tx=0x7fb9e800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:01.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.592+0000 7fb9df7fe700 1 -- 172.21.15.53:0/4096123388 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8011800 con 0x7fb9f80b25d0 2023-07-09T21:51:01.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.592+0000 7fb9df7fe700 1 -- 172.21.15.53:0/4096123388 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e8011960 con 0x7fb9f80b25d0 2023-07-09T21:51:01.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.592+0000 7fb9df7fe700 1 -- 172.21.15.53:0/4096123388 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8011cd0 con 0x7fb9f80b25d0 2023-07-09T21:51:01.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.592+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/4096123388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f80cc170 con 0x7fb9f80b25d0 2023-07-09T21:51:01.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.592+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/4096123388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f80cc730 con 0x7fb9f80b25d0 2023-07-09T21:51:01.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.593+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/4096123388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f8074350 con 0x7fb9f80b25d0 2023-07-09T21:51:01.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.594+0000 7fb9df7fe700 1 -- 172.21.15.53:0/4096123388 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb9e8021350 con 0x7fb9f80b25d0 2023-07-09T21:51:01.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.595+0000 7fb9df7fe700 1 --2- 172.21.15.53:0/4096123388 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb9e406ace0 0x7fb9e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:01.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.595+0000 7fb9df7fe700 1 -- 172.21.15.53:0/4096123388 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9e80892e0 con 0x7fb9f80b25d0 2023-07-09T21:51:01.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.595+0000 7fb9f67fc700 1 --2- 172.21.15.53:0/4096123388 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb9e406ace0 0x7fb9e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:01.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.596+0000 7fb9f67fc700 1 --2- 172.21.15.53:0/4096123388 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb9e406ace0 0x7fb9e406d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec014040 tx=0x7fb9ec008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:01.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.599+0000 7fb9df7fe700 1 -- 172.21.15.53:0/4096123388 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb9e8057eb0 con 0x7fb9f80b25d0 2023-07-09T21:51:01.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.809+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/4096123388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9f80b5470 con 0x7fb9f80b25d0 2023-07-09T21:51:01.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.810+0000 7fb9df7fe700 1 -- 172.21.15.53:0/4096123388 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb9e8057a40 con 0x7fb9f80b25d0 2023-07-09T21:51:01.812 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:51:01.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.812+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/4096123388 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb9e406ace0 msgr2=0x7fb9e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.812+0000 7fb9fd5ff700 1 --2- 172.21.15.53:0/4096123388 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb9e406ace0 0x7fb9e406d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec014040 tx=0x7fb9ec008030 comp rx=0 tx=0).stop 2023-07-09T21:51:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.812+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/4096123388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f80b25d0 msgr2=0x7fb9f80cba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.812+0000 7fb9fd5ff700 1 --2- 172.21.15.53:0/4096123388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f80b25d0 0x7fb9f80cba90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800c750 tx=0x7fb9e800ca60 comp rx=0 tx=0).stop 2023-07-09T21:51:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.812+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/4096123388 shutdown_connections 2023-07-09T21:51:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.812+0000 7fb9fd5ff700 1 --2- 172.21.15.53:0/4096123388 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb9e406ace0 0x7fb9e406d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.812+0000 7fb9fd5ff700 1 --2- 172.21.15.53:0/4096123388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9f80d0b10 0x7fb9f81f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.812+0000 7fb9fd5ff700 1 --2- 172.21.15.53:0/4096123388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f80b25d0 0x7fb9f80cba90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.812+0000 7fb9fd5ff700 1 --2- 172.21.15.53:0/4096123388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9f80b3ff0 0x7fb9f80b7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.812+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/4096123388 >> 172.21.15.53:0/4096123388 conn(0x7fb9f809c1b0 msgr2=0x7fb9f815c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.812+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/4096123388 shutdown_connections 2023-07-09T21:51:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:01.812+0000 7fb9fd5ff700 1 -- 172.21.15.53:0/4096123388 wait complete. 2023-07-09T21:51:01.831 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:51:02.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.034+0000 7f7d451ff700 1 Processor -- start 2023-07-09T21:51:02.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.034+0000 7f7d451ff700 1 -- start start 2023-07-09T21:51:02.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.035+0000 7f7d451ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7d400b3ff0 0x7f7d400b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.035+0000 7f7d451ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400d0f90 0x7f7d400b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.035+0000 7f7d451ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d400b8e80 con 0x7f7d400d0b10 2023-07-09T21:51:02.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.035+0000 7f7d451ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d400b1e30 con 0x7f7d400b3ff0 2023-07-09T21:51:02.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.035+0000 7f7d451ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400d1410 con 0x7f7d400d0f90 2023-07-09T21:51:02.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.036+0000 7f7d3ed9d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7d400b3ff0 0x7f7d400b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.036+0000 7f7d3f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400d0f90 0x7f7d400b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.036+0000 7f7d3e59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f7d400d0b10 0x7f7d400b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:51614/0 (socket says 172.21.15.53:51614) 2023-07-09T21:51:02.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.036+0000 7f7d3ed9d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7d400b3ff0 0x7f7d400b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:33828/0 (socket says 172.21.15.53:33828) 2023-07-09T21:51:02.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.036+0000 7f7d3ed9d700 1 -- 172.21.15.53:0/4165551734 learned_addr learned my addr 172.21.15.53:0/4165551734 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:02.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.036+0000 7f7d3ed9d700 1 -- 172.21.15.53:0/4165551734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400d0f90 msgr2=0x7f7d400b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:02.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.036+0000 7f7d3ed9d700 1 --2- 172.21.15.53:0/4165551734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400d0f90 0x7f7d400b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.036+0000 7f7d3ed9d700 1 -- 172.21.15.53:0/4165551734 >> v1:172.21.15.184:6789/0 conn(0x7f7d400d0b10 legacy=0x7f7d400b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.036+0000 7f7d3ed9d700 1 -- 172.21.15.53:0/4165551734 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400afaa0 con 0x7f7d400b3ff0 2023-07-09T21:51:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.036+0000 7f7d3dd9b700 1 -- 172.21.15.53:0/4165551734 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901794592 0 0) 0x7f7d34001110 con 0x7f7d400d0b10 2023-07-09T21:51:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.036+0000 7f7d3f59e700 1 --2- 172.21.15.53:0/4165551734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400d0f90 0x7f7d400b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.036+0000 7f7d3ed9d700 1 --2- 172.21.15.53:0/4165551734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400b3ff0 0x7f7d400b43c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7d300098f0 tx=0x7f7d30009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1375346499e8cf9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.037+0000 7f7d3dd9b700 1 -- 172.21.15.53:0/4165551734 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30011830 con 0x7f7d400b3ff0 2023-07-09T21:51:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.037+0000 7f7d3dd9b700 1 -- 172.21.15.53:0/4165551734 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d30011990 con 0x7f7d400b3ff0 2023-07-09T21:51:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.037+0000 7f7d3dd9b700 1 -- 172.21.15.53:0/4165551734 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30011d20 con 0x7f7d400b3ff0 2023-07-09T21:51:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.037+0000 7f7d451ff700 1 -- 172.21.15.53:0/4165551734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400b3ff0 msgr2=0x7f7d400b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.037+0000 7f7d451ff700 1 --2- 172.21.15.53:0/4165551734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400b3ff0 0x7f7d400b43c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7d300098f0 tx=0x7f7d30009c00 comp rx=0 tx=0).stop 2023-07-09T21:51:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.037+0000 7f7d451ff700 1 -- 172.21.15.53:0/4165551734 shutdown_connections 2023-07-09T21:51:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.037+0000 7f7d451ff700 1 --2- 172.21.15.53:0/4165551734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400d0f90 0x7f7d400b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.037+0000 7f7d451ff700 1 --2- 172.21.15.53:0/4165551734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400b3ff0 0x7f7d400b43c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.037+0000 7f7d451ff700 1 -- 172.21.15.53:0/4165551734 >> 172.21.15.53:0/4165551734 conn(0x7f7d4009c1b0 msgr2=0x7f7d400d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.037+0000 7f7d451ff700 1 -- 172.21.15.53:0/4165551734 shutdown_connections 2023-07-09T21:51:02.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.037+0000 7f7d451ff700 1 -- 172.21.15.53:0/4165551734 wait complete. 2023-07-09T21:51:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.039+0000 7f7d451ff700 1 Processor -- start 2023-07-09T21:51:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.039+0000 7f7d451ff700 1 -- start start 2023-07-09T21:51:02.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.040+0000 7f7d451ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d400b3ff0 0x7f7d400cf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.040+0000 7f7d451ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400d0b10 0x7f7d4015f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.040+0000 7f7d451ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400d0f90 0x7f7d4015f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.040+0000 7f7d451ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400ce790 con 0x7f7d400b3ff0 2023-07-09T21:51:02.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.040+0000 7f7d451ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400cfdb0 con 0x7f7d400d0b10 2023-07-09T21:51:02.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.040+0000 7f7d451ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400cdb10 con 0x7f7d400d0f90 2023-07-09T21:51:02.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.041+0000 7f7d3ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d400b3ff0 0x7f7d400cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.041+0000 7f7d3ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d400b3ff0 0x7f7d400cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58004/0 (socket says 172.21.15.53:58004) 2023-07-09T21:51:02.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.041+0000 7f7d3ed9d700 1 -- 172.21.15.53:0/2354448190 learned_addr learned my addr 172.21.15.53:0/2354448190 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:02.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.041+0000 7f7d3e59c700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400d0b10 0x7f7d4015f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.041+0000 7f7d3f59e700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400d0f90 0x7f7d4015f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.041+0000 7f7d3ed9d700 1 -- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400d0f90 msgr2=0x7f7d4015f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.041+0000 7f7d3ed9d700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400d0f90 0x7f7d4015f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.041+0000 7f7d3ed9d700 1 -- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400d0b10 msgr2=0x7f7d4015f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.041+0000 7f7d3ed9d700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400d0b10 0x7f7d4015f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.041+0000 7f7d3ed9d700 1 -- 172.21.15.53:0/2354448190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38009a70 con 0x7f7d400b3ff0 2023-07-09T21:51:02.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.041+0000 7f7d3ed9d700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d400b3ff0 0x7f7d400cf870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009c40 tx=0x7f7d30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:02.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.042+0000 7f7d277fe700 1 -- 172.21.15.53:0/2354448190 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30004340 con 0x7f7d400b3ff0 2023-07-09T21:51:02.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.042+0000 7f7d277fe700 1 -- 172.21.15.53:0/2354448190 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3001f070 con 0x7f7d400b3ff0 2023-07-09T21:51:02.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.042+0000 7f7d277fe700 1 -- 172.21.15.53:0/2354448190 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300036a0 con 0x7f7d400b3ff0 2023-07-09T21:51:02.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.042+0000 7f7d451ff700 1 -- 172.21.15.53:0/2354448190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d30009550 con 0x7f7d400b3ff0 2023-07-09T21:51:02.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.042+0000 7f7d451ff700 1 -- 172.21.15.53:0/2354448190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d400ce0d0 con 0x7f7d400b3ff0 2023-07-09T21:51:02.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.043+0000 7f7d451ff700 1 -- 172.21.15.53:0/2354448190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d40074350 con 0x7f7d400b3ff0 2023-07-09T21:51:02.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.044+0000 7f7d277fe700 1 -- 172.21.15.53:0/2354448190 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7d30021030 con 0x7f7d400b3ff0 2023-07-09T21:51:02.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.045+0000 7f7d277fe700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7d2c06ace0 0x7f7d2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.045+0000 7f7d277fe700 1 -- 172.21.15.53:0/2354448190 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d3008a850 con 0x7f7d400b3ff0 2023-07-09T21:51:02.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.045+0000 7f7d3e59c700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7d2c06ace0 0x7f7d2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.046+0000 7f7d3e59c700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7d2c06ace0 0x7f7d2c06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7d40152ac0 tx=0x7f7d34007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:02.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.049+0000 7f7d277fe700 1 -- 172.21.15.53:0/2354448190 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7d30055a10 con 0x7f7d400b3ff0 2023-07-09T21:51:02.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.254+0000 7f7d451ff700 1 -- 172.21.15.53:0/2354448190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7d40073380 con 0x7f7d400b3ff0 2023-07-09T21:51:02.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.254+0000 7f7d277fe700 1 -- 172.21.15.53:0/2354448190 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7d30059030 con 0x7f7d400b3ff0 2023-07-09T21:51:02.256 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:51:02.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.256+0000 7f7d451ff700 1 -- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7d2c06ace0 msgr2=0x7f7d2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.256+0000 7f7d451ff700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7d2c06ace0 0x7f7d2c06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7d40152ac0 tx=0x7f7d34007c20 comp rx=0 tx=0).stop 2023-07-09T21:51:02.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.256+0000 7f7d451ff700 1 -- 172.21.15.53:0/2354448190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d400b3ff0 msgr2=0x7f7d400cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.256+0000 7f7d451ff700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d400b3ff0 0x7f7d400cf870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009c40 tx=0x7f7d30004750 comp rx=0 tx=0).stop 2023-07-09T21:51:02.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.256+0000 7f7d451ff700 1 -- 172.21.15.53:0/2354448190 shutdown_connections 2023-07-09T21:51:02.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.256+0000 7f7d451ff700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7d2c06ace0 0x7f7d2c06d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.256+0000 7f7d451ff700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400d0f90 0x7f7d4015f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.256+0000 7f7d451ff700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d400b3ff0 0x7f7d400cf870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.256+0000 7f7d451ff700 1 --2- 172.21.15.53:0/2354448190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400d0b10 0x7f7d4015f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.256+0000 7f7d451ff700 1 -- 172.21.15.53:0/2354448190 >> 172.21.15.53:0/2354448190 conn(0x7f7d4009c1b0 msgr2=0x7f7d4006b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:02.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.257+0000 7f7d451ff700 1 -- 172.21.15.53:0/2354448190 shutdown_connections 2023-07-09T21:51:02.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.257+0000 7f7d451ff700 1 -- 172.21.15.53:0/2354448190 wait complete. 2023-07-09T21:51:02.276 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:51:02.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.478+0000 7f107afff700 1 Processor -- start 2023-07-09T21:51:02.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.478+0000 7f107afff700 1 -- start start 2023-07-09T21:51:02.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.480+0000 7f107afff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f107406c9f0 0x7f107406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.480+0000 7f107afff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f10740b1910 0x7f1074071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.480+0000 7f107afff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107415ddf0 con 0x7f10740b1d80 2023-07-09T21:51:02.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.480+0000 7f107afff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107406c4e0 con 0x7f10740b1910 2023-07-09T21:51:02.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.480+0000 7f107afff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107406bf20 con 0x7f107406c9f0 2023-07-09T21:51:02.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.480+0000 7f1073fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f10740b1910 0x7f1074071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.480+0000 7f1073fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f10740b1910 0x7f1074071170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58018/0 (socket says 172.21.15.53:58018) 2023-07-09T21:51:02.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.480+0000 7f1073fff700 1 -- 172.21.15.53:0/1942654337 learned_addr learned my addr 172.21.15.53:0/1942654337 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:02.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.480+0000 7f1078d9b700 1 --2- 172.21.15.53:0/1942654337 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f107406c9f0 0x7f107406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.480+0000 7f1073fff700 1 -- 172.21.15.53:0/1942654337 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f107406c9f0 msgr2=0x7f107406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.480+0000 7f1073fff700 1 --2- 172.21.15.53:0/1942654337 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f107406c9f0 0x7f107406b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.480+0000 7f1073fff700 1 -- 172.21.15.53:0/1942654337 >> v1:172.21.15.184:6789/0 conn(0x7f10740b1d80 legacy=0x7f10740cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.480+0000 7f1073fff700 1 -- 172.21.15.53:0/1942654337 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107406c200 con 0x7f10740b1910 2023-07-09T21:51:02.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.481+0000 7f1073fff700 1 --2- 172.21.15.53:0/1942654337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10740b1910 0x7f1074071170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f10600098f0 tx=0x7f1060009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f148143a21335065 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:02.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.481+0000 7f10737fe700 1 -- 172.21.15.53:0/1942654337 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060011830 con 0x7f10740b1910 2023-07-09T21:51:02.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.481+0000 7f10737fe700 1 -- 172.21.15.53:0/1942654337 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1060011990 con 0x7f10740b1910 2023-07-09T21:51:02.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.481+0000 7f10737fe700 1 -- 172.21.15.53:0/1942654337 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060011d20 con 0x7f10740b1910 2023-07-09T21:51:02.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.482+0000 7f107afff700 1 -- 172.21.15.53:0/1942654337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10740b1910 msgr2=0x7f1074071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.482+0000 7f107afff700 1 --2- 172.21.15.53:0/1942654337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10740b1910 0x7f1074071170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f10600098f0 tx=0x7f1060009c00 comp rx=0 tx=0).stop 2023-07-09T21:51:02.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.482+0000 7f107afff700 1 -- 172.21.15.53:0/1942654337 shutdown_connections 2023-07-09T21:51:02.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.482+0000 7f107afff700 1 --2- 172.21.15.53:0/1942654337 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f107406c9f0 0x7f107406b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.482+0000 7f107afff700 1 --2- 172.21.15.53:0/1942654337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10740b1910 0x7f1074071170 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.482+0000 7f107afff700 1 -- 172.21.15.53:0/1942654337 >> 172.21.15.53:0/1942654337 conn(0x7f10740b05d0 msgr2=0x7f10740b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:02.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.482+0000 7f107afff700 1 -- 172.21.15.53:0/1942654337 shutdown_connections 2023-07-09T21:51:02.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.482+0000 7f107afff700 1 -- 172.21.15.53:0/1942654337 wait complete. 2023-07-09T21:51:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.484+0000 7f107afff700 1 Processor -- start 2023-07-09T21:51:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.484+0000 7f107afff700 1 -- start start 2023-07-09T21:51:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f107afff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f107406c9f0 0x7f10740c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f107afff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10740b1910 0x7f10741f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f107afff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10740b1d80 0x7f1074159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f107afff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10740c74f0 con 0x7f107406c9f0 2023-07-09T21:51:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f107afff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10741f0fb0 con 0x7f10740b1d80 2023-07-09T21:51:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f107afff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10740c68e0 con 0x7f10740b1910 2023-07-09T21:51:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f1078d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f107406c9f0 0x7f10740c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f1078d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f107406c9f0 0x7f10740c7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58032/0 (socket says 172.21.15.53:58032) 2023-07-09T21:51:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f1078d9b700 1 -- 172.21.15.53:0/3674887867 learned_addr learned my addr 172.21.15.53:0/3674887867 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f107959c700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10740b1d80 0x7f1074159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f1073fff700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10740b1910 0x7f10741f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f1078d9b700 1 -- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10740b1910 msgr2=0x7f10741f0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f1078d9b700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10740b1910 0x7f10741f0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f1078d9b700 1 -- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10740b1d80 msgr2=0x7f1074159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f1078d9b700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10740b1d80 0x7f1074159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.485+0000 7f1078d9b700 1 -- 172.21.15.53:0/3674887867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060009550 con 0x7f107406c9f0 2023-07-09T21:51:02.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.486+0000 7f107959c700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10740b1d80 0x7f1074159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:02.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.486+0000 7f1073fff700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10740b1910 0x7f10741f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:02.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.486+0000 7f1078d9b700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f107406c9f0 0x7f10740c7980 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f106800e9e0 tx=0x7f106800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:02.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.486+0000 7f10717fa700 1 -- 172.21.15.53:0/3674887867 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068009710 con 0x7f107406c9f0 2023-07-09T21:51:02.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.486+0000 7f10717fa700 1 -- 172.21.15.53:0/3674887867 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106800c850 con 0x7f107406c9f0 2023-07-09T21:51:02.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.486+0000 7f107afff700 1 -- 172.21.15.53:0/3674887867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10740c6bc0 con 0x7f107406c9f0 2023-07-09T21:51:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.486+0000 7f10717fa700 1 -- 172.21.15.53:0/3674887867 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106800cbc0 con 0x7f107406c9f0 2023-07-09T21:51:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.486+0000 7f107afff700 1 -- 172.21.15.53:0/3674887867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10740c7180 con 0x7f107406c9f0 2023-07-09T21:51:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.487+0000 7f107afff700 1 -- 172.21.15.53:0/3674887867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1074074350 con 0x7f107406c9f0 2023-07-09T21:51:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.488+0000 7f10717fa700 1 -- 172.21.15.53:0/3674887867 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f106800cd20 con 0x7f107406c9f0 2023-07-09T21:51:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.490+0000 7f10717fa700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f105806ace0 0x7f105806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.490+0000 7f10717fa700 1 -- 172.21.15.53:0/3674887867 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1068089670 con 0x7f107406c9f0 2023-07-09T21:51:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.491+0000 7f1073fff700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f105806ace0 0x7f105806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.491+0000 7f1073fff700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f105806ace0 0x7f105806d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f10740ca610 tx=0x7f1060008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:02.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.494+0000 7f10717fa700 1 -- 172.21.15.53:0/3674887867 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1068058110 con 0x7f107406c9f0 2023-07-09T21:51:02.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.704+0000 7f107afff700 1 -- 172.21.15.53:0/3674887867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f107406fb10 con 0x7f107406c9f0 2023-07-09T21:51:02.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.704+0000 7f10717fa700 1 -- 172.21.15.53:0/3674887867 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1068057ca0 con 0x7f107406c9f0 2023-07-09T21:51:02.706 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:51:02.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.707+0000 7f107afff700 1 -- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f105806ace0 msgr2=0x7f105806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.707+0000 7f107afff700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f105806ace0 0x7f105806d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f10740ca610 tx=0x7f1060008030 comp rx=0 tx=0).stop 2023-07-09T21:51:02.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.707+0000 7f107afff700 1 -- 172.21.15.53:0/3674887867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f107406c9f0 msgr2=0x7f10740c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.707+0000 7f107afff700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f107406c9f0 0x7f10740c7980 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f106800e9e0 tx=0x7f106800eda0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.707+0000 7f107afff700 1 -- 172.21.15.53:0/3674887867 shutdown_connections 2023-07-09T21:51:02.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.707+0000 7f107afff700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f105806ace0 0x7f105806d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.707+0000 7f107afff700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10740b1d80 0x7f1074159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.707+0000 7f107afff700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f107406c9f0 0x7f10740c7980 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.707+0000 7f107afff700 1 --2- 172.21.15.53:0/3674887867 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10740b1910 0x7f10741f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.707+0000 7f107afff700 1 -- 172.21.15.53:0/3674887867 >> 172.21.15.53:0/3674887867 conn(0x7f10740b05d0 msgr2=0x7f10740b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:02.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.707+0000 7f107afff700 1 -- 172.21.15.53:0/3674887867 shutdown_connections 2023-07-09T21:51:02.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.707+0000 7f107afff700 1 -- 172.21.15.53:0/3674887867 wait complete. 2023-07-09T21:51:02.726 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:51:02.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.931+0000 7f51c81ff700 1 Processor -- start 2023-07-09T21:51:02.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.931+0000 7f51c81ff700 1 -- start start 2023-07-09T21:51:02.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.932+0000 7f51c81ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51c00b43c0 0x7f51c00b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.932+0000 7f51c81ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c00b8e80 con 0x7f51c00b3ff0 2023-07-09T21:51:02.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.932+0000 7f51c81ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c00afaa0 con 0x7f51c00d1220 2023-07-09T21:51:02.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.932+0000 7f51c81ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c00afd80 con 0x7f51c00b43c0 2023-07-09T21:51:02.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.933+0000 7f51c679c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51c00b43c0 0x7f51c00b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.933+0000 7f51c5f9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f51c00b3ff0 0x7f51c00d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45960/0 (socket says 172.21.15.53:45960) 2023-07-09T21:51:02.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.933+0000 7f51c5f9b700 1 -- 172.21.15.53:0/759200151 learned_addr learned my addr 172.21.15.53:0/759200151 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:02.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.933+0000 7f51c679c700 1 -- 172.21.15.53:0/759200151 >> v1:172.21.15.184:6789/0 conn(0x7f51c00d1220 legacy=0x7f51c00b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.933+0000 7f51c679c700 1 -- 172.21.15.53:0/759200151 >> v1:172.21.15.53:6789/0 conn(0x7f51c00b3ff0 legacy=0x7f51c00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.933+0000 7f51c679c700 1 -- 172.21.15.53:0/759200151 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c00b0060 con 0x7f51c00b43c0 2023-07-09T21:51:02.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.933+0000 7f51c4f99700 1 -- 172.21.15.53:0/759200151 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050811439 0 0) 0x7f51bc001110 con 0x7f51c00b3ff0 2023-07-09T21:51:02.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.933+0000 7f51c679c700 1 --2- 172.21.15.53:0/759200151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c00b43c0 0x7f51c00b1530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009d90 tx=0x7f51b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37626020d9a168a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:02.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.934+0000 7f51c4f99700 1 -- 172.21.15.53:0/759200151 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b800e070 con 0x7f51c00b43c0 2023-07-09T21:51:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.934+0000 7f51c4f99700 1 -- 172.21.15.53:0/759200151 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b800bbd0 con 0x7f51c00b43c0 2023-07-09T21:51:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.934+0000 7f51c4f99700 1 -- 172.21.15.53:0/759200151 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8012430 con 0x7f51c00b43c0 2023-07-09T21:51:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.934+0000 7f51c81ff700 1 -- 172.21.15.53:0/759200151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c00b43c0 msgr2=0x7f51c00b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.934+0000 7f51c81ff700 1 --2- 172.21.15.53:0/759200151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c00b43c0 0x7f51c00b1530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009d90 tx=0x7f51b800b330 comp rx=0 tx=0).stop 2023-07-09T21:51:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.934+0000 7f51c81ff700 1 -- 172.21.15.53:0/759200151 shutdown_connections 2023-07-09T21:51:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.934+0000 7f51c81ff700 1 --2- 172.21.15.53:0/759200151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c00b43c0 0x7f51c00b1530 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.934+0000 7f51c81ff700 1 -- 172.21.15.53:0/759200151 >> 172.21.15.53:0/759200151 conn(0x7f51c009c1b0 msgr2=0x7f51c00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.934+0000 7f51c81ff700 1 -- 172.21.15.53:0/759200151 shutdown_connections 2023-07-09T21:51:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.934+0000 7f51c81ff700 1 -- 172.21.15.53:0/759200151 wait complete. 2023-07-09T21:51:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.936+0000 7f51c81ff700 1 Processor -- start 2023-07-09T21:51:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.936+0000 7f51c81ff700 1 -- start start 2023-07-09T21:51:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.937+0000 7f51c81ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c00b3ff0 0x7f51c0156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.937+0000 7f51c81ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c00b43c0 0x7f51c00ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.937+0000 7f51c81ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c00d1220 0x7f51c015b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.937+0000 7f51c81ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00ca3f0 con 0x7f51c00b43c0 2023-07-09T21:51:02.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.937+0000 7f51c81ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00cf330 con 0x7f51c00b3ff0 2023-07-09T21:51:02.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.937+0000 7f51c81ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0156b70 con 0x7f51c00d1220 2023-07-09T21:51:02.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.937+0000 7f51c579a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c00b43c0 0x7f51c00ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.937+0000 7f51c579a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c00b43c0 0x7f51c00ca810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37208/0 (socket says 172.21.15.53:37208) 2023-07-09T21:51:02.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.937+0000 7f51c579a700 1 -- 172.21.15.53:0/275733403 learned_addr learned my addr 172.21.15.53:0/275733403 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:02.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.938+0000 7f51c5f9b700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c00b3ff0 0x7f51c0156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.938+0000 7f51c579a700 1 -- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c00d1220 msgr2=0x7f51c015b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.938+0000 7f51c579a700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c00d1220 0x7f51c015b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.938+0000 7f51c579a700 1 -- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c00b3ff0 msgr2=0x7f51c0156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:02.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.938+0000 7f51c579a700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c00b3ff0 0x7f51c0156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:02.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.938+0000 7f51c579a700 1 -- 172.21.15.53:0/275733403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b8009a70 con 0x7f51c00b43c0 2023-07-09T21:51:02.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.938+0000 7f51c5f9b700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c00b3ff0 0x7f51c0156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:02.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.938+0000 7f51c579a700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c00b43c0 0x7f51c00ca810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f51b000c480 tx=0x7f51b000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.938+0000 7f51b67fc700 1 -- 172.21.15.53:0/275733403 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00052d0 con 0x7f51c00b43c0 2023-07-09T21:51:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.938+0000 7f51b67fc700 1 -- 172.21.15.53:0/275733403 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b0005430 con 0x7f51c00b43c0 2023-07-09T21:51:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.938+0000 7f51c81ff700 1 -- 172.21.15.53:0/275733403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c00cbbc0 con 0x7f51c00b43c0 2023-07-09T21:51:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.938+0000 7f51b67fc700 1 -- 172.21.15.53:0/275733403 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00038c0 con 0x7f51c00b43c0 2023-07-09T21:51:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.939+0000 7f51c81ff700 1 -- 172.21.15.53:0/275733403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c00cc180 con 0x7f51c00b43c0 2023-07-09T21:51:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.939+0000 7f51c81ff700 1 -- 172.21.15.53:0/275733403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c00ca530 con 0x7f51c00b43c0 2023-07-09T21:51:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.941+0000 7f51b67fc700 1 -- 172.21.15.53:0/275733403 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51b0003a20 con 0x7f51c00b43c0 2023-07-09T21:51:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.942+0000 7f51b67fc700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f51a406ad10 0x7f51a406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:02.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.942+0000 7f51b67fc700 1 -- 172.21.15.53:0/275733403 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51b0088b60 con 0x7f51c00b43c0 2023-07-09T21:51:02.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.942+0000 7f51c5f9b700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f51a406ad10 0x7f51a406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:02.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.943+0000 7f51c5f9b700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f51a406ad10 0x7f51a406d1c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f51bc007fd0 tx=0x7f51bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:02.945+0000 7f51b67fc700 1 -- 172.21.15.53:0/275733403 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f51b0053c80 con 0x7f51c00b43c0 2023-07-09T21:51:03.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.152+0000 7f51c81ff700 1 -- 172.21.15.53:0/275733403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51c00ca530 con 0x7f51c00b43c0 2023-07-09T21:51:03.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.153+0000 7f51b67fc700 1 -- 172.21.15.53:0/275733403 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51b0017020 con 0x7f51c00b43c0 2023-07-09T21:51:03.154 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:51:03.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.155+0000 7f51c81ff700 1 -- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f51a406ad10 msgr2=0x7f51a406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.155+0000 7f51c81ff700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f51a406ad10 0x7f51a406d1c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f51bc007fd0 tx=0x7f51bc009040 comp rx=0 tx=0).stop 2023-07-09T21:51:03.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.155+0000 7f51c81ff700 1 -- 172.21.15.53:0/275733403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c00b43c0 msgr2=0x7f51c00ca810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.155+0000 7f51c81ff700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c00b43c0 0x7f51c00ca810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f51b000c480 tx=0x7f51b000c840 comp rx=0 tx=0).stop 2023-07-09T21:51:03.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.155+0000 7f51c81ff700 1 -- 172.21.15.53:0/275733403 shutdown_connections 2023-07-09T21:51:03.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.155+0000 7f51c81ff700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f51a406ad10 0x7f51a406d1c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.155+0000 7f51c81ff700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c00d1220 0x7f51c015b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.155+0000 7f51c81ff700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c00b3ff0 0x7f51c0156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.155+0000 7f51c81ff700 1 --2- 172.21.15.53:0/275733403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c00b43c0 0x7f51c00ca810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.155+0000 7f51c81ff700 1 -- 172.21.15.53:0/275733403 >> 172.21.15.53:0/275733403 conn(0x7f51c009c1b0 msgr2=0x7f51c00b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:03.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.155+0000 7f51c81ff700 1 -- 172.21.15.53:0/275733403 shutdown_connections 2023-07-09T21:51:03.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.155+0000 7f51c81ff700 1 -- 172.21.15.53:0/275733403 wait complete. 2023-07-09T21:51:03.174 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:03.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.373+0000 7fbb115ff700 1 Processor -- start 2023-07-09T21:51:03.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.374+0000 7fbb115ff700 1 -- start start 2023-07-09T21:51:03.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.375+0000 7fbb115ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbb0c0b1e00 0x7fbb0c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:03.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.375+0000 7fbb115ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c0d2ce0 con 0x7fbb0c0b2350 2023-07-09T21:51:03.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.375+0000 7fbb115ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c0b3350 con 0x7fbb0c0d1220 2023-07-09T21:51:03.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.375+0000 7fbb115ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0c0b3630 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.375+0000 7fbb03fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbb0c0b2350 0x7fbb0c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45966/0 (socket says 172.21.15.53:45966) 2023-07-09T21:51:03.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.375+0000 7fbb03fff700 1 -- 172.21.15.53:0/4165876713 learned_addr learned my addr 172.21.15.53:0/4165876713 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:03.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.375+0000 7fbb0affd700 1 --2- 172.21.15.53:0/4165876713 >> v2:172.21.15.184:3300/0 conn(0x7fbb0c0b1e00 0x7fbb0c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:03.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.376+0000 7fbb0a7fc700 1 -- 172.21.15.53:0/4165876713 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566273547 0 0) 0x7fbb0c0d2ce0 con 0x7fbb0c0b2350 2023-07-09T21:51:03.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.376+0000 7fbb0a7fc700 1 -- 172.21.15.53:0/4165876713 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf80035b0 con 0x7fbb0c0b2350 2023-07-09T21:51:03.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.376+0000 7fbb0a7fc700 1 -- 172.21.15.53:0/4165876713 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2011461199 0 0) 0x7fbaf80035b0 con 0x7fbb0c0b2350 2023-07-09T21:51:03.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.376+0000 7fbb0affd700 1 -- 172.21.15.53:0/4165876713 >> v1:172.21.15.184:6789/0 conn(0x7fbb0c0d1220 legacy=0x7fbb0c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.376+0000 7fbb0affd700 1 -- 172.21.15.53:0/4165876713 >> v1:172.21.15.53:6789/0 conn(0x7fbb0c0b2350 legacy=0x7fbb0c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.376+0000 7fbb0affd700 1 -- 172.21.15.53:0/4165876713 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0b3910 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.376+0000 7fbb0affd700 1 --2- 172.21.15.53:0/4165876713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb0c0b1e00 0x7fbb0c0b43f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009820 tx=0x7fbafc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=355b8f69c6db6cac server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:03.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.376+0000 7fbb0a7fc700 1 -- 172.21.15.53:0/4165876713 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4001670 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.377+0000 7fbb0a7fc700 1 -- 172.21.15.53:0/4165876713 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc005c30 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.377+0000 7fbb0a7fc700 1 -- 172.21.15.53:0/4165876713 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc004030 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.377+0000 7fbb115ff700 1 -- 172.21.15.53:0/4165876713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb0c0b1e00 msgr2=0x7fbb0c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.377+0000 7fbb115ff700 1 --2- 172.21.15.53:0/4165876713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb0c0b1e00 0x7fbb0c0b43f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009820 tx=0x7fbafc009b30 comp rx=0 tx=0).stop 2023-07-09T21:51:03.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.377+0000 7fbb115ff700 1 -- 172.21.15.53:0/4165876713 shutdown_connections 2023-07-09T21:51:03.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.377+0000 7fbb115ff700 1 --2- 172.21.15.53:0/4165876713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb0c0b1e00 0x7fbb0c0b43f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.377+0000 7fbb115ff700 1 -- 172.21.15.53:0/4165876713 >> 172.21.15.53:0/4165876713 conn(0x7fbb0c09c1d0 msgr2=0x7fbb0c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:03.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.377+0000 7fbb115ff700 1 -- 172.21.15.53:0/4165876713 shutdown_connections 2023-07-09T21:51:03.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.377+0000 7fbb115ff700 1 -- 172.21.15.53:0/4165876713 wait complete. 2023-07-09T21:51:03.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.379+0000 7fbb115ff700 1 Processor -- start 2023-07-09T21:51:03.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.379+0000 7fbb115ff700 1 -- start start 2023-07-09T21:51:03.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.380+0000 7fbb115ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0b1e00 0x7fbb0c15baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.380+0000 7fbb115ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb0c0b2350 0x7fbb0c1577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.380+0000 7fbb115ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb0c0d1220 0x7fbb0c1590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.380+0000 7fbb115ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0c8ad0 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.380+0000 7fbb115ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c15c030 con 0x7fbb0c0d1220 2023-07-09T21:51:03.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.380+0000 7fbb115ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0c7ec0 con 0x7fbb0c0b2350 2023-07-09T21:51:03.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.380+0000 7fbb0affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0b1e00 0x7fbb0c15baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:03.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.380+0000 7fbb0affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0b1e00 0x7fbb0c15baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37218/0 (socket says 172.21.15.53:37218) 2023-07-09T21:51:03.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.380+0000 7fbb0affd700 1 -- 172.21.15.53:0/4093766100 learned_addr learned my addr 172.21.15.53:0/4093766100 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:03.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.381+0000 7fbb0affd700 1 -- 172.21.15.53:0/4093766100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb0c0b2350 msgr2=0x7fbb0c1577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.381+0000 7fbb0affd700 1 --2- 172.21.15.53:0/4093766100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb0c0b2350 0x7fbb0c1577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.381+0000 7fbb0affd700 1 -- 172.21.15.53:0/4093766100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb0c0d1220 msgr2=0x7fbb0c1590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.381+0000 7fbb0affd700 1 --2- 172.21.15.53:0/4093766100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb0c0d1220 0x7fbb0c1590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.381+0000 7fbb0affd700 1 -- 172.21.15.53:0/4093766100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc009430 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.381+0000 7fbb0affd700 1 --2- 172.21.15.53:0/4093766100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0b1e00 0x7fbb0c15baf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009fd0 tx=0x7fbafc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:03.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.381+0000 7fbb037fe700 1 -- 172.21.15.53:0/4093766100 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc003bf0 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.381+0000 7fbb037fe700 1 -- 172.21.15.53:0/4093766100 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc003d70 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.381+0000 7fbb037fe700 1 -- 172.21.15.53:0/4093766100 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc006240 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.381+0000 7fbb115ff700 1 -- 172.21.15.53:0/4093766100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c0c81a0 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.381+0000 7fbb115ff700 1 -- 172.21.15.53:0/4093766100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c0c8760 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.382+0000 7fbb115ff700 1 -- 172.21.15.53:0/4093766100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c0c88f0 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.383+0000 7fbb037fe700 1 -- 172.21.15.53:0/4093766100 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbafc018030 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.384+0000 7fbb037fe700 1 --2- 172.21.15.53:0/4093766100 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbaec06ace0 0x7fbaec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:03.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.384+0000 7fbb037fe700 1 -- 172.21.15.53:0/4093766100 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbafc08a720 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.385+0000 7fbb03fff700 1 --2- 172.21.15.53:0/4093766100 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbaec06ace0 0x7fbaec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:03.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.386+0000 7fbb03fff700 1 --2- 172.21.15.53:0/4093766100 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbaec06ace0 0x7fbaec06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40011e0 tx=0x7fbaf40010f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:03.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.389+0000 7fbb037fe700 1 -- 172.21.15.53:0/4093766100 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbafc0557c0 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.598+0000 7fbb115ff700 1 -- 172.21.15.53:0/4093766100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb0c04e280 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.599+0000 7fbb037fe700 1 -- 172.21.15.53:0/4093766100 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fbafc058de0 con 0x7fbb0c0b1e00 2023-07-09T21:51:03.601 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:03.601 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:50:24.766288+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:03.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.602+0000 7fbb115ff700 1 -- 172.21.15.53:0/4093766100 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbaec06ace0 msgr2=0x7fbaec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.602+0000 7fbb115ff700 1 --2- 172.21.15.53:0/4093766100 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbaec06ace0 0x7fbaec06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40011e0 tx=0x7fbaf40010f0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.602+0000 7fbb115ff700 1 -- 172.21.15.53:0/4093766100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0b1e00 msgr2=0x7fbb0c15baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.602+0000 7fbb115ff700 1 --2- 172.21.15.53:0/4093766100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0b1e00 0x7fbb0c15baf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009fd0 tx=0x7fbafc004750 comp rx=0 tx=0).stop 2023-07-09T21:51:03.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.602+0000 7fbb115ff700 1 -- 172.21.15.53:0/4093766100 shutdown_connections 2023-07-09T21:51:03.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.602+0000 7fbb115ff700 1 --2- 172.21.15.53:0/4093766100 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbaec06ace0 0x7fbaec06d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.602+0000 7fbb115ff700 1 --2- 172.21.15.53:0/4093766100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb0c0d1220 0x7fbb0c1590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.602+0000 7fbb115ff700 1 --2- 172.21.15.53:0/4093766100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0b1e00 0x7fbb0c15baf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.602+0000 7fbb115ff700 1 --2- 172.21.15.53:0/4093766100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb0c0b2350 0x7fbb0c1577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.602+0000 7fbb115ff700 1 -- 172.21.15.53:0/4093766100 >> 172.21.15.53:0/4093766100 conn(0x7fbb0c09c1d0 msgr2=0x7fbb0c0afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:03.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.602+0000 7fbb115ff700 1 -- 172.21.15.53:0/4093766100 shutdown_connections 2023-07-09T21:51:03.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.602+0000 7fbb115ff700 1 -- 172.21.15.53:0/4093766100 wait complete. 2023-07-09T21:51:03.621 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:50:21.703759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:50:22.243698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:51:03.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:51:03.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.831+0000 7f5245bff700 1 Processor -- start 2023-07-09T21:51:03.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.831+0000 7f5245bff700 1 -- start start 2023-07-09T21:51:03.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.832+0000 7f5245bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f52400cd5f0 0x7f52400cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:03.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.832+0000 7f5245bff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52400cdf00 con 0x7f52400cf7c0 2023-07-09T21:51:03.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.832+0000 7f5245bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524015de80 con 0x7f52400cfc40 2023-07-09T21:51:03.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.832+0000 7f5245bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52400d3cb0 con 0x7f52400cd5f0 2023-07-09T21:51:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.832+0000 7f523effd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f52400cf7c0 0x7f5240160530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45968/0 (socket says 172.21.15.53:45968) 2023-07-09T21:51:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.832+0000 7f523effd700 1 -- 172.21.15.53:0/1592077014 learned_addr learned my addr 172.21.15.53:0/1592077014 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549905820 0 0) 0x7f52400cdf00 con 0x7f52400cf7c0 2023-07-09T21:51:03.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52280035b0 con 0x7f52400cf7c0 2023-07-09T21:51:03.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523f7fe700 1 --2- 172.21.15.53:0/1592077014 >> v2:172.21.15.184:3300/0 conn(0x7f52400cd5f0 0x7f52400cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:03.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407289246 0 0) 0x7f524015de80 con 0x7f52400cfc40 2023-07-09T21:51:03.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52400cdf00 con 0x7f52400cfc40 2023-07-09T21:51:03.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1426518656 0 0) 0x7f52280035b0 con 0x7f52400cf7c0 2023-07-09T21:51:03.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 >> v2:172.21.15.184:3300/0 conn(0x7f52400cd5f0 msgr2=0x7f52400cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:03.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 --2- 172.21.15.53:0/1592077014 >> v2:172.21.15.184:3300/0 conn(0x7f52400cd5f0 0x7f52400cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 >> v1:172.21.15.184:6789/0 conn(0x7f52400cfc40 legacy=0x7f5240160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5240161350 con 0x7f52400cf7c0 2023-07-09T21:51:03.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f5234001670 con 0x7f52400cf7c0 2023-07-09T21:51:03.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 >> v1:172.21.15.53:6789/0 conn(0x7f52400cf7c0 legacy=0x7f5240160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 --2- 172.21.15.53:0/1592077014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5228003b90 0x7f5228003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:03.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 --2- 172.21.15.53:0/1592077014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5228004850 0x7f5228004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:03.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 --2- 172.21.15.53:0/1592077014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5228005320 0x7f522800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:03.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52400d3cb0 con 0x7f5228005320 2023-07-09T21:51:03.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522800c250 con 0x7f5228004850 2023-07-09T21:51:03.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522800c410 con 0x7f5228003b90 2023-07-09T21:51:03.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.833+0000 7f523ffff700 1 --2- 172.21.15.53:0/1592077014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5228005320 0x7f522800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:03.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.834+0000 7f523f7fe700 1 --2- 172.21.15.53:0/1592077014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5228003b90 0x7f5228003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:03.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.834+0000 7f523effd700 1 --2- 172.21.15.53:0/1592077014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5228004850 0x7f5228004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:03.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.834+0000 7f523ffff700 1 -- 172.21.15.53:0/1592077014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5228003b90 msgr2=0x7f5228003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:03.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.834+0000 7f523ffff700 1 --2- 172.21.15.53:0/1592077014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5228003b90 0x7f5228003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.834+0000 7f523ffff700 1 -- 172.21.15.53:0/1592077014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5228004850 msgr2=0x7f5228004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:03.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.834+0000 7f523ffff700 1 --2- 172.21.15.53:0/1592077014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5228004850 0x7f5228004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.834+0000 7f523ffff700 1 -- 172.21.15.53:0/1592077014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52280035b0 con 0x7f5228005320 2023-07-09T21:51:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.834+0000 7f523ffff700 1 -- 172.21.15.53:0/1592077014 reap_dead start 2023-07-09T21:51:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.834+0000 7f523ffff700 1 --2- 172.21.15.53:0/1592077014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5228005320 0x7f522800ba10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f523800c2f0 tx=0x7f5228005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852ac631e1caf2f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.834+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238001f30 con 0x7f5228005320 2023-07-09T21:51:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.834+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5238003a00 con 0x7f5228005320 2023-07-09T21:51:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.834+0000 7f523e7fc700 1 -- 172.21.15.53:0/1592077014 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238003db0 con 0x7f5228005320 2023-07-09T21:51:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.835+0000 7f5245bff700 1 -- 172.21.15.53:0/1592077014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5228005320 msgr2=0x7f522800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.835+0000 7f5245bff700 1 --2- 172.21.15.53:0/1592077014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5228005320 0x7f522800ba10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f523800c2f0 tx=0x7f5228005880 comp rx=0 tx=0).stop 2023-07-09T21:51:03.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.835+0000 7f5245bff700 1 -- 172.21.15.53:0/1592077014 shutdown_connections 2023-07-09T21:51:03.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.835+0000 7f5245bff700 1 --2- 172.21.15.53:0/1592077014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5228005320 0x7f522800ba10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.835+0000 7f5245bff700 1 -- 172.21.15.53:0/1592077014 >> 172.21.15.53:0/1592077014 conn(0x7f524006a5c0 msgr2=0x7f524006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:03.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.835+0000 7f5245bff700 1 -- 172.21.15.53:0/1592077014 shutdown_connections 2023-07-09T21:51:03.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.835+0000 7f5245bff700 1 -- 172.21.15.53:0/1592077014 wait complete. 2023-07-09T21:51:03.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.837+0000 7f5245bff700 1 Processor -- start 2023-07-09T21:51:03.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.837+0000 7f5245bff700 1 -- start start 2023-07-09T21:51:03.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.838+0000 7f5245bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5228005320 0x7f524014dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:03.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.838+0000 7f5245bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52401f5f80 0x7f52400c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:03.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.838+0000 7f5245bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5240154e70 0x7f52401552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:03.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.838+0000 7f5245bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5240155820 con 0x7f5228005320 2023-07-09T21:51:03.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.838+0000 7f5245bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524014e0f0 con 0x7f5240154e70 2023-07-09T21:51:03.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.838+0000 7f5245bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52400cc850 con 0x7f52401f5f80 2023-07-09T21:51:03.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.838+0000 7f523f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5228005320 0x7f524014dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:03.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.838+0000 7f523f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5228005320 0x7f524014dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37230/0 (socket says 172.21.15.53:37230) 2023-07-09T21:51:03.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.838+0000 7f523f7fe700 1 -- 172.21.15.53:0/3111511461 learned_addr learned my addr 172.21.15.53:0/3111511461 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:03.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.839+0000 7f523f7fe700 1 -- 172.21.15.53:0/3111511461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52401f5f80 msgr2=0x7f52400c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.839+0000 7f523f7fe700 1 --2- 172.21.15.53:0/3111511461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52401f5f80 0x7f52400c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.839+0000 7f523f7fe700 1 -- 172.21.15.53:0/3111511461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5240154e70 msgr2=0x7f52401552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:03.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.839+0000 7f523f7fe700 1 --2- 172.21.15.53:0/3111511461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5240154e70 0x7f52401552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:03.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.839+0000 7f523f7fe700 1 -- 172.21.15.53:0/3111511461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52400ccb30 con 0x7f5228005320 2023-07-09T21:51:03.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.839+0000 7f523f7fe700 1 --2- 172.21.15.53:0/3111511461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5228005320 0x7f524014dbb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f52300108c0 tx=0x7f5230010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:03.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.839+0000 7f5227fff700 1 -- 172.21.15.53:0/3111511461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523000c7e0 con 0x7f5228005320 2023-07-09T21:51:03.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.839+0000 7f5227fff700 1 -- 172.21.15.53:0/3111511461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523000c940 con 0x7f5228005320 2023-07-09T21:51:03.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.839+0000 7f5245bff700 1 -- 172.21.15.53:0/3111511461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52400b7880 con 0x7f5228005320 2023-07-09T21:51:03.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.839+0000 7f5227fff700 1 -- 172.21.15.53:0/3111511461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523000ccd0 con 0x7f5228005320 2023-07-09T21:51:03.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.839+0000 7f5245bff700 1 -- 172.21.15.53:0/3111511461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52400b7570 con 0x7f5228005320 2023-07-09T21:51:03.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.840+0000 7f5245bff700 1 -- 172.21.15.53:0/3111511461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52400b7ed0 con 0x7f5228005320 2023-07-09T21:51:03.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.842+0000 7f5227fff700 1 -- 172.21.15.53:0/3111511461 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5230015470 con 0x7f5228005320 2023-07-09T21:51:03.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.842+0000 7f5227fff700 1 --2- 172.21.15.53:0/3111511461 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f522c06ace0 0x7f522c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:03.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.842+0000 7f5227fff700 1 -- 172.21.15.53:0/3111511461 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5230089850 con 0x7f5228005320 2023-07-09T21:51:03.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.843+0000 7f523effd700 1 --2- 172.21.15.53:0/3111511461 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f522c06ace0 0x7f522c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:03.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.844+0000 7f523effd700 1 --2- 172.21.15.53:0/3111511461 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f522c06ace0 0x7f522c06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5234001eb0 tx=0x7f5234001ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:03.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:03.847+0000 7f5227fff700 1 -- 172.21.15.53:0/3111511461 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f52300582b0 con 0x7f5228005320 2023-07-09T21:51:04.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.053+0000 7f5245bff700 1 -- 172.21.15.53:0/3111511461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f524004e210 con 0x7f5228005320 2023-07-09T21:51:04.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.053+0000 7f5227fff700 1 -- 172.21.15.53:0/3111511461 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5230057e40 con 0x7f5228005320 2023-07-09T21:51:04.055 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:51:04.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.056+0000 7f5245bff700 1 -- 172.21.15.53:0/3111511461 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f522c06ace0 msgr2=0x7f522c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:04.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.056+0000 7f5245bff700 1 --2- 172.21.15.53:0/3111511461 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f522c06ace0 0x7f522c06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5234001eb0 tx=0x7f5234001ca0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.056+0000 7f5245bff700 1 -- 172.21.15.53:0/3111511461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5228005320 msgr2=0x7f524014dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:04.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.056+0000 7f5245bff700 1 --2- 172.21.15.53:0/3111511461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5228005320 0x7f524014dbb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f52300108c0 tx=0x7f5230010c80 comp rx=0 tx=0).stop 2023-07-09T21:51:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.056+0000 7f5245bff700 1 -- 172.21.15.53:0/3111511461 shutdown_connections 2023-07-09T21:51:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.056+0000 7f5245bff700 1 --2- 172.21.15.53:0/3111511461 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f522c06ace0 0x7f522c06d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.056+0000 7f5245bff700 1 --2- 172.21.15.53:0/3111511461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5240154e70 0x7f52401552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.056+0000 7f5245bff700 1 --2- 172.21.15.53:0/3111511461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5228005320 0x7f524014dbb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.056+0000 7f5245bff700 1 --2- 172.21.15.53:0/3111511461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52401f5f80 0x7f52400c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.056+0000 7f5245bff700 1 -- 172.21.15.53:0/3111511461 >> 172.21.15.53:0/3111511461 conn(0x7f524006a5c0 msgr2=0x7f52401565d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.056+0000 7f5245bff700 1 -- 172.21.15.53:0/3111511461 shutdown_connections 2023-07-09T21:51:04.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.056+0000 7f5245bff700 1 -- 172.21.15.53:0/3111511461 wait complete. 2023-07-09T21:51:04.075 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:51:04.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.277+0000 7f9f75dff700 1 Processor -- start 2023-07-09T21:51:04.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.277+0000 7f9f75dff700 1 -- start start 2023-07-09T21:51:04.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.278+0000 7f9f75dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9f700b3ff0 0x7f9f700b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:04.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.278+0000 7f9f75dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9f700d0f90 0x7f9f700b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:04.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.278+0000 7f9f75dff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f700b8e80 con 0x7f9f700d0b10 2023-07-09T21:51:04.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.278+0000 7f9f75dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f700b1e30 con 0x7f9f700b3ff0 2023-07-09T21:51:04.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.278+0000 7f9f75dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f700afaa0 con 0x7f9f700d0f90 2023-07-09T21:51:04.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.279+0000 7f9f6f7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9f700b3ff0 0x7f9f700b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:04.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.279+0000 7f9f6effd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9f700d0b10 0x7f9f700b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45984/0 (socket says 172.21.15.53:45984) 2023-07-09T21:51:04.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.279+0000 7f9f6f7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9f700b3ff0 0x7f9f700b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37238/0 (socket says 172.21.15.53:37238) 2023-07-09T21:51:04.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.279+0000 7f9f6effd700 1 -- 172.21.15.53:0/666147641 learned_addr learned my addr 172.21.15.53:0/666147641 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:04.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.279+0000 7f9f6f7fe700 1 -- 172.21.15.53:0/666147641 >> v2:172.21.15.184:3300/0 conn(0x7f9f700d0f90 msgr2=0x7f9f700b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:04.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.279+0000 7f9f6ffff700 1 --2- 172.21.15.53:0/666147641 >> v2:172.21.15.184:3300/0 conn(0x7f9f700d0f90 0x7f9f700b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:04.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.279+0000 7f9f6f7fe700 1 --2- 172.21.15.53:0/666147641 >> v2:172.21.15.184:3300/0 conn(0x7f9f700d0f90 0x7f9f700b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.279+0000 7f9f6f7fe700 1 -- 172.21.15.53:0/666147641 >> v1:172.21.15.53:6789/0 conn(0x7f9f700d0b10 legacy=0x7f9f700b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:04.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.279+0000 7f9f6f7fe700 1 -- 172.21.15.53:0/666147641 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700afd80 con 0x7f9f700b3ff0 2023-07-09T21:51:04.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.279+0000 7f9f6e7fc700 1 -- 172.21.15.53:0/666147641 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721822385 0 0) 0x7f9f64001110 con 0x7f9f700d0b10 2023-07-09T21:51:04.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.279+0000 7f9f6ffff700 1 --2- 172.21.15.53:0/666147641 >> v2:172.21.15.184:3300/0 conn(0x7f9f700d0f90 0x7f9f700b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:04.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.279+0000 7f9f6f7fe700 1 --2- 172.21.15.53:0/666147641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f700b3ff0 0x7f9f700b43c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9f700674e0 tx=0x7f9f60009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34af4522eb35acd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:04.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.280+0000 7f9f6e7fc700 1 -- 172.21.15.53:0/666147641 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60011830 con 0x7f9f700b3ff0 2023-07-09T21:51:04.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.280+0000 7f9f6e7fc700 1 -- 172.21.15.53:0/666147641 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f60011990 con 0x7f9f700b3ff0 2023-07-09T21:51:04.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.280+0000 7f9f6e7fc700 1 -- 172.21.15.53:0/666147641 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60011d20 con 0x7f9f700b3ff0 2023-07-09T21:51:04.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.280+0000 7f9f75dff700 1 -- 172.21.15.53:0/666147641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f700b3ff0 msgr2=0x7f9f700b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:04.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.280+0000 7f9f75dff700 1 --2- 172.21.15.53:0/666147641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f700b3ff0 0x7f9f700b43c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9f700674e0 tx=0x7f9f60009b20 comp rx=0 tx=0).stop 2023-07-09T21:51:04.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.280+0000 7f9f75dff700 1 -- 172.21.15.53:0/666147641 shutdown_connections 2023-07-09T21:51:04.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.280+0000 7f9f75dff700 1 --2- 172.21.15.53:0/666147641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f700b3ff0 0x7f9f700b43c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.280+0000 7f9f75dff700 1 --2- 172.21.15.53:0/666147641 >> v2:172.21.15.184:3300/0 conn(0x7f9f700d0f90 0x7f9f700b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.280+0000 7f9f75dff700 1 -- 172.21.15.53:0/666147641 >> 172.21.15.53:0/666147641 conn(0x7f9f7009c1b0 msgr2=0x7f9f700d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:04.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.280+0000 7f9f75dff700 1 -- 172.21.15.53:0/666147641 shutdown_connections 2023-07-09T21:51:04.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.280+0000 7f9f75dff700 1 -- 172.21.15.53:0/666147641 wait complete. 2023-07-09T21:51:04.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.282+0000 7f9f75dff700 1 Processor -- start 2023-07-09T21:51:04.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.282+0000 7f9f75dff700 1 -- start start 2023-07-09T21:51:04.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.283+0000 7f9f75dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f700b3ff0 0x7f9f7014f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:04.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.283+0000 7f9f75dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f700d0b10 0x7f9f701f5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:04.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.283+0000 7f9f75dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f700d0f90 0x7f9f701f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:04.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.283+0000 7f9f75dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7014fc00 con 0x7f9f700d0f90 2023-07-09T21:51:04.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.283+0000 7f9f75dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f701f3100 con 0x7f9f700b3ff0 2023-07-09T21:51:04.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.283+0000 7f9f75dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f701f33e0 con 0x7f9f700d0b10 2023-07-09T21:51:04.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.283+0000 7f9f6ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f700d0f90 0x7f9f701f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:04.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.283+0000 7f9f6ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f700d0f90 0x7f9f701f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37244/0 (socket says 172.21.15.53:37244) 2023-07-09T21:51:04.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.283+0000 7f9f6ffff700 1 -- 172.21.15.53:0/2853558709 learned_addr learned my addr 172.21.15.53:0/2853558709 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:04.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.284+0000 7f9f6effd700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f700d0b10 0x7f9f701f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:04.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.284+0000 7f9f6f7fe700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f700b3ff0 0x7f9f7014f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:04.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.284+0000 7f9f6ffff700 1 -- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f700d0b10 msgr2=0x7f9f701f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:04.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.284+0000 7f9f6ffff700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f700d0b10 0x7f9f701f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.284+0000 7f9f6ffff700 1 -- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f700b3ff0 msgr2=0x7f9f7014f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:04.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.284+0000 7f9f6ffff700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f700b3ff0 0x7f9f7014f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.284+0000 7f9f6ffff700 1 -- 172.21.15.53:0/2853558709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f600094a0 con 0x7f9f700d0f90 2023-07-09T21:51:04.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.284+0000 7f9f6ffff700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f700d0f90 0x7f9f701f59d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800cd50 tx=0x7f9f6800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:04.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.284+0000 7f9f57fff700 1 -- 172.21.15.53:0/2853558709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800f480 con 0x7f9f700d0f90 2023-07-09T21:51:04.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.284+0000 7f9f57fff700 1 -- 172.21.15.53:0/2853558709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6800f600 con 0x7f9f700d0f90 2023-07-09T21:51:04.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.284+0000 7f9f57fff700 1 -- 172.21.15.53:0/2853558709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800f9b0 con 0x7f9f700d0f90 2023-07-09T21:51:04.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.284+0000 7f9f75dff700 1 -- 172.21.15.53:0/2853558709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f701f36c0 con 0x7f9f700d0f90 2023-07-09T21:51:04.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.285+0000 7f9f75dff700 1 -- 172.21.15.53:0/2853558709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f701f3c80 con 0x7f9f700d0f90 2023-07-09T21:51:04.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.286+0000 7f9f75dff700 1 -- 172.21.15.53:0/2853558709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f701f3ea0 con 0x7f9f700d0f90 2023-07-09T21:51:04.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.287+0000 7f9f57fff700 1 -- 172.21.15.53:0/2853558709 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f6800b040 con 0x7f9f700d0f90 2023-07-09T21:51:04.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.287+0000 7f9f57fff700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9f5c06ace0 0x7f9f5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:04.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.288+0000 7f9f57fff700 1 -- 172.21.15.53:0/2853558709 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9f68089df0 con 0x7f9f700d0f90 2023-07-09T21:51:04.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.288+0000 7f9f6f7fe700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9f5c06ace0 0x7f9f5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:04.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.289+0000 7f9f6f7fe700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9f5c06ace0 0x7f9f5c06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9f600090b0 tx=0x7f9f60008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:04.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.292+0000 7f9f57fff700 1 -- 172.21.15.53:0/2853558709 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9f68054dc0 con 0x7f9f700d0f90 2023-07-09T21:51:04.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.501+0000 7f9f75dff700 1 -- 172.21.15.53:0/2853558709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9f70074350 con 0x7f9f700d0f90 2023-07-09T21:51:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.501+0000 7f9f57fff700 1 -- 172.21.15.53:0/2853558709 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9f6801d0a0 con 0x7f9f700d0f90 2023-07-09T21:51:04.503 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:51:04.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.504+0000 7f9f75dff700 1 -- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9f5c06ace0 msgr2=0x7f9f5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:04.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.504+0000 7f9f75dff700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9f5c06ace0 0x7f9f5c06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9f600090b0 tx=0x7f9f60008030 comp rx=0 tx=0).stop 2023-07-09T21:51:04.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.504+0000 7f9f75dff700 1 -- 172.21.15.53:0/2853558709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f700d0f90 msgr2=0x7f9f701f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:04.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.504+0000 7f9f75dff700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f700d0f90 0x7f9f701f59d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800cd50 tx=0x7f9f6800a560 comp rx=0 tx=0).stop 2023-07-09T21:51:04.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.504+0000 7f9f75dff700 1 -- 172.21.15.53:0/2853558709 shutdown_connections 2023-07-09T21:51:04.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.504+0000 7f9f75dff700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9f5c06ace0 0x7f9f5c06d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.504+0000 7f9f75dff700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f700d0f90 0x7f9f701f59d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.504+0000 7f9f75dff700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f700b3ff0 0x7f9f7014f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.504+0000 7f9f75dff700 1 --2- 172.21.15.53:0/2853558709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f700d0b10 0x7f9f701f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.504+0000 7f9f75dff700 1 -- 172.21.15.53:0/2853558709 >> 172.21.15.53:0/2853558709 conn(0x7f9f7009c1b0 msgr2=0x7f9f7006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:04.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.504+0000 7f9f75dff700 1 -- 172.21.15.53:0/2853558709 shutdown_connections 2023-07-09T21:51:04.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.504+0000 7f9f75dff700 1 -- 172.21.15.53:0/2853558709 wait complete. 2023-07-09T21:51:04.523 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:51:04.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.728+0000 7f27cdfff700 1 Processor -- start 2023-07-09T21:51:04.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.728+0000 7f27cdfff700 1 -- start start 2023-07-09T21:51:04.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.729+0000 7f27cdfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f27c80b3ff0 0x7f27c80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.729+0000 7f27cdfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27c80d0b10 0x7f27c80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.729+0000 7f27cdfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27c80b25d0 0x7f27c80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.729+0000 7f27cdfff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c80d14d0 con 0x7f27c80d0b10 2023-07-09T21:51:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.729+0000 7f27cdfff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c80b8e80 con 0x7f27c80b3ff0 2023-07-09T21:51:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.729+0000 7f27cdfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80afaa0 con 0x7f27c80b25d0 2023-07-09T21:51:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.729+0000 7f27c6ffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27c80d0b10 0x7f27c80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.730+0000 7f27c6ffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27c80d0b10 0x7f27c80d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37254/0 (socket says 172.21.15.53:37254) 2023-07-09T21:51:04.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.730+0000 7f27c6ffd700 1 -- 172.21.15.53:0/3477792040 learned_addr learned my addr 172.21.15.53:0/3477792040 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:04.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.730+0000 7f27c77fe700 1 --2- 172.21.15.53:0/3477792040 >> v2:172.21.15.184:3300/0 conn(0x7f27c80b3ff0 0x7f27c80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:04.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.730+0000 7f27c7fff700 1 --2- 172.21.15.53:0/3477792040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27c80b25d0 0x7f27c80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:04.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.730+0000 7f27c6ffd700 1 -- 172.21.15.53:0/3477792040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27c80b25d0 msgr2=0x7f27c80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:04.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.730+0000 7f27c6ffd700 1 --2- 172.21.15.53:0/3477792040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27c80b25d0 0x7f27c80b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.730+0000 7f27c6ffd700 1 -- 172.21.15.53:0/3477792040 >> v2:172.21.15.184:3300/0 conn(0x7f27c80b3ff0 msgr2=0x7f27c80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.730+0000 7f27c6ffd700 1 --2- 172.21.15.53:0/3477792040 >> v2:172.21.15.184:3300/0 conn(0x7f27c80b3ff0 0x7f27c80b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.730+0000 7f27c6ffd700 1 -- 172.21.15.53:0/3477792040 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c80afd80 con 0x7f27c80d0b10 2023-07-09T21:51:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.730+0000 7f27c77fe700 1 --2- 172.21.15.53:0/3477792040 >> v2:172.21.15.184:3300/0 conn(0x7f27c80b3ff0 0x7f27c80b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.730+0000 7f27c6ffd700 1 --2- 172.21.15.53:0/3477792040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27c80d0b10 0x7f27c80d0f90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f27c80b5b00 tx=0x7f27bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad422668eec99443 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.730+0000 7f27c67fc700 1 -- 172.21.15.53:0/3477792040 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc00b870 con 0x7f27c80d0b10 2023-07-09T21:51:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.731+0000 7f27c67fc700 1 -- 172.21.15.53:0/3477792040 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc00b9d0 con 0x7f27c80d0b10 2023-07-09T21:51:04.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.731+0000 7f27c67fc700 1 -- 172.21.15.53:0/3477792040 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc00bd60 con 0x7f27c80d0b10 2023-07-09T21:51:04.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.731+0000 7f27cdfff700 1 -- 172.21.15.53:0/3477792040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27c80d0b10 msgr2=0x7f27c80d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:04.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.731+0000 7f27cdfff700 1 --2- 172.21.15.53:0/3477792040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27c80d0b10 0x7f27c80d0f90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f27c80b5b00 tx=0x7f27bc009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.731+0000 7f27cdfff700 1 -- 172.21.15.53:0/3477792040 shutdown_connections 2023-07-09T21:51:04.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.731+0000 7f27cdfff700 1 --2- 172.21.15.53:0/3477792040 >> v2:172.21.15.184:3300/0 conn(0x7f27c80b3ff0 0x7f27c80b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.731+0000 7f27cdfff700 1 --2- 172.21.15.53:0/3477792040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27c80b25d0 0x7f27c80b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.731+0000 7f27cdfff700 1 --2- 172.21.15.53:0/3477792040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27c80d0b10 0x7f27c80d0f90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.731+0000 7f27cdfff700 1 -- 172.21.15.53:0/3477792040 >> 172.21.15.53:0/3477792040 conn(0x7f27c809c1b0 msgr2=0x7f27c80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:04.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.731+0000 7f27cdfff700 1 -- 172.21.15.53:0/3477792040 shutdown_connections 2023-07-09T21:51:04.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.731+0000 7f27cdfff700 1 -- 172.21.15.53:0/3477792040 wait complete. 2023-07-09T21:51:04.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.733+0000 7f27cdfff700 1 Processor -- start 2023-07-09T21:51:04.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.733+0000 7f27cdfff700 1 -- start start 2023-07-09T21:51:04.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.734+0000 7f27cdfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27c80b25d0 0x7f27c815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:04.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.734+0000 7f27cdfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27c80b3ff0 0x7f27c80d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:04.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.734+0000 7f27cdfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27c80d0b10 0x7f27c815f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:04.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.734+0000 7f27cdfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80cd610 con 0x7f27c80b25d0 2023-07-09T21:51:04.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.734+0000 7f27cdfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80cd8f0 con 0x7f27c80d0b10 2023-07-09T21:51:04.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.734+0000 7f27cdfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80cdbd0 con 0x7f27c80b3ff0 2023-07-09T21:51:04.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.734+0000 7f27c77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27c80b25d0 0x7f27c815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:04.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.734+0000 7f27c77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27c80b25d0 0x7f27c815a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37268/0 (socket says 172.21.15.53:37268) 2023-07-09T21:51:04.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.734+0000 7f27c77fe700 1 -- 172.21.15.53:0/2910846798 learned_addr learned my addr 172.21.15.53:0/2910846798 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27c7fff700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27c80d0b10 0x7f27c815f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27c6ffd700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27c80b3ff0 0x7f27c80d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27c77fe700 1 -- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27c80b3ff0 msgr2=0x7f27c80d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27c77fe700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27c80b3ff0 0x7f27c80d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27c77fe700 1 -- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27c80d0b10 msgr2=0x7f27c815f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27c77fe700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27c80d0b10 0x7f27c815f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27c77fe700 1 -- 172.21.15.53:0/2910846798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc009550 con 0x7f27c80b25d0 2023-07-09T21:51:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27c6ffd700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27c80b3ff0 0x7f27c80d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:04.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27c77fe700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27c80b25d0 0x7f27c815a3e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f27b800e810 tx=0x7f27b800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:04.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27affff700 1 -- 172.21.15.53:0/2910846798 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8013610 con 0x7f27c80b25d0 2023-07-09T21:51:04.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27affff700 1 -- 172.21.15.53:0/2910846798 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b8013770 con 0x7f27c80b25d0 2023-07-09T21:51:04.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27affff700 1 -- 172.21.15.53:0/2910846798 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8013b20 con 0x7f27c80b25d0 2023-07-09T21:51:04.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27cdfff700 1 -- 172.21.15.53:0/2910846798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c80cb1d0 con 0x7f27c80b25d0 2023-07-09T21:51:04.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.735+0000 7f27cdfff700 1 -- 172.21.15.53:0/2910846798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c815a920 con 0x7f27c80b25d0 2023-07-09T21:51:04.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.736+0000 7f27cdfff700 1 -- 172.21.15.53:0/2910846798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c8074350 con 0x7f27c80b25d0 2023-07-09T21:51:04.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.737+0000 7f27affff700 1 -- 172.21.15.53:0/2910846798 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f27b8013c80 con 0x7f27c80b25d0 2023-07-09T21:51:04.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.738+0000 7f27affff700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f27b406ace0 0x7f27b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:04.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.738+0000 7f27affff700 1 -- 172.21.15.53:0/2910846798 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f27b8089230 con 0x7f27c80b25d0 2023-07-09T21:51:04.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.739+0000 7f27c6ffd700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f27b406ace0 0x7f27b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:04.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.740+0000 7f27c6ffd700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f27b406ace0 0x7f27b406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f27bc014040 tx=0x7f27bc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:04.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.742+0000 7f27affff700 1 -- 172.21.15.53:0/2910846798 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f27b8057c90 con 0x7f27c80b25d0 2023-07-09T21:51:04.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.957+0000 7f27cdfff700 1 -- 172.21.15.53:0/2910846798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27c8073800 con 0x7f27c80b25d0 2023-07-09T21:51:04.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.957+0000 7f27affff700 1 -- 172.21.15.53:0/2910846798 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27b8057820 con 0x7f27c80b25d0 2023-07-09T21:51:04.959 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:51:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.959+0000 7f27cdfff700 1 -- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f27b406ace0 msgr2=0x7f27b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.959+0000 7f27cdfff700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f27b406ace0 0x7f27b406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f27bc014040 tx=0x7f27bc008030 comp rx=0 tx=0).stop 2023-07-09T21:51:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.959+0000 7f27cdfff700 1 -- 172.21.15.53:0/2910846798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27c80b25d0 msgr2=0x7f27c815a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.959+0000 7f27cdfff700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27c80b25d0 0x7f27c815a3e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f27b800e810 tx=0x7f27b800ebd0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.959+0000 7f27cdfff700 1 -- 172.21.15.53:0/2910846798 shutdown_connections 2023-07-09T21:51:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.959+0000 7f27cdfff700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f27b406ace0 0x7f27b406d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.959+0000 7f27cdfff700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27c80d0b10 0x7f27c815f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.959+0000 7f27cdfff700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27c80b25d0 0x7f27c815a3e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.959+0000 7f27cdfff700 1 --2- 172.21.15.53:0/2910846798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27c80b3ff0 0x7f27c80d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.959+0000 7f27cdfff700 1 -- 172.21.15.53:0/2910846798 >> 172.21.15.53:0/2910846798 conn(0x7f27c809c1b0 msgr2=0x7f27c806a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.960+0000 7f27cdfff700 1 -- 172.21.15.53:0/2910846798 shutdown_connections 2023-07-09T21:51:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:04.960+0000 7f27cdfff700 1 -- 172.21.15.53:0/2910846798 wait complete. 2023-07-09T21:51:04.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:51:05.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.180+0000 7fe1a91ff700 1 Processor -- start 2023-07-09T21:51:05.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.181+0000 7fe1a91ff700 1 -- start start 2023-07-09T21:51:05.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.182+0000 7fe1a91ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe1a40b3ff0 0x7fe1a40b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:05.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.182+0000 7fe1a91ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a40b8e80 con 0x7fe1a40d0f90 2023-07-09T21:51:05.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.182+0000 7fe1a91ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a40b33f0 con 0x7fe1a40d0b10 2023-07-09T21:51:05.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.182+0000 7fe1a91ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a40b1e30 con 0x7fe1a40b3ff0 2023-07-09T21:51:05.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.182+0000 7fe1a2d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe1a40b3ff0 0x7fe1a40b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:05.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.182+0000 7fe1a359e700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe1a40d0f90 0x7fe1a40b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45992/0 (socket says 172.21.15.53:45992) 2023-07-09T21:51:05.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.182+0000 7fe1a359e700 1 -- 172.21.15.53:0/1272662476 learned_addr learned my addr 172.21.15.53:0/1272662476 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:05.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.183+0000 7fe1a2d9d700 1 -- 172.21.15.53:0/1272662476 >> v1:172.21.15.184:6789/0 conn(0x7fe1a40d0b10 legacy=0x7fe1a40b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:05.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.183+0000 7fe1a2d9d700 1 -- 172.21.15.53:0/1272662476 >> v1:172.21.15.53:6789/0 conn(0x7fe1a40d0f90 legacy=0x7fe1a40b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:05.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.183+0000 7fe1a2d9d700 1 -- 172.21.15.53:0/1272662476 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a40afaa0 con 0x7fe1a40b3ff0 2023-07-09T21:51:05.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.183+0000 7fe1a2d9d700 1 --2- 172.21.15.53:0/1272662476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a40b3ff0 0x7fe1a40b43c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe194009840 tx=0x7fe194009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c625a8a68ddc3b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:05.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.183+0000 7fe1a259c700 1 -- 172.21.15.53:0/1272662476 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194011830 con 0x7fe1a40b3ff0 2023-07-09T21:51:05.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.183+0000 7fe1a259c700 1 -- 172.21.15.53:0/1272662476 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe194011990 con 0x7fe1a40b3ff0 2023-07-09T21:51:05.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.183+0000 7fe1a259c700 1 -- 172.21.15.53:0/1272662476 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194011d20 con 0x7fe1a40b3ff0 2023-07-09T21:51:05.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.184+0000 7fe1a91ff700 1 -- 172.21.15.53:0/1272662476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a40b3ff0 msgr2=0x7fe1a40b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:05.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.184+0000 7fe1a91ff700 1 --2- 172.21.15.53:0/1272662476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a40b3ff0 0x7fe1a40b43c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe194009840 tx=0x7fe194009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:05.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.184+0000 7fe1a91ff700 1 -- 172.21.15.53:0/1272662476 shutdown_connections 2023-07-09T21:51:05.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.184+0000 7fe1a91ff700 1 --2- 172.21.15.53:0/1272662476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a40b3ff0 0x7fe1a40b43c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.184+0000 7fe1a91ff700 1 -- 172.21.15.53:0/1272662476 >> 172.21.15.53:0/1272662476 conn(0x7fe1a409c1b0 msgr2=0x7fe1a40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:05.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.184+0000 7fe1a91ff700 1 -- 172.21.15.53:0/1272662476 shutdown_connections 2023-07-09T21:51:05.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.184+0000 7fe1a91ff700 1 -- 172.21.15.53:0/1272662476 wait complete. 2023-07-09T21:51:05.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.186+0000 7fe1a91ff700 1 Processor -- start 2023-07-09T21:51:05.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.186+0000 7fe1a91ff700 1 -- start start 2023-07-09T21:51:05.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe1a91ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a40b3ff0 0x7fe1a41573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:05.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe1a91ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a40d0b10 0x7fe1a406b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:05.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe1a91ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a40d0f90 0x7fe1a406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:05.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe1a91ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a415e770 con 0x7fe1a40d0b10 2023-07-09T21:51:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe1a91ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40ce680 con 0x7fe1a40b3ff0 2023-07-09T21:51:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe1a91ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a415dbc0 con 0x7fe1a40d0f90 2023-07-09T21:51:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe19bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a40d0b10 0x7fe1a406b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe19bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a40d0b10 0x7fe1a406b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37294/0 (socket says 172.21.15.53:37294) 2023-07-09T21:51:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe19bfff700 1 -- 172.21.15.53:0/2006332749 learned_addr learned my addr 172.21.15.53:0/2006332749 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe1a2d9d700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a40b3ff0 0x7fe1a41573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe1a359e700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a40d0f90 0x7fe1a406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe19bfff700 1 -- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a40d0f90 msgr2=0x7fe1a406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe19bfff700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a40d0f90 0x7fe1a406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe19bfff700 1 -- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a40b3ff0 msgr2=0x7fe1a41573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe19bfff700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a40b3ff0 0x7fe1a41573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe19bfff700 1 -- 172.21.15.53:0/2006332749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1940094a0 con 0x7fe1a40d0b10 2023-07-09T21:51:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.187+0000 7fe1a2d9d700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a40b3ff0 0x7fe1a41573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.188+0000 7fe19bfff700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a40d0b10 0x7fe1a406b870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00c700 tx=0x7fe18c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:05.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.188+0000 7fe19b7fe700 1 -- 172.21.15.53:0/2006332749 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c0052d0 con 0x7fe1a40d0b10 2023-07-09T21:51:05.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.188+0000 7fe19b7fe700 1 -- 172.21.15.53:0/2006332749 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c005430 con 0x7fe1a40d0b10 2023-07-09T21:51:05.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.188+0000 7fe19b7fe700 1 -- 172.21.15.53:0/2006332749 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c003880 con 0x7fe1a40d0b10 2023-07-09T21:51:05.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.188+0000 7fe1a91ff700 1 -- 172.21.15.53:0/2006332749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a415ddd0 con 0x7fe1a40d0b10 2023-07-09T21:51:05.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.188+0000 7fe1a91ff700 1 -- 172.21.15.53:0/2006332749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a415e390 con 0x7fe1a40d0b10 2023-07-09T21:51:05.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.189+0000 7fe1a91ff700 1 -- 172.21.15.53:0/2006332749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a415e8b0 con 0x7fe1a40d0b10 2023-07-09T21:51:05.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.190+0000 7fe19b7fe700 1 -- 172.21.15.53:0/2006332749 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe18c0039e0 con 0x7fe1a40d0b10 2023-07-09T21:51:05.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.191+0000 7fe19b7fe700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe18406ace0 0x7fe18406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:05.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.191+0000 7fe19b7fe700 1 -- 172.21.15.53:0/2006332749 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe18c088920 con 0x7fe1a40d0b10 2023-07-09T21:51:05.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.192+0000 7fe1a2d9d700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe18406ace0 0x7fe18406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:05.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.192+0000 7fe1a2d9d700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe18406ace0 0x7fe18406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1940090b0 tx=0x7fe194008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:05.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.195+0000 7fe19b7fe700 1 -- 172.21.15.53:0/2006332749 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe1a415e8b0 con 0x7fe1a40d0b10 2023-07-09T21:51:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.403+0000 7fe1a91ff700 1 -- 172.21.15.53:0/2006332749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1a415e8b0 con 0x7fe1a40d0b10 2023-07-09T21:51:05.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.403+0000 7fe19b7fe700 1 -- 172.21.15.53:0/2006332749 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1a415e8b0 con 0x7fe1a40d0b10 2023-07-09T21:51:05.405 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:51:05.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.406+0000 7fe1a91ff700 1 -- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe18406ace0 msgr2=0x7fe18406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:05.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.406+0000 7fe1a91ff700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe18406ace0 0x7fe18406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1940090b0 tx=0x7fe194008030 comp rx=0 tx=0).stop 2023-07-09T21:51:05.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.406+0000 7fe1a91ff700 1 -- 172.21.15.53:0/2006332749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a40d0b10 msgr2=0x7fe1a406b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:05.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.406+0000 7fe1a91ff700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a40d0b10 0x7fe1a406b870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00c700 tx=0x7fe18c00cac0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.406+0000 7fe1a91ff700 1 -- 172.21.15.53:0/2006332749 shutdown_connections 2023-07-09T21:51:05.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.406+0000 7fe1a91ff700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe18406ace0 0x7fe18406d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.406+0000 7fe1a91ff700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a40d0f90 0x7fe1a406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.406+0000 7fe1a91ff700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a40b3ff0 0x7fe1a41573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.406+0000 7fe1a91ff700 1 --2- 172.21.15.53:0/2006332749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a40d0b10 0x7fe1a406b870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.406+0000 7fe1a91ff700 1 -- 172.21.15.53:0/2006332749 >> 172.21.15.53:0/2006332749 conn(0x7fe1a409c1b0 msgr2=0x7fe1a40b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.406+0000 7fe1a91ff700 1 -- 172.21.15.53:0/2006332749 shutdown_connections 2023-07-09T21:51:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.406+0000 7fe1a91ff700 1 -- 172.21.15.53:0/2006332749 wait complete. 2023-07-09T21:51:05.426 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:05.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.624+0000 7fe3b53ff700 1 Processor -- start 2023-07-09T21:51:05.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.624+0000 7fe3b53ff700 1 -- start start 2023-07-09T21:51:05.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.625+0000 7fe3b53ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3b00d1220 0x7fe3b00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:05.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.626+0000 7fe3b53ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3b00b2350 0x7fe3b00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:05.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.626+0000 7fe3b53ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b00d2ce0 con 0x7fe3b00b1e00 2023-07-09T21:51:05.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.626+0000 7fe3b53ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b00b3350 con 0x7fe3b00d1220 2023-07-09T21:51:05.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.626+0000 7fe3b53ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00b3630 con 0x7fe3b00b2350 2023-07-09T21:51:05.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.626+0000 7fe3ae7fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3b00d1220 0x7fe3b00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:05.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.626+0000 7fe3ae7fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3b00d1220 0x7fe3b00b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37302/0 (socket says 172.21.15.53:37302) 2023-07-09T21:51:05.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.626+0000 7fe3ae7fc700 1 -- 172.21.15.53:0/3495452042 learned_addr learned my addr 172.21.15.53:0/3495452042 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:05.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.626+0000 7fe3ae7fc700 1 -- 172.21.15.53:0/3495452042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3b00b2350 msgr2=0x7fe3b00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:05.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.626+0000 7fe3ae7fc700 1 --2- 172.21.15.53:0/3495452042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3b00b2350 0x7fe3b00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.626+0000 7fe3ae7fc700 1 -- 172.21.15.53:0/3495452042 >> v1:172.21.15.184:6789/0 conn(0x7fe3b00b1e00 legacy=0x7fe3b00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:05.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.626+0000 7fe3ae7fc700 1 -- 172.21.15.53:0/3495452042 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b00b3910 con 0x7fe3b00d1220 2023-07-09T21:51:05.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.626+0000 7fe3ae7fc700 1 --2- 172.21.15.53:0/3495452042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00d1220 0x7fe3b00b43f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40098f0 tx=0x7fe3a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d351dceffbf80 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:05.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.627+0000 7fe3adffb700 1 -- 172.21.15.53:0/3495452042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4004230 con 0x7fe3b00d1220 2023-07-09T21:51:05.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.627+0000 7fe3adffb700 1 -- 172.21.15.53:0/3495452042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a4004390 con 0x7fe3b00d1220 2023-07-09T21:51:05.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.627+0000 7fe3adffb700 1 -- 172.21.15.53:0/3495452042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a40036a0 con 0x7fe3b00d1220 2023-07-09T21:51:05.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.627+0000 7fe3b53ff700 1 -- 172.21.15.53:0/3495452042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00d1220 msgr2=0x7fe3b00b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:05.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.627+0000 7fe3b53ff700 1 --2- 172.21.15.53:0/3495452042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00d1220 0x7fe3b00b43f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40098f0 tx=0x7fe3a4009c00 comp rx=0 tx=0).stop 2023-07-09T21:51:05.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.627+0000 7fe3b53ff700 1 -- 172.21.15.53:0/3495452042 shutdown_connections 2023-07-09T21:51:05.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.627+0000 7fe3b53ff700 1 --2- 172.21.15.53:0/3495452042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3b00b2350 0x7fe3b00afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.627+0000 7fe3b53ff700 1 --2- 172.21.15.53:0/3495452042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00d1220 0x7fe3b00b43f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.627+0000 7fe3b53ff700 1 -- 172.21.15.53:0/3495452042 >> 172.21.15.53:0/3495452042 conn(0x7fe3b009c1d0 msgr2=0x7fe3b00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:05.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.627+0000 7fe3b53ff700 1 -- 172.21.15.53:0/3495452042 shutdown_connections 2023-07-09T21:51:05.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.627+0000 7fe3b53ff700 1 -- 172.21.15.53:0/3495452042 wait complete. 2023-07-09T21:51:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.629+0000 7fe3b53ff700 1 Processor -- start 2023-07-09T21:51:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.629+0000 7fe3b53ff700 1 -- start start 2023-07-09T21:51:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.630+0000 7fe3b53ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00b1e00 0x7fe3b014d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.630+0000 7fe3b53ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3b00b2350 0x7fe3b01f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.630+0000 7fe3b53ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3b00d1220 0x7fe3b015af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.630+0000 7fe3b53ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b01f3630 con 0x7fe3b00b1e00 2023-07-09T21:51:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.630+0000 7fe3b53ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00b6cf0 con 0x7fe3b00d1220 2023-07-09T21:51:05.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.630+0000 7fe3b53ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00b60e0 con 0x7fe3b00b2350 2023-07-09T21:51:05.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.630+0000 7fe3aeffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00b1e00 0x7fe3b014d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:05.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.630+0000 7fe3aeffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00b1e00 0x7fe3b014d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37318/0 (socket says 172.21.15.53:37318) 2023-07-09T21:51:05.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.630+0000 7fe3aeffd700 1 -- 172.21.15.53:0/2460760400 learned_addr learned my addr 172.21.15.53:0/2460760400 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:05.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.631+0000 7fe3ae7fc700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3b00b2350 0x7fe3b01f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:05.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.631+0000 7fe3af7fe700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3b00d1220 0x7fe3b015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:05.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.631+0000 7fe3aeffd700 1 -- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3b00b2350 msgr2=0x7fe3b01f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:05.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.631+0000 7fe3aeffd700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3b00b2350 0x7fe3b01f30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.631+0000 7fe3aeffd700 1 -- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3b00d1220 msgr2=0x7fe3b015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:05.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.631+0000 7fe3aeffd700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3b00d1220 0x7fe3b015af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.631+0000 7fe3aeffd700 1 -- 172.21.15.53:0/2460760400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a4009550 con 0x7fe3b00b1e00 2023-07-09T21:51:05.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.631+0000 7fe3af7fe700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3b00d1220 0x7fe3b015af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:05.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.631+0000 7fe3aeffd700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00b1e00 0x7fe3b014d310 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000c520 tx=0x7fe3a000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.631+0000 7fe3977fe700 1 -- 172.21.15.53:0/2460760400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00054e0 con 0x7fe3b00b1e00 2023-07-09T21:51:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.631+0000 7fe3977fe700 1 -- 172.21.15.53:0/2460760400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a00036d0 con 0x7fe3b00b1e00 2023-07-09T21:51:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.631+0000 7fe3b53ff700 1 -- 172.21.15.53:0/2460760400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b00b63c0 con 0x7fe3b00b1e00 2023-07-09T21:51:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.631+0000 7fe3977fe700 1 -- 172.21.15.53:0/2460760400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0003a80 con 0x7fe3b00b1e00 2023-07-09T21:51:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.632+0000 7fe3b53ff700 1 -- 172.21.15.53:0/2460760400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b00b6980 con 0x7fe3b00b1e00 2023-07-09T21:51:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.633+0000 7fe3b53ff700 1 -- 172.21.15.53:0/2460760400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b004e280 con 0x7fe3b00b1e00 2023-07-09T21:51:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.634+0000 7fe3977fe700 1 -- 172.21.15.53:0/2460760400 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe3a0003be0 con 0x7fe3b00b1e00 2023-07-09T21:51:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.634+0000 7fe3977fe700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe39c06ace0 0x7fe39c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.635+0000 7fe3977fe700 1 -- 172.21.15.53:0/2460760400 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe3a0088610 con 0x7fe3b00b1e00 2023-07-09T21:51:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.635+0000 7fe3ae7fc700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe39c06ace0 0x7fe39c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:05.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.636+0000 7fe3ae7fc700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe39c06ace0 0x7fe39c06d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00d1610 tx=0x7fe3a4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:05.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.639+0000 7fe3977fe700 1 -- 172.21.15.53:0/2460760400 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe3a00535e0 con 0x7fe3b00b1e00 2023-07-09T21:51:05.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.848+0000 7fe3b53ff700 1 -- 172.21.15.53:0/2460760400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3b008c5a0 con 0x7fe3b00b1e00 2023-07-09T21:51:05.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.849+0000 7fe3977fe700 1 -- 172.21.15.53:0/2460760400 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fe3a0056c00 con 0x7fe3b00b1e00 2023-07-09T21:51:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:05.851 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:04.650456+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:05.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.851+0000 7fe3b53ff700 1 -- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe39c06ace0 msgr2=0x7fe39c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:05.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.851+0000 7fe3b53ff700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe39c06ace0 0x7fe39c06d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00d1610 tx=0x7fe3a4008030 comp rx=0 tx=0).stop 2023-07-09T21:51:05.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.851+0000 7fe3b53ff700 1 -- 172.21.15.53:0/2460760400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00b1e00 msgr2=0x7fe3b014d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:05.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.851+0000 7fe3b53ff700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00b1e00 0x7fe3b014d310 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000c520 tx=0x7fe3a000c830 comp rx=0 tx=0).stop 2023-07-09T21:51:05.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.851+0000 7fe3b53ff700 1 -- 172.21.15.53:0/2460760400 shutdown_connections 2023-07-09T21:51:05.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.851+0000 7fe3b53ff700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe39c06ace0 0x7fe39c06d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.851+0000 7fe3b53ff700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3b00d1220 0x7fe3b015af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.851+0000 7fe3b53ff700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00b1e00 0x7fe3b014d310 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.851+0000 7fe3b53ff700 1 --2- 172.21.15.53:0/2460760400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3b00b2350 0x7fe3b01f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:05.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.851+0000 7fe3b53ff700 1 -- 172.21.15.53:0/2460760400 >> 172.21.15.53:0/2460760400 conn(0x7fe3b009c1d0 msgr2=0x7fe3b00d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:05.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.852+0000 7fe3b53ff700 1 -- 172.21.15.53:0/2460760400 shutdown_connections 2023-07-09T21:51:05.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:05.852+0000 7fe3b53ff700 1 -- 172.21.15.53:0/2460760400 wait complete. 2023-07-09T21:51:05.871 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:50:21.703759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:50:22.243698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:51:05.872 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:51:06.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.073+0000 7f7caefff700 1 Processor -- start 2023-07-09T21:51:06.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.074+0000 7f7caefff700 1 -- start start 2023-07-09T21:51:06.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.075+0000 7f7caefff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ca80b3ff0 0x7f7ca80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.075+0000 7f7caefff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca80b8e80 con 0x7f7ca80d0b10 2023-07-09T21:51:06.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.075+0000 7f7caefff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca80b33f0 con 0x7f7ca80d0f90 2023-07-09T21:51:06.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.075+0000 7f7caefff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca80b1e30 con 0x7f7ca80b3ff0 2023-07-09T21:51:06.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.075+0000 7f7cacd9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ca80b3ff0 0x7f7ca80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.075+0000 7f7cacd9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ca80b3ff0 0x7f7ca80b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37328/0 (socket says 172.21.15.53:37328) 2023-07-09T21:51:06.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.075+0000 7f7cacd9b700 1 -- 172.21.15.53:0/442121021 learned_addr learned my addr 172.21.15.53:0/442121021 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:06.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.075+0000 7f7ca7fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7ca80d0b10 0x7f7ca80b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46002/0 (socket says 172.21.15.53:46002) 2023-07-09T21:51:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.075+0000 7f7cacd9b700 1 -- 172.21.15.53:0/442121021 >> v1:172.21.15.184:6789/0 conn(0x7f7ca80d0f90 legacy=0x7f7ca80b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.076+0000 7f7cacd9b700 1 -- 172.21.15.53:0/442121021 >> v1:172.21.15.53:6789/0 conn(0x7f7ca80d0b10 legacy=0x7f7ca80b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.076+0000 7f7ca77fe700 1 -- 172.21.15.53:0/442121021 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308979808 0 0) 0x7f7c94001110 con 0x7f7ca80d0b10 2023-07-09T21:51:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.076+0000 7f7cacd9b700 1 -- 172.21.15.53:0/442121021 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca80afaa0 con 0x7f7ca80b3ff0 2023-07-09T21:51:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.076+0000 7f7cacd9b700 1 --2- 172.21.15.53:0/442121021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca80b3ff0 0x7f7ca80b43c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0098f0 tx=0x7f7c9c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcaee5c58a254a52 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:06.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.076+0000 7f7ca77fe700 1 -- 172.21.15.53:0/442121021 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c00b8a0 con 0x7f7ca80b3ff0 2023-07-09T21:51:06.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.076+0000 7f7ca77fe700 1 -- 172.21.15.53:0/442121021 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c00ba00 con 0x7f7ca80b3ff0 2023-07-09T21:51:06.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.076+0000 7f7ca77fe700 1 -- 172.21.15.53:0/442121021 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c00bd90 con 0x7f7ca80b3ff0 2023-07-09T21:51:06.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.077+0000 7f7caefff700 1 -- 172.21.15.53:0/442121021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca80b3ff0 msgr2=0x7f7ca80b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.077+0000 7f7caefff700 1 --2- 172.21.15.53:0/442121021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca80b3ff0 0x7f7ca80b43c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0098f0 tx=0x7f7c9c009c00 comp rx=0 tx=0).stop 2023-07-09T21:51:06.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.077+0000 7f7caefff700 1 -- 172.21.15.53:0/442121021 shutdown_connections 2023-07-09T21:51:06.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.077+0000 7f7caefff700 1 --2- 172.21.15.53:0/442121021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca80b3ff0 0x7f7ca80b43c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.077+0000 7f7caefff700 1 -- 172.21.15.53:0/442121021 >> 172.21.15.53:0/442121021 conn(0x7f7ca809c1b0 msgr2=0x7f7ca80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:06.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.077+0000 7f7caefff700 1 -- 172.21.15.53:0/442121021 shutdown_connections 2023-07-09T21:51:06.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.077+0000 7f7caefff700 1 -- 172.21.15.53:0/442121021 wait complete. 2023-07-09T21:51:06.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.079+0000 7f7caefff700 1 Processor -- start 2023-07-09T21:51:06.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.079+0000 7f7caefff700 1 -- start start 2023-07-09T21:51:06.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.080+0000 7f7caefff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ca80b3ff0 0x7f7ca80cff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.080+0000 7f7caefff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ca80d0b10 0x7f7ca815f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.080+0000 7f7caefff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca80d0f90 0x7f7ca80cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.080+0000 7f7caefff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80d0450 con 0x7f7ca80d0f90 2023-07-09T21:51:06.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.080+0000 7f7caefff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca815e770 con 0x7f7ca80d0b10 2023-07-09T21:51:06.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.080+0000 7f7caefff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca815ea50 con 0x7f7ca80b3ff0 2023-07-09T21:51:06.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.080+0000 7f7cad59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca80d0f90 0x7f7ca80cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.081+0000 7f7cad59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca80d0f90 0x7f7ca80cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37344/0 (socket says 172.21.15.53:37344) 2023-07-09T21:51:06.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.081+0000 7f7cad59c700 1 -- 172.21.15.53:0/4269777581 learned_addr learned my addr 172.21.15.53:0/4269777581 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:06.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.081+0000 7f7cacd9b700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ca80b3ff0 0x7f7ca80cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.081+0000 7f7ca7fff700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ca80d0b10 0x7f7ca815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.081+0000 7f7cad59c700 1 -- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ca80b3ff0 msgr2=0x7f7ca80cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.081+0000 7f7cad59c700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ca80b3ff0 0x7f7ca80cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.081+0000 7f7cad59c700 1 -- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ca80d0b10 msgr2=0x7f7ca815f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.081+0000 7f7cad59c700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ca80d0b10 0x7f7ca815f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.081+0000 7f7cad59c700 1 -- 172.21.15.53:0/4269777581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c009550 con 0x7f7ca80d0f90 2023-07-09T21:51:06.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.081+0000 7f7cad59c700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca80d0f90 0x7f7ca80cdfd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000cba0 tx=0x7f7ca000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:06.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.081+0000 7f7ca57fa700 1 -- 172.21.15.53:0/4269777581 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0003c00 con 0x7f7ca80d0f90 2023-07-09T21:51:06.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.081+0000 7f7ca57fa700 1 -- 172.21.15.53:0/4269777581 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca0003d60 con 0x7f7ca80d0f90 2023-07-09T21:51:06.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.081+0000 7f7caefff700 1 -- 172.21.15.53:0/4269777581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca815ed30 con 0x7f7ca80d0f90 2023-07-09T21:51:06.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.082+0000 7f7ca57fa700 1 -- 172.21.15.53:0/4269777581 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca000aba0 con 0x7f7ca80d0f90 2023-07-09T21:51:06.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.082+0000 7f7caefff700 1 -- 172.21.15.53:0/4269777581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca815f2f0 con 0x7f7ca80d0f90 2023-07-09T21:51:06.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.083+0000 7f7caefff700 1 -- 172.21.15.53:0/4269777581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca8074350 con 0x7f7ca80d0f90 2023-07-09T21:51:06.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.084+0000 7f7ca57fa700 1 -- 172.21.15.53:0/4269777581 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ca000ad00 con 0x7f7ca80d0f90 2023-07-09T21:51:06.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.085+0000 7f7ca57fa700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7c8c06ace0 0x7f7c8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.085+0000 7f7ca57fa700 1 -- 172.21.15.53:0/4269777581 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7ca0089580 con 0x7f7ca80d0f90 2023-07-09T21:51:06.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.085+0000 7f7cacd9b700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7c8c06ace0 0x7f7c8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.086+0000 7f7cacd9b700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7c8c06ace0 0x7f7c8c06d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c000c00 tx=0x7f7c9c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:06.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.089+0000 7f7ca57fa700 1 -- 172.21.15.53:0/4269777581 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7ca00545e0 con 0x7f7ca80d0f90 2023-07-09T21:51:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.295+0000 7f7caefff700 1 -- 172.21.15.53:0/4269777581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ca815f4b0 con 0x7f7ca80d0f90 2023-07-09T21:51:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.296+0000 7f7ca57fa700 1 -- 172.21.15.53:0/4269777581 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ca0057c00 con 0x7f7ca80d0f90 2023-07-09T21:51:06.297 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:51:06.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.298+0000 7f7caefff700 1 -- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7c8c06ace0 msgr2=0x7f7c8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.298+0000 7f7caefff700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7c8c06ace0 0x7f7c8c06d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c000c00 tx=0x7f7c9c008030 comp rx=0 tx=0).stop 2023-07-09T21:51:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.298+0000 7f7caefff700 1 -- 172.21.15.53:0/4269777581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca80d0f90 msgr2=0x7f7ca80cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.298+0000 7f7caefff700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca80d0f90 0x7f7ca80cdfd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000cba0 tx=0x7f7ca000cf60 comp rx=0 tx=0).stop 2023-07-09T21:51:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.298+0000 7f7caefff700 1 -- 172.21.15.53:0/4269777581 shutdown_connections 2023-07-09T21:51:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.298+0000 7f7caefff700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7c8c06ace0 0x7f7c8c06d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.298+0000 7f7caefff700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca80d0f90 0x7f7ca80cdfd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.298+0000 7f7caefff700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ca80b3ff0 0x7f7ca80cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.298+0000 7f7caefff700 1 --2- 172.21.15.53:0/4269777581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ca80d0b10 0x7f7ca815f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.298+0000 7f7caefff700 1 -- 172.21.15.53:0/4269777581 >> 172.21.15.53:0/4269777581 conn(0x7f7ca809c1b0 msgr2=0x7f7ca80b8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:06.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.298+0000 7f7caefff700 1 -- 172.21.15.53:0/4269777581 shutdown_connections 2023-07-09T21:51:06.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.298+0000 7f7caefff700 1 -- 172.21.15.53:0/4269777581 wait complete. 2023-07-09T21:51:06.317 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:51:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.519+0000 7f3bb2dff700 1 Processor -- start 2023-07-09T21:51:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.519+0000 7f3bb2dff700 1 -- start start 2023-07-09T21:51:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.520+0000 7f3bb2dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3bac0b12f0 0x7f3bac0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.520+0000 7f3bb2dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3bac0adea0 0x7f3bac0c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.520+0000 7f3bb2dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bac0c9810 0x7f3bac06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.520+0000 7f3bb2dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bac15da60 con 0x7f3bac0adea0 2023-07-09T21:51:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.520+0000 7f3bb2dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bac15ce70 con 0x7f3bac0b12f0 2023-07-09T21:51:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.520+0000 7f3bb2dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0c9c30 con 0x7f3bac0c9810 2023-07-09T21:51:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.521+0000 7f3babfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3bac0adea0 0x7f3bac0c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.521+0000 7f3babfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3bac0adea0 0x7f3bac0c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37354/0 (socket says 172.21.15.53:37354) 2023-07-09T21:51:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.521+0000 7f3babfff700 1 -- 172.21.15.53:0/3924929738 learned_addr learned my addr 172.21.15.53:0/3924929738 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.521+0000 7f3bb139c700 1 --2- 172.21.15.53:0/3924929738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bac0c9810 0x7f3bac06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.521+0000 7f3bb0b9b700 1 --2- 172.21.15.53:0/3924929738 >> v2:172.21.15.184:3300/0 conn(0x7f3bac0b12f0 0x7f3bac0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.521+0000 7f3babfff700 1 -- 172.21.15.53:0/3924929738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bac0c9810 msgr2=0x7f3bac06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:06.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.521+0000 7f3babfff700 1 --2- 172.21.15.53:0/3924929738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bac0c9810 0x7f3bac06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.521+0000 7f3babfff700 1 -- 172.21.15.53:0/3924929738 >> v2:172.21.15.184:3300/0 conn(0x7f3bac0b12f0 msgr2=0x7f3bac0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:06.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.521+0000 7f3babfff700 1 --2- 172.21.15.53:0/3924929738 >> v2:172.21.15.184:3300/0 conn(0x7f3bac0b12f0 0x7f3bac0ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.521+0000 7f3babfff700 1 -- 172.21.15.53:0/3924929738 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac15d0c0 con 0x7f3bac0adea0 2023-07-09T21:51:06.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.521+0000 7f3babfff700 1 --2- 172.21.15.53:0/3924929738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bac0adea0 0x7f3bac0c92d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3bac06f630 tx=0x7f3b9800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb28be2a7320b32 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:06.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.522+0000 7f3bab7fe700 1 -- 172.21.15.53:0/3924929738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800dd30 con 0x7f3bac0adea0 2023-07-09T21:51:06.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.522+0000 7f3bab7fe700 1 -- 172.21.15.53:0/3924929738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9800de90 con 0x7f3bac0adea0 2023-07-09T21:51:06.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.522+0000 7f3bab7fe700 1 -- 172.21.15.53:0/3924929738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98010690 con 0x7f3bac0adea0 2023-07-09T21:51:06.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.522+0000 7f3bb2dff700 1 -- 172.21.15.53:0/3924929738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bac0adea0 msgr2=0x7f3bac0c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.522+0000 7f3bb2dff700 1 --2- 172.21.15.53:0/3924929738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bac0adea0 0x7f3bac0c92d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3bac06f630 tx=0x7f3b9800be70 comp rx=0 tx=0).stop 2023-07-09T21:51:06.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.522+0000 7f3bb2dff700 1 -- 172.21.15.53:0/3924929738 shutdown_connections 2023-07-09T21:51:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.522+0000 7f3bb2dff700 1 --2- 172.21.15.53:0/3924929738 >> v2:172.21.15.184:3300/0 conn(0x7f3bac0b12f0 0x7f3bac0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.522+0000 7f3bb2dff700 1 --2- 172.21.15.53:0/3924929738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bac0c9810 0x7f3bac06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.522+0000 7f3bb2dff700 1 --2- 172.21.15.53:0/3924929738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bac0adea0 0x7f3bac0c92d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.522+0000 7f3bb2dff700 1 -- 172.21.15.53:0/3924929738 >> 172.21.15.53:0/3924929738 conn(0x7f3bac0b05d0 msgr2=0x7f3bac0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:06.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.522+0000 7f3bb2dff700 1 -- 172.21.15.53:0/3924929738 shutdown_connections 2023-07-09T21:51:06.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.522+0000 7f3bb2dff700 1 -- 172.21.15.53:0/3924929738 wait complete. 2023-07-09T21:51:06.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.525+0000 7f3bb2dff700 1 Processor -- start 2023-07-09T21:51:06.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.525+0000 7f3bb2dff700 1 -- start start 2023-07-09T21:51:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.526+0000 7f3bb2dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bac0adea0 0x7f3bac1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.526+0000 7f3bb2dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bac0b12f0 0x7f3bac1554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.526+0000 7f3bb2dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bac0c9810 0x7f3bac155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.526+0000 7f3bb2dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac154500 con 0x7f3bac0b12f0 2023-07-09T21:51:06.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.526+0000 7f3bb2dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0ad140 con 0x7f3bac0c9810 2023-07-09T21:51:06.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.526+0000 7f3bb2dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac1528f0 con 0x7f3bac0adea0 2023-07-09T21:51:06.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.527+0000 7f3babfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bac0b12f0 0x7f3bac1554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.527+0000 7f3babfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bac0b12f0 0x7f3bac1554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37358/0 (socket says 172.21.15.53:37358) 2023-07-09T21:51:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.527+0000 7f3babfff700 1 -- 172.21.15.53:0/2163678650 learned_addr learned my addr 172.21.15.53:0/2163678650 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.527+0000 7f3bb0b9b700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bac0adea0 0x7f3bac1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.527+0000 7f3bb139c700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bac0c9810 0x7f3bac155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.527+0000 7f3babfff700 1 -- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bac0adea0 msgr2=0x7f3bac1523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.527+0000 7f3babfff700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bac0adea0 0x7f3bac1523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.527+0000 7f3babfff700 1 -- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bac0c9810 msgr2=0x7f3bac155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.527+0000 7f3babfff700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bac0c9810 0x7f3bac155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.527+0000 7f3babfff700 1 -- 172.21.15.53:0/2163678650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9800b7f0 con 0x7f3bac0b12f0 2023-07-09T21:51:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.527+0000 7f3bb139c700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bac0c9810 0x7f3bac155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.527+0000 7f3babfff700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bac0b12f0 0x7f3bac1554f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800beb0 tx=0x7f3b98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.528+0000 7f3ba97fa700 1 -- 172.21.15.53:0/2163678650 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98003c70 con 0x7f3bac0b12f0 2023-07-09T21:51:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.528+0000 7f3ba97fa700 1 -- 172.21.15.53:0/2163678650 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b98003dd0 con 0x7f3bac0b12f0 2023-07-09T21:51:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.528+0000 7f3bb2dff700 1 -- 172.21.15.53:0/2163678650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac153880 con 0x7f3bac0b12f0 2023-07-09T21:51:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.528+0000 7f3ba97fa700 1 -- 172.21.15.53:0/2163678650 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b980106b0 con 0x7f3bac0b12f0 2023-07-09T21:51:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.528+0000 7f3bb2dff700 1 -- 172.21.15.53:0/2163678650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac153e40 con 0x7f3bac0b12f0 2023-07-09T21:51:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.529+0000 7f3bb2dff700 1 -- 172.21.15.53:0/2163678650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac154640 con 0x7f3bac0b12f0 2023-07-09T21:51:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.530+0000 7f3ba97fa700 1 -- 172.21.15.53:0/2163678650 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b98019400 con 0x7f3bac0b12f0 2023-07-09T21:51:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.531+0000 7f3ba97fa700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f3b9006ace0 0x7f3b9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.531+0000 7f3ba97fa700 1 -- 172.21.15.53:0/2163678650 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3b9808a940 con 0x7f3bac0b12f0 2023-07-09T21:51:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.531+0000 7f3bb0b9b700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f3b9006ace0 0x7f3b9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.532+0000 7f3bb0b9b700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f3b9006ace0 0x7f3b9006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0cbc10 tx=0x7f3ba0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.535+0000 7f3ba97fa700 1 -- 172.21.15.53:0/2163678650 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3bac154640 con 0x7f3bac0b12f0 2023-07-09T21:51:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.743+0000 7f3bb2dff700 1 -- 172.21.15.53:0/2163678650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3bac154640 con 0x7f3bac0b12f0 2023-07-09T21:51:06.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.743+0000 7f3ba97fa700 1 -- 172.21.15.53:0/2163678650 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3bac154640 con 0x7f3bac0b12f0 2023-07-09T21:51:06.745 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:51:06.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.746+0000 7f3bb2dff700 1 -- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f3b9006ace0 msgr2=0x7f3b9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.746+0000 7f3bb2dff700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f3b9006ace0 0x7f3b9006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0cbc10 tx=0x7f3ba0008040 comp rx=0 tx=0).stop 2023-07-09T21:51:06.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.746+0000 7f3bb2dff700 1 -- 172.21.15.53:0/2163678650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bac0b12f0 msgr2=0x7f3bac1554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.746+0000 7f3bb2dff700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bac0b12f0 0x7f3bac1554f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800beb0 tx=0x7f3b98004750 comp rx=0 tx=0).stop 2023-07-09T21:51:06.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.746+0000 7f3bb2dff700 1 -- 172.21.15.53:0/2163678650 shutdown_connections 2023-07-09T21:51:06.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.746+0000 7f3bb2dff700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f3b9006ace0 0x7f3b9006d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.746+0000 7f3bb2dff700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bac0c9810 0x7f3bac155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.746+0000 7f3bb2dff700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bac0adea0 0x7f3bac1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.746+0000 7f3bb2dff700 1 --2- 172.21.15.53:0/2163678650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bac0b12f0 0x7f3bac1554f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.746+0000 7f3bb2dff700 1 -- 172.21.15.53:0/2163678650 >> 172.21.15.53:0/2163678650 conn(0x7f3bac0b05d0 msgr2=0x7f3bac0710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:06.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.746+0000 7f3bb2dff700 1 -- 172.21.15.53:0/2163678650 shutdown_connections 2023-07-09T21:51:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.746+0000 7f3bb2dff700 1 -- 172.21.15.53:0/2163678650 wait complete. 2023-07-09T21:51:06.765 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:51:06.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.966+0000 7f1e335ff700 1 Processor -- start 2023-07-09T21:51:06.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.966+0000 7f1e335ff700 1 -- start start 2023-07-09T21:51:06.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.968+0000 7f1e335ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e2c0b3ff0 0x7f1e2c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.968+0000 7f1e335ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1e2c0d0b10 0x7f1e2c0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.968+0000 7f1e335ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2c0b8e80 con 0x7f1e2c0b25d0 2023-07-09T21:51:06.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.968+0000 7f1e335ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2c0d14a0 con 0x7f1e2c0d0b10 2023-07-09T21:51:06.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.968+0000 7f1e335ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0b1e30 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.968+0000 7f1e31b9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1e2c0b25d0 0x7f1e2c0b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46004/0 (socket says 172.21.15.53:46004) 2023-07-09T21:51:06.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.968+0000 7f1e31b9c700 1 -- 172.21.15.53:0/737623682 learned_addr learned my addr 172.21.15.53:0/737623682 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:06.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.968+0000 7f1e3139b700 1 --2- 172.21.15.53:0/737623682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e2c0b3ff0 0x7f1e2c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.968+0000 7f1e30b9a700 1 --2- 172.21.15.53:0/737623682 >> v2:172.21.15.184:3300/0 conn(0x7f1e2c0d0b10 0x7f1e2c0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.968+0000 7f1e23fff700 1 -- 172.21.15.53:0/737623682 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264774519 0 0) 0x7f1e24001490 con 0x7f1e2c0b25d0 2023-07-09T21:51:06.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.968+0000 7f1e23fff700 1 -- 172.21.15.53:0/737623682 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e180035b0 con 0x7f1e2c0b25d0 2023-07-09T21:51:06.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.969+0000 7f1e3139b700 1 -- 172.21.15.53:0/737623682 >> v2:172.21.15.184:3300/0 conn(0x7f1e2c0d0b10 msgr2=0x7f1e2c0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:06.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.969+0000 7f1e3139b700 1 --2- 172.21.15.53:0/737623682 >> v2:172.21.15.184:3300/0 conn(0x7f1e2c0d0b10 0x7f1e2c0d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.969+0000 7f1e3139b700 1 -- 172.21.15.53:0/737623682 >> v1:172.21.15.53:6789/0 conn(0x7f1e2c0b25d0 legacy=0x7f1e2c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.969+0000 7f1e3139b700 1 -- 172.21.15.53:0/737623682 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c0afaa0 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.969+0000 7f1e30b9a700 1 --2- 172.21.15.53:0/737623682 >> v2:172.21.15.184:3300/0 conn(0x7f1e2c0d0b10 0x7f1e2c0d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:06.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.969+0000 7f1e3139b700 1 --2- 172.21.15.53:0/737623682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e2c0b3ff0 0x7f1e2c0b43c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1e28009840 tx=0x7f1e28009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e27629d16d91c3d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:06.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.970+0000 7f1e23fff700 1 -- 172.21.15.53:0/737623682 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28011830 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.970+0000 7f1e23fff700 1 -- 172.21.15.53:0/737623682 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e28011990 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.970+0000 7f1e23fff700 1 -- 172.21.15.53:0/737623682 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28011d20 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.970+0000 7f1e335ff700 1 -- 172.21.15.53:0/737623682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e2c0b3ff0 msgr2=0x7f1e2c0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.970+0000 7f1e335ff700 1 --2- 172.21.15.53:0/737623682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e2c0b3ff0 0x7f1e2c0b43c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1e28009840 tx=0x7f1e28009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:06.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.970+0000 7f1e335ff700 1 -- 172.21.15.53:0/737623682 shutdown_connections 2023-07-09T21:51:06.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.970+0000 7f1e335ff700 1 --2- 172.21.15.53:0/737623682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e2c0b3ff0 0x7f1e2c0b43c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.970+0000 7f1e335ff700 1 --2- 172.21.15.53:0/737623682 >> v2:172.21.15.184:3300/0 conn(0x7f1e2c0d0b10 0x7f1e2c0d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.970+0000 7f1e335ff700 1 -- 172.21.15.53:0/737623682 >> 172.21.15.53:0/737623682 conn(0x7f1e2c09c1b0 msgr2=0x7f1e2c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:06.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.970+0000 7f1e335ff700 1 -- 172.21.15.53:0/737623682 shutdown_connections 2023-07-09T21:51:06.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.971+0000 7f1e335ff700 1 -- 172.21.15.53:0/737623682 wait complete. 2023-07-09T21:51:06.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.972+0000 7f1e335ff700 1 Processor -- start 2023-07-09T21:51:06.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.972+0000 7f1e335ff700 1 -- start start 2023-07-09T21:51:06.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.973+0000 7f1e335ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e2c0b25d0 0x7f1e2c1f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.973+0000 7f1e335ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2c0b3ff0 0x7f1e2c1f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.973+0000 7f1e335ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e2c0d0b10 0x7f1e2c0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.973+0000 7f1e335ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0ce5a0 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.973+0000 7f1e335ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0a0ae0 con 0x7f1e2c0d0b10 2023-07-09T21:51:06.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.973+0000 7f1e335ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0cadb0 con 0x7f1e2c0b25d0 2023-07-09T21:51:06.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.973+0000 7f1e30b9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2c0b3ff0 0x7f1e2c1f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.974+0000 7f1e30b9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2c0b3ff0 0x7f1e2c1f5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37368/0 (socket says 172.21.15.53:37368) 2023-07-09T21:51:06.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.974+0000 7f1e30b9a700 1 -- 172.21.15.53:0/730667378 learned_addr learned my addr 172.21.15.53:0/730667378 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.974+0000 7f1e31b9c700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e2c0d0b10 0x7f1e2c0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.974+0000 7f1e3139b700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e2c0b25d0 0x7f1e2c1f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.974+0000 7f1e30b9a700 1 -- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e2c0b25d0 msgr2=0x7f1e2c1f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.974+0000 7f1e30b9a700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e2c0b25d0 0x7f1e2c1f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.974+0000 7f1e30b9a700 1 -- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e2c0d0b10 msgr2=0x7f1e2c0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.974+0000 7f1e30b9a700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e2c0d0b10 0x7f1e2c0ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.974+0000 7f1e30b9a700 1 -- 172.21.15.53:0/730667378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0094a0 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.974+0000 7f1e31b9c700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e2c0d0b10 0x7f1e2c0ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:06.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.974+0000 7f1e3139b700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e2c0b25d0 0x7f1e2c1f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:06.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.974+0000 7f1e30b9a700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2c0b3ff0 0x7f1e2c1f5820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00ebe0 tx=0x7f1e1c009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:06.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.975+0000 7f1e21ffb700 1 -- 172.21.15.53:0/730667378 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00c8b0 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.975+0000 7f1e21ffb700 1 -- 172.21.15.53:0/730667378 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c00ca10 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.975+0000 7f1e21ffb700 1 -- 172.21.15.53:0/730667378 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00cda0 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.975+0000 7f1e335ff700 1 -- 172.21.15.53:0/730667378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e280094a0 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.975+0000 7f1e335ff700 1 -- 172.21.15.53:0/730667378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2c0cb370 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.976+0000 7f1e335ff700 1 -- 172.21.15.53:0/730667378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c074350 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.977+0000 7f1e21ffb700 1 -- 172.21.15.53:0/730667378 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e1c013470 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.978+0000 7f1e21ffb700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e1006ace0 0x7f1e1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.978+0000 7f1e21ffb700 1 -- 172.21.15.53:0/730667378 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1e1c089700 con 0x7f1e2c0b3ff0 2023-07-09T21:51:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.979+0000 7f1e3139b700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e1006ace0 0x7f1e1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.979+0000 7f1e3139b700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e1006ace0 0x7f1e1006d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e28000c00 tx=0x7f1e28008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:06.983+0000 7f1e21ffb700 1 -- 172.21.15.53:0/730667378 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1e1c0546d0 con 0x7f1e2c0b3ff0 2023-07-09T21:51:07.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.189+0000 7f1e335ff700 1 -- 172.21.15.53:0/730667378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e2c0b6ea0 con 0x7f1e2c0b3ff0 2023-07-09T21:51:07.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.190+0000 7f1e21ffb700 1 -- 172.21.15.53:0/730667378 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e1c057cf0 con 0x7f1e2c0b3ff0 2023-07-09T21:51:07.191 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:51:07.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.192+0000 7f1e335ff700 1 -- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e1006ace0 msgr2=0x7f1e1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:07.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.192+0000 7f1e335ff700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e1006ace0 0x7f1e1006d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e28000c00 tx=0x7f1e28008030 comp rx=0 tx=0).stop 2023-07-09T21:51:07.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.192+0000 7f1e335ff700 1 -- 172.21.15.53:0/730667378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2c0b3ff0 msgr2=0x7f1e2c1f5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:07.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.192+0000 7f1e335ff700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2c0b3ff0 0x7f1e2c1f5820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00ebe0 tx=0x7f1e1c009e20 comp rx=0 tx=0).stop 2023-07-09T21:51:07.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.192+0000 7f1e335ff700 1 -- 172.21.15.53:0/730667378 shutdown_connections 2023-07-09T21:51:07.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.192+0000 7f1e335ff700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e1006ace0 0x7f1e1006d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.192+0000 7f1e335ff700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e2c0d0b10 0x7f1e2c0ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.192+0000 7f1e335ff700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e2c0b25d0 0x7f1e2c1f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.192+0000 7f1e335ff700 1 --2- 172.21.15.53:0/730667378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2c0b3ff0 0x7f1e2c1f5820 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.192+0000 7f1e335ff700 1 -- 172.21.15.53:0/730667378 >> 172.21.15.53:0/730667378 conn(0x7f1e2c09c1b0 msgr2=0x7f1e2c0b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:07.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.192+0000 7f1e335ff700 1 -- 172.21.15.53:0/730667378 shutdown_connections 2023-07-09T21:51:07.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.192+0000 7f1e335ff700 1 -- 172.21.15.53:0/730667378 wait complete. 2023-07-09T21:51:07.212 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:51:07.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.414+0000 7fd2d73ff700 1 Processor -- start 2023-07-09T21:51:07.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.414+0000 7fd2d73ff700 1 -- start start 2023-07-09T21:51:07.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.415+0000 7fd2d73ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2d00d1220 0x7fd2d00b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:07.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.415+0000 7fd2d73ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2d00b0e20 0x7fd2d00b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:07.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.415+0000 7fd2d73ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d00b8e80 con 0x7fd2d00b3ff0 2023-07-09T21:51:07.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.415+0000 7fd2d73ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d00afaa0 con 0x7fd2d00b0e20 2023-07-09T21:51:07.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.415+0000 7fd2d73ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d00afd80 con 0x7fd2d00d1220 2023-07-09T21:51:07.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.415+0000 7fd2d599c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2d00b0e20 0x7fd2d00b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:07.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.416+0000 7fd2d599c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2d00b0e20 0x7fd2d00b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37378/0 (socket says 172.21.15.53:37378) 2023-07-09T21:51:07.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.416+0000 7fd2d599c700 1 -- 172.21.15.53:0/1065235846 learned_addr learned my addr 172.21.15.53:0/1065235846 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:07.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.416+0000 7fd2d499a700 1 --2- 172.21.15.53:0/1065235846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2d00d1220 0x7fd2d00b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:07.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.416+0000 7fd2d599c700 1 -- 172.21.15.53:0/1065235846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2d00d1220 msgr2=0x7fd2d00b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:07.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.416+0000 7fd2d599c700 1 --2- 172.21.15.53:0/1065235846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2d00d1220 0x7fd2d00b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.416+0000 7fd2d599c700 1 -- 172.21.15.53:0/1065235846 >> v1:172.21.15.184:6789/0 conn(0x7fd2d00b3ff0 legacy=0x7fd2d00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:07.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.416+0000 7fd2d599c700 1 -- 172.21.15.53:0/1065235846 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d00b0060 con 0x7fd2d00b0e20 2023-07-09T21:51:07.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.416+0000 7fd2d599c700 1 --2- 172.21.15.53:0/1065235846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2d00b0e20 0x7fd2d00b1280 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009e50 tx=0x7fd2c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48cc029b708d720 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:07.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.416+0000 7fd2c7fff700 1 -- 172.21.15.53:0/1065235846 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c800e070 con 0x7fd2d00b0e20 2023-07-09T21:51:07.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.416+0000 7fd2c7fff700 1 -- 172.21.15.53:0/1065235846 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c8003a20 con 0x7fd2d00b0e20 2023-07-09T21:51:07.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.416+0000 7fd2c7fff700 1 -- 172.21.15.53:0/1065235846 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8003dd0 con 0x7fd2d00b0e20 2023-07-09T21:51:07.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.417+0000 7fd2d73ff700 1 -- 172.21.15.53:0/1065235846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2d00b0e20 msgr2=0x7fd2d00b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:07.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.417+0000 7fd2d73ff700 1 --2- 172.21.15.53:0/1065235846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2d00b0e20 0x7fd2d00b1280 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009e50 tx=0x7fd2c800b330 comp rx=0 tx=0).stop 2023-07-09T21:51:07.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.417+0000 7fd2d73ff700 1 -- 172.21.15.53:0/1065235846 shutdown_connections 2023-07-09T21:51:07.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.417+0000 7fd2d73ff700 1 --2- 172.21.15.53:0/1065235846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2d00b0e20 0x7fd2d00b1280 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.417+0000 7fd2d73ff700 1 --2- 172.21.15.53:0/1065235846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2d00d1220 0x7fd2d00b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.417+0000 7fd2d73ff700 1 -- 172.21.15.53:0/1065235846 >> 172.21.15.53:0/1065235846 conn(0x7fd2d009c1b0 msgr2=0x7fd2d00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:07.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.417+0000 7fd2d73ff700 1 -- 172.21.15.53:0/1065235846 shutdown_connections 2023-07-09T21:51:07.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.417+0000 7fd2d73ff700 1 -- 172.21.15.53:0/1065235846 wait complete. 2023-07-09T21:51:07.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.419+0000 7fd2d73ff700 1 Processor -- start 2023-07-09T21:51:07.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.420+0000 7fd2d73ff700 1 -- start start 2023-07-09T21:51:07.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.421+0000 7fd2d73ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2d00b0e20 0x7fd2d00d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:07.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.421+0000 7fd2d73ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2d00b3ff0 0x7fd2d015bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:07.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.421+0000 7fd2d73ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d00d1220 0x7fd2d00ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:07.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.421+0000 7fd2d73ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d01f5c10 con 0x7fd2d00b0e20 2023-07-09T21:51:07.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.421+0000 7fd2d73ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d01f5ef0 con 0x7fd2d00d1220 2023-07-09T21:51:07.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.421+0000 7fd2d73ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d01f61d0 con 0x7fd2d00b3ff0 2023-07-09T21:51:07.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.421+0000 7fd2d519b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2d00b0e20 0x7fd2d00d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:07.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.421+0000 7fd2d519b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2d00b0e20 0x7fd2d00d0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37386/0 (socket says 172.21.15.53:37386) 2023-07-09T21:51:07.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.421+0000 7fd2d519b700 1 -- 172.21.15.53:0/2728841304 learned_addr learned my addr 172.21.15.53:0/2728841304 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:07.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.421+0000 7fd2d599c700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d00d1220 0x7fd2d00ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:07.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.421+0000 7fd2d499a700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2d00b3ff0 0x7fd2d015bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:07.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.422+0000 7fd2d519b700 1 -- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2d00b3ff0 msgr2=0x7fd2d015bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:07.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.422+0000 7fd2d519b700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2d00b3ff0 0x7fd2d015bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.422+0000 7fd2d519b700 1 -- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d00d1220 msgr2=0x7fd2d00ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:07.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.422+0000 7fd2d519b700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d00d1220 0x7fd2d00ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.422+0000 7fd2d519b700 1 -- 172.21.15.53:0/2728841304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c8009b30 con 0x7fd2d00b0e20 2023-07-09T21:51:07.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.422+0000 7fd2d599c700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d00d1220 0x7fd2d00ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.422+0000 7fd2d499a700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2d00b3ff0 0x7fd2d015bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.422+0000 7fd2d519b700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2d00b0e20 0x7fd2d00d0090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c4d0 tx=0x7fd2cc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.422+0000 7fd2c5ffb700 1 -- 172.21.15.53:0/2728841304 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc011790 con 0x7fd2d00b0e20 2023-07-09T21:51:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.422+0000 7fd2c5ffb700 1 -- 172.21.15.53:0/2728841304 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc0118f0 con 0x7fd2d00b0e20 2023-07-09T21:51:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.422+0000 7fd2c5ffb700 1 -- 172.21.15.53:0/2728841304 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc011ca0 con 0x7fd2d00b0e20 2023-07-09T21:51:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.422+0000 7fd2d73ff700 1 -- 172.21.15.53:0/2728841304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d01f64b0 con 0x7fd2d00b0e20 2023-07-09T21:51:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.422+0000 7fd2d73ff700 1 -- 172.21.15.53:0/2728841304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d015c330 con 0x7fd2d00b0e20 2023-07-09T21:51:07.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.423+0000 7fd2d73ff700 1 -- 172.21.15.53:0/2728841304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d0074350 con 0x7fd2d00b0e20 2023-07-09T21:51:07.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.424+0000 7fd2c5ffb700 1 -- 172.21.15.53:0/2728841304 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd2cc01c460 con 0x7fd2d00b0e20 2023-07-09T21:51:07.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.425+0000 7fd2c5ffb700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd2b406ace0 0x7fd2b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:07.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.425+0000 7fd2c5ffb700 1 -- 172.21.15.53:0/2728841304 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd2cc089410 con 0x7fd2d00b0e20 2023-07-09T21:51:07.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.426+0000 7fd2d499a700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd2b406ace0 0x7fd2b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:07.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.426+0000 7fd2d499a700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd2b406ace0 0x7fd2b406d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd2d015f800 tx=0x7fd2c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:07.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.430+0000 7fd2c5ffb700 1 -- 172.21.15.53:0/2728841304 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd2cc0543e0 con 0x7fd2d00b0e20 2023-07-09T21:51:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.636+0000 7fd2d73ff700 1 -- 172.21.15.53:0/2728841304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2d00b08d0 con 0x7fd2d00b0e20 2023-07-09T21:51:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.636+0000 7fd2c5ffb700 1 -- 172.21.15.53:0/2728841304 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2cc057a00 con 0x7fd2d00b0e20 2023-07-09T21:51:07.638 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:51:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.639+0000 7fd2d73ff700 1 -- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd2b406ace0 msgr2=0x7fd2b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.639+0000 7fd2d73ff700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd2b406ace0 0x7fd2b406d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd2d015f800 tx=0x7fd2c0008040 comp rx=0 tx=0).stop 2023-07-09T21:51:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.639+0000 7fd2d73ff700 1 -- 172.21.15.53:0/2728841304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2d00b0e20 msgr2=0x7fd2d00d0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.639+0000 7fd2d73ff700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2d00b0e20 0x7fd2d00d0090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c4d0 tx=0x7fd2cc00c890 comp rx=0 tx=0).stop 2023-07-09T21:51:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.639+0000 7fd2d73ff700 1 -- 172.21.15.53:0/2728841304 shutdown_connections 2023-07-09T21:51:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.639+0000 7fd2d73ff700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd2b406ace0 0x7fd2b406d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.639+0000 7fd2d73ff700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d00d1220 0x7fd2d00ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.639+0000 7fd2d73ff700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2d00b0e20 0x7fd2d00d0090 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.639+0000 7fd2d73ff700 1 --2- 172.21.15.53:0/2728841304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2d00b3ff0 0x7fd2d015bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.639+0000 7fd2d73ff700 1 -- 172.21.15.53:0/2728841304 >> 172.21.15.53:0/2728841304 conn(0x7fd2d009c1b0 msgr2=0x7fd2d00c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:07.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.639+0000 7fd2d73ff700 1 -- 172.21.15.53:0/2728841304 shutdown_connections 2023-07-09T21:51:07.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.639+0000 7fd2d73ff700 1 -- 172.21.15.53:0/2728841304 wait complete. 2023-07-09T21:51:07.659 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:07.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.858+0000 7f387d1ff700 1 Processor -- start 2023-07-09T21:51:07.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.858+0000 7f387d1ff700 1 -- start start 2023-07-09T21:51:07.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.860+0000 7f387d1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f38780b1e00 0x7f38780b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:07.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.860+0000 7f387d1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38780b2350 0x7f38780d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:07.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.860+0000 7f387d1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38780d14a0 con 0x7f38780d1050 2023-07-09T21:51:07.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.860+0000 7f387d1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38780d2ce0 con 0x7f38780b1e00 2023-07-09T21:51:07.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.860+0000 7f387d1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38780b3350 con 0x7f38780b2350 2023-07-09T21:51:07.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.860+0000 7f3876d9d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f38780b1e00 0x7f38780b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:07.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.860+0000 7f3876d9d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f38780b1e00 0x7f38780b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:33242/0 (socket says 172.21.15.53:33242) 2023-07-09T21:51:07.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.860+0000 7f3876d9d700 1 -- 172.21.15.53:0/3068016367 learned_addr learned my addr 172.21.15.53:0/3068016367 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:07.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.861+0000 7f387659c700 1 --2- 172.21.15.53:0/3068016367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38780b2350 0x7f38780d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:07.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.861+0000 7f3876d9d700 1 -- 172.21.15.53:0/3068016367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38780b2350 msgr2=0x7f38780d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:07.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.861+0000 7f3876d9d700 1 --2- 172.21.15.53:0/3068016367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38780b2350 0x7f38780d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.861+0000 7f3876d9d700 1 -- 172.21.15.53:0/3068016367 >> v1:172.21.15.184:6789/0 conn(0x7f38780d1050 legacy=0x7f38780afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:07.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.861+0000 7f3876d9d700 1 -- 172.21.15.53:0/3068016367 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38780b3630 con 0x7f38780b1e00 2023-07-09T21:51:07.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.861+0000 7f3875d9b700 1 -- 172.21.15.53:0/3068016367 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267103176 0 0) 0x7f3870001490 con 0x7f38780d1050 2023-07-09T21:51:07.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.861+0000 7f3876d9d700 1 --2- 172.21.15.53:0/3068016367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38780b1e00 0x7f38780b43f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3868006fd0 tx=0x7f3868009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5d5fe0070d96b89 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:07.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.861+0000 7f3875d9b700 1 -- 172.21.15.53:0/3068016367 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868005e30 con 0x7f38780b1e00 2023-07-09T21:51:07.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.862+0000 7f3875d9b700 1 -- 172.21.15.53:0/3068016367 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3868004030 con 0x7f38780b1e00 2023-07-09T21:51:07.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.862+0000 7f3875d9b700 1 -- 172.21.15.53:0/3068016367 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38680043e0 con 0x7f38780b1e00 2023-07-09T21:51:07.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.862+0000 7f387d1ff700 1 -- 172.21.15.53:0/3068016367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38780b1e00 msgr2=0x7f38780b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:07.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.862+0000 7f387d1ff700 1 --2- 172.21.15.53:0/3068016367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38780b1e00 0x7f38780b43f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3868006fd0 tx=0x7f3868009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.862+0000 7f387d1ff700 1 -- 172.21.15.53:0/3068016367 shutdown_connections 2023-07-09T21:51:07.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.862+0000 7f387d1ff700 1 --2- 172.21.15.53:0/3068016367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38780b1e00 0x7f38780b43f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.862+0000 7f387d1ff700 1 --2- 172.21.15.53:0/3068016367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38780b2350 0x7f38780d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.862+0000 7f387d1ff700 1 -- 172.21.15.53:0/3068016367 >> 172.21.15.53:0/3068016367 conn(0x7f387809c1d0 msgr2=0x7f38780d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:07.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.862+0000 7f387d1ff700 1 -- 172.21.15.53:0/3068016367 shutdown_connections 2023-07-09T21:51:07.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.862+0000 7f387d1ff700 1 -- 172.21.15.53:0/3068016367 wait complete. 2023-07-09T21:51:07.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.864+0000 7f387d1ff700 1 Processor -- start 2023-07-09T21:51:07.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.864+0000 7f387d1ff700 1 -- start start 2023-07-09T21:51:07.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.865+0000 7f387d1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38780b1e00 0x7f38780ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:07.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.865+0000 7f387d1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38780b2350 0x7f38780cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:07.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.865+0000 7f387d1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38780d1050 0x7f38780d0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:07.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.865+0000 7f387d1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38780c8570 con 0x7f38780b1e00 2023-07-09T21:51:07.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.865+0000 7f387d1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38780c8850 con 0x7f38780b2350 2023-07-09T21:51:07.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.865+0000 7f387d1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38780c8b30 con 0x7f38780d1050 2023-07-09T21:51:07.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.865+0000 7f3876d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38780b1e00 0x7f38780ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:07.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.865+0000 7f3876d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38780b1e00 0x7f38780ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37402/0 (socket says 172.21.15.53:37402) 2023-07-09T21:51:07.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.865+0000 7f3876d9d700 1 -- 172.21.15.53:0/2523318549 learned_addr learned my addr 172.21.15.53:0/2523318549 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:07.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.865+0000 7f387659c700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38780b2350 0x7f38780cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:07.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.865+0000 7f387759e700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38780d1050 0x7f38780d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:07.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.866+0000 7f3876d9d700 1 -- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38780d1050 msgr2=0x7f38780d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:07.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.866+0000 7f3876d9d700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38780d1050 0x7f38780d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.866+0000 7f3876d9d700 1 -- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38780b2350 msgr2=0x7f38780cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:07.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.866+0000 7f3876d9d700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38780b2350 0x7f38780cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:07.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.866+0000 7f3876d9d700 1 -- 172.21.15.53:0/2523318549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3868009500 con 0x7f38780b1e00 2023-07-09T21:51:07.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.866+0000 7f3876d9d700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38780b1e00 0x7f38780ca010 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3868000c00 tx=0x7f3868004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:07.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.866+0000 7f385f7fe700 1 -- 172.21.15.53:0/2523318549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868003ce0 con 0x7f38780b1e00 2023-07-09T21:51:07.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.866+0000 7f385f7fe700 1 -- 172.21.15.53:0/2523318549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3868003e60 con 0x7f38780b1e00 2023-07-09T21:51:07.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.866+0000 7f387d1ff700 1 -- 172.21.15.53:0/2523318549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38780c8e10 con 0x7f38780b1e00 2023-07-09T21:51:07.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.866+0000 7f385f7fe700 1 -- 172.21.15.53:0/2523318549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868011660 con 0x7f38780b1e00 2023-07-09T21:51:07.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.866+0000 7f387d1ff700 1 -- 172.21.15.53:0/2523318549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38780ca710 con 0x7f38780b1e00 2023-07-09T21:51:07.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.868+0000 7f387d1ff700 1 -- 172.21.15.53:0/2523318549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38780c86b0 con 0x7f38780b1e00 2023-07-09T21:51:07.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.868+0000 7f385f7fe700 1 -- 172.21.15.53:0/2523318549 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38680117c0 con 0x7f38780b1e00 2023-07-09T21:51:07.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.869+0000 7f385f7fe700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f386406ace0 0x7f386406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:07.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.869+0000 7f385f7fe700 1 -- 172.21.15.53:0/2523318549 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f386808a9c0 con 0x7f38780b1e00 2023-07-09T21:51:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.870+0000 7f387659c700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f386406ace0 0x7f386406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.872+0000 7f387659c700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f386406ace0 0x7f386406d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38781472a0 tx=0x7f386c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:07.874+0000 7f385f7fe700 1 -- 172.21.15.53:0/2523318549 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f38780c86b0 con 0x7f38780b1e00 2023-07-09T21:51:08.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.084+0000 7f387d1ff700 1 -- 172.21.15.53:0/2523318549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38780c86b0 con 0x7f38780b1e00 2023-07-09T21:51:08.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.086+0000 7f385f7fe700 1 -- 172.21.15.53:0/2523318549 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f38780c86b0 con 0x7f38780b1e00 2023-07-09T21:51:08.087 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:08.088 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:04.650456+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:08.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.088+0000 7f387d1ff700 1 -- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f386406ace0 msgr2=0x7f386406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.088+0000 7f387d1ff700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f386406ace0 0x7f386406d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38781472a0 tx=0x7f386c008040 comp rx=0 tx=0).stop 2023-07-09T21:51:08.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.088+0000 7f387d1ff700 1 -- 172.21.15.53:0/2523318549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38780b1e00 msgr2=0x7f38780ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.088+0000 7f387d1ff700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38780b1e00 0x7f38780ca010 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3868000c00 tx=0x7f3868004750 comp rx=0 tx=0).stop 2023-07-09T21:51:08.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.088+0000 7f387d1ff700 1 -- 172.21.15.53:0/2523318549 shutdown_connections 2023-07-09T21:51:08.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.088+0000 7f387d1ff700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f386406ace0 0x7f386406d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.088+0000 7f387d1ff700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38780d1050 0x7f38780d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.088+0000 7f387d1ff700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38780b1e00 0x7f38780ca010 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.088+0000 7f387d1ff700 1 --2- 172.21.15.53:0/2523318549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38780b2350 0x7f38780cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.088+0000 7f387d1ff700 1 -- 172.21.15.53:0/2523318549 >> 172.21.15.53:0/2523318549 conn(0x7f387809c1d0 msgr2=0x7f38780b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:08.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.088+0000 7f387d1ff700 1 -- 172.21.15.53:0/2523318549 shutdown_connections 2023-07-09T21:51:08.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.088+0000 7f387d1ff700 1 -- 172.21.15.53:0/2523318549 wait complete. 2023-07-09T21:51:08.108 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:50:21.703759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:50:22.243698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:51:08.109 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:51:08.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.311+0000 7f1e211ff700 1 Processor -- start 2023-07-09T21:51:08.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.311+0000 7f1e211ff700 1 -- start start 2023-07-09T21:51:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.313+0000 7f1e211ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e1c1653c0 0x7f1e1c1677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.313+0000 7f1e211ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c0d2260 con 0x7f1e1c15c860 2023-07-09T21:51:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.313+0000 7f1e211ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c15cd00 con 0x7f1e1c0cf2a0 2023-07-09T21:51:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.313+0000 7f1e211ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c146740 con 0x7f1e1c1653c0 2023-07-09T21:51:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.313+0000 7f1e13fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1e1c15c860 0x7f1e1c0c71b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46008/0 (socket says 172.21.15.53:46008) 2023-07-09T21:51:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.313+0000 7f1e13fff700 1 -- 172.21.15.53:0/1468531602 learned_addr learned my addr 172.21.15.53:0/1468531602 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.313+0000 7f1e1b59e700 1 --2- 172.21.15.53:0/1468531602 >> v2:172.21.15.53:3300/0 conn(0x7f1e1c1653c0 0x7f1e1c1677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.313+0000 7f1e1a59c700 1 -- 172.21.15.53:0/1468531602 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278510731 0 0) 0x7f1e1c0d2260 con 0x7f1e1c15c860 2023-07-09T21:51:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.313+0000 7f1e1a59c700 1 -- 172.21.15.53:0/1468531602 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e080035b0 con 0x7f1e1c15c860 2023-07-09T21:51:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.313+0000 7f1e1b59e700 1 -- 172.21.15.53:0/1468531602 >> v1:172.21.15.184:6789/0 conn(0x7f1e1c0cf2a0 legacy=0x7f1e1c0c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.314+0000 7f1e1b59e700 1 -- 172.21.15.53:0/1468531602 >> v1:172.21.15.53:6789/0 conn(0x7f1e1c15c860 legacy=0x7f1e1c0c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.314+0000 7f1e1b59e700 1 -- 172.21.15.53:0/1468531602 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0cd5a0 con 0x7f1e1c1653c0 2023-07-09T21:51:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.314+0000 7f1e1b59e700 1 --2- 172.21.15.53:0/1468531602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c1653c0 0x7f1e1c1677a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009d90 tx=0x7f1e1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb0bb1c18d921ae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.314+0000 7f1e1a59c700 1 -- 172.21.15.53:0/1468531602 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400e070 con 0x7f1e1c1653c0 2023-07-09T21:51:08.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.314+0000 7f1e1a59c700 1 -- 172.21.15.53:0/1468531602 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1400bb20 con 0x7f1e1c1653c0 2023-07-09T21:51:08.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.314+0000 7f1e1a59c700 1 -- 172.21.15.53:0/1468531602 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14012430 con 0x7f1e1c1653c0 2023-07-09T21:51:08.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.315+0000 7f1e211ff700 1 -- 172.21.15.53:0/1468531602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c1653c0 msgr2=0x7f1e1c1677a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.315+0000 7f1e211ff700 1 --2- 172.21.15.53:0/1468531602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c1653c0 0x7f1e1c1677a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009d90 tx=0x7f1e1400b330 comp rx=0 tx=0).stop 2023-07-09T21:51:08.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.315+0000 7f1e211ff700 1 -- 172.21.15.53:0/1468531602 shutdown_connections 2023-07-09T21:51:08.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.315+0000 7f1e211ff700 1 --2- 172.21.15.53:0/1468531602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c1653c0 0x7f1e1c1677a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.315+0000 7f1e211ff700 1 -- 172.21.15.53:0/1468531602 >> 172.21.15.53:0/1468531602 conn(0x7f1e1c065bd0 msgr2=0x7f1e1c065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:08.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.315+0000 7f1e211ff700 1 -- 172.21.15.53:0/1468531602 shutdown_connections 2023-07-09T21:51:08.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.315+0000 7f1e211ff700 1 -- 172.21.15.53:0/1468531602 wait complete. 2023-07-09T21:51:08.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.317+0000 7f1e211ff700 1 Processor -- start 2023-07-09T21:51:08.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.317+0000 7f1e211ff700 1 -- start start 2023-07-09T21:51:08.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e211ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e1c0cf2a0 0x7f1e1c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:08.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e211ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c15c860 0x7f1e1c0d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:08.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e211ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e1c1653c0 0x7f1e1c0d37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:08.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e211ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c15def0 con 0x7f1e1c15c860 2023-07-09T21:51:08.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e211ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0ccaa0 con 0x7f1e1c1653c0 2023-07-09T21:51:08.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e211ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c15d270 con 0x7f1e1c0cf2a0 2023-07-09T21:51:08.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e13fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c15c860 0x7f1e1c0d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:08.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e13fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c15c860 0x7f1e1c0d32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37414/0 (socket says 172.21.15.53:37414) 2023-07-09T21:51:08.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e13fff700 1 -- 172.21.15.53:0/4232990403 learned_addr learned my addr 172.21.15.53:0/4232990403 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:08.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e1b59e700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e1c1653c0 0x7f1e1c0d37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:08.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e1ad9d700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e1c0cf2a0 0x7f1e1c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:08.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e13fff700 1 -- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e1c0cf2a0 msgr2=0x7f1e1c0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e13fff700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e1c0cf2a0 0x7f1e1c0ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e13fff700 1 -- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e1c1653c0 msgr2=0x7f1e1c0d37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e13fff700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e1c1653c0 0x7f1e1c0d37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.318+0000 7f1e13fff700 1 -- 172.21.15.53:0/4232990403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e14009a70 con 0x7f1e1c15c860 2023-07-09T21:51:08.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.319+0000 7f1e13fff700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c15c860 0x7f1e1c0d32b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400c700 tx=0x7f1e0400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:08.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.319+0000 7f1e137fe700 1 -- 172.21.15.53:0/4232990403 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04005d70 con 0x7f1e1c15c860 2023-07-09T21:51:08.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.319+0000 7f1e137fe700 1 -- 172.21.15.53:0/4232990403 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e040070d0 con 0x7f1e1c15c860 2023-07-09T21:51:08.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.319+0000 7f1e137fe700 1 -- 172.21.15.53:0/4232990403 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04007460 con 0x7f1e1c15c860 2023-07-09T21:51:08.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.319+0000 7f1e211ff700 1 -- 172.21.15.53:0/4232990403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c15d550 con 0x7f1e1c15c860 2023-07-09T21:51:08.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.319+0000 7f1e211ff700 1 -- 172.21.15.53:0/4232990403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c15db10 con 0x7f1e1c15c860 2023-07-09T21:51:08.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.320+0000 7f1e211ff700 1 -- 172.21.15.53:0/4232990403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c15e030 con 0x7f1e1c15c860 2023-07-09T21:51:08.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.321+0000 7f1e137fe700 1 -- 172.21.15.53:0/4232990403 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e040075c0 con 0x7f1e1c15c860 2023-07-09T21:51:08.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.322+0000 7f1e137fe700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1dfc06ace0 0x7f1dfc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:08.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.322+0000 7f1e137fe700 1 -- 172.21.15.53:0/4232990403 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1e040888b0 con 0x7f1e1c15c860 2023-07-09T21:51:08.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.323+0000 7f1e1ad9d700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1dfc06ace0 0x7f1dfc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:08.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.323+0000 7f1e1ad9d700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1dfc06ace0 0x7f1dfc06d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c007fd0 tx=0x7f1e0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:08.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.327+0000 7f1e137fe700 1 -- 172.21.15.53:0/4232990403 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1e1c15e030 con 0x7f1e1c15c860 2023-07-09T21:51:08.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.534+0000 7f1e211ff700 1 -- 172.21.15.53:0/4232990403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e1c15e030 con 0x7f1e1c15c860 2023-07-09T21:51:08.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.535+0000 7f1e137fe700 1 -- 172.21.15.53:0/4232990403 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e1c15e030 con 0x7f1e1c15c860 2023-07-09T21:51:08.537 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:51:08.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.537+0000 7f1e211ff700 1 -- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1dfc06ace0 msgr2=0x7f1dfc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.537+0000 7f1e211ff700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1dfc06ace0 0x7f1dfc06d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c007fd0 tx=0x7f1e0c009040 comp rx=0 tx=0).stop 2023-07-09T21:51:08.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.537+0000 7f1e211ff700 1 -- 172.21.15.53:0/4232990403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c15c860 msgr2=0x7f1e1c0d32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.537+0000 7f1e211ff700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c15c860 0x7f1e1c0d32b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400c700 tx=0x7f1e0400ca10 comp rx=0 tx=0).stop 2023-07-09T21:51:08.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.537+0000 7f1e211ff700 1 -- 172.21.15.53:0/4232990403 shutdown_connections 2023-07-09T21:51:08.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.537+0000 7f1e211ff700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1dfc06ace0 0x7f1dfc06d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.537+0000 7f1e211ff700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e1c1653c0 0x7f1e1c0d37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.537+0000 7f1e211ff700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e1c0cf2a0 0x7f1e1c0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.537+0000 7f1e211ff700 1 --2- 172.21.15.53:0/4232990403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c15c860 0x7f1e1c0d32b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.537+0000 7f1e211ff700 1 -- 172.21.15.53:0/4232990403 >> 172.21.15.53:0/4232990403 conn(0x7f1e1c065bd0 msgr2=0x7f1e1c159cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:08.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.537+0000 7f1e211ff700 1 -- 172.21.15.53:0/4232990403 shutdown_connections 2023-07-09T21:51:08.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.537+0000 7f1e211ff700 1 -- 172.21.15.53:0/4232990403 wait complete. 2023-07-09T21:51:08.556 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:51:08.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.759+0000 7f0ae47ff700 1 Processor -- start 2023-07-09T21:51:08.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.759+0000 7f0ae47ff700 1 -- start start 2023-07-09T21:51:08.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.761+0000 7f0ae47ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0adc0b3ff0 0x7f0adc0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:08.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.761+0000 7f0ae47ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0adc0d0f90 0x7f0adc0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:08.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.761+0000 7f0ae47ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc0b8e80 con 0x7f0adc0d0b10 2023-07-09T21:51:08.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.761+0000 7f0ae47ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0b1e30 con 0x7f0adc0b3ff0 2023-07-09T21:51:08.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.761+0000 7f0ae47ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0d1410 con 0x7f0adc0d0f90 2023-07-09T21:51:08.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.761+0000 7f0ae259b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0adc0b3ff0 0x7f0adc0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:08.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.761+0000 7f0ae2d9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0adc0d0f90 0x7f0adc0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:08.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.761+0000 7f0ae2d9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0adc0d0f90 0x7f0adc0b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:42654/0 (socket says 172.21.15.53:42654) 2023-07-09T21:51:08.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.761+0000 7f0ae2d9c700 1 -- 172.21.15.53:0/3526596986 learned_addr learned my addr 172.21.15.53:0/3526596986 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.761+0000 7f0ae1d9a700 1 --1- 172.21.15.53:0/3526596986 >> v1:172.21.15.184:6789/0 conn(0x7f0adc0d0b10 0x7f0adc0b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:47352/0 (socket says 172.21.15.53:47352) 2023-07-09T21:51:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.762+0000 7f0ae2d9c700 1 -- 172.21.15.53:0/3526596986 >> v2:172.21.15.184:3300/0 conn(0x7f0adc0b3ff0 msgr2=0x7f0adc0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.762+0000 7f0ae2d9c700 1 --2- 172.21.15.53:0/3526596986 >> v2:172.21.15.184:3300/0 conn(0x7f0adc0b3ff0 0x7f0adc0b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.762+0000 7f0ae2d9c700 1 -- 172.21.15.53:0/3526596986 >> v1:172.21.15.184:6789/0 conn(0x7f0adc0d0b10 legacy=0x7f0adc0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.762+0000 7f0ae2d9c700 1 -- 172.21.15.53:0/3526596986 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0afaa0 con 0x7f0adc0d0f90 2023-07-09T21:51:08.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.762+0000 7f0ae1599700 1 -- 172.21.15.53:0/3526596986 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848571132 0 0) 0x7f0acc001110 con 0x7f0adc0d0b10 2023-07-09T21:51:08.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.762+0000 7f0ae259b700 1 --2- 172.21.15.53:0/3526596986 >> v2:172.21.15.184:3300/0 conn(0x7f0adc0b3ff0 0x7f0adc0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:08.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.762+0000 7f0ae2d9c700 1 --2- 172.21.15.53:0/3526596986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0adc0d0f90 0x7f0adc0b2ce0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009e50 tx=0x7f0ad400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=377e3898a17321cd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:08.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.762+0000 7f0ae1599700 1 -- 172.21.15.53:0/3526596986 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400e070 con 0x7f0adc0d0f90 2023-07-09T21:51:08.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.762+0000 7f0ae1599700 1 -- 172.21.15.53:0/3526596986 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad400b910 con 0x7f0adc0d0f90 2023-07-09T21:51:08.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.762+0000 7f0ae1599700 1 -- 172.21.15.53:0/3526596986 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400bcc0 con 0x7f0adc0d0f90 2023-07-09T21:51:08.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.763+0000 7f0ae47ff700 1 -- 172.21.15.53:0/3526596986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0adc0d0f90 msgr2=0x7f0adc0b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.763+0000 7f0ae47ff700 1 --2- 172.21.15.53:0/3526596986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0adc0d0f90 0x7f0adc0b2ce0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009e50 tx=0x7f0ad400b330 comp rx=0 tx=0).stop 2023-07-09T21:51:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.763+0000 7f0ae47ff700 1 -- 172.21.15.53:0/3526596986 shutdown_connections 2023-07-09T21:51:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.763+0000 7f0ae47ff700 1 --2- 172.21.15.53:0/3526596986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0adc0d0f90 0x7f0adc0b2ce0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.763+0000 7f0ae47ff700 1 --2- 172.21.15.53:0/3526596986 >> v2:172.21.15.184:3300/0 conn(0x7f0adc0b3ff0 0x7f0adc0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.763+0000 7f0ae47ff700 1 -- 172.21.15.53:0/3526596986 >> 172.21.15.53:0/3526596986 conn(0x7f0adc09c1b0 msgr2=0x7f0adc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:08.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.763+0000 7f0ae47ff700 1 -- 172.21.15.53:0/3526596986 shutdown_connections 2023-07-09T21:51:08.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.763+0000 7f0ae47ff700 1 -- 172.21.15.53:0/3526596986 wait complete. 2023-07-09T21:51:08.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.765+0000 7f0ae47ff700 1 Processor -- start 2023-07-09T21:51:08.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.765+0000 7f0ae47ff700 1 -- start start 2023-07-09T21:51:08.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae47ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0adc0b3ff0 0x7f0adc0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:08.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae47ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0adc0d0b10 0x7f0adc15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:08.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae47ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0adc0d0f90 0x7f0adc1f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:08.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae47ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0d0660 con 0x7f0adc0d0b10 2023-07-09T21:51:08.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae47ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0d01d0 con 0x7f0adc0b3ff0 2023-07-09T21:51:08.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae47ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc1f3230 con 0x7f0adc0d0f90 2023-07-09T21:51:08.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae1d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0adc0d0b10 0x7f0adc15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:08.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae1d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0adc0d0b10 0x7f0adc15c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37416/0 (socket says 172.21.15.53:37416) 2023-07-09T21:51:08.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae1d9a700 1 -- 172.21.15.53:0/1797149194 learned_addr learned my addr 172.21.15.53:0/1797149194 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:08.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae259b700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0adc0b3ff0 0x7f0adc0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:08.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae2d9c700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0adc0d0f90 0x7f0adc1f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:08.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae1d9a700 1 -- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0adc0d0f90 msgr2=0x7f0adc1f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae1d9a700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0adc0d0f90 0x7f0adc1f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae1d9a700 1 -- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0adc0b3ff0 msgr2=0x7f0adc0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae1d9a700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0adc0b3ff0 0x7f0adc0cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.766+0000 7f0ae1d9a700 1 -- 172.21.15.53:0/1797149194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad80094a0 con 0x7f0adc0d0b10 2023-07-09T21:51:08.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.767+0000 7f0ae1d9a700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0adc0d0b10 0x7f0adc15c020 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00c760 tx=0x7f0acc00ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:08.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.767+0000 7f0ad2ffd700 1 -- 172.21.15.53:0/1797149194 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc004c80 con 0x7f0adc0d0b10 2023-07-09T21:51:08.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.767+0000 7f0ad2ffd700 1 -- 172.21.15.53:0/1797149194 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc004e00 con 0x7f0adc0d0b10 2023-07-09T21:51:08.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.767+0000 7f0ae47ff700 1 -- 172.21.15.53:0/1797149194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad4009b30 con 0x7f0adc0d0b10 2023-07-09T21:51:08.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.767+0000 7f0ad2ffd700 1 -- 172.21.15.53:0/1797149194 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc007310 con 0x7f0adc0d0b10 2023-07-09T21:51:08.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.767+0000 7f0ae47ff700 1 -- 172.21.15.53:0/1797149194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc0cf8a0 con 0x7f0adc0d0b10 2023-07-09T21:51:08.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.768+0000 7f0ae47ff700 1 -- 172.21.15.53:0/1797149194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc074350 con 0x7f0adc0d0b10 2023-07-09T21:51:08.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.769+0000 7f0ad2ffd700 1 -- 172.21.15.53:0/1797149194 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0acc007470 con 0x7f0adc0d0b10 2023-07-09T21:51:08.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.771+0000 7f0ad2ffd700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0ac006ace0 0x7f0ac006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:08.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.771+0000 7f0ad2ffd700 1 -- 172.21.15.53:0/1797149194 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0acc089060 con 0x7f0adc0d0b10 2023-07-09T21:51:08.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.772+0000 7f0ae259b700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0ac006ace0 0x7f0ac006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:08.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.772+0000 7f0ae259b700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0ac006ace0 0x7f0ac006d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8009d70 tx=0x7f0ad8009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:08.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.775+0000 7f0ad2ffd700 1 -- 172.21.15.53:0/1797149194 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0acc0bb310 con 0x7f0adc0d0b10 2023-07-09T21:51:08.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.985+0000 7f0ae47ff700 1 -- 172.21.15.53:0/1797149194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0adc0b8e80 con 0x7f0adc0d0b10 2023-07-09T21:51:08.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.985+0000 7f0ad2ffd700 1 -- 172.21.15.53:0/1797149194 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0adc0b8e80 con 0x7f0adc0d0b10 2023-07-09T21:51:08.987 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:51:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.987+0000 7f0ae47ff700 1 -- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0ac006ace0 msgr2=0x7f0ac006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.987+0000 7f0ae47ff700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0ac006ace0 0x7f0ac006d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8009d70 tx=0x7f0ad8009210 comp rx=0 tx=0).stop 2023-07-09T21:51:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.987+0000 7f0ae47ff700 1 -- 172.21.15.53:0/1797149194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0adc0d0b10 msgr2=0x7f0adc15c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.987+0000 7f0ae47ff700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0adc0d0b10 0x7f0adc15c020 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00c760 tx=0x7f0acc00ca70 comp rx=0 tx=0).stop 2023-07-09T21:51:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.987+0000 7f0ae47ff700 1 -- 172.21.15.53:0/1797149194 shutdown_connections 2023-07-09T21:51:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.987+0000 7f0ae47ff700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0ac006ace0 0x7f0ac006d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.987+0000 7f0ae47ff700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0adc0d0f90 0x7f0adc1f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.987+0000 7f0ae47ff700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0adc0b3ff0 0x7f0adc0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.987+0000 7f0ae47ff700 1 --2- 172.21.15.53:0/1797149194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0adc0d0b10 0x7f0adc15c020 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:08.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.987+0000 7f0ae47ff700 1 -- 172.21.15.53:0/1797149194 >> 172.21.15.53:0/1797149194 conn(0x7f0adc09c1b0 msgr2=0x7f0adc0b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:08.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.987+0000 7f0ae47ff700 1 -- 172.21.15.53:0/1797149194 shutdown_connections 2023-07-09T21:51:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:08.987+0000 7f0ae47ff700 1 -- 172.21.15.53:0/1797149194 wait complete. 2023-07-09T21:51:09.006 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:51:09.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.208+0000 7f6efcbff700 1 Processor -- start 2023-07-09T21:51:09.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.209+0000 7f6efcbff700 1 -- start start 2023-07-09T21:51:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.210+0000 7f6efcbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ef80b3ff0 0x7f6ef80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.210+0000 7f6efcbff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6ef80d0b10 0x7f6ef80d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.210+0000 7f6efcbff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ef80b25d0 0x7f6ef80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.210+0000 7f6efcbff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef80b8e80 con 0x7f6ef80b25d0 2023-07-09T21:51:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.210+0000 7f6efcbff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef80d14a0 con 0x7f6ef80d0b10 2023-07-09T21:51:09.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.210+0000 7f6efcbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80afaa0 con 0x7f6ef80b3ff0 2023-07-09T21:51:09.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.210+0000 7f6ef6d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ef80b25d0 0x7f6ef80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:09.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.210+0000 7f6ef6d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ef80b25d0 0x7f6ef80b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37422/0 (socket says 172.21.15.53:37422) 2023-07-09T21:51:09.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.210+0000 7f6ef6d9d700 1 -- 172.21.15.53:0/1678972215 learned_addr learned my addr 172.21.15.53:0/1678972215 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:09.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.210+0000 7f6ef659c700 1 --2- 172.21.15.53:0/1678972215 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ef80b3ff0 0x7f6ef80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:09.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.210+0000 7f6eeffff700 1 --2- 172.21.15.53:0/1678972215 >> v2:172.21.15.184:3300/0 conn(0x7f6ef80d0b10 0x7f6ef80d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:09.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.211+0000 7f6ef6d9d700 1 -- 172.21.15.53:0/1678972215 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ef80b3ff0 msgr2=0x7f6ef80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:09.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.211+0000 7f6ef6d9d700 1 --2- 172.21.15.53:0/1678972215 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ef80b3ff0 0x7f6ef80b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.211+0000 7f6ef6d9d700 1 -- 172.21.15.53:0/1678972215 >> v2:172.21.15.184:3300/0 conn(0x7f6ef80d0b10 msgr2=0x7f6ef80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.211+0000 7f6ef6d9d700 1 --2- 172.21.15.53:0/1678972215 >> v2:172.21.15.184:3300/0 conn(0x7f6ef80d0b10 0x7f6ef80d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.211+0000 7f6ef6d9d700 1 -- 172.21.15.53:0/1678972215 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef80afd80 con 0x7f6ef80b25d0 2023-07-09T21:51:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.211+0000 7f6ef6d9d700 1 --2- 172.21.15.53:0/1678972215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ef80b25d0 0x7f6ef80b2a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80b5b30 tx=0x7f6ef000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3005b7c2cee4ec4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.211+0000 7f6ef5d9b700 1 -- 172.21.15.53:0/1678972215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef000e070 con 0x7f6ef80b25d0 2023-07-09T21:51:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.211+0000 7f6ef5d9b700 1 -- 172.21.15.53:0/1678972215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef000b910 con 0x7f6ef80b25d0 2023-07-09T21:51:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.211+0000 7f6ef5d9b700 1 -- 172.21.15.53:0/1678972215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef000bcc0 con 0x7f6ef80b25d0 2023-07-09T21:51:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.212+0000 7f6efcbff700 1 -- 172.21.15.53:0/1678972215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ef80b25d0 msgr2=0x7f6ef80b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:09.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.212+0000 7f6efcbff700 1 --2- 172.21.15.53:0/1678972215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ef80b25d0 0x7f6ef80b2a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80b5b30 tx=0x7f6ef000b330 comp rx=0 tx=0).stop 2023-07-09T21:51:09.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.212+0000 7f6efcbff700 1 -- 172.21.15.53:0/1678972215 shutdown_connections 2023-07-09T21:51:09.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.212+0000 7f6efcbff700 1 --2- 172.21.15.53:0/1678972215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ef80b25d0 0x7f6ef80b2a50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.212+0000 7f6efcbff700 1 --2- 172.21.15.53:0/1678972215 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ef80b3ff0 0x7f6ef80b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.212+0000 7f6efcbff700 1 --2- 172.21.15.53:0/1678972215 >> v2:172.21.15.184:3300/0 conn(0x7f6ef80d0b10 0x7f6ef80d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.212+0000 7f6efcbff700 1 -- 172.21.15.53:0/1678972215 >> 172.21.15.53:0/1678972215 conn(0x7f6ef809c1b0 msgr2=0x7f6ef80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:09.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.212+0000 7f6efcbff700 1 -- 172.21.15.53:0/1678972215 shutdown_connections 2023-07-09T21:51:09.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.212+0000 7f6efcbff700 1 -- 172.21.15.53:0/1678972215 wait complete. 2023-07-09T21:51:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.214+0000 7f6efcbff700 1 Processor -- start 2023-07-09T21:51:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.214+0000 7f6efcbff700 1 -- start start 2023-07-09T21:51:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.215+0000 7f6efcbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ef80b25d0 0x7f6ef81575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.215+0000 7f6efcbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ef80b3ff0 0x7f6ef80cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.215+0000 7f6efcbff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ef80d0b10 0x7f6ef80cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.215+0000 7f6efcbff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80ca010 con 0x7f6ef80d0b10 2023-07-09T21:51:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.215+0000 7f6efcbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80cc8b0 con 0x7f6ef80b25d0 2023-07-09T21:51:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.215+0000 7f6efcbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80ccb90 con 0x7f6ef80b3ff0 2023-07-09T21:51:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.215+0000 7f6ef6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ef80d0b10 0x7f6ef80cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.215+0000 7f6ef6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ef80d0b10 0x7f6ef80cd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37436/0 (socket says 172.21.15.53:37436) 2023-07-09T21:51:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.215+0000 7f6ef6d9d700 1 -- 172.21.15.53:0/1032375289 learned_addr learned my addr 172.21.15.53:0/1032375289 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.215+0000 7f6eeffff700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ef80b3ff0 0x7f6ef80cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.215+0000 7f6ef659c700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ef80b25d0 0x7f6ef81575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.216+0000 7f6ef6d9d700 1 -- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ef80b3ff0 msgr2=0x7f6ef80cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.216+0000 7f6ef6d9d700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ef80b3ff0 0x7f6ef80cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.216+0000 7f6ef6d9d700 1 -- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ef80b25d0 msgr2=0x7f6ef81575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.216+0000 7f6ef6d9d700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ef80b25d0 0x7f6ef81575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.216+0000 7f6ef6d9d700 1 -- 172.21.15.53:0/1032375289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef0009b30 con 0x7f6ef80d0b10 2023-07-09T21:51:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.216+0000 7f6eeffff700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ef80b3ff0 0x7f6ef80cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.216+0000 7f6ef659c700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ef80b25d0 0x7f6ef81575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.216+0000 7f6ef6d9d700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ef80d0b10 0x7f6ef80cd550 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80681d0 tx=0x7f6ef0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:09.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.216+0000 7f6eeeffd700 1 -- 172.21.15.53:0/1032375289 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef00099b0 con 0x7f6ef80d0b10 2023-07-09T21:51:09.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.216+0000 7f6eeeffd700 1 -- 172.21.15.53:0/1032375289 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef000ce80 con 0x7f6ef80d0b10 2023-07-09T21:51:09.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.216+0000 7f6eeeffd700 1 -- 172.21.15.53:0/1032375289 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0004490 con 0x7f6ef80d0b10 2023-07-09T21:51:09.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.216+0000 7f6efcbff700 1 -- 172.21.15.53:0/1032375289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef80cce70 con 0x7f6ef80d0b10 2023-07-09T21:51:09.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.216+0000 7f6efcbff700 1 -- 172.21.15.53:0/1032375289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef80cc5a0 con 0x7f6ef80d0b10 2023-07-09T21:51:09.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.217+0000 7f6efcbff700 1 -- 172.21.15.53:0/1032375289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef80ca180 con 0x7f6ef80d0b10 2023-07-09T21:51:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.218+0000 7f6eeeffd700 1 -- 172.21.15.53:0/1032375289 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ef00045f0 con 0x7f6ef80d0b10 2023-07-09T21:51:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.219+0000 7f6eeeffd700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6ed806ace0 0x7f6ed806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.219+0000 7f6eeeffd700 1 -- 172.21.15.53:0/1032375289 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6ef008a840 con 0x7f6ef80d0b10 2023-07-09T21:51:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.220+0000 7f6ef659c700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6ed806ace0 0x7f6ed806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.220+0000 7f6ef659c700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6ed806ace0 0x7f6ed806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009fd0 tx=0x7f6ee8009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:09.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.223+0000 7f6eeeffd700 1 -- 172.21.15.53:0/1032375289 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6ef0055810 con 0x7f6ef80d0b10 2023-07-09T21:51:09.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.432+0000 7f6efcbff700 1 -- 172.21.15.53:0/1032375289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ef8074350 con 0x7f6ef80d0b10 2023-07-09T21:51:09.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.432+0000 7f6eeeffd700 1 -- 172.21.15.53:0/1032375289 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ef0058e30 con 0x7f6ef80d0b10 2023-07-09T21:51:09.434 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:51:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.434+0000 7f6efcbff700 1 -- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6ed806ace0 msgr2=0x7f6ed806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.434+0000 7f6efcbff700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6ed806ace0 0x7f6ed806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009fd0 tx=0x7f6ee8009210 comp rx=0 tx=0).stop 2023-07-09T21:51:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.434+0000 7f6efcbff700 1 -- 172.21.15.53:0/1032375289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ef80d0b10 msgr2=0x7f6ef80cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.434+0000 7f6efcbff700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ef80d0b10 0x7f6ef80cd550 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80681d0 tx=0x7f6ef0004ad0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.435+0000 7f6efcbff700 1 -- 172.21.15.53:0/1032375289 shutdown_connections 2023-07-09T21:51:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.435+0000 7f6efcbff700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6ed806ace0 0x7f6ed806d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.435+0000 7f6efcbff700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ef80d0b10 0x7f6ef80cd550 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.435+0000 7f6efcbff700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ef80b25d0 0x7f6ef81575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.435+0000 7f6efcbff700 1 --2- 172.21.15.53:0/1032375289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ef80b3ff0 0x7f6ef80cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.435+0000 7f6efcbff700 1 -- 172.21.15.53:0/1032375289 >> 172.21.15.53:0/1032375289 conn(0x7f6ef809c1b0 msgr2=0x7f6ef806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.435+0000 7f6efcbff700 1 -- 172.21.15.53:0/1032375289 shutdown_connections 2023-07-09T21:51:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.435+0000 7f6efcbff700 1 -- 172.21.15.53:0/1032375289 wait complete. 2023-07-09T21:51:09.453 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:51:09.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.657+0000 7f4bae5ff700 1 Processor -- start 2023-07-09T21:51:09.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.657+0000 7f4bae5ff700 1 -- start start 2023-07-09T21:51:09.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4bae5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4ba806b750 0x7f4ba80cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:09.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4bae5ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4ba80b0cd0 0x7f4ba80b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:09.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4bae5ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba80b0560 con 0x7f4ba80d12c0 2023-07-09T21:51:09.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4bae5ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba80d1690 con 0x7f4ba80b0cd0 2023-07-09T21:51:09.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4bae5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba80cc760 con 0x7f4ba806b750 2023-07-09T21:51:09.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4ba7fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4ba80d12c0 0x7f4ba806b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46010/0 (socket says 172.21.15.53:46010) 2023-07-09T21:51:09.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4ba7fff700 1 -- 172.21.15.53:0/1102531206 learned_addr learned my addr 172.21.15.53:0/1102531206 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:09.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4bacb9c700 1 --2- 172.21.15.53:0/1102531206 >> v2:172.21.15.53:3300/0 conn(0x7f4ba80b0cd0 0x7f4ba80b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:09.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4ba77fe700 1 --2- 172.21.15.53:0/1102531206 >> v2:172.21.15.184:3300/0 conn(0x7f4ba806b750 0x7f4ba80cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:09.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4bacb9c700 1 -- 172.21.15.53:0/1102531206 >> v2:172.21.15.184:3300/0 conn(0x7f4ba806b750 msgr2=0x7f4ba80cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:09.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4bacb9c700 1 --2- 172.21.15.53:0/1102531206 >> v2:172.21.15.184:3300/0 conn(0x7f4ba806b750 0x7f4ba80cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4bacb9c700 1 -- 172.21.15.53:0/1102531206 >> v1:172.21.15.53:6789/0 conn(0x7f4ba80d12c0 legacy=0x7f4ba806b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:09.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4bacb9c700 1 -- 172.21.15.53:0/1102531206 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba815ced0 con 0x7f4ba80b0cd0 2023-07-09T21:51:09.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.659+0000 7f4ba6ffd700 1 -- 172.21.15.53:0/1102531206 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990635532 0 0) 0x7f4ba80b0560 con 0x7f4ba80d12c0 2023-07-09T21:51:09.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.660+0000 7f4bacb9c700 1 --2- 172.21.15.53:0/1102531206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ba80b0cd0 0x7f4ba80b1170 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8068200 tx=0x7f4ba000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1e127fe22b47c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:09.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.660+0000 7f4ba6ffd700 1 -- 172.21.15.53:0/1102531206 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000e070 con 0x7f4ba80b0cd0 2023-07-09T21:51:09.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.660+0000 7f4ba6ffd700 1 -- 172.21.15.53:0/1102531206 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba000bb20 con 0x7f4ba80b0cd0 2023-07-09T21:51:09.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.660+0000 7f4ba6ffd700 1 -- 172.21.15.53:0/1102531206 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0012430 con 0x7f4ba80b0cd0 2023-07-09T21:51:09.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.660+0000 7f4bae5ff700 1 -- 172.21.15.53:0/1102531206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ba80b0cd0 msgr2=0x7f4ba80b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:09.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.660+0000 7f4bae5ff700 1 --2- 172.21.15.53:0/1102531206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ba80b0cd0 0x7f4ba80b1170 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8068200 tx=0x7f4ba000b330 comp rx=0 tx=0).stop 2023-07-09T21:51:09.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.661+0000 7f4bae5ff700 1 -- 172.21.15.53:0/1102531206 shutdown_connections 2023-07-09T21:51:09.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.661+0000 7f4bae5ff700 1 --2- 172.21.15.53:0/1102531206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ba80b0cd0 0x7f4ba80b1170 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.661+0000 7f4bae5ff700 1 --2- 172.21.15.53:0/1102531206 >> v2:172.21.15.184:3300/0 conn(0x7f4ba806b750 0x7f4ba80cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.661+0000 7f4bae5ff700 1 -- 172.21.15.53:0/1102531206 >> 172.21.15.53:0/1102531206 conn(0x7f4ba80999e0 msgr2=0x7f4ba8099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:09.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.661+0000 7f4bae5ff700 1 -- 172.21.15.53:0/1102531206 shutdown_connections 2023-07-09T21:51:09.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.661+0000 7f4bae5ff700 1 -- 172.21.15.53:0/1102531206 wait complete. 2023-07-09T21:51:09.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.662+0000 7f4bae5ff700 1 Processor -- start 2023-07-09T21:51:09.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.663+0000 7f4bae5ff700 1 -- start start 2023-07-09T21:51:09.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.663+0000 7f4bae5ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ba806b750 0x7f4ba80cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:09.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.663+0000 7f4bae5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ba80b0cd0 0x7f4ba80b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:09.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.663+0000 7f4bae5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba80d12c0 0x7f4ba81e96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:09.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.663+0000 7f4bae5ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80cb1a0 con 0x7f4ba806b750 2023-07-09T21:51:09.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.663+0000 7f4bae5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80ce250 con 0x7f4ba80b0cd0 2023-07-09T21:51:09.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.663+0000 7f4bae5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba8155640 con 0x7f4ba80d12c0 2023-07-09T21:51:09.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.664+0000 7f4ba7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ba806b750 0x7f4ba80cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:09.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.664+0000 7f4ba7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ba806b750 0x7f4ba80cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37460/0 (socket says 172.21.15.53:37460) 2023-07-09T21:51:09.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.664+0000 7f4ba7fff700 1 -- 172.21.15.53:0/974216429 learned_addr learned my addr 172.21.15.53:0/974216429 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:09.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.664+0000 7f4ba7fff700 1 -- 172.21.15.53:0/974216429 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba80d12c0 msgr2=0x7f4ba81e96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:09.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.664+0000 7f4ba7fff700 1 --2- 172.21.15.53:0/974216429 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba80d12c0 0x7f4ba81e96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.664+0000 7f4ba7fff700 1 -- 172.21.15.53:0/974216429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ba80b0cd0 msgr2=0x7f4ba80b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:09.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.664+0000 7f4ba7fff700 1 --2- 172.21.15.53:0/974216429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ba80b0cd0 0x7f4ba80b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.664+0000 7f4ba7fff700 1 -- 172.21.15.53:0/974216429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba0009a70 con 0x7f4ba806b750 2023-07-09T21:51:09.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.664+0000 7f4ba7fff700 1 --2- 172.21.15.53:0/974216429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ba806b750 0x7f4ba80cd710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4b980011e0 tx=0x7f4b9800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:09.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.665+0000 7f4ba4ff9700 1 -- 172.21.15.53:0/974216429 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98004c80 con 0x7f4ba806b750 2023-07-09T21:51:09.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.665+0000 7f4ba4ff9700 1 -- 172.21.15.53:0/974216429 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b98004e00 con 0x7f4ba806b750 2023-07-09T21:51:09.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.665+0000 7f4ba4ff9700 1 -- 172.21.15.53:0/974216429 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98007310 con 0x7f4ba806b750 2023-07-09T21:51:09.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.665+0000 7f4bae5ff700 1 -- 172.21.15.53:0/974216429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba80caec0 con 0x7f4ba806b750 2023-07-09T21:51:09.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.665+0000 7f4bae5ff700 1 -- 172.21.15.53:0/974216429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba8155360 con 0x7f4ba806b750 2023-07-09T21:51:09.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.666+0000 7f4bae5ff700 1 -- 172.21.15.53:0/974216429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba806c370 con 0x7f4ba806b750 2023-07-09T21:51:09.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.667+0000 7f4ba4ff9700 1 -- 172.21.15.53:0/974216429 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b98007470 con 0x7f4ba806b750 2023-07-09T21:51:09.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.668+0000 7f4ba4ff9700 1 --2- 172.21.15.53:0/974216429 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4b9406ace0 0x7f4b9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:09.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.668+0000 7f4ba4ff9700 1 -- 172.21.15.53:0/974216429 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4b98089270 con 0x7f4ba806b750 2023-07-09T21:51:09.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.669+0000 7f4ba77fe700 1 --2- 172.21.15.53:0/974216429 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4b9406ace0 0x7f4b9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:09.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.670+0000 7f4ba77fe700 1 --2- 172.21.15.53:0/974216429 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4b9406ace0 0x7f4b9406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c006b20 tx=0x7f4b9c006ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:09.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.673+0000 7f4ba4ff9700 1 -- 172.21.15.53:0/974216429 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b980542d0 con 0x7f4ba806b750 2023-07-09T21:51:09.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.884+0000 7f4bae5ff700 1 -- 172.21.15.53:0/974216429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ba8154ee0 con 0x7f4ba806b750 2023-07-09T21:51:09.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.884+0000 7f4ba4ff9700 1 -- 172.21.15.53:0/974216429 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ba8154ee0 con 0x7f4ba806b750 2023-07-09T21:51:09.886 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:51:09.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.886+0000 7f4bae5ff700 1 -- 172.21.15.53:0/974216429 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4b9406ace0 msgr2=0x7f4b9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:09.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.886+0000 7f4bae5ff700 1 --2- 172.21.15.53:0/974216429 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4b9406ace0 0x7f4b9406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c006b20 tx=0x7f4b9c006ab0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.886+0000 7f4bae5ff700 1 -- 172.21.15.53:0/974216429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ba806b750 msgr2=0x7f4ba80cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:09.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.886+0000 7f4bae5ff700 1 --2- 172.21.15.53:0/974216429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ba806b750 0x7f4ba80cd710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4b980011e0 tx=0x7f4b9800cae0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.887+0000 7f4bae5ff700 1 -- 172.21.15.53:0/974216429 shutdown_connections 2023-07-09T21:51:09.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.887+0000 7f4bae5ff700 1 --2- 172.21.15.53:0/974216429 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4b9406ace0 0x7f4b9406d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.887+0000 7f4bae5ff700 1 --2- 172.21.15.53:0/974216429 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba80d12c0 0x7f4ba81e96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.887+0000 7f4bae5ff700 1 --2- 172.21.15.53:0/974216429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ba806b750 0x7f4ba80cd710 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.887+0000 7f4bae5ff700 1 --2- 172.21.15.53:0/974216429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ba80b0cd0 0x7f4ba80b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:09.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.887+0000 7f4bae5ff700 1 -- 172.21.15.53:0/974216429 >> 172.21.15.53:0/974216429 conn(0x7f4ba80999e0 msgr2=0x7f4ba80cb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:09.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.887+0000 7f4bae5ff700 1 -- 172.21.15.53:0/974216429 shutdown_connections 2023-07-09T21:51:09.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:09.887+0000 7f4bae5ff700 1 -- 172.21.15.53:0/974216429 wait complete. 2023-07-09T21:51:09.990 INFO:tasks.cephfs_test_runner:Starting test: test_nonexistent_subvolume_group_snapshot_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-07-09T21:51:09.991 INFO:tasks.cephfs_test_runner:test_nonexistent_subvolume_group_snapshot_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-07-09T21:51:09.992 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_create_and_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-07-09T21:51:09.993 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_create_and_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-07-09T21:51:09.993 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_idempotence (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-07-09T21:51:09.993 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_idempotence (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-07-09T21:51:09.994 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-07-09T21:51:09.994 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-07-09T21:51:09.994 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_rm_force (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-07-09T21:51:09.995 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_rm_force (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-07-09T21:51:09.995 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_unsupported_status (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-07-09T21:51:09.995 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status' 2023-07-09T21:51:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.198+0000 7f9690bff700 1 Processor -- start 2023-07-09T21:51:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.198+0000 7f9690bff700 1 -- start start 2023-07-09T21:51:10.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.199+0000 7f9690bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f968c0d1220 0x7f968c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:10.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.199+0000 7f9690bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f968c0b2350 0x7f968c0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:10.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.199+0000 7f9690bff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968c0d2ce0 con 0x7f968c0b1e00 2023-07-09T21:51:10.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.199+0000 7f9690bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c0b3350 con 0x7f968c0b2350 2023-07-09T21:51:10.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.199+0000 7f9690bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c0b3630 con 0x7f968c0d1220 2023-07-09T21:51:10.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.199+0000 7f968ad9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f968c0b2350 0x7f968c0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:10.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.199+0000 7f968ad9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f968c0b2350 0x7f968c0afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37470/0 (socket says 172.21.15.53:37470) 2023-07-09T21:51:10.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.199+0000 7f968a59c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f968c0b1e00 0x7f968c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46012/0 (socket says 172.21.15.53:46012) 2023-07-09T21:51:10.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.199+0000 7f968ad9d700 1 -- 172.21.15.53:0/904705909 learned_addr learned my addr 172.21.15.53:0/904705909 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:10.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.200+0000 7f9689d9b700 1 --2- 172.21.15.53:0/904705909 >> v2:172.21.15.184:3300/0 conn(0x7f968c0d1220 0x7f968c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:10.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.200+0000 7f968ad9d700 1 -- 172.21.15.53:0/904705909 >> v2:172.21.15.184:3300/0 conn(0x7f968c0d1220 msgr2=0x7f968c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:10.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.200+0000 7f968ad9d700 1 --2- 172.21.15.53:0/904705909 >> v2:172.21.15.184:3300/0 conn(0x7f968c0d1220 0x7f968c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.200+0000 7f968ad9d700 1 -- 172.21.15.53:0/904705909 >> v1:172.21.15.53:6789/0 conn(0x7f968c0b1e00 legacy=0x7f968c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:10.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.200+0000 7f968ad9d700 1 -- 172.21.15.53:0/904705909 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c0b3910 con 0x7f968c0b2350 2023-07-09T21:51:10.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.200+0000 7f968ad9d700 1 --2- 172.21.15.53:0/904705909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f968c0b2350 0x7f968c0afac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f968c072140 tx=0x7f968400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b27efc24970839 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:10.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.200+0000 7f968959a700 1 -- 172.21.15.53:0/904705909 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400e070 con 0x7f968c0b2350 2023-07-09T21:51:10.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.200+0000 7f968959a700 1 -- 172.21.15.53:0/904705909 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968400b9c0 con 0x7f968c0b2350 2023-07-09T21:51:10.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.200+0000 7f968959a700 1 -- 172.21.15.53:0/904705909 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400bd70 con 0x7f968c0b2350 2023-07-09T21:51:10.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.201+0000 7f9690bff700 1 -- 172.21.15.53:0/904705909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f968c0b2350 msgr2=0x7f968c0afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:10.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.201+0000 7f9690bff700 1 --2- 172.21.15.53:0/904705909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f968c0b2350 0x7f968c0afac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f968c072140 tx=0x7f968400b330 comp rx=0 tx=0).stop 2023-07-09T21:51:10.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.201+0000 7f9690bff700 1 -- 172.21.15.53:0/904705909 shutdown_connections 2023-07-09T21:51:10.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.201+0000 7f9690bff700 1 --2- 172.21.15.53:0/904705909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f968c0b2350 0x7f968c0afac0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.201+0000 7f9690bff700 1 --2- 172.21.15.53:0/904705909 >> v2:172.21.15.184:3300/0 conn(0x7f968c0d1220 0x7f968c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.201+0000 7f9690bff700 1 -- 172.21.15.53:0/904705909 >> 172.21.15.53:0/904705909 conn(0x7f968c09c1d0 msgr2=0x7f968c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:10.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.201+0000 7f9690bff700 1 -- 172.21.15.53:0/904705909 shutdown_connections 2023-07-09T21:51:10.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.201+0000 7f9690bff700 1 -- 172.21.15.53:0/904705909 wait complete. 2023-07-09T21:51:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.203+0000 7f9690bff700 1 Processor -- start 2023-07-09T21:51:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.203+0000 7f9690bff700 1 -- start start 2023-07-09T21:51:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.204+0000 7f9690bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f968c0b1e00 0x7f968c0b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.204+0000 7f9690bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f968c0b2350 0x7f968c1562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.204+0000 7f9690bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f968c0d1220 0x7f968c0cf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.204+0000 7f9690bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0c8a40 con 0x7f968c0b2350 2023-07-09T21:51:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.204+0000 7f9690bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0c8d20 con 0x7f968c0b1e00 2023-07-09T21:51:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.204+0000 7f9690bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0c9000 con 0x7f968c0d1220 2023-07-09T21:51:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.204+0000 7f9689d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f968c0b2350 0x7f968c1562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.204+0000 7f9689d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f968c0b2350 0x7f968c1562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37482/0 (socket says 172.21.15.53:37482) 2023-07-09T21:51:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.204+0000 7f9689d9b700 1 -- 172.21.15.53:0/83378680 learned_addr learned my addr 172.21.15.53:0/83378680 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f968a59c700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f968c0b1e00 0x7f968c0b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f968ad9d700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f968c0d1220 0x7f968c0cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f9689d9b700 1 -- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f968c0d1220 msgr2=0x7f968c0cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:10.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f9689d9b700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f968c0d1220 0x7f968c0cf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f9689d9b700 1 -- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f968c0b1e00 msgr2=0x7f968c0b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:10.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f9689d9b700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f968c0b1e00 0x7f968c0b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f9689d9b700 1 -- 172.21.15.53:0/83378680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684009b30 con 0x7f968c0b2350 2023-07-09T21:51:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f968a59c700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f968c0b1e00 0x7f968c0b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f9689d9b700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f968c0b2350 0x7f968c1562c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f968000d800 tx=0x7f968000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f967affd700 1 -- 172.21.15.53:0/83378680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96800125f0 con 0x7f968c0b2350 2023-07-09T21:51:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f967affd700 1 -- 172.21.15.53:0/83378680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9680012750 con 0x7f968c0b2350 2023-07-09T21:51:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f967affd700 1 -- 172.21.15.53:0/83378680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680012ae0 con 0x7f968c0b2350 2023-07-09T21:51:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f9690bff700 1 -- 172.21.15.53:0/83378680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c0c92e0 con 0x7f968c0b2350 2023-07-09T21:51:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.205+0000 7f9690bff700 1 -- 172.21.15.53:0/83378680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c0cb0e0 con 0x7f968c0b2350 2023-07-09T21:51:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.206+0000 7f9690bff700 1 -- 172.21.15.53:0/83378680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968c0cb4c0 con 0x7f968c0b2350 2023-07-09T21:51:10.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.207+0000 7f967affd700 1 -- 172.21.15.53:0/83378680 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9680012c40 con 0x7f968c0b2350 2023-07-09T21:51:10.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.208+0000 7f967affd700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f966c06ace0 0x7f966c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:10.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.208+0000 7f967affd700 1 -- 172.21.15.53:0/83378680 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9680089930 con 0x7f968c0b2350 2023-07-09T21:51:10.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.209+0000 7f968a59c700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f966c06ace0 0x7f966c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:10.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.209+0000 7f968a59c700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f966c06ace0 0x7f966c06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f967c001020 tx=0x7f967c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:10.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.213+0000 7f967affd700 1 -- 172.21.15.53:0/83378680 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9680054900 con 0x7f968c0b2350 2023-07-09T21:51:10.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.508+0000 7f9690bff700 1 -- 172.21.15.53:0/83378680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]} v 0) v1 -- 0x7f968c04e280 con 0x7f968c0b2350 2023-07-09T21:51:10.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.681+0000 7f967affd700 1 -- 172.21.15.53:0/83378680 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]}]=0 v67) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9680057f20 con 0x7f968c0b2350 2023-07-09T21:51:10.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.683+0000 7f9690bff700 1 -- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f966c06ace0 msgr2=0x7f966c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:10.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.683+0000 7f9690bff700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f966c06ace0 0x7f966c06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f967c001020 tx=0x7f967c009040 comp rx=0 tx=0).stop 2023-07-09T21:51:10.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.683+0000 7f9690bff700 1 -- 172.21.15.53:0/83378680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f968c0b2350 msgr2=0x7f968c1562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:10.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.683+0000 7f9690bff700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f968c0b2350 0x7f968c1562c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f968000d800 tx=0x7f968000dbc0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.683+0000 7f9690bff700 1 -- 172.21.15.53:0/83378680 shutdown_connections 2023-07-09T21:51:10.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.683+0000 7f9690bff700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f966c06ace0 0x7f966c06d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.683+0000 7f9690bff700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f968c0d1220 0x7f968c0cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.683+0000 7f9690bff700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f968c0b1e00 0x7f968c0b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.683+0000 7f9690bff700 1 --2- 172.21.15.53:0/83378680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f968c0b2350 0x7f968c1562c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.683+0000 7f9690bff700 1 -- 172.21.15.53:0/83378680 >> 172.21.15.53:0/83378680 conn(0x7f968c09c1d0 msgr2=0x7f968c06b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:10.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.684+0000 7f9690bff700 1 -- 172.21.15.53:0/83378680 shutdown_connections 2023-07-09T21:51:10.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.684+0000 7f9690bff700 1 -- 172.21.15.53:0/83378680 wait complete. 2023-07-09T21:51:10.703 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T21:51:10.711 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:51:10.753 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:51:10.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.908+0000 7fd68f1ff700 1 Processor -- start 2023-07-09T21:51:10.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.908+0000 7fd68f1ff700 1 -- start start 2023-07-09T21:51:10.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.909+0000 7fd68f1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6880cda40 0x7fd6880cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:10.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.909+0000 7fd68f1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd68806ba00 0x7fd68806be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:10.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.909+0000 7fd68f1ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6880ce3d0 con 0x7fd6880cbe40 2023-07-09T21:51:10.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.909+0000 7fd68f1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68806b5b0 con 0x7fd68806ba00 2023-07-09T21:51:10.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.909+0000 7fd68f1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd688071500 con 0x7fd6880cda40 2023-07-09T21:51:10.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.909+0000 7fd68cf9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd6880cbe40 0x7fd6880cd0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46028/0 (socket says 172.21.15.53:46028) 2023-07-09T21:51:10.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.909+0000 7fd68cf9b700 1 -- 172.21.15.53:0/2797852777 learned_addr learned my addr 172.21.15.53:0/2797852777 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:10.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.910+0000 7fd68d79c700 1 --2- 172.21.15.53:0/2797852777 >> v2:172.21.15.184:3300/0 conn(0x7fd68806ba00 0x7fd68806be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:10.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.910+0000 7fd687fff700 1 --2- 172.21.15.53:0/2797852777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6880cda40 0x7fd6880cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:10.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.910+0000 7fd6877fe700 1 -- 172.21.15.53:0/2797852777 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512065364 0 0) 0x7fd67c001110 con 0x7fd6880cbe40 2023-07-09T21:51:10.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.910+0000 7fd6877fe700 1 -- 172.21.15.53:0/2797852777 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6780034d0 con 0x7fd6880cbe40 2023-07-09T21:51:10.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.910+0000 7fd6877fe700 1 -- 172.21.15.53:0/2797852777 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2081024847 0 0) 0x7fd6780034d0 con 0x7fd6880cbe40 2023-07-09T21:51:10.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.910+0000 7fd68d79c700 1 -- 172.21.15.53:0/2797852777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6880cda40 msgr2=0x7fd6880cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.910+0000 7fd68d79c700 1 --2- 172.21.15.53:0/2797852777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6880cda40 0x7fd6880cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.910+0000 7fd68d79c700 1 -- 172.21.15.53:0/2797852777 >> v1:172.21.15.53:6789/0 conn(0x7fd6880cbe40 legacy=0x7fd6880cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.910+0000 7fd68d79c700 1 -- 172.21.15.53:0/2797852777 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880ce8c0 con 0x7fd68806ba00 2023-07-09T21:51:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.910+0000 7fd687fff700 1 --2- 172.21.15.53:0/2797852777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6880cda40 0x7fd6880cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.911+0000 7fd68d79c700 1 --2- 172.21.15.53:0/2797852777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd68806ba00 0x7fd68806be40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd680009d90 tx=0x7fd68000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c265e4025777bb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.911+0000 7fd6877fe700 1 -- 172.21.15.53:0/2797852777 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68000e070 con 0x7fd68806ba00 2023-07-09T21:51:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.911+0000 7fd6877fe700 1 -- 172.21.15.53:0/2797852777 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd680003a20 con 0x7fd68806ba00 2023-07-09T21:51:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.911+0000 7fd6877fe700 1 -- 172.21.15.53:0/2797852777 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c001800 con 0x7fd68806ba00 2023-07-09T21:51:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.911+0000 7fd68f1ff700 1 -- 172.21.15.53:0/2797852777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd68806ba00 msgr2=0x7fd68806be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.911+0000 7fd68f1ff700 1 --2- 172.21.15.53:0/2797852777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd68806ba00 0x7fd68806be40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd680009d90 tx=0x7fd68000b330 comp rx=0 tx=0).stop 2023-07-09T21:51:10.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.912+0000 7fd68f1ff700 1 -- 172.21.15.53:0/2797852777 shutdown_connections 2023-07-09T21:51:10.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.912+0000 7fd68f1ff700 1 --2- 172.21.15.53:0/2797852777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd68806ba00 0x7fd68806be40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.912+0000 7fd68f1ff700 1 --2- 172.21.15.53:0/2797852777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6880cda40 0x7fd6880cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.912+0000 7fd68f1ff700 1 -- 172.21.15.53:0/2797852777 >> 172.21.15.53:0/2797852777 conn(0x7fd6880b05d0 msgr2=0x7fd6880b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:10.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.912+0000 7fd68f1ff700 1 -- 172.21.15.53:0/2797852777 shutdown_connections 2023-07-09T21:51:10.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.912+0000 7fd68f1ff700 1 -- 172.21.15.53:0/2797852777 wait complete. 2023-07-09T21:51:10.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.913+0000 7fd68f1ff700 1 Processor -- start 2023-07-09T21:51:10.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.914+0000 7fd68f1ff700 1 -- start start 2023-07-09T21:51:10.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68f1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd68806ba00 0x7fd688154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68cf9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd68806ba00 0x7fd688154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68cf9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd68806ba00 0x7fd688154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37484/0 (socket says 172.21.15.53:37484) 2023-07-09T21:51:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68f1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6880cbe40 0x7fd6880c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68f1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6880cda40 0x7fd6880b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68f1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6881553d0 con 0x7fd68806ba00 2023-07-09T21:51:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68cf9b700 1 -- 172.21.15.53:0/3667246896 learned_addr learned my addr 172.21.15.53:0/3667246896 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68f1ff700 1 -- 172.21.15.53:0/3667246896 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68815a720 con 0x7fd6880cbe40 2023-07-09T21:51:10.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68f1ff700 1 -- 172.21.15.53:0/3667246896 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68815abb0 con 0x7fd6880cda40 2023-07-09T21:51:10.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68cf9b700 1 -- 172.21.15.53:0/3667246896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6880cda40 msgr2=0x7fd6880b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:10.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68cf9b700 1 --2- 172.21.15.53:0/3667246896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6880cda40 0x7fd6880b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68cf9b700 1 -- 172.21.15.53:0/3667246896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6880cbe40 msgr2=0x7fd6880c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:10.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68cf9b700 1 --2- 172.21.15.53:0/3667246896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6880cbe40 0x7fd6880c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:10.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.915+0000 7fd68cf9b700 1 -- 172.21.15.53:0/3667246896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6740094a0 con 0x7fd68806ba00 2023-07-09T21:51:10.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.916+0000 7fd68cf9b700 1 --2- 172.21.15.53:0/3667246896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd68806ba00 0x7fd688154e90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c780 tx=0x7fd67c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.916+0000 7fd6857fa700 1 -- 172.21.15.53:0/3667246896 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c004c80 con 0x7fd68806ba00 2023-07-09T21:51:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.916+0000 7fd6857fa700 1 -- 172.21.15.53:0/3667246896 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c004de0 con 0x7fd68806ba00 2023-07-09T21:51:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.916+0000 7fd68f1ff700 1 -- 172.21.15.53:0/3667246896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd680009a70 con 0x7fd68806ba00 2023-07-09T21:51:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.916+0000 7fd6857fa700 1 -- 172.21.15.53:0/3667246896 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0072f0 con 0x7fd68806ba00 2023-07-09T21:51:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.916+0000 7fd68f1ff700 1 -- 172.21.15.53:0/3667246896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd688159df0 con 0x7fd68806ba00 2023-07-09T21:51:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.917+0000 7fd68f1ff700 1 -- 172.21.15.53:0/3667246896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68815aa00 con 0x7fd68806ba00 2023-07-09T21:51:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.918+0000 7fd6857fa700 1 -- 172.21.15.53:0/3667246896 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd67c007450 con 0x7fd68806ba00 2023-07-09T21:51:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.919+0000 7fd6857fa700 1 --2- 172.21.15.53:0/3667246896 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd66c06ace0 0x7fd66c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.919+0000 7fd6857fa700 1 -- 172.21.15.53:0/3667246896 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd67c089160 con 0x7fd68806ba00 2023-07-09T21:51:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.920+0000 7fd687fff700 1 --2- 172.21.15.53:0/3667246896 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd66c06ace0 0x7fd66c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.920+0000 7fd687fff700 1 --2- 172.21.15.53:0/3667246896 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd66c06ace0 0x7fd66c06d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd674006f10 tx=0x7fd674006e60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:10.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:10.924+0000 7fd6857fa700 1 -- 172.21.15.53:0/3667246896 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd67c0541c0 con 0x7fd68806ba00 2023-07-09T21:51:11.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.131+0000 7fd68f1ff700 1 -- 172.21.15.53:0/3667246896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd6880ce3d0 con 0x7fd68806ba00 2023-07-09T21:51:11.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.136+0000 7fd6857fa700 1 -- 172.21.15.53:0/3667246896 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd6880ce3d0 con 0x7fd68806ba00 2023-07-09T21:51:11.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.138+0000 7fd68f1ff700 1 -- 172.21.15.53:0/3667246896 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd66c06ace0 msgr2=0x7fd66c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:11.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.138+0000 7fd68f1ff700 1 --2- 172.21.15.53:0/3667246896 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd66c06ace0 0x7fd66c06d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd674006f10 tx=0x7fd674006e60 comp rx=0 tx=0).stop 2023-07-09T21:51:11.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.138+0000 7fd68f1ff700 1 -- 172.21.15.53:0/3667246896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd68806ba00 msgr2=0x7fd688154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:11.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.138+0000 7fd68f1ff700 1 --2- 172.21.15.53:0/3667246896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd68806ba00 0x7fd688154e90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c780 tx=0x7fd67c00cb40 comp rx=0 tx=0).stop 2023-07-09T21:51:11.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.138+0000 7fd68f1ff700 1 -- 172.21.15.53:0/3667246896 shutdown_connections 2023-07-09T21:51:11.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.138+0000 7fd68f1ff700 1 --2- 172.21.15.53:0/3667246896 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd66c06ace0 0x7fd66c06d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:11.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.138+0000 7fd68f1ff700 1 --2- 172.21.15.53:0/3667246896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6880cda40 0x7fd6880b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:11.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.138+0000 7fd68f1ff700 1 --2- 172.21.15.53:0/3667246896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd68806ba00 0x7fd688154e90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:11.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.138+0000 7fd68f1ff700 1 --2- 172.21.15.53:0/3667246896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6880cbe40 0x7fd6880c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:11.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.138+0000 7fd68f1ff700 1 -- 172.21.15.53:0/3667246896 >> 172.21.15.53:0/3667246896 conn(0x7fd6880b05d0 msgr2=0x7fd688157870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:11.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.138+0000 7fd68f1ff700 1 -- 172.21.15.53:0/3667246896 shutdown_connections 2023-07-09T21:51:11.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.138+0000 7fd68f1ff700 1 -- 172.21.15.53:0/3667246896 wait complete. 2023-07-09T21:51:11.158 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:51:11.159 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:51:11.255 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:51:11.360 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:51:11.361 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:51:11.361 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:11.405 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:51:11.405 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:11.487 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:51:11.487 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:11.569 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:11.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.811+0000 7f8cde3ff700 1 Processor -- start 2023-07-09T21:51:11.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.811+0000 7f8cde3ff700 1 -- start start 2023-07-09T21:51:11.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.812+0000 7f8cde3ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8cd80b1e00 0x7f8cd80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:11.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.812+0000 7f8cde3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cd80d1220 0x7f8cd80afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:11.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.812+0000 7f8cde3ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd80d2ce0 con 0x7f8cd80b2350 2023-07-09T21:51:11.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.812+0000 7f8cde3ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd80b3350 con 0x7f8cd80b1e00 2023-07-09T21:51:11.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.812+0000 7f8cde3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80b3630 con 0x7f8cd80d1220 2023-07-09T21:51:11.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.812+0000 7f8cd7fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8cd80b1e00 0x7f8cd80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:11.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.812+0000 7f8cd77fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8cd80b2350 0x7f8cd80d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46044/0 (socket says 172.21.15.53:46044) 2023-07-09T21:51:11.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.812+0000 7f8cd77fe700 1 -- 172.21.15.53:0/1029988450 learned_addr learned my addr 172.21.15.53:0/1029988450 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:11.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.813+0000 7f8cdc99c700 1 --2- 172.21.15.53:0/1029988450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cd80d1220 0x7f8cd80afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:11.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.813+0000 7f8cd7fff700 1 -- 172.21.15.53:0/1029988450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cd80d1220 msgr2=0x7f8cd80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:11.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.813+0000 7f8cd7fff700 1 --2- 172.21.15.53:0/1029988450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cd80d1220 0x7f8cd80afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:11.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.813+0000 7f8cd7fff700 1 -- 172.21.15.53:0/1029988450 >> v1:172.21.15.53:6789/0 conn(0x7f8cd80b2350 legacy=0x7f8cd80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:11.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.813+0000 7f8cd7fff700 1 -- 172.21.15.53:0/1029988450 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd80b3910 con 0x7f8cd80b1e00 2023-07-09T21:51:11.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.813+0000 7f8cd7fff700 1 --2- 172.21.15.53:0/1029988450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd80b1e00 0x7f8cd80b43f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8009820 tx=0x7f8cc8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d973587de1a37df6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:11.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.813+0000 7f8cd6ffd700 1 -- 172.21.15.53:0/1029988450 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8005e30 con 0x7f8cd80b1e00 2023-07-09T21:51:11.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.813+0000 7f8cd6ffd700 1 -- 172.21.15.53:0/1029988450 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc8006030 con 0x7f8cd80b1e00 2023-07-09T21:51:11.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.813+0000 7f8cd6ffd700 1 -- 172.21.15.53:0/1029988450 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc80063e0 con 0x7f8cd80b1e00 2023-07-09T21:51:11.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.814+0000 7f8cde3ff700 1 -- 172.21.15.53:0/1029988450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd80b1e00 msgr2=0x7f8cd80b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:11.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.814+0000 7f8cde3ff700 1 --2- 172.21.15.53:0/1029988450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd80b1e00 0x7f8cd80b43f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8009820 tx=0x7f8cc8009b30 comp rx=0 tx=0).stop 2023-07-09T21:51:11.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.814+0000 7f8cde3ff700 1 -- 172.21.15.53:0/1029988450 shutdown_connections 2023-07-09T21:51:11.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.814+0000 7f8cde3ff700 1 --2- 172.21.15.53:0/1029988450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cd80d1220 0x7f8cd80afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:11.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.814+0000 7f8cde3ff700 1 --2- 172.21.15.53:0/1029988450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd80b1e00 0x7f8cd80b43f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:11.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.814+0000 7f8cde3ff700 1 -- 172.21.15.53:0/1029988450 >> 172.21.15.53:0/1029988450 conn(0x7f8cd809c1d0 msgr2=0x7f8cd80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.814+0000 7f8cde3ff700 1 -- 172.21.15.53:0/1029988450 shutdown_connections 2023-07-09T21:51:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.814+0000 7f8cde3ff700 1 -- 172.21.15.53:0/1029988450 wait complete. 2023-07-09T21:51:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.816+0000 7f8cde3ff700 1 Processor -- start 2023-07-09T21:51:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.816+0000 7f8cde3ff700 1 -- start start 2023-07-09T21:51:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.817+0000 7f8cde3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cd80b1e00 0x7f8cd81f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.817+0000 7f8cde3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8cd80b2350 0x7f8cd814b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.817+0000 7f8cde3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd80d1220 0x7f8cd80c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:11.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.817+0000 7f8cde3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81f62f0 con 0x7f8cd80d1220 2023-07-09T21:51:11.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.817+0000 7f8cde3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81f2e50 con 0x7f8cd80b2350 2023-07-09T21:51:11.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.817+0000 7f8cde3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd814b910 con 0x7f8cd80b1e00 2023-07-09T21:51:11.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.817+0000 7f8cdc99c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd80d1220 0x7f8cd80c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:11.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.817+0000 7f8cdc99c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd80d1220 0x7f8cd80c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37502/0 (socket says 172.21.15.53:37502) 2023-07-09T21:51:11.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.817+0000 7f8cd7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cd80b1e00 0x7f8cd81f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:11.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.817+0000 7f8cdc99c700 1 -- 172.21.15.53:0/232362515 learned_addr learned my addr 172.21.15.53:0/232362515 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.818+0000 7f8cdc99c700 1 -- 172.21.15.53:0/232362515 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cd80b1e00 msgr2=0x7f8cd81f2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.818+0000 7f8cdc99c700 1 --2- 172.21.15.53:0/232362515 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cd80b1e00 0x7f8cd81f2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.818+0000 7f8cdc99c700 1 -- 172.21.15.53:0/232362515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8cd80b2350 msgr2=0x7f8cd814b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:11.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.818+0000 7f8cdc99c700 1 --2- 172.21.15.53:0/232362515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8cd80b2350 0x7f8cd814b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:11.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.818+0000 7f8cdc99c700 1 -- 172.21.15.53:0/232362515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8009430 con 0x7f8cd80d1220 2023-07-09T21:51:11.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.818+0000 7f8cdc99c700 1 --2- 172.21.15.53:0/232362515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd80d1220 0x7f8cd80c8c40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0007e60 tx=0x7f8cd000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:11.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.818+0000 7f8cd4ff9700 1 -- 172.21.15.53:0/232362515 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd000ede0 con 0x7f8cd80d1220 2023-07-09T21:51:11.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.818+0000 7f8cd4ff9700 1 -- 172.21.15.53:0/232362515 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd0014420 con 0x7f8cd80d1220 2023-07-09T21:51:11.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.818+0000 7f8cd4ff9700 1 -- 172.21.15.53:0/232362515 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00147d0 con 0x7f8cd80d1220 2023-07-09T21:51:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.818+0000 7f8cde3ff700 1 -- 172.21.15.53:0/232362515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd81f5670 con 0x7f8cd80d1220 2023-07-09T21:51:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.818+0000 7f8cde3ff700 1 -- 172.21.15.53:0/232362515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd81f5c30 con 0x7f8cd80d1220 2023-07-09T21:51:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.819+0000 7f8cde3ff700 1 -- 172.21.15.53:0/232362515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd804e280 con 0x7f8cd80d1220 2023-07-09T21:51:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.820+0000 7f8cd4ff9700 1 -- 172.21.15.53:0/232362515 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8cd0014930 con 0x7f8cd80d1220 2023-07-09T21:51:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.822+0000 7f8cd4ff9700 1 --2- 172.21.15.53:0/232362515 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8cc406ace0 0x7f8cc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.822+0000 7f8cd4ff9700 1 -- 172.21.15.53:0/232362515 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8cd0089ba0 con 0x7f8cd80d1220 2023-07-09T21:51:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.822+0000 7f8cd7fff700 1 --2- 172.21.15.53:0/232362515 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8cc406ace0 0x7f8cc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:11.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.823+0000 7f8cd7fff700 1 --2- 172.21.15.53:0/232362515 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8cc406ace0 0x7f8cc406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8013040 tx=0x7f8cc8008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:11.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:11.826+0000 7f8cd4ff9700 1 -- 172.21.15.53:0/232362515 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8cd0054c00 con 0x7f8cd80d1220 2023-07-09T21:51:12.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.035+0000 7f8cde3ff700 1 -- 172.21.15.53:0/232362515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cd808c5a0 con 0x7f8cd80d1220 2023-07-09T21:51:12.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.037+0000 7f8cd4ff9700 1 -- 172.21.15.53:0/232362515 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f8cd0058220 con 0x7f8cd80d1220 2023-07-09T21:51:12.039 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:12.039 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:04.650456+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:12.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.039+0000 7f8cde3ff700 1 -- 172.21.15.53:0/232362515 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8cc406ace0 msgr2=0x7f8cc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.039+0000 7f8cde3ff700 1 --2- 172.21.15.53:0/232362515 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8cc406ace0 0x7f8cc406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8013040 tx=0x7f8cc8008070 comp rx=0 tx=0).stop 2023-07-09T21:51:12.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.039+0000 7f8cde3ff700 1 -- 172.21.15.53:0/232362515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd80d1220 msgr2=0x7f8cd80c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.039+0000 7f8cde3ff700 1 --2- 172.21.15.53:0/232362515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd80d1220 0x7f8cd80c8c40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0007e60 tx=0x7f8cd000e3c0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.039+0000 7f8cde3ff700 1 -- 172.21.15.53:0/232362515 shutdown_connections 2023-07-09T21:51:12.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.039+0000 7f8cde3ff700 1 --2- 172.21.15.53:0/232362515 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8cc406ace0 0x7f8cc406d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.039+0000 7f8cde3ff700 1 --2- 172.21.15.53:0/232362515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd80d1220 0x7f8cd80c8c40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.039+0000 7f8cde3ff700 1 --2- 172.21.15.53:0/232362515 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cd80b1e00 0x7f8cd81f2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.039+0000 7f8cde3ff700 1 --2- 172.21.15.53:0/232362515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8cd80b2350 0x7f8cd814b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.039+0000 7f8cde3ff700 1 -- 172.21.15.53:0/232362515 >> 172.21.15.53:0/232362515 conn(0x7f8cd809c1d0 msgr2=0x7f8cd80d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:12.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.039+0000 7f8cde3ff700 1 -- 172.21.15.53:0/232362515 shutdown_connections 2023-07-09T21:51:12.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.039+0000 7f8cde3ff700 1 -- 172.21.15.53:0/232362515 wait complete. 2023-07-09T21:51:12.060 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:50:21.703759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:50:22.243698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:51:12.061 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:51:12.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.262+0000 7f378abff700 1 Processor -- start 2023-07-09T21:51:12.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.262+0000 7f378abff700 1 -- start start 2023-07-09T21:51:12.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.263+0000 7f378abff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37840b3ff0 0x7f37840b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.263+0000 7f378abff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f37840d0b10 0x7f37840d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.263+0000 7f378abff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f37840b25d0 0x7f37840b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.263+0000 7f378abff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37840b8e80 con 0x7f37840d0b10 2023-07-09T21:51:12.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.263+0000 7f378abff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37840d14a0 con 0x7f37840b25d0 2023-07-09T21:51:12.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.263+0000 7f378abff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37840afaa0 con 0x7f37840b3ff0 2023-07-09T21:51:12.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.263+0000 7f3783fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f37840d0b10 0x7f37840d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.263+0000 7f3783fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f37840d0b10 0x7f37840d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37518/0 (socket says 172.21.15.53:37518) 2023-07-09T21:51:12.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.263+0000 7f3783fff700 1 -- 172.21.15.53:0/2558510073 learned_addr learned my addr 172.21.15.53:0/2558510073 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:12.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.263+0000 7f378899b700 1 --2- 172.21.15.53:0/2558510073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37840b3ff0 0x7f37840b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.263+0000 7f378919c700 1 --2- 172.21.15.53:0/2558510073 >> v2:172.21.15.184:3300/0 conn(0x7f37840b25d0 0x7f37840b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.264+0000 7f3783fff700 1 -- 172.21.15.53:0/2558510073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37840b3ff0 msgr2=0x7f37840b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:12.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.264+0000 7f3783fff700 1 --2- 172.21.15.53:0/2558510073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37840b3ff0 0x7f37840b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.264+0000 7f3783fff700 1 -- 172.21.15.53:0/2558510073 >> v2:172.21.15.184:3300/0 conn(0x7f37840b25d0 msgr2=0x7f37840b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:12.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.264+0000 7f3783fff700 1 --2- 172.21.15.53:0/2558510073 >> v2:172.21.15.184:3300/0 conn(0x7f37840b25d0 0x7f37840b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.264+0000 7f3783fff700 1 -- 172.21.15.53:0/2558510073 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840afd80 con 0x7f37840d0b10 2023-07-09T21:51:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.264+0000 7f378919c700 1 --2- 172.21.15.53:0/2558510073 >> v2:172.21.15.184:3300/0 conn(0x7f37840b25d0 0x7f37840b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.264+0000 7f3783fff700 1 --2- 172.21.15.53:0/2558510073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37840d0b10 0x7f37840d0f60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f378408c2e0 tx=0x7f3770009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf23d2a8953d2b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.264+0000 7f37837fe700 1 -- 172.21.15.53:0/2558510073 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770011830 con 0x7f37840d0b10 2023-07-09T21:51:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.264+0000 7f37837fe700 1 -- 172.21.15.53:0/2558510073 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770011990 con 0x7f37840d0b10 2023-07-09T21:51:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.264+0000 7f37837fe700 1 -- 172.21.15.53:0/2558510073 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770011d20 con 0x7f37840d0b10 2023-07-09T21:51:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.265+0000 7f378abff700 1 -- 172.21.15.53:0/2558510073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37840d0b10 msgr2=0x7f37840d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.265+0000 7f378abff700 1 --2- 172.21.15.53:0/2558510073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37840d0b10 0x7f37840d0f60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f378408c2e0 tx=0x7f3770009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.265+0000 7f378abff700 1 -- 172.21.15.53:0/2558510073 shutdown_connections 2023-07-09T21:51:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.265+0000 7f378abff700 1 --2- 172.21.15.53:0/2558510073 >> v2:172.21.15.184:3300/0 conn(0x7f37840b25d0 0x7f37840b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.265+0000 7f378abff700 1 --2- 172.21.15.53:0/2558510073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37840b3ff0 0x7f37840b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.265+0000 7f378abff700 1 --2- 172.21.15.53:0/2558510073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37840d0b10 0x7f37840d0f60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.265+0000 7f378abff700 1 -- 172.21.15.53:0/2558510073 >> 172.21.15.53:0/2558510073 conn(0x7f378409c1b0 msgr2=0x7f37840d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.265+0000 7f378abff700 1 -- 172.21.15.53:0/2558510073 shutdown_connections 2023-07-09T21:51:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.265+0000 7f378abff700 1 -- 172.21.15.53:0/2558510073 wait complete. 2023-07-09T21:51:12.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.268+0000 7f378abff700 1 Processor -- start 2023-07-09T21:51:12.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.268+0000 7f378abff700 1 -- start start 2023-07-09T21:51:12.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.269+0000 7f378abff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37840b25d0 0x7f378415e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.269+0000 7f378abff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37840b3ff0 0x7f378415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.269+0000 7f378abff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37840d0b10 0x7f37840cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.269+0000 7f378abff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37841f2f70 con 0x7f37840b3ff0 2023-07-09T21:51:12.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.269+0000 7f378abff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37841f22f0 con 0x7f37840b25d0 2023-07-09T21:51:12.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.269+0000 7f378abff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37841f25d0 con 0x7f37840d0b10 2023-07-09T21:51:12.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.269+0000 7f3783fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37840b3ff0 0x7f378415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.269+0000 7f3783fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37840b3ff0 0x7f378415a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37526/0 (socket says 172.21.15.53:37526) 2023-07-09T21:51:12.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.269+0000 7f3783fff700 1 -- 172.21.15.53:0/3825928998 learned_addr learned my addr 172.21.15.53:0/3825928998 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:12.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.270+0000 7f378919c700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37840d0b10 0x7f37840cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.270+0000 7f378899b700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37840b25d0 0x7f378415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.270+0000 7f3783fff700 1 -- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37840d0b10 msgr2=0x7f37840cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.270+0000 7f3783fff700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37840d0b10 0x7f37840cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.270+0000 7f3783fff700 1 -- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37840b25d0 msgr2=0x7f378415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.270+0000 7f3783fff700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37840b25d0 0x7f378415e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.270+0000 7f3783fff700 1 -- 172.21.15.53:0/3825928998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3770009550 con 0x7f37840b3ff0 2023-07-09T21:51:12.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.270+0000 7f3783fff700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37840b3ff0 0x7f378415a650 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3770009c10 tx=0x7f3770004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:12.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.270+0000 7f37817fa700 1 -- 172.21.15.53:0/3825928998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37700036a0 con 0x7f37840b3ff0 2023-07-09T21:51:12.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.270+0000 7f37817fa700 1 -- 172.21.15.53:0/3825928998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377001e070 con 0x7f37840b3ff0 2023-07-09T21:51:12.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.270+0000 7f378abff700 1 -- 172.21.15.53:0/3825928998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37841f28b0 con 0x7f37840b3ff0 2023-07-09T21:51:12.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.270+0000 7f37817fa700 1 -- 172.21.15.53:0/3825928998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770003a60 con 0x7f37840b3ff0 2023-07-09T21:51:12.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.270+0000 7f378abff700 1 -- 172.21.15.53:0/3825928998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37841f1f20 con 0x7f37840b3ff0 2023-07-09T21:51:12.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.272+0000 7f378abff700 1 -- 172.21.15.53:0/3825928998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37840d0960 con 0x7f37840b3ff0 2023-07-09T21:51:12.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.272+0000 7f37817fa700 1 -- 172.21.15.53:0/3825928998 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3770003bc0 con 0x7f37840b3ff0 2023-07-09T21:51:12.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.273+0000 7f37817fa700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f376806ace0 0x7f376806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.274+0000 7f37817fa700 1 -- 172.21.15.53:0/3825928998 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f377008a490 con 0x7f37840b3ff0 2023-07-09T21:51:12.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.274+0000 7f378899b700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f376806ace0 0x7f376806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.275+0000 7f378899b700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f376806ace0 0x7f376806d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f378406c650 tx=0x7f3778008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:12.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.278+0000 7f37817fa700 1 -- 172.21.15.53:0/3825928998 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f37700554f0 con 0x7f37840b3ff0 2023-07-09T21:51:12.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.483+0000 7f378abff700 1 -- 172.21.15.53:0/3825928998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f378415cd90 con 0x7f37840b3ff0 2023-07-09T21:51:12.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.483+0000 7f37817fa700 1 -- 172.21.15.53:0/3825928998 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f377002c3b0 con 0x7f37840b3ff0 2023-07-09T21:51:12.486 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:51:12.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.486+0000 7f378abff700 1 -- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f376806ace0 msgr2=0x7f376806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.486+0000 7f378abff700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f376806ace0 0x7f376806d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f378406c650 tx=0x7f3778008040 comp rx=0 tx=0).stop 2023-07-09T21:51:12.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.486+0000 7f378abff700 1 -- 172.21.15.53:0/3825928998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37840b3ff0 msgr2=0x7f378415a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.486+0000 7f378abff700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37840b3ff0 0x7f378415a650 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3770009c10 tx=0x7f3770004750 comp rx=0 tx=0).stop 2023-07-09T21:51:12.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.486+0000 7f378abff700 1 -- 172.21.15.53:0/3825928998 shutdown_connections 2023-07-09T21:51:12.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.486+0000 7f378abff700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f376806ace0 0x7f376806d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.486+0000 7f378abff700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37840d0b10 0x7f37840cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.486+0000 7f378abff700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37840b25d0 0x7f378415e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.486+0000 7f378abff700 1 --2- 172.21.15.53:0/3825928998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37840b3ff0 0x7f378415a650 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.486+0000 7f378abff700 1 -- 172.21.15.53:0/3825928998 >> 172.21.15.53:0/3825928998 conn(0x7f378409c1b0 msgr2=0x7f37840b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:12.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.486+0000 7f378abff700 1 -- 172.21.15.53:0/3825928998 shutdown_connections 2023-07-09T21:51:12.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.486+0000 7f378abff700 1 -- 172.21.15.53:0/3825928998 wait complete. 2023-07-09T21:51:12.507 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:51:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.707+0000 7f1fa79ff700 1 Processor -- start 2023-07-09T21:51:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.707+0000 7f1fa79ff700 1 -- start start 2023-07-09T21:51:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.709+0000 7f1fa79ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b3ff0 0x7f1fa00b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.709+0000 7f1fa79ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa00b8e80 con 0x7f1fa00d0f60 2023-07-09T21:51:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.709+0000 7f1fa79ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa00b33f0 con 0x7f1fa00d0b10 2023-07-09T21:51:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.709+0000 7f1fa79ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00b1e30 con 0x7f1fa00b3ff0 2023-07-09T21:51:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.709+0000 7f1fa5f9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1fa00d0f60 0x7f1fa00b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46046/0 (socket says 172.21.15.53:46046) 2023-07-09T21:51:12.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.709+0000 7f1fa5f9c700 1 -- 172.21.15.53:0/1287669704 learned_addr learned my addr 172.21.15.53:0/1287669704 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:12.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.709+0000 7f1fa579b700 1 --2- 172.21.15.53:0/1287669704 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b3ff0 0x7f1fa00b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.709+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213085809 0 0) 0x7f1f98001490 con 0x7f1fa00d0f60 2023-07-09T21:51:12.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.709+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f8c0035b0 con 0x7f1fa00d0f60 2023-07-09T21:51:12.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678666343 0 0) 0x7f1fa00b33f0 con 0x7f1fa00d0b10 2023-07-09T21:51:12.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f98001490 con 0x7f1fa00d0b10 2023-07-09T21:51:12.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 304639211 0 0) 0x7f1f8c0035b0 con 0x7f1fa00d0f60 2023-07-09T21:51:12.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b3ff0 msgr2=0x7f1fa00b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:12.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 --2- 172.21.15.53:0/1287669704 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b3ff0 0x7f1fa00b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 >> v1:172.21.15.184:6789/0 conn(0x7f1fa00d0b10 legacy=0x7f1fa00b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa00afaa0 con 0x7f1fa00d0f60 2023-07-09T21:51:12.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f1f98001b80 con 0x7f1fa00d0f60 2023-07-09T21:51:12.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 >> v1:172.21.15.53:6789/0 conn(0x7f1fa00d0f60 legacy=0x7f1fa00b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 --2- 172.21.15.53:0/1287669704 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f8c003bc0 0x7f1f8c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 --2- 172.21.15.53:0/1287669704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f8c004850 0x7f1f8c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 --2- 172.21.15.53:0/1287669704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f8c005200 0x7f1f8c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00b1e30 con 0x7f1f8c005200 2023-07-09T21:51:12.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c00bf80 con 0x7f1f8c004850 2023-07-09T21:51:12.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c00c140 con 0x7f1f8c003bc0 2023-07-09T21:51:12.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1fa579b700 1 --2- 172.21.15.53:0/1287669704 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b3ff0 0x7f1fa00b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:12.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1fa5f9c700 1 --2- 172.21.15.53:0/1287669704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f8c005200 0x7f1f8c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1fa4f9a700 1 --2- 172.21.15.53:0/1287669704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f8c004850 0x7f1f8c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.710+0000 7f1fa579b700 1 --2- 172.21.15.53:0/1287669704 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f8c003bc0 0x7f1f8c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.711+0000 7f1fa5f9c700 1 -- 172.21.15.53:0/1287669704 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f8c003bc0 msgr2=0x7f1f8c003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:12.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.711+0000 7f1fa5f9c700 1 --2- 172.21.15.53:0/1287669704 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f8c003bc0 0x7f1f8c003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.711+0000 7f1fa5f9c700 1 -- 172.21.15.53:0/1287669704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f8c004850 msgr2=0x7f1f8c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:12.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.711+0000 7f1fa5f9c700 1 --2- 172.21.15.53:0/1287669704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f8c004850 0x7f1f8c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.711+0000 7f1fa5f9c700 1 -- 172.21.15.53:0/1287669704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c0035b0 con 0x7f1f8c005200 2023-07-09T21:51:12.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.711+0000 7f1fa5f9c700 1 --2- 172.21.15.53:0/1287669704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f8c005200 0x7f1f8c00ba10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800a6f0 tx=0x7f1f8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6f433cdb925990 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:12.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.711+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800a350 con 0x7f1f8c005200 2023-07-09T21:51:12.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.711+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f98007310 con 0x7f1f8c005200 2023-07-09T21:51:12.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.711+0000 7f1f97fff700 1 -- 172.21.15.53:0/1287669704 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f980076c0 con 0x7f1f8c005200 2023-07-09T21:51:12.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.712+0000 7f1fa79ff700 1 -- 172.21.15.53:0/1287669704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f8c005200 msgr2=0x7f1f8c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.712+0000 7f1fa79ff700 1 --2- 172.21.15.53:0/1287669704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f8c005200 0x7f1f8c00ba10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800a6f0 tx=0x7f1f8c005880 comp rx=0 tx=0).stop 2023-07-09T21:51:12.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.712+0000 7f1fa5f9c700 1 -- 172.21.15.53:0/1287669704 reap_dead start 2023-07-09T21:51:12.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.712+0000 7f1fa79ff700 1 -- 172.21.15.53:0/1287669704 shutdown_connections 2023-07-09T21:51:12.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.712+0000 7f1fa79ff700 1 -- 172.21.15.53:0/1287669704 >> 172.21.15.53:0/1287669704 conn(0x7f1fa009c1b0 msgr2=0x7f1fa00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:12.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.712+0000 7f1fa79ff700 1 -- 172.21.15.53:0/1287669704 shutdown_connections 2023-07-09T21:51:12.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.712+0000 7f1fa79ff700 1 -- 172.21.15.53:0/1287669704 wait complete. 2023-07-09T21:51:12.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.714+0000 7f1fa79ff700 1 Processor -- start 2023-07-09T21:51:12.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.714+0000 7f1fa79ff700 1 -- start start 2023-07-09T21:51:12.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.715+0000 7f1fa79ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f8c005200 0x7f1fa00ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.715+0000 7f1fa79ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa01561f0 0x7f1fa014d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.715+0000 7f1fa79ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00cbc10 0x7f1fa00cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.715+0000 7f1fa79ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa0156a70 con 0x7f1fa01561f0 2023-07-09T21:51:12.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.715+0000 7f1fa79ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00cc8e0 con 0x7f1f8c005200 2023-07-09T21:51:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.715+0000 7f1fa79ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00ccbc0 con 0x7f1fa00cbc10 2023-07-09T21:51:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.715+0000 7f1fa4f9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa01561f0 0x7f1fa014d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.715+0000 7f1fa4f9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa01561f0 0x7f1fa014d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37544/0 (socket says 172.21.15.53:37544) 2023-07-09T21:51:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.715+0000 7f1fa4f9a700 1 -- 172.21.15.53:0/2132942094 learned_addr learned my addr 172.21.15.53:0/2132942094 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.715+0000 7f1fa579b700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f8c005200 0x7f1fa00ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.715+0000 7f1fa5f9c700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00cbc10 0x7f1fa00cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.716+0000 7f1fa4f9a700 1 -- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00cbc10 msgr2=0x7f1fa00cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.716+0000 7f1fa4f9a700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00cbc10 0x7f1fa00cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.716+0000 7f1fa4f9a700 1 -- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f8c005200 msgr2=0x7f1fa00ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.716+0000 7f1fa4f9a700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f8c005200 0x7f1fa00ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.716+0000 7f1fa4f9a700 1 -- 172.21.15.53:0/2132942094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa00ccea0 con 0x7f1fa01561f0 2023-07-09T21:51:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.716+0000 7f1fa4f9a700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa01561f0 0x7f1fa014d150 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000f7e0 tx=0x7f1f9000faf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.716+0000 7f1f95ffb700 1 -- 172.21.15.53:0/2132942094 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90001520 con 0x7f1fa01561f0 2023-07-09T21:51:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.716+0000 7f1f95ffb700 1 -- 172.21.15.53:0/2132942094 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f900052e0 con 0x7f1fa01561f0 2023-07-09T21:51:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.716+0000 7f1fa79ff700 1 -- 172.21.15.53:0/2132942094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa00cd180 con 0x7f1fa01561f0 2023-07-09T21:51:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.716+0000 7f1f95ffb700 1 -- 172.21.15.53:0/2132942094 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90003680 con 0x7f1fa01561f0 2023-07-09T21:51:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.716+0000 7f1fa79ff700 1 -- 172.21.15.53:0/2132942094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa00ca6d0 con 0x7f1fa01561f0 2023-07-09T21:51:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.717+0000 7f1fa79ff700 1 -- 172.21.15.53:0/2132942094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa00cdc20 con 0x7f1fa01561f0 2023-07-09T21:51:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.718+0000 7f1f95ffb700 1 -- 172.21.15.53:0/2132942094 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f90003800 con 0x7f1fa01561f0 2023-07-09T21:51:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.719+0000 7f1f95ffb700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1f8406ace0 0x7f1f8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.719+0000 7f1f95ffb700 1 -- 172.21.15.53:0/2132942094 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1f90089470 con 0x7f1fa01561f0 2023-07-09T21:51:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.720+0000 7f1fa579b700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1f8406ace0 0x7f1f8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.720+0000 7f1fa579b700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1f8406ace0 0x7f1f8406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00b5b00 tx=0x7f1f9c009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.724+0000 7f1f95ffb700 1 -- 172.21.15.53:0/2132942094 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f900543c0 con 0x7f1fa01561f0 2023-07-09T21:51:12.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.929+0000 7f1fa79ff700 1 -- 172.21.15.53:0/2132942094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1fa0074350 con 0x7f1fa01561f0 2023-07-09T21:51:12.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.929+0000 7f1f95ffb700 1 -- 172.21.15.53:0/2132942094 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1f900579e0 con 0x7f1fa01561f0 2023-07-09T21:51:12.932 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:51:12.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.931+0000 7f1fa79ff700 1 -- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1f8406ace0 msgr2=0x7f1f8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.931+0000 7f1fa79ff700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1f8406ace0 0x7f1f8406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00b5b00 tx=0x7f1f9c009210 comp rx=0 tx=0).stop 2023-07-09T21:51:12.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.931+0000 7f1fa79ff700 1 -- 172.21.15.53:0/2132942094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa01561f0 msgr2=0x7f1fa014d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:12.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.931+0000 7f1fa79ff700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa01561f0 0x7f1fa014d150 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000f7e0 tx=0x7f1f9000faf0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.932+0000 7f1fa79ff700 1 -- 172.21.15.53:0/2132942094 shutdown_connections 2023-07-09T21:51:12.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.932+0000 7f1fa79ff700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1f8406ace0 0x7f1f8406d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.932+0000 7f1fa79ff700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00cbc10 0x7f1fa00cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.932+0000 7f1fa79ff700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f8c005200 0x7f1fa00ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.932+0000 7f1fa79ff700 1 --2- 172.21.15.53:0/2132942094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa01561f0 0x7f1fa014d150 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:12.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.932+0000 7f1fa79ff700 1 -- 172.21.15.53:0/2132942094 >> 172.21.15.53:0/2132942094 conn(0x7f1fa009c1b0 msgr2=0x7f1fa006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:12.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.932+0000 7f1fa79ff700 1 -- 172.21.15.53:0/2132942094 shutdown_connections 2023-07-09T21:51:12.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:12.932+0000 7f1fa79ff700 1 -- 172.21.15.53:0/2132942094 wait complete. 2023-07-09T21:51:12.952 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:51:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.153+0000 7f6978bff700 1 Processor -- start 2023-07-09T21:51:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.153+0000 7f6978bff700 1 -- start start 2023-07-09T21:51:13.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.154+0000 7f6978bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69740b3ff0 0x7f69740b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:13.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.154+0000 7f6978bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f69740d0b10 0x7f69740d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:13.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.154+0000 7f6978bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f69740b25d0 0x7f69740b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:13.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.154+0000 7f6978bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69740b8e80 con 0x7f69740d0b10 2023-07-09T21:51:13.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.154+0000 7f6978bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69740d14a0 con 0x7f69740b25d0 2023-07-09T21:51:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.154+0000 7f6978bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69740afaa0 con 0x7f69740b3ff0 2023-07-09T21:51:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.155+0000 7f6971d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f69740d0b10 0x7f69740d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.155+0000 7f6971d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f69740d0b10 0x7f69740d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51056/0 (socket says 172.21.15.53:51056) 2023-07-09T21:51:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.155+0000 7f6971d9b700 1 -- 172.21.15.53:0/1869990481 learned_addr learned my addr 172.21.15.53:0/1869990481 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.155+0000 7f6972d9d700 1 --2- 172.21.15.53:0/1869990481 >> v2:172.21.15.184:3300/0 conn(0x7f69740b25d0 0x7f69740b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:13.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.155+0000 7f697259c700 1 --2- 172.21.15.53:0/1869990481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69740b3ff0 0x7f69740b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:13.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.155+0000 7f6971d9b700 1 -- 172.21.15.53:0/1869990481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69740b3ff0 msgr2=0x7f69740b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.155+0000 7f6971d9b700 1 --2- 172.21.15.53:0/1869990481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69740b3ff0 0x7f69740b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.155+0000 7f6971d9b700 1 -- 172.21.15.53:0/1869990481 >> v2:172.21.15.184:3300/0 conn(0x7f69740b25d0 msgr2=0x7f69740b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.155+0000 7f6971d9b700 1 --2- 172.21.15.53:0/1869990481 >> v2:172.21.15.184:3300/0 conn(0x7f69740b25d0 0x7f69740b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.155+0000 7f6971d9b700 1 -- 172.21.15.53:0/1869990481 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740afd80 con 0x7f69740d0b10 2023-07-09T21:51:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.156+0000 7f6971d9b700 1 --2- 172.21.15.53:0/1869990481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69740d0b10 0x7f69740d0f60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f697408c2e0 tx=0x7f6968009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7419e52ed160a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.156+0000 7f697159a700 1 -- 172.21.15.53:0/1869990481 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968011830 con 0x7f69740d0b10 2023-07-09T21:51:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.156+0000 7f697159a700 1 -- 172.21.15.53:0/1869990481 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968011990 con 0x7f69740d0b10 2023-07-09T21:51:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.156+0000 7f697159a700 1 -- 172.21.15.53:0/1869990481 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968011d20 con 0x7f69740d0b10 2023-07-09T21:51:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.156+0000 7f6978bff700 1 -- 172.21.15.53:0/1869990481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69740d0b10 msgr2=0x7f69740d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.156+0000 7f6978bff700 1 --2- 172.21.15.53:0/1869990481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69740d0b10 0x7f69740d0f60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f697408c2e0 tx=0x7f6968009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.156+0000 7f6978bff700 1 -- 172.21.15.53:0/1869990481 shutdown_connections 2023-07-09T21:51:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.156+0000 7f6978bff700 1 --2- 172.21.15.53:0/1869990481 >> v2:172.21.15.184:3300/0 conn(0x7f69740b25d0 0x7f69740b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.156+0000 7f6978bff700 1 --2- 172.21.15.53:0/1869990481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69740b3ff0 0x7f69740b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.156+0000 7f6978bff700 1 --2- 172.21.15.53:0/1869990481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69740d0b10 0x7f69740d0f60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.156+0000 7f6978bff700 1 -- 172.21.15.53:0/1869990481 >> 172.21.15.53:0/1869990481 conn(0x7f697409c1b0 msgr2=0x7f69740d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.156+0000 7f6978bff700 1 -- 172.21.15.53:0/1869990481 shutdown_connections 2023-07-09T21:51:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.157+0000 7f6978bff700 1 -- 172.21.15.53:0/1869990481 wait complete. 2023-07-09T21:51:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.158+0000 7f6978bff700 1 Processor -- start 2023-07-09T21:51:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.158+0000 7f6978bff700 1 -- start start 2023-07-09T21:51:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.159+0000 7f6978bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69740b25d0 0x7f69740cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.159+0000 7f6978bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69740b3ff0 0x7f6974157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.159+0000 7f6978bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69740d0b10 0x7f6974157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.159+0000 7f6978bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6974158fd0 con 0x7f69740d0b10 2023-07-09T21:51:13.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.159+0000 7f6978bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6974158650 con 0x7f69740b3ff0 2023-07-09T21:51:13.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.159+0000 7f6978bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69740caf60 con 0x7f69740b25d0 2023-07-09T21:51:13.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.160+0000 7f6972d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69740d0b10 0x7f6974157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:13.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.160+0000 7f6972d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69740d0b10 0x7f6974157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51058/0 (socket says 172.21.15.53:51058) 2023-07-09T21:51:13.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.160+0000 7f6972d9d700 1 -- 172.21.15.53:0/2881057492 learned_addr learned my addr 172.21.15.53:0/2881057492 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:13.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.160+0000 7f6971d9b700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69740b3ff0 0x7f6974157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:13.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.160+0000 7f697259c700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69740b25d0 0x7f69740cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.160+0000 7f6972d9d700 1 -- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69740b25d0 msgr2=0x7f69740cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.160+0000 7f6972d9d700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69740b25d0 0x7f69740cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.160+0000 7f6972d9d700 1 -- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69740b3ff0 msgr2=0x7f6974157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.160+0000 7f6972d9d700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69740b3ff0 0x7f6974157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.160+0000 7f6972d9d700 1 -- 172.21.15.53:0/2881057492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6968009550 con 0x7f69740d0b10 2023-07-09T21:51:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.160+0000 7f6971d9b700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69740b3ff0 0x7f6974157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.160+0000 7f6972d9d700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69740d0b10 0x7f6974157ff0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f696c00efc0 tx=0x7f696c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.161+0000 7f6962ffd700 1 -- 172.21.15.53:0/2881057492 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c00cd40 con 0x7f69740d0b10 2023-07-09T21:51:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.161+0000 7f6962ffd700 1 -- 172.21.15.53:0/2881057492 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c00f040 con 0x7f69740d0b10 2023-07-09T21:51:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.161+0000 7f6962ffd700 1 -- 172.21.15.53:0/2881057492 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c0146c0 con 0x7f69740d0b10 2023-07-09T21:51:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.161+0000 7f6978bff700 1 -- 172.21.15.53:0/2881057492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6974158910 con 0x7f69740d0b10 2023-07-09T21:51:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.161+0000 7f6978bff700 1 -- 172.21.15.53:0/2881057492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697415ac50 con 0x7f69740d0b10 2023-07-09T21:51:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.162+0000 7f6978bff700 1 -- 172.21.15.53:0/2881057492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6974159110 con 0x7f69740d0b10 2023-07-09T21:51:13.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.163+0000 7f6962ffd700 1 -- 172.21.15.53:0/2881057492 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f696c014820 con 0x7f69740d0b10 2023-07-09T21:51:13.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.164+0000 7f6962ffd700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f695406ace0 0x7f695406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:13.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.164+0000 7f6962ffd700 1 -- 172.21.15.53:0/2881057492 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f696c08a0d0 con 0x7f69740d0b10 2023-07-09T21:51:13.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.165+0000 7f697259c700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f695406ace0 0x7f695406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:13.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.165+0000 7f697259c700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f695406ace0 0x7f695406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6964009af0 tx=0x7f6964008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:13.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.169+0000 7f6962ffd700 1 -- 172.21.15.53:0/2881057492 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f696c058bc0 con 0x7f69740d0b10 2023-07-09T21:51:13.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.374+0000 7f6978bff700 1 -- 172.21.15.53:0/2881057492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6974074350 con 0x7f69740d0b10 2023-07-09T21:51:13.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.375+0000 7f6962ffd700 1 -- 172.21.15.53:0/2881057492 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f696c018020 con 0x7f69740d0b10 2023-07-09T21:51:13.377 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:51:13.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.377+0000 7f6978bff700 1 -- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f695406ace0 msgr2=0x7f695406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:13.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.377+0000 7f6978bff700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f695406ace0 0x7f695406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6964009af0 tx=0x7f6964008040 comp rx=0 tx=0).stop 2023-07-09T21:51:13.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.377+0000 7f6978bff700 1 -- 172.21.15.53:0/2881057492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69740d0b10 msgr2=0x7f6974157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:13.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.377+0000 7f6978bff700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69740d0b10 0x7f6974157ff0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f696c00efc0 tx=0x7f696c00c3a0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.377+0000 7f6978bff700 1 -- 172.21.15.53:0/2881057492 shutdown_connections 2023-07-09T21:51:13.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.377+0000 7f6978bff700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f695406ace0 0x7f695406d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.377+0000 7f6978bff700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69740d0b10 0x7f6974157ff0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.377+0000 7f6978bff700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69740b25d0 0x7f69740cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.377+0000 7f6978bff700 1 --2- 172.21.15.53:0/2881057492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69740b3ff0 0x7f6974157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.377+0000 7f6978bff700 1 -- 172.21.15.53:0/2881057492 >> 172.21.15.53:0/2881057492 conn(0x7f697409c1b0 msgr2=0x7f69740d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:13.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.378+0000 7f6978bff700 1 -- 172.21.15.53:0/2881057492 shutdown_connections 2023-07-09T21:51:13.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.378+0000 7f6978bff700 1 -- 172.21.15.53:0/2881057492 wait complete. 2023-07-09T21:51:13.397 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:51:13.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.598+0000 7f87eedff700 1 Processor -- start 2023-07-09T21:51:13.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.598+0000 7f87eedff700 1 -- start start 2023-07-09T21:51:13.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.599+0000 7f87eedff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e80b3ff0 0x7f87e80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:13.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.599+0000 7f87eedff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f87e80d0f60 0x7f87e80b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:13.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.599+0000 7f87eedff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e80b8e80 con 0x7f87e80d0b10 2023-07-09T21:51:13.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.599+0000 7f87eedff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e80b1e30 con 0x7f87e80d0f60 2023-07-09T21:51:13.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.599+0000 7f87eedff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80afaa0 con 0x7f87e80b3ff0 2023-07-09T21:51:13.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.600+0000 7f87e7fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f87e80d0b10 0x7f87e80b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43548/0 (socket says 172.21.15.53:43548) 2023-07-09T21:51:13.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.600+0000 7f87e7fff700 1 -- 172.21.15.53:0/1413234442 learned_addr learned my addr 172.21.15.53:0/1413234442 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:13.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.600+0000 7f87ecb9b700 1 --2- 172.21.15.53:0/1413234442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e80b3ff0 0x7f87e80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:13.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.600+0000 7f87ed39c700 1 --2- 172.21.15.53:0/1413234442 >> v2:172.21.15.184:3300/0 conn(0x7f87e80d0f60 0x7f87e80b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:13.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.600+0000 7f87e77fe700 1 -- 172.21.15.53:0/1413234442 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 558655532 0 0) 0x7f87d4001110 con 0x7f87e80d0b10 2023-07-09T21:51:13.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.600+0000 7f87e77fe700 1 -- 172.21.15.53:0/1413234442 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87d80035b0 con 0x7f87e80d0b10 2023-07-09T21:51:13.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.600+0000 7f87ecb9b700 1 -- 172.21.15.53:0/1413234442 >> v2:172.21.15.184:3300/0 conn(0x7f87e80d0f60 msgr2=0x7f87e80b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:13.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.600+0000 7f87ecb9b700 1 --2- 172.21.15.53:0/1413234442 >> v2:172.21.15.184:3300/0 conn(0x7f87e80d0f60 0x7f87e80b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.600+0000 7f87ecb9b700 1 -- 172.21.15.53:0/1413234442 >> v1:172.21.15.53:6789/0 conn(0x7f87e80d0b10 legacy=0x7f87e80b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:13.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.600+0000 7f87ecb9b700 1 -- 172.21.15.53:0/1413234442 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80afd80 con 0x7f87e80b3ff0 2023-07-09T21:51:13.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.600+0000 7f87ed39c700 1 --2- 172.21.15.53:0/1413234442 >> v2:172.21.15.184:3300/0 conn(0x7f87e80d0f60 0x7f87e80b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:13.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.601+0000 7f87ecb9b700 1 --2- 172.21.15.53:0/1413234442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e80b3ff0 0x7f87e80b43c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009840 tx=0x7f87dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c76efd05f19292cb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:13.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.601+0000 7f87e77fe700 1 -- 172.21.15.53:0/1413234442 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc011830 con 0x7f87e80b3ff0 2023-07-09T21:51:13.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.601+0000 7f87e77fe700 1 -- 172.21.15.53:0/1413234442 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc011990 con 0x7f87e80b3ff0 2023-07-09T21:51:13.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.601+0000 7f87e77fe700 1 -- 172.21.15.53:0/1413234442 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc011d20 con 0x7f87e80b3ff0 2023-07-09T21:51:13.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.601+0000 7f87eedff700 1 -- 172.21.15.53:0/1413234442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e80b3ff0 msgr2=0x7f87e80b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:13.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.601+0000 7f87eedff700 1 --2- 172.21.15.53:0/1413234442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e80b3ff0 0x7f87e80b43c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009840 tx=0x7f87dc009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:13.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.601+0000 7f87eedff700 1 -- 172.21.15.53:0/1413234442 shutdown_connections 2023-07-09T21:51:13.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.601+0000 7f87eedff700 1 --2- 172.21.15.53:0/1413234442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e80b3ff0 0x7f87e80b43c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.601+0000 7f87eedff700 1 --2- 172.21.15.53:0/1413234442 >> v2:172.21.15.184:3300/0 conn(0x7f87e80d0f60 0x7f87e80b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.601+0000 7f87eedff700 1 -- 172.21.15.53:0/1413234442 >> 172.21.15.53:0/1413234442 conn(0x7f87e809c1b0 msgr2=0x7f87e80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:13.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.602+0000 7f87eedff700 1 -- 172.21.15.53:0/1413234442 shutdown_connections 2023-07-09T21:51:13.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.602+0000 7f87eedff700 1 -- 172.21.15.53:0/1413234442 wait complete. 2023-07-09T21:51:13.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.603+0000 7f87eedff700 1 Processor -- start 2023-07-09T21:51:13.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.604+0000 7f87eedff700 1 -- start start 2023-07-09T21:51:13.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.604+0000 7f87eedff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e80b3ff0 0x7f87e815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:13.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87eedff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e80d0b10 0x7f87e815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:13.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87eedff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e80d0f60 0x7f87e815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:13.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87eedff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80a0830 con 0x7f87e80d0f60 2023-07-09T21:51:13.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87eedff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e815d990 con 0x7f87e80b3ff0 2023-07-09T21:51:13.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87eedff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e815dc70 con 0x7f87e80d0b10 2023-07-09T21:51:13.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87ed39c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e80d0f60 0x7f87e815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:13.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87ed39c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e80d0f60 0x7f87e815f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51064/0 (socket says 172.21.15.53:51064) 2023-07-09T21:51:13.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87ed39c700 1 -- 172.21.15.53:0/3425860793 learned_addr learned my addr 172.21.15.53:0/3425860793 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:13.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87ecb9b700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e80b3ff0 0x7f87e815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:13.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87e7fff700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e80d0b10 0x7f87e815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:13.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87ed39c700 1 -- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e80d0b10 msgr2=0x7f87e815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:13.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87ed39c700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e80d0b10 0x7f87e815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87ed39c700 1 -- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e80b3ff0 msgr2=0x7f87e815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:13.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87ed39c700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e80b3ff0 0x7f87e815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.605+0000 7f87ed39c700 1 -- 172.21.15.53:0/3425860793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e0009a70 con 0x7f87e80d0f60 2023-07-09T21:51:13.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.606+0000 7f87ed39c700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e80d0f60 0x7f87e815f1d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f87e000efc0 tx=0x7f87e000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:13.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.606+0000 7f87e57fa700 1 -- 172.21.15.53:0/3425860793 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0009cd0 con 0x7f87e80d0f60 2023-07-09T21:51:13.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.606+0000 7f87e57fa700 1 -- 172.21.15.53:0/3425860793 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e000f040 con 0x7f87e80d0f60 2023-07-09T21:51:13.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.606+0000 7f87e57fa700 1 -- 172.21.15.53:0/3425860793 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000cd60 con 0x7f87e80d0f60 2023-07-09T21:51:13.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.606+0000 7f87eedff700 1 -- 172.21.15.53:0/3425860793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87dc0094a0 con 0x7f87e80d0f60 2023-07-09T21:51:13.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.606+0000 7f87eedff700 1 -- 172.21.15.53:0/3425860793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e815e230 con 0x7f87e80d0f60 2023-07-09T21:51:13.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.607+0000 7f87eedff700 1 -- 172.21.15.53:0/3425860793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e8074350 con 0x7f87e80d0f60 2023-07-09T21:51:13.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.608+0000 7f87e57fa700 1 -- 172.21.15.53:0/3425860793 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87e0014480 con 0x7f87e80d0f60 2023-07-09T21:51:13.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.609+0000 7f87e57fa700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f87cc06ace0 0x7f87cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:13.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.609+0000 7f87e57fa700 1 -- 172.21.15.53:0/3425860793 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f87e0089bf0 con 0x7f87e80d0f60 2023-07-09T21:51:13.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.610+0000 7f87ecb9b700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f87cc06ace0 0x7f87cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:13.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.610+0000 7f87ecb9b700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f87cc06ace0 0x7f87cc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f87dc000c00 tx=0x7f87dc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:13.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.613+0000 7f87e57fa700 1 -- 172.21.15.53:0/3425860793 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f87e0054c90 con 0x7f87e80d0f60 2023-07-09T21:51:13.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.823+0000 7f87eedff700 1 -- 172.21.15.53:0/3425860793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87e8073800 con 0x7f87e80d0f60 2023-07-09T21:51:13.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.824+0000 7f87e57fa700 1 -- 172.21.15.53:0/3425860793 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87e00582b0 con 0x7f87e80d0f60 2023-07-09T21:51:13.826 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:51:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.826+0000 7f87eedff700 1 -- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f87cc06ace0 msgr2=0x7f87cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.826+0000 7f87eedff700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f87cc06ace0 0x7f87cc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f87dc000c00 tx=0x7f87dc008030 comp rx=0 tx=0).stop 2023-07-09T21:51:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.826+0000 7f87eedff700 1 -- 172.21.15.53:0/3425860793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e80d0f60 msgr2=0x7f87e815f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.826+0000 7f87eedff700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e80d0f60 0x7f87e815f1d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f87e000efc0 tx=0x7f87e000c3a0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.826+0000 7f87eedff700 1 -- 172.21.15.53:0/3425860793 shutdown_connections 2023-07-09T21:51:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.826+0000 7f87eedff700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f87cc06ace0 0x7f87cc06d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.826+0000 7f87eedff700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e80d0f60 0x7f87e815f1d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.826+0000 7f87eedff700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e80b3ff0 0x7f87e815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.826+0000 7f87eedff700 1 --2- 172.21.15.53:0/3425860793 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e80d0b10 0x7f87e815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.826+0000 7f87eedff700 1 -- 172.21.15.53:0/3425860793 >> 172.21.15.53:0/3425860793 conn(0x7f87e809c1b0 msgr2=0x7f87e80b7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.826+0000 7f87eedff700 1 -- 172.21.15.53:0/3425860793 shutdown_connections 2023-07-09T21:51:13.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:13.826+0000 7f87eedff700 1 -- 172.21.15.53:0/3425860793 wait complete. 2023-07-09T21:51:13.846 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:51:14.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.045+0000 7fe8927ff700 1 Processor -- start 2023-07-09T21:51:14.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.045+0000 7fe8927ff700 1 -- start start 2023-07-09T21:51:14.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.046+0000 7fe8927ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0b3ff0 0x7fe88c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:14.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.046+0000 7fe8927ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe88c0d0b10 0x7fe88c0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:14.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.046+0000 7fe8927ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88c0b8e80 con 0x7fe88c0b25d0 2023-07-09T21:51:14.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.046+0000 7fe8927ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88c0d14a0 con 0x7fe88c0d0b10 2023-07-09T21:51:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.046+0000 7fe8927ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0b1e30 con 0x7fe88c0b3ff0 2023-07-09T21:51:14.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.047+0000 7fe88b7fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe88c0d0b10 0x7fe88c0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:14.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.047+0000 7fe88bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0b3ff0 0x7fe88c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:14.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.047+0000 7fe88b7fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe88c0d0b10 0x7fe88c0d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:49742/0 (socket says 172.21.15.53:49742) 2023-07-09T21:51:14.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.047+0000 7fe88b7fe700 1 -- 172.21.15.53:0/900839282 learned_addr learned my addr 172.21.15.53:0/900839282 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:14.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.047+0000 7fe88b7fe700 1 -- 172.21.15.53:0/900839282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0b3ff0 msgr2=0x7fe88c0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:14.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.047+0000 7fe88b7fe700 1 --2- 172.21.15.53:0/900839282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0b3ff0 0x7fe88c0b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.047+0000 7fe88b7fe700 1 -- 172.21.15.53:0/900839282 >> v1:172.21.15.184:6789/0 conn(0x7fe88c0b25d0 legacy=0x7fe88c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:14.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.047+0000 7fe88b7fe700 1 -- 172.21.15.53:0/900839282 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c0afaa0 con 0x7fe88c0d0b10 2023-07-09T21:51:14.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.047+0000 7fe88b7fe700 1 --2- 172.21.15.53:0/900839282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0d0b10 0x7fe88c0d0f60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe8800098f0 tx=0x7fe880009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0010f994b4c7e8a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:14.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.048+0000 7fe88affd700 1 -- 172.21.15.53:0/900839282 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880011830 con 0x7fe88c0d0b10 2023-07-09T21:51:14.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.048+0000 7fe88affd700 1 -- 172.21.15.53:0/900839282 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe880011990 con 0x7fe88c0d0b10 2023-07-09T21:51:14.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.048+0000 7fe88affd700 1 -- 172.21.15.53:0/900839282 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880011d20 con 0x7fe88c0d0b10 2023-07-09T21:51:14.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.048+0000 7fe8927ff700 1 -- 172.21.15.53:0/900839282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0d0b10 msgr2=0x7fe88c0d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:14.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.048+0000 7fe8927ff700 1 --2- 172.21.15.53:0/900839282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0d0b10 0x7fe88c0d0f60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe8800098f0 tx=0x7fe880009c00 comp rx=0 tx=0).stop 2023-07-09T21:51:14.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.048+0000 7fe8927ff700 1 -- 172.21.15.53:0/900839282 shutdown_connections 2023-07-09T21:51:14.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.048+0000 7fe8927ff700 1 --2- 172.21.15.53:0/900839282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0b3ff0 0x7fe88c0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.048+0000 7fe8927ff700 1 --2- 172.21.15.53:0/900839282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0d0b10 0x7fe88c0d0f60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.048+0000 7fe8927ff700 1 -- 172.21.15.53:0/900839282 >> 172.21.15.53:0/900839282 conn(0x7fe88c09c1b0 msgr2=0x7fe88c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:14.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.048+0000 7fe8927ff700 1 -- 172.21.15.53:0/900839282 shutdown_connections 2023-07-09T21:51:14.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.048+0000 7fe8927ff700 1 -- 172.21.15.53:0/900839282 wait complete. 2023-07-09T21:51:14.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.050+0000 7fe8927ff700 1 Processor -- start 2023-07-09T21:51:14.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.050+0000 7fe8927ff700 1 -- start start 2023-07-09T21:51:14.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.051+0000 7fe8927ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0b25d0 0x7fe88c14d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:14.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.051+0000 7fe8927ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0b3ff0 0x7fe88c149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:14.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.051+0000 7fe8927ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe88c0d0b10 0x7fe88c0cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:14.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.051+0000 7fe8927ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0cd3a0 con 0x7fe88c0d0b10 2023-07-09T21:51:14.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.051+0000 7fe8927ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0ccf10 con 0x7fe88c0b3ff0 2023-07-09T21:51:14.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.051+0000 7fe8927ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c14ce70 con 0x7fe88c0b25d0 2023-07-09T21:51:14.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.052+0000 7fe890d9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe88c0d0b10 0x7fe88c0cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:14.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.052+0000 7fe890d9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe88c0d0b10 0x7fe88c0cfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51074/0 (socket says 172.21.15.53:51074) 2023-07-09T21:51:14.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.052+0000 7fe890d9c700 1 -- 172.21.15.53:0/2932387153 learned_addr learned my addr 172.21.15.53:0/2932387153 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:14.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.052+0000 7fe88bfff700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0b25d0 0x7fe88c14d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:14.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.052+0000 7fe88b7fe700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0b3ff0 0x7fe88c149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:14.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.052+0000 7fe890d9c700 1 -- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0b25d0 msgr2=0x7fe88c14d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:14.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.052+0000 7fe890d9c700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0b25d0 0x7fe88c14d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.052+0000 7fe890d9c700 1 -- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0b3ff0 msgr2=0x7fe88c149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:14.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.052+0000 7fe890d9c700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0b3ff0 0x7fe88c149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.052+0000 7fe890d9c700 1 -- 172.21.15.53:0/2932387153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe880009550 con 0x7fe88c0d0b10 2023-07-09T21:51:14.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.052+0000 7fe890d9c700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe88c0d0b10 0x7fe88c0cfd90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe88400cc50 tx=0x7fe88400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:14.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.052+0000 7fe888ff9700 1 -- 172.21.15.53:0/2932387153 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884003c00 con 0x7fe88c0d0b10 2023-07-09T21:51:14.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.053+0000 7fe888ff9700 1 -- 172.21.15.53:0/2932387153 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe884003d60 con 0x7fe88c0d0b10 2023-07-09T21:51:14.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.053+0000 7fe888ff9700 1 -- 172.21.15.53:0/2932387153 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400aab0 con 0x7fe88c0d0b10 2023-07-09T21:51:14.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.053+0000 7fe8927ff700 1 -- 172.21.15.53:0/2932387153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88c0cc620 con 0x7fe88c0d0b10 2023-07-09T21:51:14.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.053+0000 7fe8927ff700 1 -- 172.21.15.53:0/2932387153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88c0ccba0 con 0x7fe88c0d0b10 2023-07-09T21:51:14.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.054+0000 7fe8927ff700 1 -- 172.21.15.53:0/2932387153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88c0cd080 con 0x7fe88c0d0b10 2023-07-09T21:51:14.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.055+0000 7fe888ff9700 1 -- 172.21.15.53:0/2932387153 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe88400ac10 con 0x7fe88c0d0b10 2023-07-09T21:51:14.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.055+0000 7fe888ff9700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe87806ace0 0x7fe87806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:14.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.056+0000 7fe888ff9700 1 -- 172.21.15.53:0/2932387153 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe884089300 con 0x7fe88c0d0b10 2023-07-09T21:51:14.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.056+0000 7fe88bfff700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe87806ace0 0x7fe87806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:14.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.057+0000 7fe88bfff700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe87806ace0 0x7fe87806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009be0 tx=0x7fe87c009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:14.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.060+0000 7fe888ff9700 1 -- 172.21.15.53:0/2932387153 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe8840542d0 con 0x7fe88c0d0b10 2023-07-09T21:51:14.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.281+0000 7fe8927ff700 1 -- 172.21.15.53:0/2932387153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe88c0b8e80 con 0x7fe88c0d0b10 2023-07-09T21:51:14.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.281+0000 7fe888ff9700 1 -- 172.21.15.53:0/2932387153 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe88c0b8e80 con 0x7fe88c0d0b10 2023-07-09T21:51:14.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.284+0000 7fe8927ff700 1 -- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe87806ace0 msgr2=0x7fe87806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:14.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.284+0000 7fe8927ff700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe87806ace0 0x7fe87806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009be0 tx=0x7fe87c009210 comp rx=0 tx=0).stop 2023-07-09T21:51:14.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.284+0000 7fe8927ff700 1 -- 172.21.15.53:0/2932387153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe88c0d0b10 msgr2=0x7fe88c0cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:14.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.284+0000 7fe8927ff700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe88c0d0b10 0x7fe88c0cfd90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe88400cc50 tx=0x7fe88400cf60 comp rx=0 tx=0).stop 2023-07-09T21:51:14.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.284+0000 7fe8927ff700 1 -- 172.21.15.53:0/2932387153 shutdown_connections 2023-07-09T21:51:14.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.284+0000 7fe8927ff700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe87806ace0 0x7fe87806d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.284+0000 7fe8927ff700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe88c0d0b10 0x7fe88c0cfd90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.284+0000 7fe8927ff700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0b25d0 0x7fe88c14d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.284+0000 7fe8927ff700 1 --2- 172.21.15.53:0/2932387153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0b3ff0 0x7fe88c149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.284+0000 7fe8927ff700 1 -- 172.21.15.53:0/2932387153 >> 172.21.15.53:0/2932387153 conn(0x7fe88c09c1b0 msgr2=0x7fe88c0d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.284+0000 7fe8927ff700 1 -- 172.21.15.53:0/2932387153 shutdown_connections 2023-07-09T21:51:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.284+0000 7fe8927ff700 1 -- 172.21.15.53:0/2932387153 wait complete. 2023-07-09T21:51:14.290 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-07-09T21:51:14.304 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T21:51:14.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:14.305 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-09T21:51:14.398 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:51:14.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:14.400 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T21:51:14.452 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:51:14.452 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:14.500 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:51:14.501 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:14.585 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:51:14.586 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:14.670 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:14.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.871+0000 7f21ef5ff700 1 Processor -- start 2023-07-09T21:51:14.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.871+0000 7f21ef5ff700 1 -- start start 2023-07-09T21:51:14.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.872+0000 7f21ef5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f21e806f1d0 0x7f21e80ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:14.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.872+0000 7f21ef5ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21e80cb270 0x7f21e80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:14.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.872+0000 7f21ef5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e806dd30 con 0x7f21e80cd5e0 2023-07-09T21:51:14.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.872+0000 7f21ef5ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e815cda0 con 0x7f21e80cb270 2023-07-09T21:51:14.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.872+0000 7f21ef5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e80cc8f0 con 0x7f21e806f1d0 2023-07-09T21:51:14.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.873+0000 7f21edb9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21e80cb270 0x7f21e80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:14.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.873+0000 7f21edb9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21e80cb270 0x7f21e80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51078/0 (socket says 172.21.15.53:51078) 2023-07-09T21:51:14.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.873+0000 7f21edb9c700 1 -- 172.21.15.53:0/210177876 learned_addr learned my addr 172.21.15.53:0/210177876 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:14.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.873+0000 7f21ecb9a700 1 --2- 172.21.15.53:0/210177876 >> v2:172.21.15.184:3300/0 conn(0x7f21e806f1d0 0x7f21e80ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:14.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.873+0000 7f21edb9c700 1 -- 172.21.15.53:0/210177876 >> v2:172.21.15.184:3300/0 conn(0x7f21e806f1d0 msgr2=0x7f21e80ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:14.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.873+0000 7f21edb9c700 1 --2- 172.21.15.53:0/210177876 >> v2:172.21.15.184:3300/0 conn(0x7f21e806f1d0 0x7f21e80ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.873+0000 7f21edb9c700 1 -- 172.21.15.53:0/210177876 >> v1:172.21.15.184:6789/0 conn(0x7f21e80cd5e0 legacy=0x7f21e80cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:14.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.873+0000 7f21edb9c700 1 -- 172.21.15.53:0/210177876 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e80ccbd0 con 0x7f21e80cb270 2023-07-09T21:51:14.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.873+0000 7f21edb9c700 1 --2- 172.21.15.53:0/210177876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cb270 0x7f21e80cb6f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f21e80704d0 tx=0x7f21e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e60921d32b7675 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:14.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.873+0000 7f21dffff700 1 -- 172.21.15.53:0/210177876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e000e070 con 0x7f21e80cb270 2023-07-09T21:51:14.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.874+0000 7f21dffff700 1 -- 172.21.15.53:0/210177876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e000b9c0 con 0x7f21e80cb270 2023-07-09T21:51:14.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.874+0000 7f21dffff700 1 -- 172.21.15.53:0/210177876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e000bd70 con 0x7f21e80cb270 2023-07-09T21:51:14.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.874+0000 7f21ef5ff700 1 -- 172.21.15.53:0/210177876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cb270 msgr2=0x7f21e80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:14.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.874+0000 7f21ef5ff700 1 --2- 172.21.15.53:0/210177876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cb270 0x7f21e80cb6f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f21e80704d0 tx=0x7f21e000b330 comp rx=0 tx=0).stop 2023-07-09T21:51:14.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.874+0000 7f21ef5ff700 1 -- 172.21.15.53:0/210177876 shutdown_connections 2023-07-09T21:51:14.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.874+0000 7f21ef5ff700 1 --2- 172.21.15.53:0/210177876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cb270 0x7f21e80cb6f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.874+0000 7f21ef5ff700 1 --2- 172.21.15.53:0/210177876 >> v2:172.21.15.184:3300/0 conn(0x7f21e806f1d0 0x7f21e80ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.874+0000 7f21ef5ff700 1 -- 172.21.15.53:0/210177876 >> 172.21.15.53:0/210177876 conn(0x7f21e80999e0 msgr2=0x7f21e8099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:14.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.874+0000 7f21ef5ff700 1 -- 172.21.15.53:0/210177876 shutdown_connections 2023-07-09T21:51:14.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.874+0000 7f21ef5ff700 1 -- 172.21.15.53:0/210177876 wait complete. 2023-07-09T21:51:14.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.876+0000 7f21ef5ff700 1 Processor -- start 2023-07-09T21:51:14.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.876+0000 7f21ef5ff700 1 -- start start 2023-07-09T21:51:14.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.877+0000 7f21ef5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21e806f1d0 0x7f21e8159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:14.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.877+0000 7f21ef5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21e80cb270 0x7f21e80c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:14.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.877+0000 7f21ef5ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cd5e0 0x7f21e80b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:14.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.877+0000 7f21ef5ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80b0af0 con 0x7f21e80cd5e0 2023-07-09T21:51:14.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.877+0000 7f21ef5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80c87a0 con 0x7f21e806f1d0 2023-07-09T21:51:14.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.877+0000 7f21ef5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80c8a80 con 0x7f21e80cb270 2023-07-09T21:51:14.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.877+0000 7f21edb9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cd5e0 0x7f21e80b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:14.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.877+0000 7f21edb9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cd5e0 0x7f21e80b5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51088/0 (socket says 172.21.15.53:51088) 2023-07-09T21:51:14.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.877+0000 7f21edb9c700 1 -- 172.21.15.53:0/2056521438 learned_addr learned my addr 172.21.15.53:0/2056521438 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:14.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.877+0000 7f21ecb9a700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21e80cb270 0x7f21e80c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:14.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.878+0000 7f21ed39b700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21e806f1d0 0x7f21e8159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:14.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.878+0000 7f21edb9c700 1 -- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21e80cb270 msgr2=0x7f21e80c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:14.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.878+0000 7f21edb9c700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21e80cb270 0x7f21e80c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.878+0000 7f21edb9c700 1 -- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21e806f1d0 msgr2=0x7f21e8159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:14.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.878+0000 7f21edb9c700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21e806f1d0 0x7f21e8159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:14.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.878+0000 7f21edb9c700 1 -- 172.21.15.53:0/2056521438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e0009b30 con 0x7f21e80cd5e0 2023-07-09T21:51:14.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.878+0000 7f21edb9c700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cd5e0 0x7f21e80b5c20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f21e000b370 tx=0x7f21e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:14.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.878+0000 7f21ddffb700 1 -- 172.21.15.53:0/2056521438 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e00099b0 con 0x7f21e80cd5e0 2023-07-09T21:51:14.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.878+0000 7f21ddffb700 1 -- 172.21.15.53:0/2056521438 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e00092e0 con 0x7f21e80cd5e0 2023-07-09T21:51:14.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.878+0000 7f21ddffb700 1 -- 172.21.15.53:0/2056521438 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e001c660 con 0x7f21e80cd5e0 2023-07-09T21:51:14.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.878+0000 7f21ef5ff700 1 -- 172.21.15.53:0/2056521438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e80c8d60 con 0x7f21e80cd5e0 2023-07-09T21:51:14.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.878+0000 7f21ef5ff700 1 -- 172.21.15.53:0/2056521438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e81596d0 con 0x7f21e80cd5e0 2023-07-09T21:51:14.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.880+0000 7f21ef5ff700 1 -- 172.21.15.53:0/2056521438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e80c8f50 con 0x7f21e80cd5e0 2023-07-09T21:51:14.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.880+0000 7f21ddffb700 1 -- 172.21.15.53:0/2056521438 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21e001c7c0 con 0x7f21e80cd5e0 2023-07-09T21:51:14.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.881+0000 7f21ddffb700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f21cc06ace0 0x7f21cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:14.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.881+0000 7f21ddffb700 1 -- 172.21.15.53:0/2056521438 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f21e008b220 con 0x7f21e80cd5e0 2023-07-09T21:51:14.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.882+0000 7f21ed39b700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f21cc06ace0 0x7f21cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:14.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.883+0000 7f21ed39b700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f21cc06ace0 0x7f21cc06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21e4000f60 tx=0x7f21e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:14.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:14.886+0000 7f21ddffb700 1 -- 172.21.15.53:0/2056521438 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f21e0056280 con 0x7f21e80cd5e0 2023-07-09T21:51:15.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.095+0000 7f21ef5ff700 1 -- 172.21.15.53:0/2056521438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21e804e280 con 0x7f21e80cd5e0 2023-07-09T21:51:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.097+0000 7f21ddffb700 1 -- 172.21.15.53:0/2056521438 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f21e00598a0 con 0x7f21e80cd5e0 2023-07-09T21:51:15.099 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:15.100 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:04.650456+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.099+0000 7f21ef5ff700 1 -- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f21cc06ace0 msgr2=0x7f21cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.099+0000 7f21ef5ff700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f21cc06ace0 0x7f21cc06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21e4000f60 tx=0x7f21e4009040 comp rx=0 tx=0).stop 2023-07-09T21:51:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.099+0000 7f21ef5ff700 1 -- 172.21.15.53:0/2056521438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cd5e0 msgr2=0x7f21e80b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.099+0000 7f21ef5ff700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cd5e0 0x7f21e80b5c20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f21e000b370 tx=0x7f21e0004ad0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.099+0000 7f21ef5ff700 1 -- 172.21.15.53:0/2056521438 shutdown_connections 2023-07-09T21:51:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.099+0000 7f21ef5ff700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f21cc06ace0 0x7f21cc06d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.099+0000 7f21ef5ff700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cd5e0 0x7f21e80b5c20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.099+0000 7f21ef5ff700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21e806f1d0 0x7f21e8159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.099+0000 7f21ef5ff700 1 --2- 172.21.15.53:0/2056521438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21e80cb270 0x7f21e80c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.100+0000 7f21ef5ff700 1 -- 172.21.15.53:0/2056521438 >> 172.21.15.53:0/2056521438 conn(0x7f21e80999e0 msgr2=0x7f21e80ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.100+0000 7f21ef5ff700 1 -- 172.21.15.53:0/2056521438 shutdown_connections 2023-07-09T21:51:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.100+0000 7f21ef5ff700 1 -- 172.21.15.53:0/2056521438 wait complete. 2023-07-09T21:51:15.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:50:21.703759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:50:22.243698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:51:15.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:51:15.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.323+0000 7f787bbff700 1 Processor -- start 2023-07-09T21:51:15.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.323+0000 7f787bbff700 1 -- start start 2023-07-09T21:51:15.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787bbff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78740b3ff0 0x7f78740b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:15.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787bbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78740d0b10 0x7f78740d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:15.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787bbff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78740b8e80 con 0x7f78740b25d0 2023-07-09T21:51:15.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787bbff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78740d14a0 con 0x7f78740b3ff0 2023-07-09T21:51:15.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787bbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78740b1e30 con 0x7f78740d0b10 2023-07-09T21:51:15.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787999b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78740b3ff0 0x7f78740b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:15.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787999b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78740b3ff0 0x7f78740b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51096/0 (socket says 172.21.15.53:51096) 2023-07-09T21:51:15.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787a19c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f78740b25d0 0x7f78740b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43560/0 (socket says 172.21.15.53:43560) 2023-07-09T21:51:15.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787999b700 1 -- 172.21.15.53:0/178816402 learned_addr learned my addr 172.21.15.53:0/178816402 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:15.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787919a700 1 --2- 172.21.15.53:0/178816402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78740d0b10 0x7f78740d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787999b700 1 -- 172.21.15.53:0/178816402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78740d0b10 msgr2=0x7f78740d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787999b700 1 --2- 172.21.15.53:0/178816402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78740d0b10 0x7f78740d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787999b700 1 -- 172.21.15.53:0/178816402 >> v1:172.21.15.53:6789/0 conn(0x7f78740b25d0 legacy=0x7f78740b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.325+0000 7f787999b700 1 -- 172.21.15.53:0/178816402 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78740afaa0 con 0x7f78740b3ff0 2023-07-09T21:51:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.326+0000 7f787999b700 1 --2- 172.21.15.53:0/178816402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78740b3ff0 0x7f78740b43c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f78700098f0 tx=0x7f7870009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe306bd2415bd4c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.326+0000 7f7878999700 1 -- 172.21.15.53:0/178816402 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787000b8a0 con 0x7f78740b3ff0 2023-07-09T21:51:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.326+0000 7f7878999700 1 -- 172.21.15.53:0/178816402 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787000ba00 con 0x7f78740b3ff0 2023-07-09T21:51:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.326+0000 7f7878999700 1 -- 172.21.15.53:0/178816402 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787000bd90 con 0x7f78740b3ff0 2023-07-09T21:51:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.326+0000 7f787bbff700 1 -- 172.21.15.53:0/178816402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78740b3ff0 msgr2=0x7f78740b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.326+0000 7f787bbff700 1 --2- 172.21.15.53:0/178816402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78740b3ff0 0x7f78740b43c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f78700098f0 tx=0x7f7870009c00 comp rx=0 tx=0).stop 2023-07-09T21:51:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.327+0000 7f787bbff700 1 -- 172.21.15.53:0/178816402 shutdown_connections 2023-07-09T21:51:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.327+0000 7f787bbff700 1 --2- 172.21.15.53:0/178816402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78740b3ff0 0x7f78740b43c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.327+0000 7f787bbff700 1 --2- 172.21.15.53:0/178816402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78740d0b10 0x7f78740d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.327+0000 7f787bbff700 1 -- 172.21.15.53:0/178816402 >> 172.21.15.53:0/178816402 conn(0x7f787409c1b0 msgr2=0x7f78740d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:15.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.327+0000 7f787bbff700 1 -- 172.21.15.53:0/178816402 shutdown_connections 2023-07-09T21:51:15.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.327+0000 7f787bbff700 1 -- 172.21.15.53:0/178816402 wait complete. 2023-07-09T21:51:15.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.328+0000 7f787bbff700 1 Processor -- start 2023-07-09T21:51:15.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.329+0000 7f787bbff700 1 -- start start 2023-07-09T21:51:15.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.329+0000 7f787bbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78740b25d0 0x7f7874156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:15.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.329+0000 7f787bbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78740b3ff0 0x7f7874157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:15.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.329+0000 7f787bbff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78740d0b10 0x7f787415d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:15.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.330+0000 7f787bbff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787415ff10 con 0x7f78740d0b10 2023-07-09T21:51:15.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.330+0000 7f787bbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740cdd40 con 0x7f78740b25d0 2023-07-09T21:51:15.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.330+0000 7f787bbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7874157510 con 0x7f78740b3ff0 2023-07-09T21:51:15.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.330+0000 7f787a19c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78740d0b10 0x7f787415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:15.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.330+0000 7f787a19c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78740d0b10 0x7f787415d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51106/0 (socket says 172.21.15.53:51106) 2023-07-09T21:51:15.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.330+0000 7f787a19c700 1 -- 172.21.15.53:0/625693546 learned_addr learned my addr 172.21.15.53:0/625693546 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:15.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.330+0000 7f787919a700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78740b3ff0 0x7f7874157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:15.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.330+0000 7f787999b700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78740b25d0 0x7f7874156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.330+0000 7f787a19c700 1 -- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78740b3ff0 msgr2=0x7f7874157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.330+0000 7f787a19c700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78740b3ff0 0x7f7874157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.330+0000 7f787a19c700 1 -- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78740b25d0 msgr2=0x7f7874156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.330+0000 7f787a19c700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78740b25d0 0x7f7874156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.330+0000 7f787a19c700 1 -- 172.21.15.53:0/625693546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7870009550 con 0x7f78740d0b10 2023-07-09T21:51:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.331+0000 7f787a19c700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78740d0b10 0x7f787415d010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f786c00cbd0 tx=0x7f786c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.331+0000 7f786a7fc700 1 -- 172.21.15.53:0/625693546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c00aaa0 con 0x7f78740d0b10 2023-07-09T21:51:15.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.331+0000 7f786a7fc700 1 -- 172.21.15.53:0/625693546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c00ac00 con 0x7f78740d0b10 2023-07-09T21:51:15.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.331+0000 7f786a7fc700 1 -- 172.21.15.53:0/625693546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c007070 con 0x7f78740d0b10 2023-07-09T21:51:15.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.331+0000 7f787bbff700 1 -- 172.21.15.53:0/625693546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787415da60 con 0x7f78740d0b10 2023-07-09T21:51:15.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.331+0000 7f787bbff700 1 -- 172.21.15.53:0/625693546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78740ce270 con 0x7f78740d0b10 2023-07-09T21:51:15.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.332+0000 7f787bbff700 1 -- 172.21.15.53:0/625693546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7874074350 con 0x7f78740d0b10 2023-07-09T21:51:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.333+0000 7f786a7fc700 1 -- 172.21.15.53:0/625693546 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f786c0071d0 con 0x7f78740d0b10 2023-07-09T21:51:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.334+0000 7f786a7fc700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f785806ace0 0x7f785806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.334+0000 7f786a7fc700 1 -- 172.21.15.53:0/625693546 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f786c088f80 con 0x7f78740d0b10 2023-07-09T21:51:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.335+0000 7f787999b700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f785806ace0 0x7f785806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:15.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.335+0000 7f787999b700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f785806ace0 0x7f785806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7870009c40 tx=0x7f7870008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:15.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.338+0000 7f786a7fc700 1 -- 172.21.15.53:0/625693546 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f786c054090 con 0x7f78740d0b10 2023-07-09T21:51:15.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.543+0000 7f787bbff700 1 -- 172.21.15.53:0/625693546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78740b8e80 con 0x7f78740d0b10 2023-07-09T21:51:15.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.544+0000 7f786a7fc700 1 -- 172.21.15.53:0/625693546 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78740b8e80 con 0x7f78740d0b10 2023-07-09T21:51:15.546 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:51:15.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.546+0000 7f787bbff700 1 -- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f785806ace0 msgr2=0x7f785806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.546+0000 7f787bbff700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f785806ace0 0x7f785806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7870009c40 tx=0x7f7870008030 comp rx=0 tx=0).stop 2023-07-09T21:51:15.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.546+0000 7f787bbff700 1 -- 172.21.15.53:0/625693546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78740d0b10 msgr2=0x7f787415d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.546+0000 7f787bbff700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78740d0b10 0x7f787415d010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f786c00cbd0 tx=0x7f786c00cee0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.546+0000 7f787bbff700 1 -- 172.21.15.53:0/625693546 shutdown_connections 2023-07-09T21:51:15.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.546+0000 7f787bbff700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f785806ace0 0x7f785806d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.546+0000 7f787bbff700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78740d0b10 0x7f787415d010 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.546+0000 7f787bbff700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78740b25d0 0x7f7874156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.546+0000 7f787bbff700 1 --2- 172.21.15.53:0/625693546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78740b3ff0 0x7f7874157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.546+0000 7f787bbff700 1 -- 172.21.15.53:0/625693546 >> 172.21.15.53:0/625693546 conn(0x7f787409c1b0 msgr2=0x7f78740d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:15.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.546+0000 7f787bbff700 1 -- 172.21.15.53:0/625693546 shutdown_connections 2023-07-09T21:51:15.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.546+0000 7f787bbff700 1 -- 172.21.15.53:0/625693546 wait complete. 2023-07-09T21:51:15.566 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:51:15.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.767+0000 7f39375ff700 1 Processor -- start 2023-07-09T21:51:15.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.767+0000 7f39375ff700 1 -- start start 2023-07-09T21:51:15.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.768+0000 7f39375ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f39300d1220 0x7f39300b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.769+0000 7f39375ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39300b0e20 0x7f39300b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.769+0000 7f39375ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39300b8e80 con 0x7f39300b3ff0 2023-07-09T21:51:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.769+0000 7f39375ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39300afaa0 con 0x7f39300d1220 2023-07-09T21:51:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.769+0000 7f39375ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39300afd80 con 0x7f39300b0e20 2023-07-09T21:51:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.769+0000 7f3935b9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39300b0e20 0x7f39300b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.769+0000 7f3934b9a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f39300d1220 0x7f39300b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.769+0000 7f3935b9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39300b0e20 0x7f39300b1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:34128/0 (socket says 172.21.15.53:34128) 2023-07-09T21:51:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.769+0000 7f3935b9c700 1 -- 172.21.15.53:0/1041957582 learned_addr learned my addr 172.21.15.53:0/1041957582 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.769+0000 7f3934b9a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f39300d1220 0x7f39300b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:49766/0 (socket says 172.21.15.53:49766) 2023-07-09T21:51:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.769+0000 7f393539b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f39300b3ff0 0x7f39300d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:60388/0 (socket says 172.21.15.53:60388) 2023-07-09T21:51:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.770+0000 7f3935b9c700 1 -- 172.21.15.53:0/1041957582 >> v2:172.21.15.184:3300/0 conn(0x7f39300d1220 msgr2=0x7f39300b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.770+0000 7f3935b9c700 1 --2- 172.21.15.53:0/1041957582 >> v2:172.21.15.184:3300/0 conn(0x7f39300d1220 0x7f39300b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.770+0000 7f3935b9c700 1 -- 172.21.15.53:0/1041957582 >> v1:172.21.15.184:6789/0 conn(0x7f39300b3ff0 legacy=0x7f39300d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.770+0000 7f3935b9c700 1 -- 172.21.15.53:0/1041957582 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39300b0060 con 0x7f39300b0e20 2023-07-09T21:51:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.770+0000 7f3935b9c700 1 --2- 172.21.15.53:0/1041957582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39300b0e20 0x7f39300b1240 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3928009e50 tx=0x7f392800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d61990cb787f696d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.770+0000 7f3927fff700 1 -- 172.21.15.53:0/1041957582 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392800e070 con 0x7f39300b0e20 2023-07-09T21:51:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.770+0000 7f3927fff700 1 -- 172.21.15.53:0/1041957582 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392800b910 con 0x7f39300b0e20 2023-07-09T21:51:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.770+0000 7f3927fff700 1 -- 172.21.15.53:0/1041957582 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392800bcc0 con 0x7f39300b0e20 2023-07-09T21:51:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.771+0000 7f39375ff700 1 -- 172.21.15.53:0/1041957582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39300b0e20 msgr2=0x7f39300b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.771+0000 7f39375ff700 1 --2- 172.21.15.53:0/1041957582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39300b0e20 0x7f39300b1240 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3928009e50 tx=0x7f392800b330 comp rx=0 tx=0).stop 2023-07-09T21:51:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.771+0000 7f39375ff700 1 -- 172.21.15.53:0/1041957582 shutdown_connections 2023-07-09T21:51:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.771+0000 7f39375ff700 1 --2- 172.21.15.53:0/1041957582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39300b0e20 0x7f39300b1240 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.771+0000 7f39375ff700 1 --2- 172.21.15.53:0/1041957582 >> v2:172.21.15.184:3300/0 conn(0x7f39300d1220 0x7f39300b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.771+0000 7f39375ff700 1 -- 172.21.15.53:0/1041957582 >> 172.21.15.53:0/1041957582 conn(0x7f393009c1b0 msgr2=0x7f39300d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.771+0000 7f39375ff700 1 -- 172.21.15.53:0/1041957582 shutdown_connections 2023-07-09T21:51:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.771+0000 7f39375ff700 1 -- 172.21.15.53:0/1041957582 wait complete. 2023-07-09T21:51:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.773+0000 7f39375ff700 1 Processor -- start 2023-07-09T21:51:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.773+0000 7f39375ff700 1 -- start start 2023-07-09T21:51:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f39375ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39300b0e20 0x7f39301f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f39375ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39300b3ff0 0x7f393015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f39375ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39300d1220 0x7f393015f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f39375ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39300cbf00 con 0x7f39300b0e20 2023-07-09T21:51:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f39375ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39300ccd50 con 0x7f39300d1220 2023-07-09T21:51:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f39375ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39300cc140 con 0x7f39300b3ff0 2023-07-09T21:51:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f393539b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39300b0e20 0x7f39301f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f393539b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39300b0e20 0x7f39301f4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51108/0 (socket says 172.21.15.53:51108) 2023-07-09T21:51:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f393539b700 1 -- 172.21.15.53:0/2038943622 learned_addr learned my addr 172.21.15.53:0/2038943622 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f3934b9a700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39300b3ff0 0x7f393015edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f3935b9c700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39300d1220 0x7f393015f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f393539b700 1 -- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39300b3ff0 msgr2=0x7f393015edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f393539b700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39300b3ff0 0x7f393015edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f393539b700 1 -- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39300d1220 msgr2=0x7f393015f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f393539b700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39300d1220 0x7f393015f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.774+0000 7f393539b700 1 -- 172.21.15.53:0/2038943622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928009b30 con 0x7f39300b0e20 2023-07-09T21:51:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.775+0000 7f393539b700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39300b0e20 0x7f39301f4e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f392c00c520 tx=0x7f392c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.775+0000 7f3925ffb700 1 -- 172.21.15.53:0/2038943622 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c005cb0 con 0x7f39300b0e20 2023-07-09T21:51:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.775+0000 7f3925ffb700 1 -- 172.21.15.53:0/2038943622 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c005e10 con 0x7f39300b0e20 2023-07-09T21:51:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.775+0000 7f3925ffb700 1 -- 172.21.15.53:0/2038943622 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0072d0 con 0x7f39300b0e20 2023-07-09T21:51:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.775+0000 7f39375ff700 1 -- 172.21.15.53:0/2038943622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39300cc420 con 0x7f39300b0e20 2023-07-09T21:51:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.775+0000 7f39375ff700 1 -- 172.21.15.53:0/2038943622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39300cc9e0 con 0x7f39300b0e20 2023-07-09T21:51:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.776+0000 7f39375ff700 1 -- 172.21.15.53:0/2038943622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3930074350 con 0x7f39300b0e20 2023-07-09T21:51:15.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.777+0000 7f3925ffb700 1 -- 172.21.15.53:0/2038943622 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f392c007430 con 0x7f39300b0e20 2023-07-09T21:51:15.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.778+0000 7f3925ffb700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f391406ace0 0x7f391406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:15.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.778+0000 7f3925ffb700 1 -- 172.21.15.53:0/2038943622 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f392c088790 con 0x7f39300b0e20 2023-07-09T21:51:15.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.779+0000 7f3934b9a700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f391406ace0 0x7f391406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:15.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.780+0000 7f3934b9a700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f391406ace0 0x7f391406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f393015c990 tx=0x7f3920008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:15.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.783+0000 7f3925ffb700 1 -- 172.21.15.53:0/2038943622 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f392c053810 con 0x7f39300b0e20 2023-07-09T21:51:15.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.989+0000 7f39375ff700 1 -- 172.21.15.53:0/2038943622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39300b8e80 con 0x7f39300b0e20 2023-07-09T21:51:15.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.990+0000 7f3925ffb700 1 -- 172.21.15.53:0/2038943622 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f39300b8e80 con 0x7f39300b0e20 2023-07-09T21:51:15.992 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:51:15.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.992+0000 7f39375ff700 1 -- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f391406ace0 msgr2=0x7f391406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.992+0000 7f39375ff700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f391406ace0 0x7f391406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f393015c990 tx=0x7f3920008040 comp rx=0 tx=0).stop 2023-07-09T21:51:15.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.992+0000 7f39375ff700 1 -- 172.21.15.53:0/2038943622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39300b0e20 msgr2=0x7f39301f4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:15.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.992+0000 7f39375ff700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39300b0e20 0x7f39301f4e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f392c00c520 tx=0x7f392c00c8e0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.992+0000 7f39375ff700 1 -- 172.21.15.53:0/2038943622 shutdown_connections 2023-07-09T21:51:15.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.992+0000 7f39375ff700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f391406ace0 0x7f391406d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.992+0000 7f39375ff700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39300d1220 0x7f393015f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.992+0000 7f39375ff700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39300b0e20 0x7f39301f4e10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.992+0000 7f39375ff700 1 --2- 172.21.15.53:0/2038943622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39300b3ff0 0x7f393015edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:15.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.992+0000 7f39375ff700 1 -- 172.21.15.53:0/2038943622 >> 172.21.15.53:0/2038943622 conn(0x7f393009c1b0 msgr2=0x7f39300d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:15.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.992+0000 7f39375ff700 1 -- 172.21.15.53:0/2038943622 shutdown_connections 2023-07-09T21:51:15.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:15.992+0000 7f39375ff700 1 -- 172.21.15.53:0/2038943622 wait complete. 2023-07-09T21:51:16.013 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:51:16.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.213+0000 7ff25cbff700 1 Processor -- start 2023-07-09T21:51:16.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.214+0000 7ff25cbff700 1 -- start start 2023-07-09T21:51:16.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.215+0000 7ff25cbff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff2581608e0 0x7ff25806a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:16.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.215+0000 7ff25cbff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff258160d60 con 0x7ff258071650 2023-07-09T21:51:16.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.216+0000 7ff25659c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff258071650 0x7ff2580ce030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43574/0 (socket says 172.21.15.53:43574) 2023-07-09T21:51:16.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.216+0000 7ff25cbff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2580cdba0 con 0x7ff258069f30 2023-07-09T21:51:16.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.216+0000 7ff25659c700 1 -- 172.21.15.53:0/1416319828 learned_addr learned my addr 172.21.15.53:0/1416319828 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:16.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.216+0000 7ff25cbff700 1 -- 172.21.15.53:0/1416319828 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25806a910 con 0x7ff2581608e0 2023-07-09T21:51:16.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.216+0000 7ff256d9d700 1 --2- 172.21.15.53:0/1416319828 >> v2:172.21.15.184:3300/0 conn(0x7ff2581608e0 0x7ff25806a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:16.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.216+0000 7ff25559a700 1 -- 172.21.15.53:0/1416319828 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991519540 0 0) 0x7ff248001110 con 0x7ff258071650 2023-07-09T21:51:16.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.216+0000 7ff25559a700 1 -- 172.21.15.53:0/1416319828 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2400035b0 con 0x7ff258071650 2023-07-09T21:51:16.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.216+0000 7ff256d9d700 1 -- 172.21.15.53:0/1416319828 >> v1:172.21.15.184:6789/0 conn(0x7ff258069f30 legacy=0x7ff2581601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:16.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.216+0000 7ff256d9d700 1 -- 172.21.15.53:0/1416319828 >> v1:172.21.15.53:6789/0 conn(0x7ff258071650 legacy=0x7ff2580ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.216+0000 7ff256d9d700 1 -- 172.21.15.53:0/1416319828 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2580cf370 con 0x7ff2581608e0 2023-07-09T21:51:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.217+0000 7ff256d9d700 1 --2- 172.21.15.53:0/1416319828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2581608e0 0x7ff25806a3d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff250009d90 tx=0x7ff25000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5877d3bae3fd4666 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.217+0000 7ff25559a700 1 -- 172.21.15.53:0/1416319828 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25000e070 con 0x7ff2581608e0 2023-07-09T21:51:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.217+0000 7ff25559a700 1 -- 172.21.15.53:0/1416319828 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25000bb20 con 0x7ff2581608e0 2023-07-09T21:51:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.217+0000 7ff25559a700 1 -- 172.21.15.53:0/1416319828 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff250012430 con 0x7ff2581608e0 2023-07-09T21:51:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.218+0000 7ff25cbff700 1 -- 172.21.15.53:0/1416319828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2581608e0 msgr2=0x7ff25806a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.218+0000 7ff25cbff700 1 --2- 172.21.15.53:0/1416319828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2581608e0 0x7ff25806a3d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff250009d90 tx=0x7ff25000b330 comp rx=0 tx=0).stop 2023-07-09T21:51:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.218+0000 7ff25cbff700 1 -- 172.21.15.53:0/1416319828 shutdown_connections 2023-07-09T21:51:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.218+0000 7ff25cbff700 1 --2- 172.21.15.53:0/1416319828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2581608e0 0x7ff25806a3d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.218+0000 7ff25cbff700 1 -- 172.21.15.53:0/1416319828 >> 172.21.15.53:0/1416319828 conn(0x7ff2580cc640 msgr2=0x7ff2580cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.218+0000 7ff25cbff700 1 -- 172.21.15.53:0/1416319828 shutdown_connections 2023-07-09T21:51:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.218+0000 7ff25cbff700 1 -- 172.21.15.53:0/1416319828 wait complete. 2023-07-09T21:51:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.219+0000 7ff25cbff700 1 Processor -- start 2023-07-09T21:51:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.220+0000 7ff25cbff700 1 -- start start 2023-07-09T21:51:16.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.220+0000 7ff25cbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff258069f30 0x7ff2580b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:16.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.220+0000 7ff25cbff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff258071650 0x7ff258158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:16.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.220+0000 7ff25cbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2581608e0 0x7ff258155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:16.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff25cbff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2580b4950 con 0x7ff258071650 2023-07-09T21:51:16.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff25cbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2580b4c30 con 0x7ff2581608e0 2023-07-09T21:51:16.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff25cbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2580b4f10 con 0x7ff258069f30 2023-07-09T21:51:16.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff255d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff258071650 0x7ff258158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:16.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff255d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff258071650 0x7ff258158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51118/0 (socket says 172.21.15.53:51118) 2023-07-09T21:51:16.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff255d9b700 1 -- 172.21.15.53:0/834682952 learned_addr learned my addr 172.21.15.53:0/834682952 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:16.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff25659c700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff258069f30 0x7ff2580b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:16.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff256d9d700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2581608e0 0x7ff258155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:16.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff255d9b700 1 -- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff258069f30 msgr2=0x7ff2580b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:16.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff255d9b700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff258069f30 0x7ff2580b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff255d9b700 1 -- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2581608e0 msgr2=0x7ff258155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff255d9b700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2581608e0 0x7ff258155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff255d9b700 1 -- 172.21.15.53:0/834682952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff250009a70 con 0x7ff258071650 2023-07-09T21:51:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.221+0000 7ff25659c700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff258069f30 0x7ff2580b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.222+0000 7ff255d9b700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff258071650 0x7ff258158190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00c4e0 tx=0x7ff24c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.222+0000 7ff246ffd700 1 -- 172.21.15.53:0/834682952 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0052d0 con 0x7ff258071650 2023-07-09T21:51:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.222+0000 7ff246ffd700 1 -- 172.21.15.53:0/834682952 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c005430 con 0x7ff258071650 2023-07-09T21:51:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.222+0000 7ff25cbff700 1 -- 172.21.15.53:0/834682952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2580b51f0 con 0x7ff258071650 2023-07-09T21:51:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.222+0000 7ff246ffd700 1 -- 172.21.15.53:0/834682952 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0038c0 con 0x7ff258071650 2023-07-09T21:51:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.222+0000 7ff25cbff700 1 -- 172.21.15.53:0/834682952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2580b3b70 con 0x7ff258071650 2023-07-09T21:51:16.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.223+0000 7ff25cbff700 1 -- 172.21.15.53:0/834682952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2580b5710 con 0x7ff258071650 2023-07-09T21:51:16.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.224+0000 7ff246ffd700 1 -- 172.21.15.53:0/834682952 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff24c003a20 con 0x7ff258071650 2023-07-09T21:51:16.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.225+0000 7ff246ffd700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff23806ace0 0x7ff23806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:16.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.226+0000 7ff246ffd700 1 -- 172.21.15.53:0/834682952 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff24c088970 con 0x7ff258071650 2023-07-09T21:51:16.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.226+0000 7ff25659c700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff23806ace0 0x7ff23806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:16.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.227+0000 7ff25659c700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff23806ace0 0x7ff23806d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff248001270 tx=0x7ff248009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:16.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.230+0000 7ff246ffd700 1 -- 172.21.15.53:0/834682952 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff2580b5710 con 0x7ff258071650 2023-07-09T21:51:16.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.434+0000 7ff25cbff700 1 -- 172.21.15.53:0/834682952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2580b5710 con 0x7ff258071650 2023-07-09T21:51:16.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.435+0000 7ff246ffd700 1 -- 172.21.15.53:0/834682952 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff2580b5710 con 0x7ff258071650 2023-07-09T21:51:16.438 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:51:16.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.437+0000 7ff25cbff700 1 -- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff23806ace0 msgr2=0x7ff23806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:16.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.437+0000 7ff25cbff700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff23806ace0 0x7ff23806d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff248001270 tx=0x7ff248009040 comp rx=0 tx=0).stop 2023-07-09T21:51:16.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.437+0000 7ff25cbff700 1 -- 172.21.15.53:0/834682952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff258071650 msgr2=0x7ff258158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:16.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.437+0000 7ff25cbff700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff258071650 0x7ff258158190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00c4e0 tx=0x7ff24c00c7f0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.437+0000 7ff25cbff700 1 -- 172.21.15.53:0/834682952 shutdown_connections 2023-07-09T21:51:16.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.437+0000 7ff25cbff700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff23806ace0 0x7ff23806d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.437+0000 7ff25cbff700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2581608e0 0x7ff258155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.437+0000 7ff25cbff700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff258069f30 0x7ff2580b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.437+0000 7ff25cbff700 1 --2- 172.21.15.53:0/834682952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff258071650 0x7ff258158190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.437+0000 7ff25cbff700 1 -- 172.21.15.53:0/834682952 >> 172.21.15.53:0/834682952 conn(0x7ff2580cc640 msgr2=0x7ff25806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:16.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.437+0000 7ff25cbff700 1 -- 172.21.15.53:0/834682952 shutdown_connections 2023-07-09T21:51:16.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.437+0000 7ff25cbff700 1 -- 172.21.15.53:0/834682952 wait complete. 2023-07-09T21:51:16.458 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:51:16.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.658+0000 7f67439ff700 1 Processor -- start 2023-07-09T21:51:16.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.658+0000 7f67439ff700 1 -- start start 2023-07-09T21:51:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.659+0000 7f67439ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c0cbe40 0x7f673c0cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.659+0000 7f67439ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f673c06ca10 0x7f673c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.660+0000 7f67439ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673c0ce8c0 con 0x7f673c0cda40 2023-07-09T21:51:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.660+0000 7f67439ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c06b5b0 con 0x7f673c06ca10 2023-07-09T21:51:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.660+0000 7f67439ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c071500 con 0x7f673c0cbe40 2023-07-09T21:51:16.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.660+0000 7f6741f9c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f673c06ca10 0x7f673c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:16.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.660+0000 7f674179b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c0cbe40 0x7f673c0cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:16.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.660+0000 7f6741f9c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f673c06ca10 0x7f673c0cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:49794/0 (socket says 172.21.15.53:49794) 2023-07-09T21:51:16.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.660+0000 7f6741f9c700 1 -- 172.21.15.53:0/3255620573 learned_addr learned my addr 172.21.15.53:0/3255620573 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:16.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.660+0000 7f6740f9a700 1 --1- 172.21.15.53:0/3255620573 >> v1:172.21.15.184:6789/0 conn(0x7f673c0cda40 0x7f673c15c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:60416/0 (socket says 172.21.15.53:60416) 2023-07-09T21:51:16.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.661+0000 7f6741f9c700 1 -- 172.21.15.53:0/3255620573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c0cbe40 msgr2=0x7f673c0cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:16.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.661+0000 7f6741f9c700 1 --2- 172.21.15.53:0/3255620573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c0cbe40 0x7f673c0cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.661+0000 7f6741f9c700 1 -- 172.21.15.53:0/3255620573 >> v1:172.21.15.184:6789/0 conn(0x7f673c0cda40 legacy=0x7f673c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:16.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.661+0000 7f6741f9c700 1 -- 172.21.15.53:0/3255620573 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c0cc2b0 con 0x7f673c06ca10 2023-07-09T21:51:16.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.661+0000 7f6741f9c700 1 --2- 172.21.15.53:0/3255620573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f673c06ca10 0x7f673c0cdeb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6734009e50 tx=0x7f673400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9994d7cf8fdf11 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:16.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.661+0000 7f6733fff700 1 -- 172.21.15.53:0/3255620573 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400e070 con 0x7f673c06ca10 2023-07-09T21:51:16.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.661+0000 7f6733fff700 1 -- 172.21.15.53:0/3255620573 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673400b910 con 0x7f673c06ca10 2023-07-09T21:51:16.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.661+0000 7f6733fff700 1 -- 172.21.15.53:0/3255620573 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400bcc0 con 0x7f673c06ca10 2023-07-09T21:51:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.662+0000 7f67439ff700 1 -- 172.21.15.53:0/3255620573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f673c06ca10 msgr2=0x7f673c0cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.662+0000 7f67439ff700 1 --2- 172.21.15.53:0/3255620573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f673c06ca10 0x7f673c0cdeb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6734009e50 tx=0x7f673400b330 comp rx=0 tx=0).stop 2023-07-09T21:51:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.662+0000 7f67439ff700 1 -- 172.21.15.53:0/3255620573 shutdown_connections 2023-07-09T21:51:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.662+0000 7f67439ff700 1 --2- 172.21.15.53:0/3255620573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f673c06ca10 0x7f673c0cdeb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.662+0000 7f67439ff700 1 --2- 172.21.15.53:0/3255620573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c0cbe40 0x7f673c0cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.662+0000 7f67439ff700 1 -- 172.21.15.53:0/3255620573 >> 172.21.15.53:0/3255620573 conn(0x7f673c0b05d0 msgr2=0x7f673c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.662+0000 7f67439ff700 1 -- 172.21.15.53:0/3255620573 shutdown_connections 2023-07-09T21:51:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.662+0000 7f67439ff700 1 -- 172.21.15.53:0/3255620573 wait complete. 2023-07-09T21:51:16.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.664+0000 7f67439ff700 1 Processor -- start 2023-07-09T21:51:16.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.664+0000 7f67439ff700 1 -- start start 2023-07-09T21:51:16.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f67439ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c06ca10 0x7f673c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:16.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f67439ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f673c0cbe40 0x7f673c0c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:16.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f67439ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f673c0cda40 0x7f673c0c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:16.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f67439ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c145c40 con 0x7f673c0cbe40 2023-07-09T21:51:16.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f67439ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0c7c20 con 0x7f673c0cda40 2023-07-09T21:51:16.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f67439ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0c7f00 con 0x7f673c06ca10 2023-07-09T21:51:16.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f6740f9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f673c0cbe40 0x7f673c0c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:16.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f6740f9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f673c0cbe40 0x7f673c0c3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51126/0 (socket says 172.21.15.53:51126) 2023-07-09T21:51:16.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f6740f9a700 1 -- 172.21.15.53:0/4260655683 learned_addr learned my addr 172.21.15.53:0/4260655683 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:16.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f6741f9c700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f673c0cda40 0x7f673c0c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:16.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f674179b700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c06ca10 0x7f673c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:16.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f6740f9a700 1 -- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c06ca10 msgr2=0x7f673c15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:16.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f6740f9a700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c06ca10 0x7f673c15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f6740f9a700 1 -- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f673c0cda40 msgr2=0x7f673c0c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:16.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f6740f9a700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f673c0cda40 0x7f673c0c35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.665+0000 7f6740f9a700 1 -- 172.21.15.53:0/4260655683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734009b30 con 0x7f673c0cbe40 2023-07-09T21:51:16.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.666+0000 7f6740f9a700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f673c0cbe40 0x7f673c0c3070 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f672c00c520 tx=0x7f672c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:16.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.666+0000 7f6731ffb700 1 -- 172.21.15.53:0/4260655683 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c005cb0 con 0x7f673c0cbe40 2023-07-09T21:51:16.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.666+0000 7f6731ffb700 1 -- 172.21.15.53:0/4260655683 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c005e10 con 0x7f673c0cbe40 2023-07-09T21:51:16.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.666+0000 7f67439ff700 1 -- 172.21.15.53:0/4260655683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673c0c81e0 con 0x7f673c0cbe40 2023-07-09T21:51:16.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.666+0000 7f6731ffb700 1 -- 172.21.15.53:0/4260655683 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0072d0 con 0x7f673c0cbe40 2023-07-09T21:51:16.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.666+0000 7f67439ff700 1 -- 172.21.15.53:0/4260655683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c15bf10 con 0x7f673c0cbe40 2023-07-09T21:51:16.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.667+0000 7f67439ff700 1 -- 172.21.15.53:0/4260655683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673c0c86a0 con 0x7f673c0cbe40 2023-07-09T21:51:16.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.668+0000 7f6731ffb700 1 -- 172.21.15.53:0/4260655683 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f672c007430 con 0x7f673c0cbe40 2023-07-09T21:51:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.670+0000 7f6731ffb700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f672006ace0 0x7f672006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.670+0000 7f6731ffb700 1 -- 172.21.15.53:0/4260655683 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f672c0887f0 con 0x7f673c0cbe40 2023-07-09T21:51:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.670+0000 7f674179b700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f672006ace0 0x7f672006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.671+0000 7f674179b700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f672006ace0 0x7f672006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6738009be0 tx=0x7f6738009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:16.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.674+0000 7f6731ffb700 1 -- 172.21.15.53:0/4260655683 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f672c053870 con 0x7f673c0cbe40 2023-07-09T21:51:16.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.882+0000 7f67439ff700 1 -- 172.21.15.53:0/4260655683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f673c074350 con 0x7f673c0cbe40 2023-07-09T21:51:16.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.882+0000 7f6731ffb700 1 -- 172.21.15.53:0/4260655683 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f672c056e90 con 0x7f673c0cbe40 2023-07-09T21:51:16.885 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:51:16.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.885+0000 7f67439ff700 1 -- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f672006ace0 msgr2=0x7f672006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:16.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.885+0000 7f67439ff700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f672006ace0 0x7f672006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6738009be0 tx=0x7f6738009210 comp rx=0 tx=0).stop 2023-07-09T21:51:16.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.885+0000 7f67439ff700 1 -- 172.21.15.53:0/4260655683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f673c0cbe40 msgr2=0x7f673c0c3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:16.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.885+0000 7f67439ff700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f673c0cbe40 0x7f673c0c3070 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f672c00c520 tx=0x7f672c00c830 comp rx=0 tx=0).stop 2023-07-09T21:51:16.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.885+0000 7f67439ff700 1 -- 172.21.15.53:0/4260655683 shutdown_connections 2023-07-09T21:51:16.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.885+0000 7f67439ff700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f672006ace0 0x7f672006d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.885+0000 7f67439ff700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f673c0cda40 0x7f673c0c35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.885+0000 7f67439ff700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c06ca10 0x7f673c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.885+0000 7f67439ff700 1 --2- 172.21.15.53:0/4260655683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f673c0cbe40 0x7f673c0c3070 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:16.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.885+0000 7f67439ff700 1 -- 172.21.15.53:0/4260655683 >> 172.21.15.53:0/4260655683 conn(0x7f673c0b05d0 msgr2=0x7f673c06ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:16.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.885+0000 7f67439ff700 1 -- 172.21.15.53:0/4260655683 shutdown_connections 2023-07-09T21:51:16.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:16.885+0000 7f67439ff700 1 -- 172.21.15.53:0/4260655683 wait complete. 2023-07-09T21:51:16.906 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:51:17.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.106+0000 7f12f2bff700 1 Processor -- start 2023-07-09T21:51:17.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.106+0000 7f12f2bff700 1 -- start start 2023-07-09T21:51:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.107+0000 7f12f2bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12ec0d1220 0x7f12ec0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.107+0000 7f12f2bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f12ec0b0e20 0x7f12ec0b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.107+0000 7f12f2bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0b8e80 con 0x7f12ec0b3ff0 2023-07-09T21:51:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.107+0000 7f12f2bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ec0afaa0 con 0x7f12ec0b0e20 2023-07-09T21:51:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.107+0000 7f12f2bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0afd80 con 0x7f12ec0d1220 2023-07-09T21:51:17.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.107+0000 7f12f119c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f12ec0b0e20 0x7f12ec0b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:17.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.107+0000 7f12f119c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f12ec0b0e20 0x7f12ec0b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51138/0 (socket says 172.21.15.53:51138) 2023-07-09T21:51:17.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.107+0000 7f12f119c700 1 -- 172.21.15.53:0/3892029896 learned_addr learned my addr 172.21.15.53:0/3892029896 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:17.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.107+0000 7f12ebfff700 1 --2- 172.21.15.53:0/3892029896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12ec0d1220 0x7f12ec0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.108+0000 7f12f119c700 1 -- 172.21.15.53:0/3892029896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12ec0d1220 msgr2=0x7f12ec0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.108+0000 7f12f119c700 1 --2- 172.21.15.53:0/3892029896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12ec0d1220 0x7f12ec0b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.108+0000 7f12f119c700 1 -- 172.21.15.53:0/3892029896 >> v1:172.21.15.184:6789/0 conn(0x7f12ec0b3ff0 legacy=0x7f12ec0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.108+0000 7f12f119c700 1 -- 172.21.15.53:0/3892029896 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec0b0060 con 0x7f12ec0b0e20 2023-07-09T21:51:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.108+0000 7f12f119c700 1 --2- 172.21.15.53:0/3892029896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12ec0b0e20 0x7f12ec0b1280 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009e50 tx=0x7f12e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5355ec058e9e662b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.108+0000 7f12eb7fe700 1 -- 172.21.15.53:0/3892029896 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e400e070 con 0x7f12ec0b0e20 2023-07-09T21:51:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.108+0000 7f12eb7fe700 1 -- 172.21.15.53:0/3892029896 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e400b910 con 0x7f12ec0b0e20 2023-07-09T21:51:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.108+0000 7f12eb7fe700 1 -- 172.21.15.53:0/3892029896 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e400bcc0 con 0x7f12ec0b0e20 2023-07-09T21:51:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.109+0000 7f12f2bff700 1 -- 172.21.15.53:0/3892029896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12ec0b0e20 msgr2=0x7f12ec0b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.109+0000 7f12f2bff700 1 --2- 172.21.15.53:0/3892029896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12ec0b0e20 0x7f12ec0b1280 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009e50 tx=0x7f12e400b330 comp rx=0 tx=0).stop 2023-07-09T21:51:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.109+0000 7f12f2bff700 1 -- 172.21.15.53:0/3892029896 shutdown_connections 2023-07-09T21:51:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.109+0000 7f12f2bff700 1 --2- 172.21.15.53:0/3892029896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12ec0b0e20 0x7f12ec0b1280 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.109+0000 7f12f2bff700 1 --2- 172.21.15.53:0/3892029896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12ec0d1220 0x7f12ec0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.109+0000 7f12f2bff700 1 -- 172.21.15.53:0/3892029896 >> 172.21.15.53:0/3892029896 conn(0x7f12ec09c1b0 msgr2=0x7f12ec0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.109+0000 7f12f2bff700 1 -- 172.21.15.53:0/3892029896 shutdown_connections 2023-07-09T21:51:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.109+0000 7f12f2bff700 1 -- 172.21.15.53:0/3892029896 wait complete. 2023-07-09T21:51:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.111+0000 7f12f2bff700 1 Processor -- start 2023-07-09T21:51:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.111+0000 7f12f2bff700 1 -- start start 2023-07-09T21:51:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.112+0000 7f12f2bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12ec0b0e20 0x7f12ec1f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.112+0000 7f12f2bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12ec0b3ff0 0x7f12ec15e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.112+0000 7f12f2bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12ec0d1220 0x7f12ec0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.112+0000 7f12f2bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec15dd60 con 0x7f12ec0d1220 2023-07-09T21:51:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.112+0000 7f12f2bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec1f2ec0 con 0x7f12ec0b3ff0 2023-07-09T21:51:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.112+0000 7f12f2bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec15d150 con 0x7f12ec0b0e20 2023-07-09T21:51:17.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.112+0000 7f12f119c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12ec0d1220 0x7f12ec0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:17.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.112+0000 7f12f099b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12ec0b0e20 0x7f12ec1f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:17.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.112+0000 7f12f119c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12ec0d1220 0x7f12ec0ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51140/0 (socket says 172.21.15.53:51140) 2023-07-09T21:51:17.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.112+0000 7f12f119c700 1 -- 172.21.15.53:0/484690994 learned_addr learned my addr 172.21.15.53:0/484690994 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:17.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.112+0000 7f12ebfff700 1 --2- 172.21.15.53:0/484690994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12ec0b3ff0 0x7f12ec15e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:17.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.113+0000 7f12f119c700 1 -- 172.21.15.53:0/484690994 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12ec0b0e20 msgr2=0x7f12ec1f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:17.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.113+0000 7f12f119c700 1 --2- 172.21.15.53:0/484690994 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12ec0b0e20 0x7f12ec1f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.113+0000 7f12f119c700 1 -- 172.21.15.53:0/484690994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12ec0b3ff0 msgr2=0x7f12ec15e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.113+0000 7f12f119c700 1 --2- 172.21.15.53:0/484690994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12ec0b3ff0 0x7f12ec15e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.113+0000 7f12f119c700 1 -- 172.21.15.53:0/484690994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e4009b30 con 0x7f12ec0d1220 2023-07-09T21:51:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.113+0000 7f12f119c700 1 --2- 172.21.15.53:0/484690994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12ec0d1220 0x7f12ec0ce7b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0681d0 tx=0x7f12e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.113+0000 7f12e97fa700 1 -- 172.21.15.53:0/484690994 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e4004800 con 0x7f12ec0d1220 2023-07-09T21:51:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.113+0000 7f12e97fa700 1 -- 172.21.15.53:0/484690994 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e4004960 con 0x7f12ec0d1220 2023-07-09T21:51:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.113+0000 7f12e97fa700 1 -- 172.21.15.53:0/484690994 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e401c680 con 0x7f12ec0d1220 2023-07-09T21:51:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.113+0000 7f12f2bff700 1 -- 172.21.15.53:0/484690994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ec15d430 con 0x7f12ec0d1220 2023-07-09T21:51:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.113+0000 7f12f2bff700 1 -- 172.21.15.53:0/484690994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec15d9f0 con 0x7f12ec0d1220 2023-07-09T21:51:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.114+0000 7f12f2bff700 1 -- 172.21.15.53:0/484690994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ec074350 con 0x7f12ec0d1220 2023-07-09T21:51:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.115+0000 7f12e97fa700 1 -- 172.21.15.53:0/484690994 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f12e401c7e0 con 0x7f12ec0d1220 2023-07-09T21:51:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.117+0000 7f12e97fa700 1 --2- 172.21.15.53:0/484690994 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f12d006ace0 0x7f12d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.117+0000 7f12e97fa700 1 -- 172.21.15.53:0/484690994 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f12e408ad10 con 0x7f12ec0d1220 2023-07-09T21:51:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.117+0000 7f12f099b700 1 --2- 172.21.15.53:0/484690994 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f12d006ace0 0x7f12d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.118+0000 7f12f099b700 1 --2- 172.21.15.53:0/484690994 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f12d006ace0 0x7f12d006d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0b3d60 tx=0x7f12e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.121+0000 7f12e97fa700 1 -- 172.21.15.53:0/484690994 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f12e4055d80 con 0x7f12ec0d1220 2023-07-09T21:51:17.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.344+0000 7f12f2bff700 1 -- 172.21.15.53:0/484690994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f12ec08b870 con 0x7f12ec0d1220 2023-07-09T21:51:17.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.345+0000 7f12e97fa700 1 -- 172.21.15.53:0/484690994 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f12e40593a0 con 0x7f12ec0d1220 2023-07-09T21:51:17.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.347+0000 7f12f2bff700 1 -- 172.21.15.53:0/484690994 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f12d006ace0 msgr2=0x7f12d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:17.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.347+0000 7f12f2bff700 1 --2- 172.21.15.53:0/484690994 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f12d006ace0 0x7f12d006d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0b3d60 tx=0x7f12e0009040 comp rx=0 tx=0).stop 2023-07-09T21:51:17.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.347+0000 7f12f2bff700 1 -- 172.21.15.53:0/484690994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12ec0d1220 msgr2=0x7f12ec0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:17.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.347+0000 7f12f2bff700 1 --2- 172.21.15.53:0/484690994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12ec0d1220 0x7f12ec0ce7b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0681d0 tx=0x7f12e4004ad0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.347+0000 7f12f2bff700 1 -- 172.21.15.53:0/484690994 shutdown_connections 2023-07-09T21:51:17.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.347+0000 7f12f2bff700 1 --2- 172.21.15.53:0/484690994 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f12d006ace0 0x7f12d006d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.347+0000 7f12f2bff700 1 --2- 172.21.15.53:0/484690994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12ec0d1220 0x7f12ec0ce7b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.347+0000 7f12f2bff700 1 --2- 172.21.15.53:0/484690994 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12ec0b0e20 0x7f12ec1f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.347+0000 7f12f2bff700 1 --2- 172.21.15.53:0/484690994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12ec0b3ff0 0x7f12ec15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.347+0000 7f12f2bff700 1 -- 172.21.15.53:0/484690994 >> 172.21.15.53:0/484690994 conn(0x7f12ec09c1b0 msgr2=0x7f12ec06b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:17.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.347+0000 7f12f2bff700 1 -- 172.21.15.53:0/484690994 shutdown_connections 2023-07-09T21:51:17.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.347+0000 7f12f2bff700 1 -- 172.21.15.53:0/484690994 wait complete. 2023-07-09T21:51:17.351 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-07-09T21:51:17.367 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T21:51:17.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:17.368 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-09T21:51:17.457 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:51:17.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:17.458 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T21:51:17.514 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:51:17.515 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:17.559 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:51:17.559 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:17.641 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:51:17.642 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:17.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:17.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.961+0000 7f4c31fff700 1 Processor -- start 2023-07-09T21:51:17.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.961+0000 7f4c31fff700 1 -- start start 2023-07-09T21:51:17.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.962+0000 7f4c31fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4c2c0b1e00 0x7f4c2c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:17.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.962+0000 7f4c31fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c2c0d1220 0x7f4c2c0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:17.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.962+0000 7f4c31fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2c0d2ce0 con 0x7f4c2c0b2350 2023-07-09T21:51:17.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.962+0000 7f4c31fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c0b3350 con 0x7f4c2c0b1e00 2023-07-09T21:51:17.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.962+0000 7f4c31fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0b3630 con 0x7f4c2c0d1220 2023-07-09T21:51:17.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.963+0000 7f4c2b7fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4c2c0b1e00 0x7f4c2c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:17.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.963+0000 7f4c2bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c2c0d1220 0x7f4c2c0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:17.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.963+0000 7f4c2bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c2c0d1220 0x7f4c2c0afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:34200/0 (socket says 172.21.15.53:34200) 2023-07-09T21:51:17.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.963+0000 7f4c2bfff700 1 -- 172.21.15.53:0/955279165 learned_addr learned my addr 172.21.15.53:0/955279165 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:17.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.963+0000 7f4c2b7fe700 1 -- 172.21.15.53:0/955279165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c2c0d1220 msgr2=0x7f4c2c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:17.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.963+0000 7f4c2b7fe700 1 --2- 172.21.15.53:0/955279165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c2c0d1220 0x7f4c2c0afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.963+0000 7f4c2b7fe700 1 -- 172.21.15.53:0/955279165 >> v1:172.21.15.184:6789/0 conn(0x7f4c2c0b2350 legacy=0x7f4c2c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:17.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.963+0000 7f4c2b7fe700 1 -- 172.21.15.53:0/955279165 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c0b3910 con 0x7f4c2c0b1e00 2023-07-09T21:51:17.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.963+0000 7f4c2a7fc700 1 -- 172.21.15.53:0/955279165 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187588909 0 0) 0x7f4c2c0d2ce0 con 0x7f4c2c0b2350 2023-07-09T21:51:17.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.963+0000 7f4c2b7fe700 1 --2- 172.21.15.53:0/955279165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c2c0b1e00 0x7f4c2c0b43f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009820 tx=0x7f4c1c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2245d41ca3ba8c31 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:17.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.964+0000 7f4c2a7fc700 1 -- 172.21.15.53:0/955279165 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c005e30 con 0x7f4c2c0b1e00 2023-07-09T21:51:17.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.964+0000 7f4c2a7fc700 1 -- 172.21.15.53:0/955279165 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c006030 con 0x7f4c2c0b1e00 2023-07-09T21:51:17.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.964+0000 7f4c2a7fc700 1 -- 172.21.15.53:0/955279165 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0063c0 con 0x7f4c2c0b1e00 2023-07-09T21:51:17.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.964+0000 7f4c31fff700 1 -- 172.21.15.53:0/955279165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c2c0b1e00 msgr2=0x7f4c2c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:17.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.964+0000 7f4c31fff700 1 --2- 172.21.15.53:0/955279165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c2c0b1e00 0x7f4c2c0b43f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009820 tx=0x7f4c1c009b30 comp rx=0 tx=0).stop 2023-07-09T21:51:17.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.964+0000 7f4c31fff700 1 -- 172.21.15.53:0/955279165 shutdown_connections 2023-07-09T21:51:17.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.964+0000 7f4c31fff700 1 --2- 172.21.15.53:0/955279165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c2c0d1220 0x7f4c2c0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.964+0000 7f4c31fff700 1 --2- 172.21.15.53:0/955279165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c2c0b1e00 0x7f4c2c0b43f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.964+0000 7f4c31fff700 1 -- 172.21.15.53:0/955279165 >> 172.21.15.53:0/955279165 conn(0x7f4c2c09c1d0 msgr2=0x7f4c2c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:17.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.964+0000 7f4c31fff700 1 -- 172.21.15.53:0/955279165 shutdown_connections 2023-07-09T21:51:17.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.964+0000 7f4c31fff700 1 -- 172.21.15.53:0/955279165 wait complete. 2023-07-09T21:51:17.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.966+0000 7f4c31fff700 1 Processor -- start 2023-07-09T21:51:17.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.966+0000 7f4c31fff700 1 -- start start 2023-07-09T21:51:17.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.967+0000 7f4c31fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c2c0b1e00 0x7f4c2c0b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:17.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.967+0000 7f4c31fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c2c0b2350 0x7f4c2c142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:17.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.967+0000 7f4c31fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c2c0d1220 0x7f4c2c142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:17.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.967+0000 7f4c31fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0cba40 con 0x7f4c2c0b2350 2023-07-09T21:51:17.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.967+0000 7f4c31fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0cca10 con 0x7f4c2c0d1220 2023-07-09T21:51:17.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.967+0000 7f4c31fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0b6630 con 0x7f4c2c0b1e00 2023-07-09T21:51:17.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.968+0000 7f4c2affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c2c0b2350 0x7f4c2c142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:17.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.968+0000 7f4c2affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c2c0b2350 0x7f4c2c142020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51154/0 (socket says 172.21.15.53:51154) 2023-07-09T21:51:17.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.968+0000 7f4c2affd700 1 -- 172.21.15.53:0/1455033559 learned_addr learned my addr 172.21.15.53:0/1455033559 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:17.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.968+0000 7f4c2b7fe700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c2c0b1e00 0x7f4c2c0b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:17.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.968+0000 7f4c2bfff700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c2c0d1220 0x7f4c2c142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:17.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.968+0000 7f4c2affd700 1 -- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c2c0b1e00 msgr2=0x7f4c2c0b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:17.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.968+0000 7f4c2affd700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c2c0b1e00 0x7f4c2c0b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.968+0000 7f4c2affd700 1 -- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c2c0d1220 msgr2=0x7f4c2c142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:17.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.968+0000 7f4c2affd700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c2c0d1220 0x7f4c2c142560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:17.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.968+0000 7f4c2affd700 1 -- 172.21.15.53:0/1455033559 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c009430 con 0x7f4c2c0b2350 2023-07-09T21:51:17.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.968+0000 7f4c2affd700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c2c0b2350 0x7f4c2c142020 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c750 tx=0x7f4c2000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:17.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.969+0000 7f4c13fff700 1 -- 172.21.15.53:0/1455033559 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c200054e0 con 0x7f4c2c0b2350 2023-07-09T21:51:17.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.969+0000 7f4c13fff700 1 -- 172.21.15.53:0/1455033559 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c20003680 con 0x7f4c2c0b2350 2023-07-09T21:51:17.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.969+0000 7f4c31fff700 1 -- 172.21.15.53:0/1455033559 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2c0cbc50 con 0x7f4c2c0b2350 2023-07-09T21:51:17.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.969+0000 7f4c13fff700 1 -- 172.21.15.53:0/1455033559 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20003a30 con 0x7f4c2c0b2350 2023-07-09T21:51:17.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.969+0000 7f4c31fff700 1 -- 172.21.15.53:0/1455033559 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2c0cc210 con 0x7f4c2c0b2350 2023-07-09T21:51:17.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.970+0000 7f4c31fff700 1 -- 172.21.15.53:0/1455033559 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2c04e280 con 0x7f4c2c0b2350 2023-07-09T21:51:17.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.971+0000 7f4c13fff700 1 -- 172.21.15.53:0/1455033559 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c20003b90 con 0x7f4c2c0b2350 2023-07-09T21:51:17.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.972+0000 7f4c13fff700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4c1806ace0 0x7f4c1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:17.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.972+0000 7f4c13fff700 1 -- 172.21.15.53:0/1455033559 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4c200888e0 con 0x7f4c2c0b2350 2023-07-09T21:51:17.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.972+0000 7f4c2b7fe700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4c1806ace0 0x7f4c1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:17.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.973+0000 7f4c2b7fe700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4c1806ace0 0x7f4c1806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c000c00 tx=0x7f4c1c008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:17.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:17.976+0000 7f4c13fff700 1 -- 172.21.15.53:0/1455033559 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4c20053940 con 0x7f4c2c0b2350 2023-07-09T21:51:18.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.185+0000 7f4c31fff700 1 -- 172.21.15.53:0/1455033559 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c2c08c5a0 con 0x7f4c2c0b2350 2023-07-09T21:51:18.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.187+0000 7f4c13fff700 1 -- 172.21.15.53:0/1455033559 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f4c20017090 con 0x7f4c2c0b2350 2023-07-09T21:51:18.189 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:18.190 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:04.650456+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:18.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.189+0000 7f4c31fff700 1 -- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4c1806ace0 msgr2=0x7f4c1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.189+0000 7f4c31fff700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4c1806ace0 0x7f4c1806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c000c00 tx=0x7f4c1c008070 comp rx=0 tx=0).stop 2023-07-09T21:51:18.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.189+0000 7f4c31fff700 1 -- 172.21.15.53:0/1455033559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c2c0b2350 msgr2=0x7f4c2c142020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.189+0000 7f4c31fff700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c2c0b2350 0x7f4c2c142020 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c750 tx=0x7f4c2000ca60 comp rx=0 tx=0).stop 2023-07-09T21:51:18.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.189+0000 7f4c31fff700 1 -- 172.21.15.53:0/1455033559 shutdown_connections 2023-07-09T21:51:18.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.189+0000 7f4c31fff700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4c1806ace0 0x7f4c1806d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.189+0000 7f4c31fff700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c2c0d1220 0x7f4c2c142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.189+0000 7f4c31fff700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c2c0b1e00 0x7f4c2c0b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.189+0000 7f4c31fff700 1 --2- 172.21.15.53:0/1455033559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c2c0b2350 0x7f4c2c142020 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.189+0000 7f4c31fff700 1 -- 172.21.15.53:0/1455033559 >> 172.21.15.53:0/1455033559 conn(0x7f4c2c09c1d0 msgr2=0x7f4c2c0b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:18.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.189+0000 7f4c31fff700 1 -- 172.21.15.53:0/1455033559 shutdown_connections 2023-07-09T21:51:18.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.189+0000 7f4c31fff700 1 -- 172.21.15.53:0/1455033559 wait complete. 2023-07-09T21:51:18.210 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:50:21.703759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:50:22.243698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:51:18.211 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:51:18.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.412+0000 7eff0dfff700 1 Processor -- start 2023-07-09T21:51:18.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.412+0000 7eff0dfff700 1 -- start start 2023-07-09T21:51:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff0dfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff080b43c0 0x7eff080b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff0dfff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff080b8e80 con 0x7eff080b3ff0 2023-07-09T21:51:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff0dfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff080afaa0 con 0x7eff080d1220 2023-07-09T21:51:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff0dfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff080afd80 con 0x7eff080b43c0 2023-07-09T21:51:18.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff077fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7eff080b3ff0 0x7eff080d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43586/0 (socket says 172.21.15.53:43586) 2023-07-09T21:51:18.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff077fe700 1 -- 172.21.15.53:0/3465889697 learned_addr learned my addr 172.21.15.53:0/3465889697 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:18.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff07fff700 1 --2- 172.21.15.53:0/3465889697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff080b43c0 0x7eff080b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:18.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff067fc700 1 -- 172.21.15.53:0/3465889697 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572676020 0 0) 0x7efef8001110 con 0x7eff080b3ff0 2023-07-09T21:51:18.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff067fc700 1 -- 172.21.15.53:0/3465889697 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efef00035b0 con 0x7eff080b3ff0 2023-07-09T21:51:18.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff067fc700 1 -- 172.21.15.53:0/3465889697 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790777707 0 0) 0x7eff080afaa0 con 0x7eff080d1220 2023-07-09T21:51:18.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff067fc700 1 -- 172.21.15.53:0/3465889697 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efef8001110 con 0x7eff080d1220 2023-07-09T21:51:18.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff07fff700 1 -- 172.21.15.53:0/3465889697 >> v1:172.21.15.184:6789/0 conn(0x7eff080d1220 legacy=0x7eff080b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff07fff700 1 -- 172.21.15.53:0/3465889697 >> v1:172.21.15.53:6789/0 conn(0x7eff080b3ff0 legacy=0x7eff080d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.414+0000 7eff07fff700 1 -- 172.21.15.53:0/3465889697 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff080b0060 con 0x7eff080b43c0 2023-07-09T21:51:18.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.415+0000 7eff07fff700 1 --2- 172.21.15.53:0/3465889697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff080b43c0 0x7eff080b1530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff00009dc0 tx=0x7eff0000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a3af6cc21570db5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:18.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.415+0000 7eff067fc700 1 -- 172.21.15.53:0/3465889697 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0000e070 con 0x7eff080b43c0 2023-07-09T21:51:18.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.415+0000 7eff067fc700 1 -- 172.21.15.53:0/3465889697 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0000bb20 con 0x7eff080b43c0 2023-07-09T21:51:18.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.415+0000 7eff067fc700 1 -- 172.21.15.53:0/3465889697 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00012430 con 0x7eff080b43c0 2023-07-09T21:51:18.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.416+0000 7eff0dfff700 1 -- 172.21.15.53:0/3465889697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff080b43c0 msgr2=0x7eff080b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.416+0000 7eff0dfff700 1 --2- 172.21.15.53:0/3465889697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff080b43c0 0x7eff080b1530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff00009dc0 tx=0x7eff0000b330 comp rx=0 tx=0).stop 2023-07-09T21:51:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.416+0000 7eff0dfff700 1 -- 172.21.15.53:0/3465889697 shutdown_connections 2023-07-09T21:51:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.416+0000 7eff0dfff700 1 --2- 172.21.15.53:0/3465889697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff080b43c0 0x7eff080b1530 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.416+0000 7eff0dfff700 1 -- 172.21.15.53:0/3465889697 >> 172.21.15.53:0/3465889697 conn(0x7eff0809c1b0 msgr2=0x7eff080d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.416+0000 7eff0dfff700 1 -- 172.21.15.53:0/3465889697 shutdown_connections 2023-07-09T21:51:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.416+0000 7eff0dfff700 1 -- 172.21.15.53:0/3465889697 wait complete. 2023-07-09T21:51:18.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.418+0000 7eff0dfff700 1 Processor -- start 2023-07-09T21:51:18.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.418+0000 7eff0dfff700 1 -- start start 2023-07-09T21:51:18.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff0dfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff080b3ff0 0x7eff080cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:18.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff0dfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff080b43c0 0x7eff080b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:18.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff0dfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff080d1220 0x7eff080cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:18.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff0dfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff080cb100 con 0x7eff080b43c0 2023-07-09T21:51:18.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff0dfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff080ccbe0 con 0x7eff080b3ff0 2023-07-09T21:51:18.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff0dfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff080cb3a0 con 0x7eff080d1220 2023-07-09T21:51:18.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff06ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff080b43c0 0x7eff080b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:18.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff06ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff080b43c0 0x7eff080b6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51160/0 (socket says 172.21.15.53:51160) 2023-07-09T21:51:18.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff06ffd700 1 -- 172.21.15.53:0/3994429657 learned_addr learned my addr 172.21.15.53:0/3994429657 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:18.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff077fe700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff080b3ff0 0x7eff080cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:18.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff07fff700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff080d1220 0x7eff080cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:18.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff06ffd700 1 -- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff080d1220 msgr2=0x7eff080cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff06ffd700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff080d1220 0x7eff080cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff06ffd700 1 -- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff080b3ff0 msgr2=0x7eff080cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff06ffd700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff080b3ff0 0x7eff080cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.419+0000 7eff06ffd700 1 -- 172.21.15.53:0/3994429657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00009a70 con 0x7eff080b43c0 2023-07-09T21:51:18.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.420+0000 7eff06ffd700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff080b43c0 0x7eff080b6b20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efefc00c500 tx=0x7efefc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:18.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.420+0000 7efeeffff700 1 -- 172.21.15.53:0/3994429657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc0052d0 con 0x7eff080b43c0 2023-07-09T21:51:18.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.420+0000 7efeeffff700 1 -- 172.21.15.53:0/3994429657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc005450 con 0x7eff080b43c0 2023-07-09T21:51:18.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.420+0000 7eff0dfff700 1 -- 172.21.15.53:0/3994429657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff080cb680 con 0x7eff080b43c0 2023-07-09T21:51:18.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.420+0000 7efeeffff700 1 -- 172.21.15.53:0/3994429657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc0038c0 con 0x7eff080b43c0 2023-07-09T21:51:18.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.420+0000 7eff0dfff700 1 -- 172.21.15.53:0/3994429657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0815b950 con 0x7eff080b43c0 2023-07-09T21:51:18.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.421+0000 7eff0dfff700 1 -- 172.21.15.53:0/3994429657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff080cb8c0 con 0x7eff080b43c0 2023-07-09T21:51:18.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.422+0000 7efeeffff700 1 -- 172.21.15.53:0/3994429657 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efefc003a20 con 0x7eff080b43c0 2023-07-09T21:51:18.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.423+0000 7efeeffff700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7efef406ace0 0x7efef406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:18.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.423+0000 7efeeffff700 1 -- 172.21.15.53:0/3994429657 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efefc088930 con 0x7eff080b43c0 2023-07-09T21:51:18.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.424+0000 7eff077fe700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7efef406ace0 0x7efef406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:18.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.424+0000 7eff077fe700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7efef406ace0 0x7efef406d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efef8007fd0 tx=0x7efef8007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:18.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.427+0000 7efeeffff700 1 -- 172.21.15.53:0/3994429657 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7eff080cb8c0 con 0x7eff080b43c0 2023-07-09T21:51:18.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.639+0000 7eff0dfff700 1 -- 172.21.15.53:0/3994429657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff080cb8c0 con 0x7eff080b43c0 2023-07-09T21:51:18.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.640+0000 7efeeffff700 1 -- 172.21.15.53:0/3994429657 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7efefc017020 con 0x7eff080b43c0 2023-07-09T21:51:18.643 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:51:18.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.642+0000 7eff0dfff700 1 -- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7efef406ace0 msgr2=0x7efef406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.642+0000 7eff0dfff700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7efef406ace0 0x7efef406d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efef8007fd0 tx=0x7efef8007dc0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.642+0000 7eff0dfff700 1 -- 172.21.15.53:0/3994429657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff080b43c0 msgr2=0x7eff080b6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.642+0000 7eff0dfff700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff080b43c0 0x7eff080b6b20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efefc00c500 tx=0x7efefc00c810 comp rx=0 tx=0).stop 2023-07-09T21:51:18.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.642+0000 7eff0dfff700 1 -- 172.21.15.53:0/3994429657 shutdown_connections 2023-07-09T21:51:18.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.642+0000 7eff0dfff700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7efef406ace0 0x7efef406d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.642+0000 7eff0dfff700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff080d1220 0x7eff080cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.642+0000 7eff0dfff700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff080b3ff0 0x7eff080cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.642+0000 7eff0dfff700 1 --2- 172.21.15.53:0/3994429657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff080b43c0 0x7eff080b6b20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.642+0000 7eff0dfff700 1 -- 172.21.15.53:0/3994429657 >> 172.21.15.53:0/3994429657 conn(0x7eff0809c1b0 msgr2=0x7eff080b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:18.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.642+0000 7eff0dfff700 1 -- 172.21.15.53:0/3994429657 shutdown_connections 2023-07-09T21:51:18.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.642+0000 7eff0dfff700 1 -- 172.21.15.53:0/3994429657 wait complete. 2023-07-09T21:51:18.663 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:51:18.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.867+0000 7fbc86bff700 1 Processor -- start 2023-07-09T21:51:18.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.867+0000 7fbc86bff700 1 -- start start 2023-07-09T21:51:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.868+0000 7fbc86bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc800cf2a0 0x7fbc8015c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.868+0000 7fbc86bff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc800d2260 con 0x7fbc800c6aa0 2023-07-09T21:51:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.868+0000 7fbc86bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc800cd5a0 con 0x7fbc800b49d0 2023-07-09T21:51:18.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.868+0000 7fbc86bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc80146740 con 0x7fbc800cf2a0 2023-07-09T21:51:18.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.868+0000 7fbc7ffff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbc800c6aa0 0x7fbc800c6f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43590/0 (socket says 172.21.15.53:43590) 2023-07-09T21:51:18.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.868+0000 7fbc7ffff700 1 -- 172.21.15.53:0/4075722122 learned_addr learned my addr 172.21.15.53:0/4075722122 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.869+0000 7fbc8499b700 1 --2- 172.21.15.53:0/4075722122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc800cf2a0 0x7fbc8015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.869+0000 7fbc7f7fe700 1 -- 172.21.15.53:0/4075722122 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751611648 0 0) 0x7fbc800d2260 con 0x7fbc800c6aa0 2023-07-09T21:51:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.869+0000 7fbc7f7fe700 1 -- 172.21.15.53:0/4075722122 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc700035b0 con 0x7fbc800c6aa0 2023-07-09T21:51:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.869+0000 7fbc7f7fe700 1 -- 172.21.15.53:0/4075722122 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348528289 0 0) 0x7fbc800cd5a0 con 0x7fbc800b49d0 2023-07-09T21:51:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.869+0000 7fbc7f7fe700 1 -- 172.21.15.53:0/4075722122 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc800d2260 con 0x7fbc800b49d0 2023-07-09T21:51:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.869+0000 7fbc8499b700 1 -- 172.21.15.53:0/4075722122 >> v1:172.21.15.184:6789/0 conn(0x7fbc800b49d0 legacy=0x7fbc800b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.869+0000 7fbc8499b700 1 -- 172.21.15.53:0/4075722122 >> v1:172.21.15.53:6789/0 conn(0x7fbc800c6aa0 legacy=0x7fbc800c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.869+0000 7fbc8499b700 1 -- 172.21.15.53:0/4075722122 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc800cd7f0 con 0x7fbc800cf2a0 2023-07-09T21:51:18.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.870+0000 7fbc8499b700 1 --2- 172.21.15.53:0/4075722122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc800cf2a0 0x7fbc8015c860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009870 tx=0x7fbc74009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78d8112d7f4103da server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:18.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.870+0000 7fbc7f7fe700 1 -- 172.21.15.53:0/4075722122 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74011830 con 0x7fbc800cf2a0 2023-07-09T21:51:18.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.870+0000 7fbc7f7fe700 1 -- 172.21.15.53:0/4075722122 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc74011990 con 0x7fbc800cf2a0 2023-07-09T21:51:18.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.870+0000 7fbc7f7fe700 1 -- 172.21.15.53:0/4075722122 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74011d20 con 0x7fbc800cf2a0 2023-07-09T21:51:18.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.870+0000 7fbc86bff700 1 -- 172.21.15.53:0/4075722122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc800cf2a0 msgr2=0x7fbc8015c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.870+0000 7fbc86bff700 1 --2- 172.21.15.53:0/4075722122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc800cf2a0 0x7fbc8015c860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009870 tx=0x7fbc74009b80 comp rx=0 tx=0).stop 2023-07-09T21:51:18.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.871+0000 7fbc86bff700 1 -- 172.21.15.53:0/4075722122 shutdown_connections 2023-07-09T21:51:18.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.871+0000 7fbc86bff700 1 --2- 172.21.15.53:0/4075722122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc800cf2a0 0x7fbc8015c860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.871+0000 7fbc86bff700 1 -- 172.21.15.53:0/4075722122 >> 172.21.15.53:0/4075722122 conn(0x7fbc80065bd0 msgr2=0x7fbc80065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:18.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.871+0000 7fbc86bff700 1 -- 172.21.15.53:0/4075722122 shutdown_connections 2023-07-09T21:51:18.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.871+0000 7fbc86bff700 1 -- 172.21.15.53:0/4075722122 wait complete. 2023-07-09T21:51:18.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.872+0000 7fbc86bff700 1 Processor -- start 2023-07-09T21:51:18.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.873+0000 7fbc86bff700 1 -- start start 2023-07-09T21:51:18.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.873+0000 7fbc86bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc800b49d0 0x7fbc8015ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:18.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.873+0000 7fbc86bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc800c6aa0 0x7fbc801f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:18.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.873+0000 7fbc86bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc800cf2a0 0x7fbc801f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:18.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc86bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800c9890 con 0x7fbc800c6aa0 2023-07-09T21:51:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc86bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800c8ff0 con 0x7fbc800b49d0 2023-07-09T21:51:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc86bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800c92d0 con 0x7fbc800cf2a0 2023-07-09T21:51:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc7ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc800c6aa0 0x7fbc801f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc7ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc800c6aa0 0x7fbc801f55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51168/0 (socket says 172.21.15.53:51168) 2023-07-09T21:51:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc7ffff700 1 -- 172.21.15.53:0/1845925372 learned_addr learned my addr 172.21.15.53:0/1845925372 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc8519c700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc800cf2a0 0x7fbc801f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc8499b700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc800b49d0 0x7fbc8015ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc7ffff700 1 -- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc800cf2a0 msgr2=0x7fbc801f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc7ffff700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc800cf2a0 0x7fbc801f5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc7ffff700 1 -- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc800b49d0 msgr2=0x7fbc8015ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc7ffff700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc800b49d0 0x7fbc8015ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc7ffff700 1 -- 172.21.15.53:0/1845925372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc740094a0 con 0x7fbc800c6aa0 2023-07-09T21:51:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc8499b700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc800b49d0 0x7fbc8015ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.874+0000 7fbc7ffff700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc800c6aa0 0x7fbc801f55d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00c700 tx=0x7fbc6c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:18.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.875+0000 7fbc7d7fa700 1 -- 172.21.15.53:0/1845925372 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c005d70 con 0x7fbc800c6aa0 2023-07-09T21:51:18.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.875+0000 7fbc7d7fa700 1 -- 172.21.15.53:0/1845925372 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c0070d0 con 0x7fbc800c6aa0 2023-07-09T21:51:18.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.875+0000 7fbc7d7fa700 1 -- 172.21.15.53:0/1845925372 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c007460 con 0x7fbc800c6aa0 2023-07-09T21:51:18.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.875+0000 7fbc86bff700 1 -- 172.21.15.53:0/1845925372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc800c95b0 con 0x7fbc800c6aa0 2023-07-09T21:51:18.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.875+0000 7fbc86bff700 1 -- 172.21.15.53:0/1845925372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc800c8cc0 con 0x7fbc800c6aa0 2023-07-09T21:51:18.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.876+0000 7fbc86bff700 1 -- 172.21.15.53:0/1845925372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc800ca390 con 0x7fbc800c6aa0 2023-07-09T21:51:18.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.877+0000 7fbc7d7fa700 1 -- 172.21.15.53:0/1845925372 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc6c0075c0 con 0x7fbc800c6aa0 2023-07-09T21:51:18.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.879+0000 7fbc7d7fa700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbc6406ace0 0x7fbc6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:18.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.879+0000 7fbc7d7fa700 1 -- 172.21.15.53:0/1845925372 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbc6c088b30 con 0x7fbc800c6aa0 2023-07-09T21:51:18.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.879+0000 7fbc8499b700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbc6406ace0 0x7fbc6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:18.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.880+0000 7fbc8499b700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbc6406ace0 0x7fbc6406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbc740097c0 tx=0x7fbc7401c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:18.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:18.883+0000 7fbc7d7fa700 1 -- 172.21.15.53:0/1845925372 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbc800ca390 con 0x7fbc800c6aa0 2023-07-09T21:51:19.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.086+0000 7fbc86bff700 1 -- 172.21.15.53:0/1845925372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbc800ca390 con 0x7fbc800c6aa0 2023-07-09T21:51:19.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.087+0000 7fbc7d7fa700 1 -- 172.21.15.53:0/1845925372 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbc800ca390 con 0x7fbc800c6aa0 2023-07-09T21:51:19.089 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:51:19.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.089+0000 7fbc86bff700 1 -- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbc6406ace0 msgr2=0x7fbc6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.089+0000 7fbc86bff700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbc6406ace0 0x7fbc6406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbc740097c0 tx=0x7fbc7401c040 comp rx=0 tx=0).stop 2023-07-09T21:51:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.089+0000 7fbc86bff700 1 -- 172.21.15.53:0/1845925372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc800c6aa0 msgr2=0x7fbc801f55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.089+0000 7fbc86bff700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc800c6aa0 0x7fbc801f55d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00c700 tx=0x7fbc6c00cac0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.089+0000 7fbc86bff700 1 -- 172.21.15.53:0/1845925372 shutdown_connections 2023-07-09T21:51:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.089+0000 7fbc86bff700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbc6406ace0 0x7fbc6406d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.089+0000 7fbc86bff700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc800cf2a0 0x7fbc801f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.089+0000 7fbc86bff700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc800b49d0 0x7fbc8015ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.089+0000 7fbc86bff700 1 --2- 172.21.15.53:0/1845925372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc800c6aa0 0x7fbc801f55d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.089+0000 7fbc86bff700 1 -- 172.21.15.53:0/1845925372 >> 172.21.15.53:0/1845925372 conn(0x7fbc80065bd0 msgr2=0x7fbc80159670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:19.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.089+0000 7fbc86bff700 1 -- 172.21.15.53:0/1845925372 shutdown_connections 2023-07-09T21:51:19.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.089+0000 7fbc86bff700 1 -- 172.21.15.53:0/1845925372 wait complete. 2023-07-09T21:51:19.109 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:51:19.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.310+0000 7f291ddff700 1 Processor -- start 2023-07-09T21:51:19.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.310+0000 7f291ddff700 1 -- start start 2023-07-09T21:51:19.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.311+0000 7f291ddff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f29180b3ff0 0x7f29180b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:19.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.311+0000 7f291ddff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29180b8e80 con 0x7f29180d0b10 2023-07-09T21:51:19.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.311+0000 7f291ddff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29180b33f0 con 0x7f29180d0f90 2023-07-09T21:51:19.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.311+0000 7f291ddff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29180b1e30 con 0x7f29180b3ff0 2023-07-09T21:51:19.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.311+0000 7f2916ffd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f29180d0b10 0x7f29180b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43600/0 (socket says 172.21.15.53:43600) 2023-07-09T21:51:19.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.311+0000 7f2916ffd700 1 -- 172.21.15.53:0/168106211 learned_addr learned my addr 172.21.15.53:0/168106211 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:19.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.311+0000 7f29177fe700 1 --2- 172.21.15.53:0/168106211 >> v2:172.21.15.184:3300/0 conn(0x7f29180b3ff0 0x7f29180b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:19.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.312+0000 7f29167fc700 1 -- 172.21.15.53:0/168106211 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456438615 0 0) 0x7f290c001110 con 0x7f29180d0b10 2023-07-09T21:51:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.312+0000 7f29167fc700 1 -- 172.21.15.53:0/168106211 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29000035b0 con 0x7f29180d0b10 2023-07-09T21:51:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.312+0000 7f29177fe700 1 -- 172.21.15.53:0/168106211 >> v1:172.21.15.184:6789/0 conn(0x7f29180d0f90 legacy=0x7f29180b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.312+0000 7f29167fc700 1 -- 172.21.15.53:0/168106211 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751389629 0 0) 0x7f29180b33f0 con 0x7f29180d0f90 2023-07-09T21:51:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.312+0000 7f29177fe700 1 -- 172.21.15.53:0/168106211 >> v1:172.21.15.53:6789/0 conn(0x7f29180d0b10 legacy=0x7f29180b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.312+0000 7f29177fe700 1 -- 172.21.15.53:0/168106211 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29180afaa0 con 0x7f29180b3ff0 2023-07-09T21:51:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.312+0000 7f29177fe700 1 --2- 172.21.15.53:0/168106211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29180b3ff0 0x7f29180b43c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2908009840 tx=0x7f2908009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60a0645a81b8fd05 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.313+0000 7f29167fc700 1 -- 172.21.15.53:0/168106211 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2908011830 con 0x7f29180b3ff0 2023-07-09T21:51:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.313+0000 7f29167fc700 1 -- 172.21.15.53:0/168106211 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2908011990 con 0x7f29180b3ff0 2023-07-09T21:51:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.313+0000 7f29167fc700 1 -- 172.21.15.53:0/168106211 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2908011d20 con 0x7f29180b3ff0 2023-07-09T21:51:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.313+0000 7f291ddff700 1 -- 172.21.15.53:0/168106211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29180b3ff0 msgr2=0x7f29180b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.313+0000 7f291ddff700 1 --2- 172.21.15.53:0/168106211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29180b3ff0 0x7f29180b43c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2908009840 tx=0x7f2908009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.313+0000 7f291ddff700 1 -- 172.21.15.53:0/168106211 shutdown_connections 2023-07-09T21:51:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.313+0000 7f291ddff700 1 --2- 172.21.15.53:0/168106211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29180b3ff0 0x7f29180b43c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.313+0000 7f291ddff700 1 -- 172.21.15.53:0/168106211 >> 172.21.15.53:0/168106211 conn(0x7f291809c1b0 msgr2=0x7f29180d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.313+0000 7f291ddff700 1 -- 172.21.15.53:0/168106211 shutdown_connections 2023-07-09T21:51:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.313+0000 7f291ddff700 1 -- 172.21.15.53:0/168106211 wait complete. 2023-07-09T21:51:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.316+0000 7f291ddff700 1 Processor -- start 2023-07-09T21:51:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.316+0000 7f291ddff700 1 -- start start 2023-07-09T21:51:19.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.317+0000 7f291ddff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29180b3ff0 0x7f2918158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.317+0000 7f291ddff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29180d0b10 0x7f29180cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.317+0000 7f291ddff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29180d0f90 0x7f29181f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.317+0000 7f291ddff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29180d0030 con 0x7f29180b3ff0 2023-07-09T21:51:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.317+0000 7f291ddff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29181f5be0 con 0x7f29180d0f90 2023-07-09T21:51:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.317+0000 7f291ddff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29181f5e10 con 0x7f29180d0b10 2023-07-09T21:51:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.317+0000 7f29177fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29180b3ff0 0x7f2918158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.317+0000 7f29177fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29180b3ff0 0x7f2918158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51170/0 (socket says 172.21.15.53:51170) 2023-07-09T21:51:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.317+0000 7f29177fe700 1 -- 172.21.15.53:0/2511671154 learned_addr learned my addr 172.21.15.53:0/2511671154 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.318+0000 7f2916ffd700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29180d0b10 0x7f29180cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.318+0000 7f29177fe700 1 -- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29180d0b10 msgr2=0x7f29180cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.318+0000 7f2917fff700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29180d0f90 0x7f29181f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.318+0000 7f29177fe700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29180d0b10 0x7f29180cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.318+0000 7f29177fe700 1 -- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29180d0f90 msgr2=0x7f29181f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.318+0000 7f29177fe700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29180d0f90 0x7f29181f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.318+0000 7f29177fe700 1 -- 172.21.15.53:0/2511671154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29080094a0 con 0x7f29180b3ff0 2023-07-09T21:51:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.318+0000 7f2917fff700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29180d0f90 0x7f29181f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.318+0000 7f2916ffd700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29180d0b10 0x7f29180cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.318+0000 7f29177fe700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29180b3ff0 0x7f2918158ff0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f29080090b0 tx=0x7f2908004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.318+0000 7f28fffff700 1 -- 172.21.15.53:0/2511671154 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290801a910 con 0x7f29180b3ff0 2023-07-09T21:51:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.318+0000 7f28fffff700 1 -- 172.21.15.53:0/2511671154 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290801aa70 con 0x7f29180b3ff0 2023-07-09T21:51:19.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.319+0000 7f28fffff700 1 -- 172.21.15.53:0/2511671154 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290801ade0 con 0x7f29180b3ff0 2023-07-09T21:51:19.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.319+0000 7f291ddff700 1 -- 172.21.15.53:0/2511671154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29181f60f0 con 0x7f29180b3ff0 2023-07-09T21:51:19.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.319+0000 7f291ddff700 1 -- 172.21.15.53:0/2511671154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29180cd6f0 con 0x7f29180b3ff0 2023-07-09T21:51:19.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.320+0000 7f291ddff700 1 -- 172.21.15.53:0/2511671154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29181f6610 con 0x7f29180b3ff0 2023-07-09T21:51:19.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.321+0000 7f28fffff700 1 -- 172.21.15.53:0/2511671154 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2908022070 con 0x7f29180b3ff0 2023-07-09T21:51:19.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.321+0000 7f28fffff700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f290406ace0 0x7f290406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:19.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.322+0000 7f28fffff700 1 -- 172.21.15.53:0/2511671154 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f290808a370 con 0x7f29180b3ff0 2023-07-09T21:51:19.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.322+0000 7f2916ffd700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f290406ace0 0x7f290406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:19.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.323+0000 7f2916ffd700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f290406ace0 0x7f290406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f290c007fd0 tx=0x7f290c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:19.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.326+0000 7f28fffff700 1 -- 172.21.15.53:0/2511671154 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f29181f6610 con 0x7f29180b3ff0 2023-07-09T21:51:19.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.532+0000 7f291ddff700 1 -- 172.21.15.53:0/2511671154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29181f6610 con 0x7f29180b3ff0 2023-07-09T21:51:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.533+0000 7f28fffff700 1 -- 172.21.15.53:0/2511671154 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2908015020 con 0x7f29180b3ff0 2023-07-09T21:51:19.535 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:51:19.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.535+0000 7f291ddff700 1 -- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f290406ace0 msgr2=0x7f290406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.535+0000 7f291ddff700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f290406ace0 0x7f290406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f290c007fd0 tx=0x7f290c009040 comp rx=0 tx=0).stop 2023-07-09T21:51:19.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.535+0000 7f291ddff700 1 -- 172.21.15.53:0/2511671154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29180b3ff0 msgr2=0x7f2918158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.535+0000 7f291ddff700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29180b3ff0 0x7f2918158ff0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f29080090b0 tx=0x7f2908004750 comp rx=0 tx=0).stop 2023-07-09T21:51:19.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.535+0000 7f291ddff700 1 -- 172.21.15.53:0/2511671154 shutdown_connections 2023-07-09T21:51:19.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.535+0000 7f291ddff700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f290406ace0 0x7f290406d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.535+0000 7f291ddff700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29180d0f90 0x7f29181f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.535+0000 7f291ddff700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29180b3ff0 0x7f2918158ff0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.535+0000 7f291ddff700 1 --2- 172.21.15.53:0/2511671154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29180d0b10 0x7f29180cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.535+0000 7f291ddff700 1 -- 172.21.15.53:0/2511671154 >> 172.21.15.53:0/2511671154 conn(0x7f291809c1b0 msgr2=0x7f291806b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:19.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.536+0000 7f291ddff700 1 -- 172.21.15.53:0/2511671154 shutdown_connections 2023-07-09T21:51:19.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.536+0000 7f291ddff700 1 -- 172.21.15.53:0/2511671154 wait complete. 2023-07-09T21:51:19.559 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:51:19.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.761+0000 7fa5afbff700 1 Processor -- start 2023-07-09T21:51:19.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.761+0000 7fa5afbff700 1 -- start start 2023-07-09T21:51:19.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.762+0000 7fa5afbff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa5a80d1220 0x7fa5a80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:19.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.762+0000 7fa5afbff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a80b8e80 con 0x7fa5a80b0e20 2023-07-09T21:51:19.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.762+0000 7fa5afbff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a80afaa0 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.762+0000 7fa5afbff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a80afd80 con 0x7fa5a80d1220 2023-07-09T21:51:19.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.762+0000 7fa5ae19c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa5a80b0e20 0x7fa5a80b1220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43614/0 (socket says 172.21.15.53:43614) 2023-07-09T21:51:19.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.762+0000 7fa5ae19c700 1 -- 172.21.15.53:0/2560840091 learned_addr learned my addr 172.21.15.53:0/2560840091 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:19.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.763+0000 7fa5ad19a700 1 --2- 172.21.15.53:0/2560840091 >> v2:172.21.15.184:3300/0 conn(0x7fa5a80d1220 0x7fa5a80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:19.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.763+0000 7fa5ac999700 1 -- 172.21.15.53:0/2560840091 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117117890 0 0) 0x7fa5a0001490 con 0x7fa5a80b0e20 2023-07-09T21:51:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.763+0000 7fa5ac999700 1 -- 172.21.15.53:0/2560840091 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5940035b0 con 0x7fa5a80b0e20 2023-07-09T21:51:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.763+0000 7fa5ac999700 1 -- 172.21.15.53:0/2560840091 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873499668 0 0) 0x7fa5a80afaa0 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.763+0000 7fa5ac999700 1 -- 172.21.15.53:0/2560840091 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a0001490 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.763+0000 7fa5ac999700 1 -- 172.21.15.53:0/2560840091 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1960339709 0 0) 0x7fa5940035b0 con 0x7fa5a80b0e20 2023-07-09T21:51:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.763+0000 7fa5ad19a700 1 -- 172.21.15.53:0/2560840091 >> v1:172.21.15.184:6789/0 conn(0x7fa5a80b3ff0 legacy=0x7fa5a80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.763+0000 7fa5ad19a700 1 -- 172.21.15.53:0/2560840091 >> v1:172.21.15.53:6789/0 conn(0x7fa5a80b0e20 legacy=0x7fa5a80b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.763+0000 7fa5ad19a700 1 -- 172.21.15.53:0/2560840091 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a80b0060 con 0x7fa5a80d1220 2023-07-09T21:51:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.763+0000 7fa5ad19a700 1 --2- 172.21.15.53:0/2560840091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5a80d1220 0x7fa5a80b43c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa598009840 tx=0x7fa598009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f045c9612a3d66a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.764+0000 7fa5ac999700 1 -- 172.21.15.53:0/2560840091 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0001b80 con 0x7fa5a80d1220 2023-07-09T21:51:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.764+0000 7fa5ac999700 1 -- 172.21.15.53:0/2560840091 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa598004030 con 0x7fa5a80d1220 2023-07-09T21:51:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.764+0000 7fa5ac999700 1 -- 172.21.15.53:0/2560840091 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5980043c0 con 0x7fa5a80d1220 2023-07-09T21:51:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.764+0000 7fa5afbff700 1 -- 172.21.15.53:0/2560840091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5a80d1220 msgr2=0x7fa5a80b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.764+0000 7fa5afbff700 1 --2- 172.21.15.53:0/2560840091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5a80d1220 0x7fa5a80b43c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa598009840 tx=0x7fa598009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:19.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.764+0000 7fa5afbff700 1 -- 172.21.15.53:0/2560840091 shutdown_connections 2023-07-09T21:51:19.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.764+0000 7fa5afbff700 1 --2- 172.21.15.53:0/2560840091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5a80d1220 0x7fa5a80b43c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.764+0000 7fa5afbff700 1 -- 172.21.15.53:0/2560840091 >> 172.21.15.53:0/2560840091 conn(0x7fa5a809c1b0 msgr2=0x7fa5a80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:19.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.764+0000 7fa5afbff700 1 -- 172.21.15.53:0/2560840091 shutdown_connections 2023-07-09T21:51:19.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.764+0000 7fa5afbff700 1 -- 172.21.15.53:0/2560840091 wait complete. 2023-07-09T21:51:19.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.766+0000 7fa5afbff700 1 Processor -- start 2023-07-09T21:51:19.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.766+0000 7fa5afbff700 1 -- start start 2023-07-09T21:51:19.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.767+0000 7fa5afbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5a80b0e20 0x7fa5a81f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:19.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.767+0000 7fa5afbff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a80b3ff0 0x7fa5a815e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:19.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.767+0000 7fa5afbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5a80d1220 0x7fa5a80c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:19.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.767+0000 7fa5afbff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80c76e0 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.767+0000 7fa5afbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a81f2e40 con 0x7fa5a80b0e20 2023-07-09T21:51:19.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.767+0000 7fa5afbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80c6ad0 con 0x7fa5a80d1220 2023-07-09T21:51:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.767+0000 7fa5ad19a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a80b3ff0 0x7fa5a815e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.767+0000 7fa5ad19a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a80b3ff0 0x7fa5a815e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51178/0 (socket says 172.21.15.53:51178) 2023-07-09T21:51:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.767+0000 7fa5ad19a700 1 -- 172.21.15.53:0/3256403996 learned_addr learned my addr 172.21.15.53:0/3256403996 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:19.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.767+0000 7fa5ad99b700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5a80b0e20 0x7fa5a81f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:19.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.768+0000 7fa5ae19c700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5a80d1220 0x7fa5a80c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:19.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.768+0000 7fa5ad19a700 1 -- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5a80d1220 msgr2=0x7fa5a80c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.768+0000 7fa5ad19a700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5a80d1220 0x7fa5a80c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.768+0000 7fa5ad19a700 1 -- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5a80b0e20 msgr2=0x7fa5a81f2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.768+0000 7fa5ad19a700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5a80b0e20 0x7fa5a81f2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.768+0000 7fa5ad19a700 1 -- 172.21.15.53:0/3256403996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5980094a0 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.768+0000 7fa5ad99b700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5a80b0e20 0x7fa5a81f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:19.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.768+0000 7fa5ad19a700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a80b3ff0 0x7fa5a815e3a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa598009790 tx=0x7fa598004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:19.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.768+0000 7fa59e7fc700 1 -- 172.21.15.53:0/3256403996 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598003e30 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.768+0000 7fa59e7fc700 1 -- 172.21.15.53:0/3256403996 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59801f070 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.768+0000 7fa59e7fc700 1 -- 172.21.15.53:0/3256403996 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598011870 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.768+0000 7fa5afbff700 1 -- 172.21.15.53:0/3256403996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a80c6db0 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.769+0000 7fa5afbff700 1 -- 172.21.15.53:0/3256403996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a80c7370 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.769+0000 7fa5afbff700 1 -- 172.21.15.53:0/3256403996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a80c7500 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.770+0000 7fa59e7fc700 1 -- 172.21.15.53:0/3256403996 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa598021030 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.771+0000 7fa59e7fc700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa58c06ace0 0x7fa58c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:19.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.772+0000 7fa59e7fc700 1 -- 172.21.15.53:0/3256403996 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa59808a7a0 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.772+0000 7fa5ad99b700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa58c06ace0 0x7fa58c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:19.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.774+0000 7fa5ad99b700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa58c06ace0 0x7fa58c06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40011e0 tx=0x7fa5a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:19.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.776+0000 7fa59e7fc700 1 -- 172.21.15.53:0/3256403996 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa5980558a0 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.987+0000 7fa5afbff700 1 -- 172.21.15.53:0/3256403996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa5a80c7890 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.987+0000 7fa59e7fc700 1 -- 172.21.15.53:0/3256403996 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa5a80c7890 con 0x7fa5a80b3ff0 2023-07-09T21:51:19.990 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:51:19.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.990+0000 7fa5afbff700 1 -- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa58c06ace0 msgr2=0x7fa58c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.990+0000 7fa5afbff700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa58c06ace0 0x7fa58c06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40011e0 tx=0x7fa5a4009040 comp rx=0 tx=0).stop 2023-07-09T21:51:19.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.990+0000 7fa5afbff700 1 -- 172.21.15.53:0/3256403996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a80b3ff0 msgr2=0x7fa5a815e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:19.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.990+0000 7fa5afbff700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a80b3ff0 0x7fa5a815e3a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa598009790 tx=0x7fa598004750 comp rx=0 tx=0).stop 2023-07-09T21:51:19.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.990+0000 7fa5afbff700 1 -- 172.21.15.53:0/3256403996 shutdown_connections 2023-07-09T21:51:19.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.990+0000 7fa5afbff700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa58c06ace0 0x7fa58c06d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.990+0000 7fa5afbff700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5a80d1220 0x7fa5a80c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.990+0000 7fa5afbff700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5a80b0e20 0x7fa5a81f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.990+0000 7fa5afbff700 1 --2- 172.21.15.53:0/3256403996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a80b3ff0 0x7fa5a815e3a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:19.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.990+0000 7fa5afbff700 1 -- 172.21.15.53:0/3256403996 >> 172.21.15.53:0/3256403996 conn(0x7fa5a809c1b0 msgr2=0x7fa5a806b470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:19.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.990+0000 7fa5afbff700 1 -- 172.21.15.53:0/3256403996 shutdown_connections 2023-07-09T21:51:19.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:19.990+0000 7fa5afbff700 1 -- 172.21.15.53:0/3256403996 wait complete. 2023-07-09T21:51:20.010 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:51:20.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.211+0000 7fc09b1ff700 1 Processor -- start 2023-07-09T21:51:20.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.211+0000 7fc09b1ff700 1 -- start start 2023-07-09T21:51:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.211+0000 7fc09b1ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0940b3ff0 0x7fc0940b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.211+0000 7fc09b1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0940d0b10 0x7fc0940d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.211+0000 7fc09b1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc0940b25d0 0x7fc0940b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.211+0000 7fc09b1ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0940b8e80 con 0x7fc0940b3ff0 2023-07-09T21:51:20.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.211+0000 7fc09b1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0940d14a0 con 0x7fc0940b25d0 2023-07-09T21:51:20.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.211+0000 7fc09b1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940afaa0 con 0x7fc0940d0b10 2023-07-09T21:51:20.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.211+0000 7fc098f9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0940b3ff0 0x7fc0940b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:20.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.211+0000 7fc098f9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0940b3ff0 0x7fc0940b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51188/0 (socket says 172.21.15.53:51188) 2023-07-09T21:51:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.211+0000 7fc098f9b700 1 -- 172.21.15.53:0/2887161813 learned_addr learned my addr 172.21.15.53:0/2887161813 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.212+0000 7fc09979c700 1 --2- 172.21.15.53:0/2887161813 >> v2:172.21.15.184:3300/0 conn(0x7fc0940b25d0 0x7fc0940b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.212+0000 7fc098f9b700 1 -- 172.21.15.53:0/2887161813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0940d0b10 msgr2=0x7fc0940d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.212+0000 7fc093fff700 1 --2- 172.21.15.53:0/2887161813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0940d0b10 0x7fc0940d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.212+0000 7fc098f9b700 1 --2- 172.21.15.53:0/2887161813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0940d0b10 0x7fc0940d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.212+0000 7fc098f9b700 1 -- 172.21.15.53:0/2887161813 >> v2:172.21.15.184:3300/0 conn(0x7fc0940b25d0 msgr2=0x7fc0940b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.212+0000 7fc098f9b700 1 --2- 172.21.15.53:0/2887161813 >> v2:172.21.15.184:3300/0 conn(0x7fc0940b25d0 0x7fc0940b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.212+0000 7fc098f9b700 1 -- 172.21.15.53:0/2887161813 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940afd80 con 0x7fc0940b3ff0 2023-07-09T21:51:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.212+0000 7fc09979c700 1 --2- 172.21.15.53:0/2887161813 >> v2:172.21.15.184:3300/0 conn(0x7fc0940b25d0 0x7fc0940b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.212+0000 7fc093fff700 1 --2- 172.21.15.53:0/2887161813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0940d0b10 0x7fc0940d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.212+0000 7fc098f9b700 1 --2- 172.21.15.53:0/2887161813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0940b3ff0 0x7fc0940b43c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc09408c2e0 tx=0x7fc088009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750820257cce3ba1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.212+0000 7fc0937fe700 1 -- 172.21.15.53:0/2887161813 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08800b870 con 0x7fc0940b3ff0 2023-07-09T21:51:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.212+0000 7fc0937fe700 1 -- 172.21.15.53:0/2887161813 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08800b9d0 con 0x7fc0940b3ff0 2023-07-09T21:51:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.212+0000 7fc0937fe700 1 -- 172.21.15.53:0/2887161813 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08800bd60 con 0x7fc0940b3ff0 2023-07-09T21:51:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.213+0000 7fc09b1ff700 1 -- 172.21.15.53:0/2887161813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0940b3ff0 msgr2=0x7fc0940b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.213+0000 7fc09b1ff700 1 --2- 172.21.15.53:0/2887161813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0940b3ff0 0x7fc0940b43c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc09408c2e0 tx=0x7fc088009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.213+0000 7fc09b1ff700 1 -- 172.21.15.53:0/2887161813 shutdown_connections 2023-07-09T21:51:20.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.213+0000 7fc09b1ff700 1 --2- 172.21.15.53:0/2887161813 >> v2:172.21.15.184:3300/0 conn(0x7fc0940b25d0 0x7fc0940b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:20.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.213+0000 7fc09b1ff700 1 --2- 172.21.15.53:0/2887161813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0940b3ff0 0x7fc0940b43c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:20.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.213+0000 7fc09b1ff700 1 --2- 172.21.15.53:0/2887161813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0940d0b10 0x7fc0940d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:20.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.213+0000 7fc09b1ff700 1 -- 172.21.15.53:0/2887161813 >> 172.21.15.53:0/2887161813 conn(0x7fc09409c1b0 msgr2=0x7fc0940d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:20.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.213+0000 7fc09b1ff700 1 -- 172.21.15.53:0/2887161813 shutdown_connections 2023-07-09T21:51:20.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.213+0000 7fc09b1ff700 1 -- 172.21.15.53:0/2887161813 wait complete. 2023-07-09T21:51:20.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.215+0000 7fc09b1ff700 1 Processor -- start 2023-07-09T21:51:20.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.215+0000 7fc09b1ff700 1 -- start start 2023-07-09T21:51:20.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc09b1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0940b25d0 0x7fc09415f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:20.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc09b1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0940b3ff0 0x7fc0940cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc09b1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0940d0b10 0x7fc0940cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc09b1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09415e700 con 0x7fc0940b3ff0 2023-07-09T21:51:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc09b1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09415e950 con 0x7fc0940d0b10 2023-07-09T21:51:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc09b1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09415ec30 con 0x7fc0940b25d0 2023-07-09T21:51:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc093fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0940b3ff0 0x7fc0940cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc093fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0940b3ff0 0x7fc0940cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51192/0 (socket says 172.21.15.53:51192) 2023-07-09T21:51:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc093fff700 1 -- 172.21.15.53:0/3450966368 learned_addr learned my addr 172.21.15.53:0/3450966368 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc09979c700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0940d0b10 0x7fc0940cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc098f9b700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0940b25d0 0x7fc09415f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc093fff700 1 -- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0940b25d0 msgr2=0x7fc09415f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc093fff700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0940b25d0 0x7fc09415f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc093fff700 1 -- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0940d0b10 msgr2=0x7fc0940cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc093fff700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0940d0b10 0x7fc0940cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc093fff700 1 -- 172.21.15.53:0/3450966368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088009550 con 0x7fc0940b3ff0 2023-07-09T21:51:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc09979c700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0940d0b10 0x7fc0940cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc093fff700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0940b3ff0 0x7fc0940cc020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc08000c7f0 tx=0x7fc08000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc0917fa700 1 -- 172.21.15.53:0/3450966368 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080011800 con 0x7fc0940b3ff0 2023-07-09T21:51:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc0917fa700 1 -- 172.21.15.53:0/3450966368 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc080011960 con 0x7fc0940b3ff0 2023-07-09T21:51:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc09b1ff700 1 -- 172.21.15.53:0/3450966368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09415ef10 con 0x7fc0940b3ff0 2023-07-09T21:51:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc0917fa700 1 -- 172.21.15.53:0/3450966368 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080011cf0 con 0x7fc0940b3ff0 2023-07-09T21:51:20.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.217+0000 7fc09b1ff700 1 -- 172.21.15.53:0/3450966368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09415f4d0 con 0x7fc0940b3ff0 2023-07-09T21:51:20.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.218+0000 7fc09b1ff700 1 -- 172.21.15.53:0/3450966368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09415f6f0 con 0x7fc0940b3ff0 2023-07-09T21:51:20.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.219+0000 7fc0917fa700 1 -- 172.21.15.53:0/3450966368 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc080018360 con 0x7fc0940b3ff0 2023-07-09T21:51:20.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.221+0000 7fc0917fa700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc07806ace0 0x7fc07806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:20.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.221+0000 7fc0917fa700 1 -- 172.21.15.53:0/3450966368 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc080089490 con 0x7fc0940b3ff0 2023-07-09T21:51:20.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.221+0000 7fc098f9b700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc07806ace0 0x7fc07806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:20.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.222+0000 7fc098f9b700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc07806ace0 0x7fc07806d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc088000c00 tx=0x7fc088008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:20.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.225+0000 7fc0917fa700 1 -- 172.21.15.53:0/3450966368 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc0800543e0 con 0x7fc0940b3ff0 2023-07-09T21:51:20.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.447+0000 7fc09b1ff700 1 -- 172.21.15.53:0/3450966368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc094074350 con 0x7fc0940b3ff0 2023-07-09T21:51:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.448+0000 7fc0917fa700 1 -- 172.21.15.53:0/3450966368 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc080057a00 con 0x7fc0940b3ff0 2023-07-09T21:51:20.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.450+0000 7fc09b1ff700 1 -- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc07806ace0 msgr2=0x7fc07806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:20.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.450+0000 7fc09b1ff700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc07806ace0 0x7fc07806d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc088000c00 tx=0x7fc088008030 comp rx=0 tx=0).stop 2023-07-09T21:51:20.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.450+0000 7fc09b1ff700 1 -- 172.21.15.53:0/3450966368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0940b3ff0 msgr2=0x7fc0940cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:20.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.450+0000 7fc09b1ff700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0940b3ff0 0x7fc0940cc020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc08000c7f0 tx=0x7fc08000cb00 comp rx=0 tx=0).stop 2023-07-09T21:51:20.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.450+0000 7fc09b1ff700 1 -- 172.21.15.53:0/3450966368 shutdown_connections 2023-07-09T21:51:20.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.450+0000 7fc09b1ff700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc07806ace0 0x7fc07806d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:20.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.450+0000 7fc09b1ff700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0940d0b10 0x7fc0940cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:20.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.450+0000 7fc09b1ff700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0940b25d0 0x7fc09415f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:20.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.450+0000 7fc09b1ff700 1 --2- 172.21.15.53:0/3450966368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0940b3ff0 0x7fc0940cc020 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:20.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.450+0000 7fc09b1ff700 1 -- 172.21.15.53:0/3450966368 >> 172.21.15.53:0/3450966368 conn(0x7fc09409c1b0 msgr2=0x7fc09406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:20.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.450+0000 7fc09b1ff700 1 -- 172.21.15.53:0/3450966368 shutdown_connections 2023-07-09T21:51:20.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:20.450+0000 7fc09b1ff700 1 -- 172.21.15.53:0/3450966368 wait complete. 2023-07-09T21:51:20.453 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-07-09T21:51:20.469 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-09T21:51:20.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:20.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-09T21:51:20.553 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:51:20.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:20.554 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-09T21:51:20.597 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:51:20.597 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:20.643 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:51:20.644 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:20.729 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:51:20.730 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:20.812 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:21.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.011+0000 7f323ffff700 1 Processor -- start 2023-07-09T21:51:21.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.011+0000 7f323ffff700 1 -- start start 2023-07-09T21:51:21.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.013+0000 7f323ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32380d1220 0x7f32380b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.013+0000 7f323ffff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f32380b2350 0x7f32380afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.013+0000 7f323ffff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32380d2ce0 con 0x7f32380b1e00 2023-07-09T21:51:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.013+0000 7f323ffff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32380b3350 con 0x7f32380d1220 2023-07-09T21:51:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.013+0000 7f323ffff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32380b3630 con 0x7f32380b2350 2023-07-09T21:51:21.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.013+0000 7f323d59a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32380d1220 0x7f32380b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.013+0000 7f323d59a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32380d1220 0x7f32380b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51194/0 (socket says 172.21.15.53:51194) 2023-07-09T21:51:21.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.013+0000 7f323d59a700 1 -- 172.21.15.53:0/1325800764 learned_addr learned my addr 172.21.15.53:0/1325800764 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:21.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.013+0000 7f323e59c700 1 --2- 172.21.15.53:0/1325800764 >> v2:172.21.15.184:3300/0 conn(0x7f32380b2350 0x7f32380afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.013+0000 7f323d59a700 1 -- 172.21.15.53:0/1325800764 >> v2:172.21.15.184:3300/0 conn(0x7f32380b2350 msgr2=0x7f32380afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:21.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.013+0000 7f323d59a700 1 --2- 172.21.15.53:0/1325800764 >> v2:172.21.15.184:3300/0 conn(0x7f32380b2350 0x7f32380afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.013+0000 7f323d59a700 1 -- 172.21.15.53:0/1325800764 >> v1:172.21.15.184:6789/0 conn(0x7f32380b1e00 legacy=0x7f32380d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.013+0000 7f323d59a700 1 -- 172.21.15.53:0/1325800764 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32380b3910 con 0x7f32380d1220 2023-07-09T21:51:21.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.014+0000 7f323d59a700 1 --2- 172.21.15.53:0/1325800764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32380d1220 0x7f32380b43f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f323808d650 tx=0x7f3228009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f329ae049e6121 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:21.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.014+0000 7f323cd99700 1 -- 172.21.15.53:0/1325800764 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228011830 con 0x7f32380d1220 2023-07-09T21:51:21.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.014+0000 7f323cd99700 1 -- 172.21.15.53:0/1325800764 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228011990 con 0x7f32380d1220 2023-07-09T21:51:21.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.014+0000 7f323cd99700 1 -- 172.21.15.53:0/1325800764 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228011d20 con 0x7f32380d1220 2023-07-09T21:51:21.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.014+0000 7f323ffff700 1 -- 172.21.15.53:0/1325800764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32380d1220 msgr2=0x7f32380b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.014+0000 7f323ffff700 1 --2- 172.21.15.53:0/1325800764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32380d1220 0x7f32380b43f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f323808d650 tx=0x7f3228009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.015+0000 7f323ffff700 1 -- 172.21.15.53:0/1325800764 shutdown_connections 2023-07-09T21:51:21.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.015+0000 7f323ffff700 1 --2- 172.21.15.53:0/1325800764 >> v2:172.21.15.184:3300/0 conn(0x7f32380b2350 0x7f32380afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.015+0000 7f323ffff700 1 --2- 172.21.15.53:0/1325800764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32380d1220 0x7f32380b43f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.015+0000 7f323ffff700 1 -- 172.21.15.53:0/1325800764 >> 172.21.15.53:0/1325800764 conn(0x7f323809c1d0 msgr2=0x7f32380d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:21.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.015+0000 7f323ffff700 1 -- 172.21.15.53:0/1325800764 shutdown_connections 2023-07-09T21:51:21.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.015+0000 7f323ffff700 1 -- 172.21.15.53:0/1325800764 wait complete. 2023-07-09T21:51:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.017+0000 7f323ffff700 1 Processor -- start 2023-07-09T21:51:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.017+0000 7f323ffff700 1 -- start start 2023-07-09T21:51:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.018+0000 7f323ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32380b1e00 0x7f3238152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.018+0000 7f323ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32380b2350 0x7f32380cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32380d1220 0x7f32380cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323ffff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32381533c0 con 0x7f32380d1220 2023-07-09T21:51:21.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323ffff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32380cf950 con 0x7f32380b2350 2023-07-09T21:51:21.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323ffff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32380ce130 con 0x7f32380b1e00 2023-07-09T21:51:21.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32380d1220 0x7f32380cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32380d1220 0x7f32380cd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51206/0 (socket says 172.21.15.53:51206) 2023-07-09T21:51:21.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323d59a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32380b2350 0x7f32380cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323e59c700 1 -- 172.21.15.53:0/1391984536 learned_addr learned my addr 172.21.15.53:0/1391984536 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:21.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323dd9b700 1 --2- 172.21.15.53:0/1391984536 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32380b1e00 0x7f3238152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323e59c700 1 -- 172.21.15.53:0/1391984536 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32380b1e00 msgr2=0x7f3238152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323e59c700 1 --2- 172.21.15.53:0/1391984536 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32380b1e00 0x7f3238152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323e59c700 1 -- 172.21.15.53:0/1391984536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32380b2350 msgr2=0x7f32380cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323e59c700 1 --2- 172.21.15.53:0/1391984536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32380b2350 0x7f32380cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.019+0000 7f323e59c700 1 -- 172.21.15.53:0/1391984536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3228009550 con 0x7f32380d1220 2023-07-09T21:51:21.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.020+0000 7f323e59c700 1 --2- 172.21.15.53:0/1391984536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32380d1220 0x7f32380cd550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f323000efc0 tx=0x7f323000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:21.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.020+0000 7f322e7fc700 1 -- 172.21.15.53:0/1391984536 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230009ea0 con 0x7f32380d1220 2023-07-09T21:51:21.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.020+0000 7f322e7fc700 1 -- 172.21.15.53:0/1391984536 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323000f040 con 0x7f32380d1220 2023-07-09T21:51:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.020+0000 7f322e7fc700 1 -- 172.21.15.53:0/1391984536 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323000ced0 con 0x7f32380d1220 2023-07-09T21:51:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.020+0000 7f323ffff700 1 -- 172.21.15.53:0/1391984536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32380ce410 con 0x7f32380d1220 2023-07-09T21:51:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.020+0000 7f323ffff700 1 -- 172.21.15.53:0/1391984536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32380cec10 con 0x7f32380d1220 2023-07-09T21:51:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.021+0000 7f323ffff700 1 -- 172.21.15.53:0/1391984536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323804e280 con 0x7f32380d1220 2023-07-09T21:51:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.022+0000 7f322e7fc700 1 -- 172.21.15.53:0/1391984536 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3230014480 con 0x7f32380d1220 2023-07-09T21:51:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.023+0000 7f322e7fc700 1 --2- 172.21.15.53:0/1391984536 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f321c06ace0 0x7f321c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.023+0000 7f322e7fc700 1 -- 172.21.15.53:0/1391984536 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3230089d30 con 0x7f32380d1220 2023-07-09T21:51:21.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.024+0000 7f323dd9b700 1 --2- 172.21.15.53:0/1391984536 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f321c06ace0 0x7f321c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.024+0000 7f323dd9b700 1 --2- 172.21.15.53:0/1391984536 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f321c06ace0 0x7f321c06d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f32380a0e10 tx=0x7f3234009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:21.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.028+0000 7f322e7fc700 1 -- 172.21.15.53:0/1391984536 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3230054d90 con 0x7f32380d1220 2023-07-09T21:51:21.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.235+0000 7f323ffff700 1 -- 172.21.15.53:0/1391984536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f323806c530 con 0x7f32380d1220 2023-07-09T21:51:21.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.236+0000 7f322e7fc700 1 -- 172.21.15.53:0/1391984536 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f3230018090 con 0x7f32380d1220 2023-07-09T21:51:21.237 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:21.238 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:04.650456+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:21.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.238+0000 7f323ffff700 1 -- 172.21.15.53:0/1391984536 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f321c06ace0 msgr2=0x7f321c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.238+0000 7f323ffff700 1 --2- 172.21.15.53:0/1391984536 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f321c06ace0 0x7f321c06d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f32380a0e10 tx=0x7f3234009040 comp rx=0 tx=0).stop 2023-07-09T21:51:21.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.238+0000 7f323ffff700 1 -- 172.21.15.53:0/1391984536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32380d1220 msgr2=0x7f32380cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.238+0000 7f323ffff700 1 --2- 172.21.15.53:0/1391984536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32380d1220 0x7f32380cd550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f323000efc0 tx=0x7f323000c3a0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.238+0000 7f323ffff700 1 -- 172.21.15.53:0/1391984536 shutdown_connections 2023-07-09T21:51:21.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.238+0000 7f323ffff700 1 --2- 172.21.15.53:0/1391984536 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f321c06ace0 0x7f321c06d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.238+0000 7f323ffff700 1 --2- 172.21.15.53:0/1391984536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32380d1220 0x7f32380cd550 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.238+0000 7f323ffff700 1 --2- 172.21.15.53:0/1391984536 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32380b1e00 0x7f3238152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.238+0000 7f323ffff700 1 --2- 172.21.15.53:0/1391984536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32380b2350 0x7f32380cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.238+0000 7f323ffff700 1 -- 172.21.15.53:0/1391984536 >> 172.21.15.53:0/1391984536 conn(0x7f323809c1d0 msgr2=0x7f32380b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:21.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.239+0000 7f323ffff700 1 -- 172.21.15.53:0/1391984536 shutdown_connections 2023-07-09T21:51:21.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.239+0000 7f323ffff700 1 -- 172.21.15.53:0/1391984536 wait complete. 2023-07-09T21:51:21.258 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:50:21.703759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:50:22.243698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:51:21.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:51:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.460+0000 7f0d663ff700 1 Processor -- start 2023-07-09T21:51:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.460+0000 7f0d663ff700 1 -- start start 2023-07-09T21:51:21.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.461+0000 7f0d663ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0d600b3ff0 0x7f0d600b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.461+0000 7f0d663ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d600d0f90 0x7f0d600b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.461+0000 7f0d663ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d600b8e80 con 0x7f0d600d0b10 2023-07-09T21:51:21.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.461+0000 7f0d663ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d600b1e30 con 0x7f0d600d0f90 2023-07-09T21:51:21.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.461+0000 7f0d663ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d600afaa0 con 0x7f0d600b3ff0 2023-07-09T21:51:21.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.461+0000 7f0d6499c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d600d0f90 0x7f0d600b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.461+0000 7f0d6499c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d600d0f90 0x7f0d600b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51208/0 (socket says 172.21.15.53:51208) 2023-07-09T21:51:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.461+0000 7f0d6499c700 1 -- 172.21.15.53:0/654651597 learned_addr learned my addr 172.21.15.53:0/654651597 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.461+0000 7f0d5ffff700 1 --2- 172.21.15.53:0/654651597 >> v2:172.21.15.184:3300/0 conn(0x7f0d600b3ff0 0x7f0d600b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.462+0000 7f0d6499c700 1 -- 172.21.15.53:0/654651597 >> v2:172.21.15.184:3300/0 conn(0x7f0d600b3ff0 msgr2=0x7f0d600b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.462+0000 7f0d6499c700 1 --2- 172.21.15.53:0/654651597 >> v2:172.21.15.184:3300/0 conn(0x7f0d600b3ff0 0x7f0d600b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.462+0000 7f0d6499c700 1 -- 172.21.15.53:0/654651597 >> v1:172.21.15.184:6789/0 conn(0x7f0d600d0b10 legacy=0x7f0d600b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.462+0000 7f0d6499c700 1 -- 172.21.15.53:0/654651597 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600afd80 con 0x7f0d600d0f90 2023-07-09T21:51:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.462+0000 7f0d5effd700 1 -- 172.21.15.53:0/654651597 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34173850 0 0) 0x7f0d54001110 con 0x7f0d600d0b10 2023-07-09T21:51:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.462+0000 7f0d6499c700 1 --2- 172.21.15.53:0/654651597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600d0f90 0x7f0d600b2ce0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0d600b5b00 tx=0x7f0d5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4859bb9054ec386f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.462+0000 7f0d5effd700 1 -- 172.21.15.53:0/654651597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800e070 con 0x7f0d600d0f90 2023-07-09T21:51:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.462+0000 7f0d5effd700 1 -- 172.21.15.53:0/654651597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5800b910 con 0x7f0d600d0f90 2023-07-09T21:51:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.462+0000 7f0d5effd700 1 -- 172.21.15.53:0/654651597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800bcc0 con 0x7f0d600d0f90 2023-07-09T21:51:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.463+0000 7f0d663ff700 1 -- 172.21.15.53:0/654651597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600d0f90 msgr2=0x7f0d600b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.463+0000 7f0d663ff700 1 --2- 172.21.15.53:0/654651597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600d0f90 0x7f0d600b2ce0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0d600b5b00 tx=0x7f0d5800b330 comp rx=0 tx=0).stop 2023-07-09T21:51:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.463+0000 7f0d663ff700 1 -- 172.21.15.53:0/654651597 shutdown_connections 2023-07-09T21:51:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.463+0000 7f0d663ff700 1 --2- 172.21.15.53:0/654651597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600d0f90 0x7f0d600b2ce0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.463+0000 7f0d663ff700 1 --2- 172.21.15.53:0/654651597 >> v2:172.21.15.184:3300/0 conn(0x7f0d600b3ff0 0x7f0d600b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.463+0000 7f0d663ff700 1 -- 172.21.15.53:0/654651597 >> 172.21.15.53:0/654651597 conn(0x7f0d6009c1b0 msgr2=0x7f0d600d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.463+0000 7f0d663ff700 1 -- 172.21.15.53:0/654651597 shutdown_connections 2023-07-09T21:51:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.463+0000 7f0d663ff700 1 -- 172.21.15.53:0/654651597 wait complete. 2023-07-09T21:51:21.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.465+0000 7f0d663ff700 1 Processor -- start 2023-07-09T21:51:21.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.465+0000 7f0d663ff700 1 -- start start 2023-07-09T21:51:21.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.466+0000 7f0d663ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d600b3ff0 0x7f0d601f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.466+0000 7f0d663ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d600d0b10 0x7f0d600c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.466+0000 7f0d663ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600d0f90 0x7f0d600c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.466+0000 7f0d663ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60152aa0 con 0x7f0d600d0f90 2023-07-09T21:51:21.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.466+0000 7f0d663ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600ca010 con 0x7f0d600d0b10 2023-07-09T21:51:21.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.466+0000 7f0d663ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600c7dc0 con 0x7f0d600b3ff0 2023-07-09T21:51:21.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.466+0000 7f0d6499c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600d0f90 0x7f0d600c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.466+0000 7f0d5ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d600b3ff0 0x7f0d601f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.466+0000 7f0d6499c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600d0f90 0x7f0d600c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51224/0 (socket says 172.21.15.53:51224) 2023-07-09T21:51:21.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.466+0000 7f0d6499c700 1 -- 172.21.15.53:0/3457152497 learned_addr learned my addr 172.21.15.53:0/3457152497 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:21.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.466+0000 7f0d5f7fe700 1 --2- 172.21.15.53:0/3457152497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d600d0b10 0x7f0d600c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.467+0000 7f0d6499c700 1 -- 172.21.15.53:0/3457152497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d600b3ff0 msgr2=0x7f0d601f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.467+0000 7f0d6499c700 1 --2- 172.21.15.53:0/3457152497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d600b3ff0 0x7f0d601f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.467+0000 7f0d6499c700 1 -- 172.21.15.53:0/3457152497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d600d0b10 msgr2=0x7f0d600c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.467+0000 7f0d6499c700 1 --2- 172.21.15.53:0/3457152497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d600d0b10 0x7f0d600c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.467+0000 7f0d6499c700 1 -- 172.21.15.53:0/3457152497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58009b30 con 0x7f0d600d0f90 2023-07-09T21:51:21.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.467+0000 7f0d6499c700 1 --2- 172.21.15.53:0/3457152497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600d0f90 0x7f0d600c8b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0d600681d0 tx=0x7f0d58004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:21.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.467+0000 7f0d5cff9700 1 -- 172.21.15.53:0/3457152497 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58004880 con 0x7f0d600d0f90 2023-07-09T21:51:21.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.467+0000 7f0d5cff9700 1 -- 172.21.15.53:0/3457152497 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d580099b0 con 0x7f0d600d0f90 2023-07-09T21:51:21.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.467+0000 7f0d5cff9700 1 -- 172.21.15.53:0/3457152497 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5801b670 con 0x7f0d600d0f90 2023-07-09T21:51:21.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.467+0000 7f0d663ff700 1 -- 172.21.15.53:0/3457152497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d600c80a0 con 0x7f0d600d0f90 2023-07-09T21:51:21.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.468+0000 7f0d663ff700 1 -- 172.21.15.53:0/3457152497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d600ca590 con 0x7f0d600d0f90 2023-07-09T21:51:21.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.469+0000 7f0d663ff700 1 -- 172.21.15.53:0/3457152497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d60074350 con 0x7f0d600d0f90 2023-07-09T21:51:21.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.469+0000 7f0d5cff9700 1 -- 172.21.15.53:0/3457152497 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d5801b7d0 con 0x7f0d600d0f90 2023-07-09T21:51:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.470+0000 7f0d5cff9700 1 --2- 172.21.15.53:0/3457152497 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0d4c06ace0 0x7f0d4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.470+0000 7f0d5cff9700 1 -- 172.21.15.53:0/3457152497 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0d5808aa10 con 0x7f0d600d0f90 2023-07-09T21:51:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.471+0000 7f0d5ffff700 1 --2- 172.21.15.53:0/3457152497 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0d4c06ace0 0x7f0d4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.471+0000 7f0d5ffff700 1 --2- 172.21.15.53:0/3457152497 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0d4c06ace0 0x7f0d4c06d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009be0 tx=0x7f0d50009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:21.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.474+0000 7f0d5cff9700 1 -- 172.21.15.53:0/3457152497 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0d580559e0 con 0x7f0d600d0f90 2023-07-09T21:51:21.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.679+0000 7f0d663ff700 1 -- 172.21.15.53:0/3457152497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d6008ceb0 con 0x7f0d600d0f90 2023-07-09T21:51:21.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.679+0000 7f0d5cff9700 1 -- 172.21.15.53:0/3457152497 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d58059000 con 0x7f0d600d0f90 2023-07-09T21:51:21.681 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:51:21.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.682+0000 7f0d663ff700 1 -- 172.21.15.53:0/3457152497 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0d4c06ace0 msgr2=0x7f0d4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.682+0000 7f0d663ff700 1 --2- 172.21.15.53:0/3457152497 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0d4c06ace0 0x7f0d4c06d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009be0 tx=0x7f0d50009210 comp rx=0 tx=0).stop 2023-07-09T21:51:21.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.682+0000 7f0d663ff700 1 -- 172.21.15.53:0/3457152497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600d0f90 msgr2=0x7f0d600c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.682+0000 7f0d663ff700 1 --2- 172.21.15.53:0/3457152497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600d0f90 0x7f0d600c8b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0d600681d0 tx=0x7f0d58004ad0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.682+0000 7f0d663ff700 1 -- 172.21.15.53:0/3457152497 shutdown_connections 2023-07-09T21:51:21.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.682+0000 7f0d663ff700 1 --2- 172.21.15.53:0/3457152497 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0d4c06ace0 0x7f0d4c06d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.682+0000 7f0d663ff700 1 --2- 172.21.15.53:0/3457152497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600d0f90 0x7f0d600c8b10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.682+0000 7f0d663ff700 1 --2- 172.21.15.53:0/3457152497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d600b3ff0 0x7f0d601f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.682+0000 7f0d663ff700 1 --2- 172.21.15.53:0/3457152497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d600d0b10 0x7f0d600c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.682+0000 7f0d663ff700 1 -- 172.21.15.53:0/3457152497 >> 172.21.15.53:0/3457152497 conn(0x7f0d6009c1b0 msgr2=0x7f0d6006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:21.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.682+0000 7f0d663ff700 1 -- 172.21.15.53:0/3457152497 shutdown_connections 2023-07-09T21:51:21.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.682+0000 7f0d663ff700 1 -- 172.21.15.53:0/3457152497 wait complete. 2023-07-09T21:51:21.701 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:51:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.904+0000 7f1a05dff700 1 Processor -- start 2023-07-09T21:51:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.904+0000 7f1a05dff700 1 -- start start 2023-07-09T21:51:21.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.905+0000 7f1a05dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1a000b3ff0 0x7f1a000b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.906+0000 7f1a05dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a000d0b10 0x7f1a000d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.906+0000 7f1a05dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a000b8e80 con 0x7f1a000b25d0 2023-07-09T21:51:21.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.906+0000 7f1a05dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a000d14a0 con 0x7f1a000b3ff0 2023-07-09T21:51:21.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.906+0000 7f1a05dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000b1e30 con 0x7f1a000d0b10 2023-07-09T21:51:21.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.906+0000 7f19ff7fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1a000b3ff0 0x7f1a000b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.906+0000 7f19ff7fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1a000b3ff0 0x7f1a000b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:49936/0 (socket says 172.21.15.53:49936) 2023-07-09T21:51:21.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.906+0000 7f19ff7fe700 1 -- 172.21.15.53:0/1003416265 learned_addr learned my addr 172.21.15.53:0/1003416265 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:21.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.906+0000 7f19feffd700 1 --2- 172.21.15.53:0/1003416265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a000d0b10 0x7f1a000d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.907+0000 7f19feffd700 1 -- 172.21.15.53:0/1003416265 >> v2:172.21.15.184:3300/0 conn(0x7f1a000b3ff0 msgr2=0x7f1a000b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.907+0000 7f19feffd700 1 --2- 172.21.15.53:0/1003416265 >> v2:172.21.15.184:3300/0 conn(0x7f1a000b3ff0 0x7f1a000b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.907+0000 7f19feffd700 1 -- 172.21.15.53:0/1003416265 >> v1:172.21.15.184:6789/0 conn(0x7f1a000b25d0 legacy=0x7f1a000b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.907+0000 7f19feffd700 1 -- 172.21.15.53:0/1003416265 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a000afaa0 con 0x7f1a000d0b10 2023-07-09T21:51:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.907+0000 7f19fe7fc700 1 -- 172.21.15.53:0/1003416265 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327155958 0 0) 0x7f19f8001490 con 0x7f1a000b25d0 2023-07-09T21:51:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.907+0000 7f19ff7fe700 1 --2- 172.21.15.53:0/1003416265 >> v2:172.21.15.184:3300/0 conn(0x7f1a000b3ff0 0x7f1a000b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.907+0000 7f19feffd700 1 --2- 172.21.15.53:0/1003416265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a000d0b10 0x7f1a000d0f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009840 tx=0x7f19f4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d446d1c199d210aa server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.907+0000 7f19fe7fc700 1 -- 172.21.15.53:0/1003416265 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4011830 con 0x7f1a000d0b10 2023-07-09T21:51:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.907+0000 7f19fe7fc700 1 -- 172.21.15.53:0/1003416265 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f4011990 con 0x7f1a000d0b10 2023-07-09T21:51:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.908+0000 7f19fe7fc700 1 -- 172.21.15.53:0/1003416265 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4011d20 con 0x7f1a000d0b10 2023-07-09T21:51:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.908+0000 7f1a05dff700 1 -- 172.21.15.53:0/1003416265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a000d0b10 msgr2=0x7f1a000d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.908+0000 7f1a05dff700 1 --2- 172.21.15.53:0/1003416265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a000d0b10 0x7f1a000d0f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009840 tx=0x7f19f4009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.908+0000 7f1a05dff700 1 -- 172.21.15.53:0/1003416265 shutdown_connections 2023-07-09T21:51:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.908+0000 7f1a05dff700 1 --2- 172.21.15.53:0/1003416265 >> v2:172.21.15.184:3300/0 conn(0x7f1a000b3ff0 0x7f1a000b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.908+0000 7f1a05dff700 1 --2- 172.21.15.53:0/1003416265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a000d0b10 0x7f1a000d0f60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.908+0000 7f1a05dff700 1 -- 172.21.15.53:0/1003416265 >> 172.21.15.53:0/1003416265 conn(0x7f1a0009c1b0 msgr2=0x7f1a000d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.908+0000 7f1a05dff700 1 -- 172.21.15.53:0/1003416265 shutdown_connections 2023-07-09T21:51:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.908+0000 7f1a05dff700 1 -- 172.21.15.53:0/1003416265 wait complete. 2023-07-09T21:51:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.910+0000 7f1a05dff700 1 Processor -- start 2023-07-09T21:51:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.910+0000 7f1a05dff700 1 -- start start 2023-07-09T21:51:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.911+0000 7f1a05dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a000b25d0 0x7f1a0014b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.911+0000 7f1a05dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a000b3ff0 0x7f1a0014bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.911+0000 7f1a05dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a000d0b10 0x7f1a0015dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.911+0000 7f1a05dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0015cf50 con 0x7f1a000b3ff0 2023-07-09T21:51:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.911+0000 7f1a05dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0015d1f0 con 0x7f1a000b25d0 2023-07-09T21:51:21.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.911+0000 7f1a05dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0015d4d0 con 0x7f1a000d0b10 2023-07-09T21:51:21.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.911+0000 7f19feffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a000b3ff0 0x7f1a0014bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.911+0000 7f19feffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a000b3ff0 0x7f1a0014bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51230/0 (socket says 172.21.15.53:51230) 2023-07-09T21:51:21.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.911+0000 7f19feffd700 1 -- 172.21.15.53:0/1186512677 learned_addr learned my addr 172.21.15.53:0/1186512677 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.911+0000 7f19ff7fe700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a000b25d0 0x7f1a0014b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.911+0000 7f19fffff700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a000d0b10 0x7f1a0015dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.912+0000 7f19feffd700 1 -- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a000d0b10 msgr2=0x7f1a0015dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.912+0000 7f19feffd700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a000d0b10 0x7f1a0015dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.912+0000 7f19feffd700 1 -- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a000b25d0 msgr2=0x7f1a0014b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.912+0000 7f19feffd700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a000b25d0 0x7f1a0014b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.912+0000 7f19feffd700 1 -- 172.21.15.53:0/1186512677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f0009550 con 0x7f1a000b3ff0 2023-07-09T21:51:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.912+0000 7f19feffd700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a000b3ff0 0x7f1a0014bdb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f19f4014040 tx=0x7f19f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.912+0000 7f19e7fff700 1 -- 172.21.15.53:0/1186512677 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40036a0 con 0x7f1a000b3ff0 2023-07-09T21:51:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.912+0000 7f19e7fff700 1 -- 172.21.15.53:0/1186512677 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f401e070 con 0x7f1a000b3ff0 2023-07-09T21:51:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.912+0000 7f19e7fff700 1 -- 172.21.15.53:0/1186512677 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4003a40 con 0x7f1a000b3ff0 2023-07-09T21:51:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.912+0000 7f1a05dff700 1 -- 172.21.15.53:0/1186512677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f40094a0 con 0x7f1a000b3ff0 2023-07-09T21:51:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.913+0000 7f1a05dff700 1 -- 172.21.15.53:0/1186512677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0015da90 con 0x7f1a000b3ff0 2023-07-09T21:51:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.913+0000 7f1a05dff700 1 -- 172.21.15.53:0/1186512677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0015d610 con 0x7f1a000b3ff0 2023-07-09T21:51:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.914+0000 7f19e7fff700 1 -- 172.21.15.53:0/1186512677 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19f4003ba0 con 0x7f1a000b3ff0 2023-07-09T21:51:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.915+0000 7f19e7fff700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f19ec06ace0 0x7f19ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.915+0000 7f19e7fff700 1 -- 172.21.15.53:0/1186512677 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f19f408a490 con 0x7f1a000b3ff0 2023-07-09T21:51:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.916+0000 7f19ff7fe700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f19ec06ace0 0x7f19ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.916+0000 7f19ff7fe700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f19ec06ace0 0x7f19ec06d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f19f0006d30 tx=0x7f19f00092c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:21.920+0000 7f19e7fff700 1 -- 172.21.15.53:0/1186512677 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1a0015d610 con 0x7f1a000b3ff0 2023-07-09T21:51:22.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.127+0000 7f1a05dff700 1 -- 172.21.15.53:0/1186512677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1a0015d610 con 0x7f1a000b3ff0 2023-07-09T21:51:22.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.128+0000 7f19e7fff700 1 -- 172.21.15.53:0/1186512677 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1a0015d610 con 0x7f1a000b3ff0 2023-07-09T21:51:22.129 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:51:22.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.130+0000 7f1a05dff700 1 -- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f19ec06ace0 msgr2=0x7f19ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:22.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.130+0000 7f1a05dff700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f19ec06ace0 0x7f19ec06d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f19f0006d30 tx=0x7f19f00092c0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.130+0000 7f1a05dff700 1 -- 172.21.15.53:0/1186512677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a000b3ff0 msgr2=0x7f1a0014bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:22.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.130+0000 7f1a05dff700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a000b3ff0 0x7f1a0014bdb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f19f4014040 tx=0x7f19f4004750 comp rx=0 tx=0).stop 2023-07-09T21:51:22.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.130+0000 7f1a05dff700 1 -- 172.21.15.53:0/1186512677 shutdown_connections 2023-07-09T21:51:22.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.130+0000 7f1a05dff700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f19ec06ace0 0x7f19ec06d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.130+0000 7f1a05dff700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a000d0b10 0x7f1a0015dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.130+0000 7f1a05dff700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a000b25d0 0x7f1a0014b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.130+0000 7f1a05dff700 1 --2- 172.21.15.53:0/1186512677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a000b3ff0 0x7f1a0014bdb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.130+0000 7f1a05dff700 1 -- 172.21.15.53:0/1186512677 >> 172.21.15.53:0/1186512677 conn(0x7f1a0009c1b0 msgr2=0x7f1a000d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:22.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.130+0000 7f1a05dff700 1 -- 172.21.15.53:0/1186512677 shutdown_connections 2023-07-09T21:51:22.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.130+0000 7f1a05dff700 1 -- 172.21.15.53:0/1186512677 wait complete. 2023-07-09T21:51:22.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:51:22.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.352+0000 7f133a3ff700 1 Processor -- start 2023-07-09T21:51:22.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.352+0000 7f133a3ff700 1 -- start start 2023-07-09T21:51:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.353+0000 7f133a3ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13340d12c0 0x7f13340cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.353+0000 7f133a3ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13340b1ce0 0x7f133406b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.353+0000 7f133a3ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13340b0560 con 0x7f133406b040 2023-07-09T21:51:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.353+0000 7f133a3ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13340d1690 con 0x7f13340b1ce0 2023-07-09T21:51:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.353+0000 7f133a3ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133406b9f0 con 0x7f13340d12c0 2023-07-09T21:51:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.354+0000 7f133899c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13340b1ce0 0x7f133406b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.354+0000 7f133899c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13340b1ce0 0x7f133406b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51236/0 (socket says 172.21.15.53:51236) 2023-07-09T21:51:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.354+0000 7f133899c700 1 -- 172.21.15.53:0/3582606249 learned_addr learned my addr 172.21.15.53:0/3582606249 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.354+0000 7f1333fff700 1 --2- 172.21.15.53:0/3582606249 >> v2:172.21.15.184:3300/0 conn(0x7f13340d12c0 0x7f13340cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.354+0000 7f133899c700 1 -- 172.21.15.53:0/3582606249 >> v2:172.21.15.184:3300/0 conn(0x7f13340d12c0 msgr2=0x7f13340cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.354+0000 7f133899c700 1 --2- 172.21.15.53:0/3582606249 >> v2:172.21.15.184:3300/0 conn(0x7f13340d12c0 0x7f13340cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.354+0000 7f133899c700 1 -- 172.21.15.53:0/3582606249 >> v1:172.21.15.184:6789/0 conn(0x7f133406b040 legacy=0x7f13340cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.354+0000 7f133899c700 1 -- 172.21.15.53:0/3582606249 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13340cc760 con 0x7f13340b1ce0 2023-07-09T21:51:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.354+0000 7f133899c700 1 --2- 172.21.15.53:0/3582606249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13340b1ce0 0x7f133406b4b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1334071510 tx=0x7f132c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a6b17c43037468 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.355+0000 7f1332ffd700 1 -- 172.21.15.53:0/3582606249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00e070 con 0x7f13340b1ce0 2023-07-09T21:51:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.355+0000 7f1332ffd700 1 -- 172.21.15.53:0/3582606249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c003a20 con 0x7f13340b1ce0 2023-07-09T21:51:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.355+0000 7f1332ffd700 1 -- 172.21.15.53:0/3582606249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c003dd0 con 0x7f13340b1ce0 2023-07-09T21:51:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.355+0000 7f133a3ff700 1 -- 172.21.15.53:0/3582606249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13340b1ce0 msgr2=0x7f133406b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.355+0000 7f133a3ff700 1 --2- 172.21.15.53:0/3582606249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13340b1ce0 0x7f133406b4b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1334071510 tx=0x7f132c00b330 comp rx=0 tx=0).stop 2023-07-09T21:51:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.355+0000 7f133a3ff700 1 -- 172.21.15.53:0/3582606249 shutdown_connections 2023-07-09T21:51:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.355+0000 7f133a3ff700 1 --2- 172.21.15.53:0/3582606249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13340b1ce0 0x7f133406b4b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.355+0000 7f133a3ff700 1 --2- 172.21.15.53:0/3582606249 >> v2:172.21.15.184:3300/0 conn(0x7f13340d12c0 0x7f13340cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.355+0000 7f133a3ff700 1 -- 172.21.15.53:0/3582606249 >> 172.21.15.53:0/3582606249 conn(0x7f13340999e0 msgr2=0x7f1334099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.355+0000 7f133a3ff700 1 -- 172.21.15.53:0/3582606249 shutdown_connections 2023-07-09T21:51:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.355+0000 7f133a3ff700 1 -- 172.21.15.53:0/3582606249 wait complete. 2023-07-09T21:51:22.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.357+0000 7f133a3ff700 1 Processor -- start 2023-07-09T21:51:22.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.357+0000 7f133a3ff700 1 -- start start 2023-07-09T21:51:22.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.358+0000 7f133a3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133406b040 0x7f13340b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:22.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.358+0000 7f133a3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13340b1ce0 0x7f133409c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:22.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.358+0000 7f133a3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13340d12c0 0x7f13341f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:22.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.358+0000 7f133a3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133409c420 con 0x7f13340b1ce0 2023-07-09T21:51:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.358+0000 7f133a3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13340b48a0 con 0x7f133406b040 2023-07-09T21:51:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.358+0000 7f133a3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133409ddb0 con 0x7f13340d12c0 2023-07-09T21:51:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.359+0000 7f13337fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13340b1ce0 0x7f133409c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.359+0000 7f13337fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13340b1ce0 0x7f133409c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51244/0 (socket says 172.21.15.53:51244) 2023-07-09T21:51:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.359+0000 7f13337fe700 1 -- 172.21.15.53:0/700413557 learned_addr learned my addr 172.21.15.53:0/700413557 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.359+0000 7f1333fff700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133406b040 0x7f13340b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.359+0000 7f133899c700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13340d12c0 0x7f13341f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:22.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.359+0000 7f13337fe700 1 -- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13340d12c0 msgr2=0x7f13341f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:22.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.359+0000 7f13337fe700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13340d12c0 0x7f13341f1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.359+0000 7f13337fe700 1 -- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133406b040 msgr2=0x7f13340b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:22.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.359+0000 7f13337fe700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133406b040 0x7f13340b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.359+0000 7f13337fe700 1 -- 172.21.15.53:0/700413557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c009b30 con 0x7f13340b1ce0 2023-07-09T21:51:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.359+0000 7f13337fe700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13340b1ce0 0x7f133409c930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f132800b4a0 tx=0x7f132800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.359+0000 7f1330ff9700 1 -- 172.21.15.53:0/700413557 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328011830 con 0x7f13340b1ce0 2023-07-09T21:51:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.360+0000 7f1330ff9700 1 -- 172.21.15.53:0/700413557 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1328011990 con 0x7f13340b1ce0 2023-07-09T21:51:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.360+0000 7f133a3ff700 1 -- 172.21.15.53:0/700413557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133409ce70 con 0x7f13340b1ce0 2023-07-09T21:51:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.360+0000 7f1330ff9700 1 -- 172.21.15.53:0/700413557 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328011d40 con 0x7f13340b1ce0 2023-07-09T21:51:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.360+0000 7f133a3ff700 1 -- 172.21.15.53:0/700413557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133409d6f0 con 0x7f13340b1ce0 2023-07-09T21:51:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.361+0000 7f133a3ff700 1 -- 172.21.15.53:0/700413557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133406c370 con 0x7f13340b1ce0 2023-07-09T21:51:22.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.362+0000 7f1330ff9700 1 -- 172.21.15.53:0/700413557 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f132801a400 con 0x7f13340b1ce0 2023-07-09T21:51:22.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.363+0000 7f1330ff9700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f132006ace0 0x7f132006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:22.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.363+0000 7f1330ff9700 1 -- 172.21.15.53:0/700413557 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1328089090 con 0x7f13340b1ce0 2023-07-09T21:51:22.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.363+0000 7f1333fff700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f132006ace0 0x7f132006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:22.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.364+0000 7f1333fff700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f132006ace0 0x7f132006d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1324006b20 tx=0x7f1324008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:22.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.367+0000 7f1330ff9700 1 -- 172.21.15.53:0/700413557 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1328054120 con 0x7f13340b1ce0 2023-07-09T21:51:22.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.573+0000 7f133a3ff700 1 -- 172.21.15.53:0/700413557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f133415ceb0 con 0x7f13340b1ce0 2023-07-09T21:51:22.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.574+0000 7f1330ff9700 1 -- 172.21.15.53:0/700413557 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1328015020 con 0x7f13340b1ce0 2023-07-09T21:51:22.576 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:51:22.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.576+0000 7f133a3ff700 1 -- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f132006ace0 msgr2=0x7f132006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:22.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.576+0000 7f133a3ff700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f132006ace0 0x7f132006d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1324006b20 tx=0x7f1324008040 comp rx=0 tx=0).stop 2023-07-09T21:51:22.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.576+0000 7f133a3ff700 1 -- 172.21.15.53:0/700413557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13340b1ce0 msgr2=0x7f133409c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:22.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.576+0000 7f133a3ff700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13340b1ce0 0x7f133409c930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f132800b4a0 tx=0x7f132800b7b0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.576+0000 7f133a3ff700 1 -- 172.21.15.53:0/700413557 shutdown_connections 2023-07-09T21:51:22.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.576+0000 7f133a3ff700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f132006ace0 0x7f132006d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.576+0000 7f133a3ff700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13340d12c0 0x7f13341f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.576+0000 7f133a3ff700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133406b040 0x7f13340b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.576+0000 7f133a3ff700 1 --2- 172.21.15.53:0/700413557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13340b1ce0 0x7f133409c930 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.577+0000 7f133a3ff700 1 -- 172.21.15.53:0/700413557 >> 172.21.15.53:0/700413557 conn(0x7f13340999e0 msgr2=0x7f13340b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.577+0000 7f133a3ff700 1 -- 172.21.15.53:0/700413557 shutdown_connections 2023-07-09T21:51:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.577+0000 7f133a3ff700 1 -- 172.21.15.53:0/700413557 wait complete. 2023-07-09T21:51:22.596 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:51:22.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.799+0000 7f5177bff700 1 Processor -- start 2023-07-09T21:51:22.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.800+0000 7f5177bff700 1 -- start start 2023-07-09T21:51:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.801+0000 7f5177bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f51700b3ff0 0x7f51700b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.801+0000 7f5177bff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51700b8e80 con 0x7f51700d0b10 2023-07-09T21:51:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.801+0000 7f5177bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51700b33f0 con 0x7f51700d0f90 2023-07-09T21:51:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.801+0000 7f5177bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51700b1e30 con 0x7f51700b3ff0 2023-07-09T21:51:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.801+0000 7f517519a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f51700d0b10 0x7f51700b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43620/0 (socket says 172.21.15.53:43620) 2023-07-09T21:51:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.801+0000 7f517519a700 1 -- 172.21.15.53:0/2754134599 learned_addr learned my addr 172.21.15.53:0/2754134599 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:22.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.801+0000 7f517599b700 1 --2- 172.21.15.53:0/2754134599 >> v2:172.21.15.184:3300/0 conn(0x7f51700b3ff0 0x7f51700b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:22.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.801+0000 7f5174999700 1 -- 172.21.15.53:0/2754134599 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103453173 0 0) 0x7f5160001110 con 0x7f51700d0b10 2023-07-09T21:51:22.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.802+0000 7f5174999700 1 -- 172.21.15.53:0/2754134599 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f515c0035b0 con 0x7f51700d0b10 2023-07-09T21:51:22.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.802+0000 7f5174999700 1 -- 172.21.15.53:0/2754134599 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301061184 0 0) 0x7f51700b33f0 con 0x7f51700d0f90 2023-07-09T21:51:22.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.802+0000 7f5174999700 1 -- 172.21.15.53:0/2754134599 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5160001110 con 0x7f51700d0f90 2023-07-09T21:51:22.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.802+0000 7f517599b700 1 -- 172.21.15.53:0/2754134599 >> v1:172.21.15.184:6789/0 conn(0x7f51700d0f90 legacy=0x7f51700b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:22.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.802+0000 7f517599b700 1 -- 172.21.15.53:0/2754134599 >> v1:172.21.15.53:6789/0 conn(0x7f51700d0b10 legacy=0x7f51700b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:22.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.802+0000 7f517599b700 1 -- 172.21.15.53:0/2754134599 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51700afaa0 con 0x7f51700b3ff0 2023-07-09T21:51:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.802+0000 7f517599b700 1 --2- 172.21.15.53:0/2754134599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51700b3ff0 0x7f51700b43c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f516c009840 tx=0x7f516c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b766d9b8a529f45 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.802+0000 7f5174999700 1 -- 172.21.15.53:0/2754134599 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c011830 con 0x7f51700b3ff0 2023-07-09T21:51:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.802+0000 7f5174999700 1 -- 172.21.15.53:0/2754134599 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c011990 con 0x7f51700b3ff0 2023-07-09T21:51:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.803+0000 7f5174999700 1 -- 172.21.15.53:0/2754134599 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c011d20 con 0x7f51700b3ff0 2023-07-09T21:51:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.803+0000 7f5177bff700 1 -- 172.21.15.53:0/2754134599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51700b3ff0 msgr2=0x7f51700b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.803+0000 7f5177bff700 1 --2- 172.21.15.53:0/2754134599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51700b3ff0 0x7f51700b43c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f516c009840 tx=0x7f516c009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.803+0000 7f5177bff700 1 -- 172.21.15.53:0/2754134599 shutdown_connections 2023-07-09T21:51:22.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.803+0000 7f5177bff700 1 --2- 172.21.15.53:0/2754134599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51700b3ff0 0x7f51700b43c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.803+0000 7f5177bff700 1 -- 172.21.15.53:0/2754134599 >> 172.21.15.53:0/2754134599 conn(0x7f517009c1b0 msgr2=0x7f51700d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:22.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.803+0000 7f5177bff700 1 -- 172.21.15.53:0/2754134599 shutdown_connections 2023-07-09T21:51:22.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.803+0000 7f5177bff700 1 -- 172.21.15.53:0/2754134599 wait complete. 2023-07-09T21:51:22.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.805+0000 7f5177bff700 1 Processor -- start 2023-07-09T21:51:22.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.805+0000 7f5177bff700 1 -- start start 2023-07-09T21:51:22.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.806+0000 7f5177bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51700b3ff0 0x7f517015a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:22.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.806+0000 7f5177bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51700d0b10 0x7f51700caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:22.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.806+0000 7f5177bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51700d0f90 0x7f517006b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:22.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.806+0000 7f5177bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51700ca6b0 con 0x7f51700d0b10 2023-07-09T21:51:22.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.806+0000 7f5177bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51700ca3d0 con 0x7f51700d0f90 2023-07-09T21:51:22.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.806+0000 7f5177bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51700ce610 con 0x7f51700b3ff0 2023-07-09T21:51:22.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.806+0000 7f517519a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51700d0b10 0x7f51700caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:22.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.806+0000 7f517519a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51700d0b10 0x7f51700caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51248/0 (socket says 172.21.15.53:51248) 2023-07-09T21:51:22.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.806+0000 7f517519a700 1 -- 172.21.15.53:0/1528587039 learned_addr learned my addr 172.21.15.53:0/1528587039 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:22.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.806+0000 7f517599b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51700b3ff0 0x7f517015a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:22.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.806+0000 7f517619c700 1 --2- 172.21.15.53:0/1528587039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51700d0f90 0x7f517006b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:22.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.807+0000 7f517519a700 1 -- 172.21.15.53:0/1528587039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51700b3ff0 msgr2=0x7f517015a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:22.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.807+0000 7f517519a700 1 --2- 172.21.15.53:0/1528587039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51700b3ff0 0x7f517015a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.807+0000 7f517519a700 1 -- 172.21.15.53:0/1528587039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51700d0f90 msgr2=0x7f517006b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:22.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.807+0000 7f517519a700 1 --2- 172.21.15.53:0/1528587039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51700d0f90 0x7f517006b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:22.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.807+0000 7f517519a700 1 -- 172.21.15.53:0/1528587039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c0094a0 con 0x7f51700d0b10 2023-07-09T21:51:22.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.807+0000 7f517519a700 1 --2- 172.21.15.53:0/1528587039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51700d0b10 0x7f51700caa20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5160001eb0 tx=0x7f516000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:22.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.807+0000 7f51667fc700 1 -- 172.21.15.53:0/1528587039 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160005d70 con 0x7f51700d0b10 2023-07-09T21:51:22.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.807+0000 7f51667fc700 1 -- 172.21.15.53:0/1528587039 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51600070d0 con 0x7f51700d0b10 2023-07-09T21:51:22.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.807+0000 7f51667fc700 1 -- 172.21.15.53:0/1528587039 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160007460 con 0x7f51700d0b10 2023-07-09T21:51:22.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.807+0000 7f5177bff700 1 -- 172.21.15.53:0/1528587039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51700ce8f0 con 0x7f51700d0b10 2023-07-09T21:51:22.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.808+0000 7f5177bff700 1 -- 172.21.15.53:0/1528587039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517015ac70 con 0x7f51700d0b10 2023-07-09T21:51:22.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.809+0000 7f5177bff700 1 -- 172.21.15.53:0/1528587039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51700cee10 con 0x7f51700d0b10 2023-07-09T21:51:22.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.809+0000 7f51667fc700 1 -- 172.21.15.53:0/1528587039 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51600075c0 con 0x7f51700d0b10 2023-07-09T21:51:22.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.810+0000 7f51667fc700 1 --2- 172.21.15.53:0/1528587039 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f515406ace0 0x7f515406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:22.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.811+0000 7f51667fc700 1 -- 172.21.15.53:0/1528587039 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5160088920 con 0x7f51700d0b10 2023-07-09T21:51:22.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.811+0000 7f517599b700 1 --2- 172.21.15.53:0/1528587039 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f515406ace0 0x7f515406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:22.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.812+0000 7f517599b700 1 --2- 172.21.15.53:0/1528587039 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f515406ace0 0x7f515406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f516c009fd0 tx=0x7f516c01c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:22.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:22.815+0000 7f51667fc700 1 -- 172.21.15.53:0/1528587039 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f51700cee10 con 0x7f51700d0b10 2023-07-09T21:51:23.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.023+0000 7f5177bff700 1 -- 172.21.15.53:0/1528587039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51700b8e80 con 0x7f51700d0b10 2023-07-09T21:51:23.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.024+0000 7f51667fc700 1 -- 172.21.15.53:0/1528587039 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51700b8e80 con 0x7f51700d0b10 2023-07-09T21:51:23.026 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:51:23.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.026+0000 7f5177bff700 1 -- 172.21.15.53:0/1528587039 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f515406ace0 msgr2=0x7f515406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:23.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.026+0000 7f5177bff700 1 --2- 172.21.15.53:0/1528587039 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f515406ace0 0x7f515406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f516c009fd0 tx=0x7f516c01c040 comp rx=0 tx=0).stop 2023-07-09T21:51:23.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.026+0000 7f5177bff700 1 -- 172.21.15.53:0/1528587039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51700d0b10 msgr2=0x7f51700caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:23.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.026+0000 7f5177bff700 1 --2- 172.21.15.53:0/1528587039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51700d0b10 0x7f51700caa20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5160001eb0 tx=0x7f516000c9e0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.026+0000 7f5177bff700 1 -- 172.21.15.53:0/1528587039 shutdown_connections 2023-07-09T21:51:23.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.026+0000 7f5177bff700 1 --2- 172.21.15.53:0/1528587039 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f515406ace0 0x7f515406d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.026+0000 7f5177bff700 1 --2- 172.21.15.53:0/1528587039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51700d0f90 0x7f517006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.026+0000 7f5177bff700 1 --2- 172.21.15.53:0/1528587039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51700b3ff0 0x7f517015a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.026+0000 7f5177bff700 1 --2- 172.21.15.53:0/1528587039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51700d0b10 0x7f51700caa20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.026+0000 7f5177bff700 1 -- 172.21.15.53:0/1528587039 >> 172.21.15.53:0/1528587039 conn(0x7f517009c1b0 msgr2=0x7f51700b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:23.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.027+0000 7f5177bff700 1 -- 172.21.15.53:0/1528587039 shutdown_connections 2023-07-09T21:51:23.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.027+0000 7f5177bff700 1 -- 172.21.15.53:0/1528587039 wait complete. 2023-07-09T21:51:23.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:51:23.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.245+0000 7f9fa37ff700 1 Processor -- start 2023-07-09T21:51:23.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.246+0000 7f9fa37ff700 1 -- start start 2023-07-09T21:51:23.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.247+0000 7f9fa37ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f9c0d1220 0x7f9f9c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:23.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.247+0000 7f9fa37ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9f9c0b0e20 0x7f9f9c0b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:23.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.247+0000 7f9fa37ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c0b8e80 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.247+0000 7f9fa37ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9c0afaa0 con 0x7f9f9c0b0e20 2023-07-09T21:51:23.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.247+0000 7f9fa37ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0afd80 con 0x7f9f9c0d1220 2023-07-09T21:51:23.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.247+0000 7f9fa1d9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9f9c0b0e20 0x7f9f9c0b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:23.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.247+0000 7f9fa1d9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9f9c0b0e20 0x7f9f9c0b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53230/0 (socket says 172.21.15.53:53230) 2023-07-09T21:51:23.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.247+0000 7f9fa1d9c700 1 -- 172.21.15.53:0/3501576244 learned_addr learned my addr 172.21.15.53:0/3501576244 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:23.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.247+0000 7f9fa0d9a700 1 --2- 172.21.15.53:0/3501576244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f9c0d1220 0x7f9f9c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:23.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.248+0000 7f9fa1d9c700 1 -- 172.21.15.53:0/3501576244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f9c0d1220 msgr2=0x7f9f9c0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:23.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.248+0000 7f9fa1d9c700 1 --2- 172.21.15.53:0/3501576244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f9c0d1220 0x7f9f9c0b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.248+0000 7f9fa1d9c700 1 -- 172.21.15.53:0/3501576244 >> v1:172.21.15.184:6789/0 conn(0x7f9f9c0b3ff0 legacy=0x7f9f9c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:23.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.248+0000 7f9fa1d9c700 1 -- 172.21.15.53:0/3501576244 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c0b0060 con 0x7f9f9c0b0e20 2023-07-09T21:51:23.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.248+0000 7f9fa0d9a700 1 --2- 172.21.15.53:0/3501576244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f9c0d1220 0x7f9f9c0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:23.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.248+0000 7f9fa1d9c700 1 --2- 172.21.15.53:0/3501576244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f9c0b0e20 0x7f9f9c0b1280 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009e50 tx=0x7f9f9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27748346071250d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:23.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.248+0000 7f9f93fff700 1 -- 172.21.15.53:0/3501576244 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9400e070 con 0x7f9f9c0b0e20 2023-07-09T21:51:23.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.248+0000 7f9f93fff700 1 -- 172.21.15.53:0/3501576244 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9400b9c0 con 0x7f9f9c0b0e20 2023-07-09T21:51:23.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.248+0000 7f9f93fff700 1 -- 172.21.15.53:0/3501576244 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9400bd70 con 0x7f9f9c0b0e20 2023-07-09T21:51:23.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.249+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3501576244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f9c0b0e20 msgr2=0x7f9f9c0b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:23.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.249+0000 7f9fa37ff700 1 --2- 172.21.15.53:0/3501576244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f9c0b0e20 0x7f9f9c0b1280 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009e50 tx=0x7f9f9400b330 comp rx=0 tx=0).stop 2023-07-09T21:51:23.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.249+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3501576244 shutdown_connections 2023-07-09T21:51:23.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.249+0000 7f9fa37ff700 1 --2- 172.21.15.53:0/3501576244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f9c0b0e20 0x7f9f9c0b1280 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.249+0000 7f9fa37ff700 1 --2- 172.21.15.53:0/3501576244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f9c0d1220 0x7f9f9c0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.249+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3501576244 >> 172.21.15.53:0/3501576244 conn(0x7f9f9c09c1b0 msgr2=0x7f9f9c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:23.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.249+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3501576244 shutdown_connections 2023-07-09T21:51:23.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.249+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3501576244 wait complete. 2023-07-09T21:51:23.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.250+0000 7f9fa37ff700 1 Processor -- start 2023-07-09T21:51:23.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.251+0000 7f9fa37ff700 1 -- start start 2023-07-09T21:51:23.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.251+0000 7f9fa37ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f9c0b0e20 0x7f9f9c1569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:23.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa37ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f9c0b3ff0 0x7f9f9c15d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:23.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa37ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f9c0d1220 0x7f9f9c15e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:23.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa37ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c15ed00 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa37ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c15efe0 con 0x7f9f9c0b0e20 2023-07-09T21:51:23.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa37ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c15cf50 con 0x7f9f9c0d1220 2023-07-09T21:51:23.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa0d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f9c0b3ff0 0x7f9f9c15d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:23.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa0d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f9c0b3ff0 0x7f9f9c15d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53236/0 (socket says 172.21.15.53:53236) 2023-07-09T21:51:23.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa0d9a700 1 -- 172.21.15.53:0/3659343169 learned_addr learned my addr 172.21.15.53:0/3659343169 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:23.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa159b700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f9c0b0e20 0x7f9f9c1569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:23.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa1d9c700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f9c0d1220 0x7f9f9c15e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:23.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa0d9a700 1 -- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f9c0d1220 msgr2=0x7f9f9c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:23.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa0d9a700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f9c0d1220 0x7f9f9c15e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa0d9a700 1 -- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f9c0b0e20 msgr2=0x7f9f9c1569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:23.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa0d9a700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f9c0b0e20 0x7f9f9c1569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.252+0000 7f9fa0d9a700 1 -- 172.21.15.53:0/3659343169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f94009b30 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.253+0000 7f9fa0d9a700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f9c0b3ff0 0x7f9f9c15d750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00e810 tx=0x7f9f8c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.253+0000 7f9f91ffb700 1 -- 172.21.15.53:0/3659343169 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c00c070 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.253+0000 7f9f91ffb700 1 -- 172.21.15.53:0/3659343169 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c013630 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.253+0000 7f9f91ffb700 1 -- 172.21.15.53:0/3659343169 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0139e0 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.253+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3659343169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c15d230 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.253+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3659343169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c15dc90 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.254+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3659343169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c0d0960 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.255+0000 7f9f91ffb700 1 -- 172.21.15.53:0/3659343169 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f8c013b40 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.256+0000 7f9f91ffb700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9f8006ace0 0x7f9f8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:23.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.256+0000 7f9f91ffb700 1 -- 172.21.15.53:0/3659343169 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9f8c088e20 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.256+0000 7f9fa159b700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9f8006ace0 0x7f9f8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:23.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.257+0000 7f9fa159b700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9f8006ace0 0x7f9f8006d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0d08a0 tx=0x7f9f98009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:23.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.260+0000 7f9f91ffb700 1 -- 172.21.15.53:0/3659343169 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9f8c057910 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.483+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3659343169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9f9c15cdb0 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.484+0000 7f9f91ffb700 1 -- 172.21.15.53:0/3659343169 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9f9c15cdb0 con 0x7f9f9c0b3ff0 2023-07-09T21:51:23.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.486+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9f8006ace0 msgr2=0x7f9f8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:23.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.486+0000 7f9fa37ff700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9f8006ace0 0x7f9f8006d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0d08a0 tx=0x7f9f98009040 comp rx=0 tx=0).stop 2023-07-09T21:51:23.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.486+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3659343169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f9c0b3ff0 msgr2=0x7f9f9c15d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:23.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.486+0000 7f9fa37ff700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f9c0b3ff0 0x7f9f9c15d750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00e810 tx=0x7f9f8c00eb20 comp rx=0 tx=0).stop 2023-07-09T21:51:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.486+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3659343169 shutdown_connections 2023-07-09T21:51:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.486+0000 7f9fa37ff700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9f8006ace0 0x7f9f8006d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.486+0000 7f9fa37ff700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f9c0d1220 0x7f9f9c15e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.486+0000 7f9fa37ff700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f9c0b0e20 0x7f9f9c1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.486+0000 7f9fa37ff700 1 --2- 172.21.15.53:0/3659343169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f9c0b3ff0 0x7f9f9c15d750 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.486+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3659343169 >> 172.21.15.53:0/3659343169 conn(0x7f9f9c09c1b0 msgr2=0x7f9f9c0b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.486+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3659343169 shutdown_connections 2023-07-09T21:51:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.487+0000 7f9fa37ff700 1 -- 172.21.15.53:0/3659343169 wait complete. 2023-07-09T21:51:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-07-09T21:51:23.506 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-09T21:51:23.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:23.507 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-09T21:51:23.595 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:51:23.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:23.596 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-09T21:51:23.639 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T21:51:23.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:51:23.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.839+0000 7fa094bff700 1 Processor -- start 2023-07-09T21:51:23.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.840+0000 7fa094bff700 1 -- start start 2023-07-09T21:51:23.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.841+0000 7fa094bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa0900b1e00 0x7fa0900b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:23.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.841+0000 7fa094bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa0900b2350 0x7fa0900d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:23.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.841+0000 7fa094bff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0900d2ce0 con 0x7fa0900d1050 2023-07-09T21:51:23.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.841+0000 7fa094bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0900d14d0 con 0x7fa0900b1e00 2023-07-09T21:51:23.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.841+0000 7fa094bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0900b3350 con 0x7fa0900b2350 2023-07-09T21:51:23.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.841+0000 7fa08e59c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa0900b1e00 0x7fa0900b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:23.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.841+0000 7fa08ed9d700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa0900d1050 0x7fa0900afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59026/0 (socket says 172.21.15.53:59026) 2023-07-09T21:51:23.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.841+0000 7fa08ed9d700 1 -- 172.21.15.53:0/241239449 learned_addr learned my addr 172.21.15.53:0/241239449 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:23.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.842+0000 7fa08e59c700 1 -- 172.21.15.53:0/241239449 >> v2:172.21.15.184:3300/0 conn(0x7fa0900b2350 msgr2=0x7fa0900d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:23.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.842+0000 7fa087fff700 1 --2- 172.21.15.53:0/241239449 >> v2:172.21.15.184:3300/0 conn(0x7fa0900b2350 0x7fa0900d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:23.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.842+0000 7fa08e59c700 1 --2- 172.21.15.53:0/241239449 >> v2:172.21.15.184:3300/0 conn(0x7fa0900b2350 0x7fa0900d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.842+0000 7fa08e59c700 1 -- 172.21.15.53:0/241239449 >> v1:172.21.15.53:6789/0 conn(0x7fa0900d1050 legacy=0x7fa0900afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:23.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.842+0000 7fa08dd9b700 1 -- 172.21.15.53:0/241239449 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904237403 0 0) 0x7fa0900d2ce0 con 0x7fa0900d1050 2023-07-09T21:51:23.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.842+0000 7fa08e59c700 1 -- 172.21.15.53:0/241239449 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0900b3630 con 0x7fa0900b1e00 2023-07-09T21:51:23.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.842+0000 7fa087fff700 1 --2- 172.21.15.53:0/241239449 >> v2:172.21.15.184:3300/0 conn(0x7fa0900b2350 0x7fa0900d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:23.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.842+0000 7fa08e59c700 1 --2- 172.21.15.53:0/241239449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0900b1e00 0x7fa0900b43f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa090072140 tx=0x7fa080009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3a35a0704762d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:23.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.842+0000 7fa08dd9b700 1 -- 172.21.15.53:0/241239449 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa080011830 con 0x7fa0900b1e00 2023-07-09T21:51:23.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.842+0000 7fa08dd9b700 1 -- 172.21.15.53:0/241239449 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa080011990 con 0x7fa0900b1e00 2023-07-09T21:51:23.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.842+0000 7fa08dd9b700 1 -- 172.21.15.53:0/241239449 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa080011d40 con 0x7fa0900b1e00 2023-07-09T21:51:23.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.843+0000 7fa094bff700 1 -- 172.21.15.53:0/241239449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0900b1e00 msgr2=0x7fa0900b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:23.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.843+0000 7fa094bff700 1 --2- 172.21.15.53:0/241239449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0900b1e00 0x7fa0900b43f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa090072140 tx=0x7fa080009b10 comp rx=0 tx=0).stop 2023-07-09T21:51:23.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.843+0000 7fa094bff700 1 -- 172.21.15.53:0/241239449 shutdown_connections 2023-07-09T21:51:23.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.843+0000 7fa094bff700 1 --2- 172.21.15.53:0/241239449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0900b1e00 0x7fa0900b43f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.843+0000 7fa094bff700 1 --2- 172.21.15.53:0/241239449 >> v2:172.21.15.184:3300/0 conn(0x7fa0900b2350 0x7fa0900d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.843+0000 7fa094bff700 1 -- 172.21.15.53:0/241239449 >> 172.21.15.53:0/241239449 conn(0x7fa09009c1d0 msgr2=0x7fa0900d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:23.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.843+0000 7fa094bff700 1 -- 172.21.15.53:0/241239449 shutdown_connections 2023-07-09T21:51:23.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.843+0000 7fa094bff700 1 -- 172.21.15.53:0/241239449 wait complete. 2023-07-09T21:51:23.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.845+0000 7fa094bff700 1 Processor -- start 2023-07-09T21:51:23.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.845+0000 7fa094bff700 1 -- start start 2023-07-09T21:51:23.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa094bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0900b1e00 0x7fa090153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:23.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa094bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900b2350 0x7fa0900cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:23.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa094bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0900d1050 0x7fa0900ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:23.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa094bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900c9580 con 0x7fa0900b1e00 2023-07-09T21:51:23.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa094bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900cd0a0 con 0x7fa0900b2350 2023-07-09T21:51:23.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa094bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09015a310 con 0x7fa0900d1050 2023-07-09T21:51:23.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa08e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0900b1e00 0x7fa090153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:23.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa08e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0900b1e00 0x7fa090153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53268/0 (socket says 172.21.15.53:53268) 2023-07-09T21:51:23.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa08e59c700 1 -- 172.21.15.53:0/116319223 learned_addr learned my addr 172.21.15.53:0/116319223 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:23.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa087fff700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900b2350 0x7fa0900cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:23.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa08ed9d700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0900d1050 0x7fa0900ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:23.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa08e59c700 1 -- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0900d1050 msgr2=0x7fa0900ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:23.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa08e59c700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0900d1050 0x7fa0900ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa08e59c700 1 -- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900b2350 msgr2=0x7fa0900cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:23.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa08e59c700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900b2350 0x7fa0900cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:23.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa08e59c700 1 -- 172.21.15.53:0/116319223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa080009440 con 0x7fa0900b1e00 2023-07-09T21:51:23.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.846+0000 7fa087fff700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900b2350 0x7fa0900cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:23.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.847+0000 7fa08e59c700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0900b1e00 0x7fa090153d70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa0800090b0 tx=0x7fa080004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:23.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.847+0000 7fa086ffd700 1 -- 172.21.15.53:0/116319223 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa080004520 con 0x7fa0900b1e00 2023-07-09T21:51:23.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.847+0000 7fa086ffd700 1 -- 172.21.15.53:0/116319223 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0800036a0 con 0x7fa0900b1e00 2023-07-09T21:51:23.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.847+0000 7fa086ffd700 1 -- 172.21.15.53:0/116319223 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa080003a30 con 0x7fa0900b1e00 2023-07-09T21:51:23.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.847+0000 7fa094bff700 1 -- 172.21.15.53:0/116319223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0900ced50 con 0x7fa0900b1e00 2023-07-09T21:51:23.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.847+0000 7fa094bff700 1 -- 172.21.15.53:0/116319223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0900cf310 con 0x7fa0900b1e00 2023-07-09T21:51:23.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.848+0000 7fa094bff700 1 -- 172.21.15.53:0/116319223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0900723e0 con 0x7fa0900b1e00 2023-07-09T21:51:23.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.849+0000 7fa086ffd700 1 -- 172.21.15.53:0/116319223 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa080003b90 con 0x7fa0900b1e00 2023-07-09T21:51:23.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.850+0000 7fa086ffd700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa07006ace0 0x7fa07006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:23.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.850+0000 7fa086ffd700 1 -- 172.21.15.53:0/116319223 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa08008a4f0 con 0x7fa0900b1e00 2023-07-09T21:51:23.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.851+0000 7fa087fff700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa07006ace0 0x7fa07006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:23.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.851+0000 7fa087fff700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa07006ace0 0x7fa07006d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa090159860 tx=0x7fa078008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:23.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:23.855+0000 7fa086ffd700 1 -- 172.21.15.53:0/116319223 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa080055550 con 0x7fa0900b1e00 2023-07-09T21:51:24.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.104+0000 7fa094bff700 1 -- 172.21.15.53:0/116319223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa09004e280 con 0x7fa0900b1e00 2023-07-09T21:51:24.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.105+0000 7fa086ffd700 1 -- 172.21.15.53:0/116319223 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7fa080058b70 con 0x7fa0900b1e00 2023-07-09T21:51:24.106 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:24.106 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3421374491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3421374491},{"type":"v1","addr":"172.21.15.53:6835","nonce":3421374491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1569539203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":1569539203},{"type":"v1","addr":"172.21.15.184:6837","nonce":1569539203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3569510065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3569510065},{"type":"v1","addr":"172.21.15.53:6834","nonce":3569510065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:50:23.272725+0000","modified":"2023-07-09T21:50:26.798670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/3002520227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3002520227},{"type":"v1","addr":"172.21.15.184:6836","nonce":3002520227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:51:24.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.107+0000 7fa094bff700 1 -- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa07006ace0 msgr2=0x7fa07006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:24.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.107+0000 7fa094bff700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa07006ace0 0x7fa07006d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa090159860 tx=0x7fa078008040 comp rx=0 tx=0).stop 2023-07-09T21:51:24.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.107+0000 7fa094bff700 1 -- 172.21.15.53:0/116319223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0900b1e00 msgr2=0x7fa090153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:24.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.107+0000 7fa094bff700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0900b1e00 0x7fa090153d70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa0800090b0 tx=0x7fa080004750 comp rx=0 tx=0).stop 2023-07-09T21:51:24.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.107+0000 7fa094bff700 1 -- 172.21.15.53:0/116319223 shutdown_connections 2023-07-09T21:51:24.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.107+0000 7fa094bff700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa07006ace0 0x7fa07006d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.107+0000 7fa094bff700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0900d1050 0x7fa0900ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.107+0000 7fa094bff700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0900b1e00 0x7fa090153d70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.107+0000 7fa094bff700 1 --2- 172.21.15.53:0/116319223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900b2350 0x7fa0900cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.107+0000 7fa094bff700 1 -- 172.21.15.53:0/116319223 >> 172.21.15.53:0/116319223 conn(0x7fa09009c1d0 msgr2=0x7fa09015a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:24.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.107+0000 7fa094bff700 1 -- 172.21.15.53:0/116319223 shutdown_connections 2023-07-09T21:51:24.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.107+0000 7fa094bff700 1 -- 172.21.15.53:0/116319223 wait complete. 2023-07-09T21:51:24.110 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 8 2023-07-09T21:51:24.127 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:24.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.325+0000 7fc1dafff700 1 Processor -- start 2023-07-09T21:51:24.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.325+0000 7fc1dafff700 1 -- start start 2023-07-09T21:51:24.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.326+0000 7fc1dafff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc1d40b1e00 0x7fc1d40b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:24.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.326+0000 7fc1dafff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1d40b2350 0x7fc1d40d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:24.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.326+0000 7fc1dafff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc1d40d1050 0x7fc1d40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:24.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.326+0000 7fc1dafff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d40d14a0 con 0x7fc1d40b1e00 2023-07-09T21:51:24.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.326+0000 7fc1dafff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d40d2ce0 con 0x7fc1d40d1050 2023-07-09T21:51:24.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.326+0000 7fc1dafff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d40b3350 con 0x7fc1d40b2350 2023-07-09T21:51:24.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.326+0000 7fc1d8d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc1d40b1e00 0x7fc1d40b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:24.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.327+0000 7fc1d8d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc1d40b1e00 0x7fc1d40b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53282/0 (socket says 172.21.15.53:53282) 2023-07-09T21:51:24.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.327+0000 7fc1d8d9b700 1 -- 172.21.15.53:0/1025504476 learned_addr learned my addr 172.21.15.53:0/1025504476 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:24.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.327+0000 7fc1d959c700 1 --2- 172.21.15.53:0/1025504476 >> v2:172.21.15.184:3300/0 conn(0x7fc1d40d1050 0x7fc1d40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.327+0000 7fc1d3fff700 1 --2- 172.21.15.53:0/1025504476 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1d40b2350 0x7fc1d40d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.327+0000 7fc1d8d9b700 1 -- 172.21.15.53:0/1025504476 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1d40b2350 msgr2=0x7fc1d40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.327+0000 7fc1d8d9b700 1 --2- 172.21.15.53:0/1025504476 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1d40b2350 0x7fc1d40d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.327+0000 7fc1d8d9b700 1 -- 172.21.15.53:0/1025504476 >> v2:172.21.15.184:3300/0 conn(0x7fc1d40d1050 msgr2=0x7fc1d40afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.327+0000 7fc1d8d9b700 1 --2- 172.21.15.53:0/1025504476 >> v2:172.21.15.184:3300/0 conn(0x7fc1d40d1050 0x7fc1d40afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.327+0000 7fc1d8d9b700 1 -- 172.21.15.53:0/1025504476 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d40b3630 con 0x7fc1d40b1e00 2023-07-09T21:51:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.327+0000 7fc1d959c700 1 --2- 172.21.15.53:0/1025504476 >> v2:172.21.15.184:3300/0 conn(0x7fc1d40d1050 0x7fc1d40afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:24.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.327+0000 7fc1d3fff700 1 --2- 172.21.15.53:0/1025504476 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1d40b2350 0x7fc1d40d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:24.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.327+0000 7fc1d8d9b700 1 --2- 172.21.15.53:0/1025504476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1d40b1e00 0x7fc1d40b43f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40b3280 tx=0x7fc1c8009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45617f28f27bff3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:24.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.328+0000 7fc1d37fe700 1 -- 172.21.15.53:0/1025504476 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c800b8a0 con 0x7fc1d40b1e00 2023-07-09T21:51:24.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.328+0000 7fc1d37fe700 1 -- 172.21.15.53:0/1025504476 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c800ba00 con 0x7fc1d40b1e00 2023-07-09T21:51:24.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.328+0000 7fc1d37fe700 1 -- 172.21.15.53:0/1025504476 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c800bdb0 con 0x7fc1d40b1e00 2023-07-09T21:51:24.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.328+0000 7fc1dafff700 1 -- 172.21.15.53:0/1025504476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1d40b1e00 msgr2=0x7fc1d40b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:24.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.328+0000 7fc1dafff700 1 --2- 172.21.15.53:0/1025504476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1d40b1e00 0x7fc1d40b43f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40b3280 tx=0x7fc1c8009bc0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.328+0000 7fc1dafff700 1 -- 172.21.15.53:0/1025504476 shutdown_connections 2023-07-09T21:51:24.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.328+0000 7fc1dafff700 1 --2- 172.21.15.53:0/1025504476 >> v2:172.21.15.184:3300/0 conn(0x7fc1d40d1050 0x7fc1d40afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.328+0000 7fc1dafff700 1 --2- 172.21.15.53:0/1025504476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1d40b1e00 0x7fc1d40b43f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.328+0000 7fc1dafff700 1 --2- 172.21.15.53:0/1025504476 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1d40b2350 0x7fc1d40d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.328+0000 7fc1dafff700 1 -- 172.21.15.53:0/1025504476 >> 172.21.15.53:0/1025504476 conn(0x7fc1d409c1d0 msgr2=0x7fc1d40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:24.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.328+0000 7fc1dafff700 1 -- 172.21.15.53:0/1025504476 shutdown_connections 2023-07-09T21:51:24.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.328+0000 7fc1dafff700 1 -- 172.21.15.53:0/1025504476 wait complete. 2023-07-09T21:51:24.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.330+0000 7fc1dafff700 1 Processor -- start 2023-07-09T21:51:24.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.330+0000 7fc1dafff700 1 -- start start 2023-07-09T21:51:24.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.331+0000 7fc1dafff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1d40b1e00 0x7fc1d4157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:24.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.331+0000 7fc1dafff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1d40b2350 0x7fc1d415df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:24.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.331+0000 7fc1dafff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1d40d1050 0x7fc1d4157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:24.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.331+0000 7fc1dafff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d41583c0 con 0x7fc1d40b2350 2023-07-09T21:51:24.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.331+0000 7fc1dafff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d415fc80 con 0x7fc1d40b1e00 2023-07-09T21:51:24.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.331+0000 7fc1dafff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d415e490 con 0x7fc1d40d1050 2023-07-09T21:51:24.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1d40b2350 0x7fc1d415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:24.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1d40b2350 0x7fc1d415df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53296/0 (socket says 172.21.15.53:53296) 2023-07-09T21:51:24.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d3fff700 1 -- 172.21.15.53:0/1050587818 learned_addr learned my addr 172.21.15.53:0/1050587818 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:24.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d8d9b700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1d40b1e00 0x7fc1d4157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:24.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d959c700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1d40d1050 0x7fc1d4157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:24.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d3fff700 1 -- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1d40d1050 msgr2=0x7fc1d4157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:24.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d3fff700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1d40d1050 0x7fc1d4157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d3fff700 1 -- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1d40b1e00 msgr2=0x7fc1d4157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:24.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d3fff700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1d40b1e00 0x7fc1d4157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d3fff700 1 -- 172.21.15.53:0/1050587818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c80094f0 con 0x7fc1d40b2350 2023-07-09T21:51:24.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d3fff700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1d40b2350 0x7fc1d415df50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000d800 tx=0x7fc1c000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:24.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d17fa700 1 -- 172.21.15.53:0/1050587818 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0004030 con 0x7fc1d40b2350 2023-07-09T21:51:24.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d17fa700 1 -- 172.21.15.53:0/1050587818 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c0004190 con 0x7fc1d40b2350 2023-07-09T21:51:24.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1d17fa700 1 -- 172.21.15.53:0/1050587818 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0004520 con 0x7fc1d40b2350 2023-07-09T21:51:24.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.332+0000 7fc1dafff700 1 -- 172.21.15.53:0/1050587818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d41578d0 con 0x7fc1d40b2350 2023-07-09T21:51:24.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.333+0000 7fc1dafff700 1 -- 172.21.15.53:0/1050587818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d40c8750 con 0x7fc1d40b2350 2023-07-09T21:51:24.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.334+0000 7fc1dafff700 1 -- 172.21.15.53:0/1050587818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d40c82a0 con 0x7fc1d40b2350 2023-07-09T21:51:24.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.335+0000 7fc1d17fa700 1 -- 172.21.15.53:0/1050587818 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc1c00036a0 con 0x7fc1d40b2350 2023-07-09T21:51:24.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.336+0000 7fc1d17fa700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc1b806ace0 0x7fc1b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:24.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.336+0000 7fc1d17fa700 1 -- 172.21.15.53:0/1050587818 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc1c0088ae0 con 0x7fc1d40b2350 2023-07-09T21:51:24.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.336+0000 7fc1d8d9b700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc1b806ace0 0x7fc1b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:24.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.337+0000 7fc1d8d9b700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc1b806ace0 0x7fc1b806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8009c00 tx=0x7fc1c8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:24.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.340+0000 7fc1d17fa700 1 -- 172.21.15.53:0/1050587818 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc1c0053b60 con 0x7fc1d40b2350 2023-07-09T21:51:24.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.548+0000 7fc1dafff700 1 -- 172.21.15.53:0/1050587818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1d404e280 con 0x7fc1d40b2350 2023-07-09T21:51:24.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.549+0000 7fc1d17fa700 1 -- 172.21.15.53:0/1050587818 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fc1c0018090 con 0x7fc1d40b2350 2023-07-09T21:51:24.550 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:24.551 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:04.650456+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:24.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.551+0000 7fc1dafff700 1 -- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc1b806ace0 msgr2=0x7fc1b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:24.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.551+0000 7fc1dafff700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc1b806ace0 0x7fc1b806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8009c00 tx=0x7fc1c8008030 comp rx=0 tx=0).stop 2023-07-09T21:51:24.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.551+0000 7fc1dafff700 1 -- 172.21.15.53:0/1050587818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1d40b2350 msgr2=0x7fc1d415df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:24.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.551+0000 7fc1dafff700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1d40b2350 0x7fc1d415df50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000d800 tx=0x7fc1c000db10 comp rx=0 tx=0).stop 2023-07-09T21:51:24.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.551+0000 7fc1dafff700 1 -- 172.21.15.53:0/1050587818 shutdown_connections 2023-07-09T21:51:24.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.551+0000 7fc1dafff700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc1b806ace0 0x7fc1b806d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.551+0000 7fc1dafff700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1d40d1050 0x7fc1d4157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.551+0000 7fc1dafff700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1d40b1e00 0x7fc1d4157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.551+0000 7fc1dafff700 1 --2- 172.21.15.53:0/1050587818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1d40b2350 0x7fc1d415df50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.551+0000 7fc1dafff700 1 -- 172.21.15.53:0/1050587818 >> 172.21.15.53:0/1050587818 conn(0x7fc1d409c1d0 msgr2=0x7fc1d40b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:24.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.551+0000 7fc1dafff700 1 -- 172.21.15.53:0/1050587818 shutdown_connections 2023-07-09T21:51:24.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.551+0000 7fc1dafff700 1 -- 172.21.15.53:0/1050587818 wait complete. 2023-07-09T21:51:24.571 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:50:21.703759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:50:22.243698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:51:24.572 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:51:24.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.775+0000 7f573dbff700 1 Processor -- start 2023-07-09T21:51:24.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.775+0000 7f573dbff700 1 -- start start 2023-07-09T21:51:24.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.776+0000 7f573dbff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f57380adea0 0x7f57380ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:24.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.776+0000 7f573dbff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57380c99e0 0x7f57380cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:24.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.776+0000 7f573dbff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573815ce70 con 0x7f57380b12f0 2023-07-09T21:51:24.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.776+0000 7f573dbff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573815da60 con 0x7f57380c99e0 2023-07-09T21:51:24.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.776+0000 7f573dbff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573815d0c0 con 0x7f57380adea0 2023-07-09T21:51:24.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.777+0000 7f5737fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57380c99e0 0x7f57380cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:24.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.777+0000 7f5737fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57380c99e0 0x7f57380cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53310/0 (socket says 172.21.15.53:53310) 2023-07-09T21:51:24.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.777+0000 7f5737fff700 1 -- 172.21.15.53:0/3351093181 learned_addr learned my addr 172.21.15.53:0/3351093181 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:24.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.777+0000 7f5736ffd700 1 --2- 172.21.15.53:0/3351093181 >> v2:172.21.15.184:3300/0 conn(0x7f57380adea0 0x7f57380ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:24.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.777+0000 7f5737fff700 1 -- 172.21.15.53:0/3351093181 >> v2:172.21.15.184:3300/0 conn(0x7f57380adea0 msgr2=0x7f57380ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:24.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.777+0000 7f5737fff700 1 --2- 172.21.15.53:0/3351093181 >> v2:172.21.15.184:3300/0 conn(0x7f57380adea0 0x7f57380ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.777+0000 7f5737fff700 1 -- 172.21.15.53:0/3351093181 >> v1:172.21.15.184:6789/0 conn(0x7f57380b12f0 legacy=0x7f57380c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:24.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.777+0000 7f5737fff700 1 -- 172.21.15.53:0/3351093181 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573815d3a0 con 0x7f57380c99e0 2023-07-09T21:51:24.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.777+0000 7f5737fff700 1 --2- 172.21.15.53:0/3351093181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57380c99e0 0x7f57380cc690 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f573806d890 tx=0x7f573000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db83194d89efacd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:24.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.777+0000 7f57367fc700 1 -- 172.21.15.53:0/3351093181 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573000e070 con 0x7f57380c99e0 2023-07-09T21:51:24.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.778+0000 7f57367fc700 1 -- 172.21.15.53:0/3351093181 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5730003a20 con 0x7f57380c99e0 2023-07-09T21:51:24.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.778+0000 7f57367fc700 1 -- 172.21.15.53:0/3351093181 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5730003dd0 con 0x7f57380c99e0 2023-07-09T21:51:24.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.778+0000 7f573dbff700 1 -- 172.21.15.53:0/3351093181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57380c99e0 msgr2=0x7f57380cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:24.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.778+0000 7f573dbff700 1 --2- 172.21.15.53:0/3351093181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57380c99e0 0x7f57380cc690 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f573806d890 tx=0x7f573000b330 comp rx=0 tx=0).stop 2023-07-09T21:51:24.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.778+0000 7f573dbff700 1 -- 172.21.15.53:0/3351093181 shutdown_connections 2023-07-09T21:51:24.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.778+0000 7f573dbff700 1 --2- 172.21.15.53:0/3351093181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57380c99e0 0x7f57380cc690 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.778+0000 7f573dbff700 1 --2- 172.21.15.53:0/3351093181 >> v2:172.21.15.184:3300/0 conn(0x7f57380adea0 0x7f57380ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.778+0000 7f573dbff700 1 -- 172.21.15.53:0/3351093181 >> 172.21.15.53:0/3351093181 conn(0x7f57380b05d0 msgr2=0x7f57380b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:24.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.778+0000 7f573dbff700 1 -- 172.21.15.53:0/3351093181 shutdown_connections 2023-07-09T21:51:24.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.778+0000 7f573dbff700 1 -- 172.21.15.53:0/3351093181 wait complete. 2023-07-09T21:51:24.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.781+0000 7f573dbff700 1 Processor -- start 2023-07-09T21:51:24.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.781+0000 7f573dbff700 1 -- start start 2023-07-09T21:51:24.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f573dbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57380adea0 0x7f573815a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:24.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f573dbff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57380b12f0 0x7f573815c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:24.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f573dbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57380c99e0 0x7f5738154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:24.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f573dbff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573815c7a0 con 0x7f57380b12f0 2023-07-09T21:51:24.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f573dbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5738153100 con 0x7f57380c99e0 2023-07-09T21:51:24.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f573dbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57381533e0 con 0x7f57380adea0 2023-07-09T21:51:24.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f5736ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57380b12f0 0x7f573815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:24.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f57377fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57380adea0 0x7f573815a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:24.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f5737fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57380c99e0 0x7f5738154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:24.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f57377fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57380adea0 0x7f573815a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:52056/0 (socket says 172.21.15.53:52056) 2023-07-09T21:51:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f57377fe700 1 -- 172.21.15.53:0/2628247593 learned_addr learned my addr 172.21.15.53:0/2628247593 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f5736ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57380b12f0 0x7f573815c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53316/0 (socket says 172.21.15.53:53316) 2023-07-09T21:51:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f5736ffd700 1 -- 172.21.15.53:0/2628247593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57380adea0 msgr2=0x7f573815a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f5736ffd700 1 --2- 172.21.15.53:0/2628247593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57380adea0 0x7f573815a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f5736ffd700 1 -- 172.21.15.53:0/2628247593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57380c99e0 msgr2=0x7f5738154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f5736ffd700 1 --2- 172.21.15.53:0/2628247593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57380c99e0 0x7f5738154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.783+0000 7f5736ffd700 1 -- 172.21.15.53:0/2628247593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730009b30 con 0x7f57380b12f0 2023-07-09T21:51:24.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.784+0000 7f5736ffd700 1 --2- 172.21.15.53:0/2628247593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57380b12f0 0x7f573815c260 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f572c00e7e0 tx=0x7f572c00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:24.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.784+0000 7f571ffff700 1 -- 172.21.15.53:0/2628247593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00c070 con 0x7f57380b12f0 2023-07-09T21:51:24.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.784+0000 7f571ffff700 1 -- 172.21.15.53:0/2628247593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c013610 con 0x7f57380b12f0 2023-07-09T21:51:24.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.784+0000 7f571ffff700 1 -- 172.21.15.53:0/2628247593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c0139a0 con 0x7f57380b12f0 2023-07-09T21:51:24.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.784+0000 7f573dbff700 1 -- 172.21.15.53:0/2628247593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57381536c0 con 0x7f57380b12f0 2023-07-09T21:51:24.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.784+0000 7f573dbff700 1 -- 172.21.15.53:0/2628247593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5738153c80 con 0x7f57380b12f0 2023-07-09T21:51:24.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.785+0000 7f573dbff700 1 -- 172.21.15.53:0/2628247593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5738074350 con 0x7f57380b12f0 2023-07-09T21:51:24.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.786+0000 7f571ffff700 1 -- 172.21.15.53:0/2628247593 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f572c013b00 con 0x7f57380b12f0 2023-07-09T21:51:24.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.787+0000 7f571ffff700 1 --2- 172.21.15.53:0/2628247593 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f572406ace0 0x7f572406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:24.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.787+0000 7f571ffff700 1 -- 172.21.15.53:0/2628247593 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f572c0891f0 con 0x7f57380b12f0 2023-07-09T21:51:24.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.788+0000 7f57377fe700 1 --2- 172.21.15.53:0/2628247593 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f572406ace0 0x7f572406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:24.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.788+0000 7f57377fe700 1 --2- 172.21.15.53:0/2628247593 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f572406ace0 0x7f572406d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5728003ac0 tx=0x7f5728003a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:24.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:24.791+0000 7f571ffff700 1 -- 172.21.15.53:0/2628247593 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f572c0541d0 con 0x7f57380b12f0 2023-07-09T21:51:25.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.000+0000 7f573dbff700 1 -- 172.21.15.53:0/2628247593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57380b4a40 con 0x7f57380b12f0 2023-07-09T21:51:25.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.000+0000 7f571ffff700 1 -- 172.21.15.53:0/2628247593 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f572c013db0 con 0x7f57380b12f0 2023-07-09T21:51:25.002 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:51:25.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.003+0000 7f573dbff700 1 -- 172.21.15.53:0/2628247593 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f572406ace0 msgr2=0x7f572406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.003+0000 7f573dbff700 1 --2- 172.21.15.53:0/2628247593 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f572406ace0 0x7f572406d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5728003ac0 tx=0x7f5728003a50 comp rx=0 tx=0).stop 2023-07-09T21:51:25.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.003+0000 7f573dbff700 1 -- 172.21.15.53:0/2628247593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57380b12f0 msgr2=0x7f573815c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.003+0000 7f573dbff700 1 --2- 172.21.15.53:0/2628247593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57380b12f0 0x7f573815c260 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f572c00e7e0 tx=0x7f572c00eaf0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.003+0000 7f573dbff700 1 -- 172.21.15.53:0/2628247593 shutdown_connections 2023-07-09T21:51:25.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.003+0000 7f573dbff700 1 --2- 172.21.15.53:0/2628247593 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f572406ace0 0x7f572406d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.003+0000 7f573dbff700 1 --2- 172.21.15.53:0/2628247593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57380c99e0 0x7f5738154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.003+0000 7f573dbff700 1 --2- 172.21.15.53:0/2628247593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57380adea0 0x7f573815a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.003+0000 7f573dbff700 1 --2- 172.21.15.53:0/2628247593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57380b12f0 0x7f573815c260 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.003+0000 7f573dbff700 1 -- 172.21.15.53:0/2628247593 >> 172.21.15.53:0/2628247593 conn(0x7f57380b05d0 msgr2=0x7f5738070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:25.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.003+0000 7f573dbff700 1 -- 172.21.15.53:0/2628247593 shutdown_connections 2023-07-09T21:51:25.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.003+0000 7f573dbff700 1 -- 172.21.15.53:0/2628247593 wait complete. 2023-07-09T21:51:25.023 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:51:25.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.226+0000 7f718c7ff700 1 Processor -- start 2023-07-09T21:51:25.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.226+0000 7f718c7ff700 1 -- start start 2023-07-09T21:51:25.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.227+0000 7f718c7ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f71840cbe40 0x7f71840cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:25.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.227+0000 7f718c7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f718406ca10 0x7f71840cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:25.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.227+0000 7f718c7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71840ce3d0 con 0x7f71840cda40 2023-07-09T21:51:25.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.227+0000 7f718c7ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718406b5b0 con 0x7f71840cbe40 2023-07-09T21:51:25.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.227+0000 7f718c7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7184071500 con 0x7f718406ca10 2023-07-09T21:51:25.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.228+0000 7f718ad9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f718406ca10 0x7f71840cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:25.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.228+0000 7f718a59b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f71840cbe40 0x7f71840cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:25.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.228+0000 7f718ad9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f718406ca10 0x7f71840cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:52072/0 (socket says 172.21.15.53:52072) 2023-07-09T21:51:25.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.228+0000 7f718ad9c700 1 -- 172.21.15.53:0/597792904 learned_addr learned my addr 172.21.15.53:0/597792904 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:25.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.228+0000 7f7189d9a700 1 --1- 172.21.15.53:0/597792904 >> v1:172.21.15.184:6789/0 conn(0x7f71840cda40 0x7f718415c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:44564/0 (socket says 172.21.15.53:44564) 2023-07-09T21:51:25.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.228+0000 7f718ad9c700 1 -- 172.21.15.53:0/597792904 >> v2:172.21.15.184:3300/0 conn(0x7f71840cbe40 msgr2=0x7f71840cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:25.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.228+0000 7f718ad9c700 1 --2- 172.21.15.53:0/597792904 >> v2:172.21.15.184:3300/0 conn(0x7f71840cbe40 0x7f71840cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.228+0000 7f718ad9c700 1 -- 172.21.15.53:0/597792904 >> v1:172.21.15.184:6789/0 conn(0x7f71840cda40 legacy=0x7f718415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.228+0000 7f718ad9c700 1 -- 172.21.15.53:0/597792904 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71840ce8c0 con 0x7f718406ca10 2023-07-09T21:51:25.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.228+0000 7f718a59b700 1 --2- 172.21.15.53:0/597792904 >> v2:172.21.15.184:3300/0 conn(0x7f71840cbe40 0x7f71840cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:25.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.229+0000 7f718ad9c700 1 --2- 172.21.15.53:0/597792904 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f718406ca10 0x7f71840cde90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f717c009e50 tx=0x7f717c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc855806ba9c662 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:25.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.229+0000 7f7189599700 1 -- 172.21.15.53:0/597792904 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00e070 con 0x7f718406ca10 2023-07-09T21:51:25.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.229+0000 7f7189599700 1 -- 172.21.15.53:0/597792904 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c00b910 con 0x7f718406ca10 2023-07-09T21:51:25.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.229+0000 7f7189599700 1 -- 172.21.15.53:0/597792904 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00bcc0 con 0x7f718406ca10 2023-07-09T21:51:25.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.229+0000 7f718c7ff700 1 -- 172.21.15.53:0/597792904 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f718406ca10 msgr2=0x7f71840cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.229+0000 7f718c7ff700 1 --2- 172.21.15.53:0/597792904 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f718406ca10 0x7f71840cde90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f717c009e50 tx=0x7f717c00b330 comp rx=0 tx=0).stop 2023-07-09T21:51:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.229+0000 7f718c7ff700 1 -- 172.21.15.53:0/597792904 shutdown_connections 2023-07-09T21:51:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.229+0000 7f718c7ff700 1 --2- 172.21.15.53:0/597792904 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f718406ca10 0x7f71840cde90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.229+0000 7f718c7ff700 1 --2- 172.21.15.53:0/597792904 >> v2:172.21.15.184:3300/0 conn(0x7f71840cbe40 0x7f71840cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.229+0000 7f718c7ff700 1 -- 172.21.15.53:0/597792904 >> 172.21.15.53:0/597792904 conn(0x7f71840b05d0 msgr2=0x7f71840b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.230+0000 7f718c7ff700 1 -- 172.21.15.53:0/597792904 shutdown_connections 2023-07-09T21:51:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.230+0000 7f718c7ff700 1 -- 172.21.15.53:0/597792904 wait complete. 2023-07-09T21:51:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.231+0000 7f718c7ff700 1 Processor -- start 2023-07-09T21:51:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.231+0000 7f718c7ff700 1 -- start start 2023-07-09T21:51:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.232+0000 7f718c7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f718406ca10 0x7f71840c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.232+0000 7f718c7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71840cbe40 0x7f7184152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.232+0000 7f718c7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71840cda40 0x7f718406f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.232+0000 7f718c7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71840c8af0 con 0x7f718406ca10 2023-07-09T21:51:25.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.232+0000 7f718c7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71840c6020 con 0x7f71840cbe40 2023-07-09T21:51:25.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.232+0000 7f718c7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71840c6300 con 0x7f71840cda40 2023-07-09T21:51:25.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.233+0000 7f718a59b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f718406ca10 0x7f71840c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:25.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.233+0000 7f718a59b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f718406ca10 0x7f71840c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53328/0 (socket says 172.21.15.53:53328) 2023-07-09T21:51:25.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.233+0000 7f718a59b700 1 -- 172.21.15.53:0/2313310723 learned_addr learned my addr 172.21.15.53:0/2313310723 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:25.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.233+0000 7f7189d9a700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71840cbe40 0x7f7184152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:25.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.233+0000 7f718ad9c700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71840cda40 0x7f718406f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:25.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.233+0000 7f718a59b700 1 -- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71840cda40 msgr2=0x7f718406f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.233+0000 7f718a59b700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71840cda40 0x7f718406f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.233+0000 7f718a59b700 1 -- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71840cbe40 msgr2=0x7f7184152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.233+0000 7f718a59b700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71840cbe40 0x7f7184152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.233+0000 7f718a59b700 1 -- 172.21.15.53:0/2313310723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71800094a0 con 0x7f718406ca10 2023-07-09T21:51:25.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.233+0000 7f718a59b700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f718406ca10 0x7f71840c85b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f718000ebe0 tx=0x7f718000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:25.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.234+0000 7f717affd700 1 -- 172.21.15.53:0/2313310723 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718000c850 con 0x7f718406ca10 2023-07-09T21:51:25.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.234+0000 7f717affd700 1 -- 172.21.15.53:0/2313310723 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718000c9b0 con 0x7f718406ca10 2023-07-09T21:51:25.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.234+0000 7f717affd700 1 -- 172.21.15.53:0/2313310723 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718000cd40 con 0x7f718406ca10 2023-07-09T21:51:25.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.234+0000 7f718c7ff700 1 -- 172.21.15.53:0/2313310723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c009b30 con 0x7f718406ca10 2023-07-09T21:51:25.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.234+0000 7f718c7ff700 1 -- 172.21.15.53:0/2313310723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71840c68c0 con 0x7f718406ca10 2023-07-09T21:51:25.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.235+0000 7f718c7ff700 1 -- 172.21.15.53:0/2313310723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7184074350 con 0x7f718406ca10 2023-07-09T21:51:25.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.236+0000 7f717affd700 1 -- 172.21.15.53:0/2313310723 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7180013470 con 0x7f718406ca10 2023-07-09T21:51:25.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.237+0000 7f717affd700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f716806ad10 0x7f716806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:25.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.237+0000 7f717affd700 1 -- 172.21.15.53:0/2313310723 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f71800899d0 con 0x7f718406ca10 2023-07-09T21:51:25.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.237+0000 7f7189d9a700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f716806ad10 0x7f716806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:25.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.238+0000 7f7189d9a700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f716806ad10 0x7f716806d1c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f71840aff70 tx=0x7f7174007ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.241+0000 7f717affd700 1 -- 172.21.15.53:0/2313310723 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7180054910 con 0x7f718406ca10 2023-07-09T21:51:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.448+0000 7f718c7ff700 1 -- 172.21.15.53:0/2313310723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f718406f7d0 con 0x7f718406ca10 2023-07-09T21:51:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.448+0000 7f717affd700 1 -- 172.21.15.53:0/2313310723 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f71800210a0 con 0x7f718406ca10 2023-07-09T21:51:25.451 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:51:25.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.451+0000 7f718c7ff700 1 -- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f716806ad10 msgr2=0x7f716806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.451+0000 7f718c7ff700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f716806ad10 0x7f716806d1c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f71840aff70 tx=0x7f7174007ed0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.451+0000 7f718c7ff700 1 -- 172.21.15.53:0/2313310723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f718406ca10 msgr2=0x7f71840c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.451+0000 7f718c7ff700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f718406ca10 0x7f71840c85b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f718000ebe0 tx=0x7f718000eef0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.451+0000 7f718c7ff700 1 -- 172.21.15.53:0/2313310723 shutdown_connections 2023-07-09T21:51:25.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.451+0000 7f718c7ff700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f716806ad10 0x7f716806d1c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.451+0000 7f718c7ff700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71840cda40 0x7f718406f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.451+0000 7f718c7ff700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f718406ca10 0x7f71840c85b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.451+0000 7f718c7ff700 1 --2- 172.21.15.53:0/2313310723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71840cbe40 0x7f7184152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.451+0000 7f718c7ff700 1 -- 172.21.15.53:0/2313310723 >> 172.21.15.53:0/2313310723 conn(0x7f71840b05d0 msgr2=0x7f71841538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:25.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.451+0000 7f718c7ff700 1 -- 172.21.15.53:0/2313310723 shutdown_connections 2023-07-09T21:51:25.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.451+0000 7f718c7ff700 1 -- 172.21.15.53:0/2313310723 wait complete. 2023-07-09T21:51:25.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:51:25.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.672+0000 7fd69ddff700 1 Processor -- start 2023-07-09T21:51:25.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.673+0000 7fd69ddff700 1 -- start start 2023-07-09T21:51:25.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.674+0000 7fd69ddff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd6980d1220 0x7fd6980b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:25.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.674+0000 7fd69ddff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6980b8e80 con 0x7fd6980b3ff0 2023-07-09T21:51:25.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.674+0000 7fd69ddff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6980afaa0 con 0x7fd6980b0e20 2023-07-09T21:51:25.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.674+0000 7fd69ddff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6980afd80 con 0x7fd6980d1220 2023-07-09T21:51:25.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.674+0000 7fd6977fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd6980b3ff0 0x7fd6980d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59028/0 (socket says 172.21.15.53:59028) 2023-07-09T21:51:25.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.674+0000 7fd6977fe700 1 -- 172.21.15.53:0/3692049223 learned_addr learned my addr 172.21.15.53:0/3692049223 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:25.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.674+0000 7fd696ffd700 1 --2- 172.21.15.53:0/3692049223 >> v2:172.21.15.184:3300/0 conn(0x7fd6980d1220 0x7fd6980b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:25.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.674+0000 7fd6967fc700 1 -- 172.21.15.53:0/3692049223 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319531489 0 0) 0x7fd688001110 con 0x7fd6980b3ff0 2023-07-09T21:51:25.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.675+0000 7fd6967fc700 1 -- 172.21.15.53:0/3692049223 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6800035b0 con 0x7fd6980b3ff0 2023-07-09T21:51:25.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.675+0000 7fd696ffd700 1 -- 172.21.15.53:0/3692049223 >> v1:172.21.15.184:6789/0 conn(0x7fd6980b0e20 legacy=0x7fd6980b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.675+0000 7fd696ffd700 1 -- 172.21.15.53:0/3692049223 >> v1:172.21.15.53:6789/0 conn(0x7fd6980b3ff0 legacy=0x7fd6980d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.675+0000 7fd696ffd700 1 -- 172.21.15.53:0/3692049223 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6980b0060 con 0x7fd6980d1220 2023-07-09T21:51:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.675+0000 7fd696ffd700 1 --2- 172.21.15.53:0/3692049223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6980d1220 0x7fd6980b43c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009840 tx=0x7fd68c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a893901c3d791fc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.675+0000 7fd6967fc700 1 -- 172.21.15.53:0/3692049223 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c011830 con 0x7fd6980d1220 2023-07-09T21:51:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.675+0000 7fd6967fc700 1 -- 172.21.15.53:0/3692049223 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c011990 con 0x7fd6980d1220 2023-07-09T21:51:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.675+0000 7fd6967fc700 1 -- 172.21.15.53:0/3692049223 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c011d20 con 0x7fd6980d1220 2023-07-09T21:51:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.676+0000 7fd69ddff700 1 -- 172.21.15.53:0/3692049223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6980d1220 msgr2=0x7fd6980b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.676+0000 7fd69ddff700 1 --2- 172.21.15.53:0/3692049223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6980d1220 0x7fd6980b43c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009840 tx=0x7fd68c009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.676+0000 7fd69ddff700 1 -- 172.21.15.53:0/3692049223 shutdown_connections 2023-07-09T21:51:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.676+0000 7fd69ddff700 1 --2- 172.21.15.53:0/3692049223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6980d1220 0x7fd6980b43c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.676+0000 7fd69ddff700 1 -- 172.21.15.53:0/3692049223 >> 172.21.15.53:0/3692049223 conn(0x7fd69809c1b0 msgr2=0x7fd6980d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.676+0000 7fd69ddff700 1 -- 172.21.15.53:0/3692049223 shutdown_connections 2023-07-09T21:51:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.676+0000 7fd69ddff700 1 -- 172.21.15.53:0/3692049223 wait complete. 2023-07-09T21:51:25.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.678+0000 7fd69ddff700 1 Processor -- start 2023-07-09T21:51:25.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.678+0000 7fd69ddff700 1 -- start start 2023-07-09T21:51:25.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd69ddff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6980b0e20 0x7fd6981f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:25.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd69ddff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6980b3ff0 0x7fd6980cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:25.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd69ddff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980d1220 0x7fd6980ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:25.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd69ddff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd698152990 con 0x7fd6980d1220 2023-07-09T21:51:25.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd69ddff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd698151ea0 con 0x7fd6980b0e20 2023-07-09T21:51:25.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd69ddff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980ca010 con 0x7fd6980b3ff0 2023-07-09T21:51:25.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd697fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980d1220 0x7fd6980ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:25.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd697fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980d1220 0x7fd6980ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53338/0 (socket says 172.21.15.53:53338) 2023-07-09T21:51:25.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd697fff700 1 -- 172.21.15.53:0/2418845203 learned_addr learned my addr 172.21.15.53:0/2418845203 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:25.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd6977fe700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6980b0e20 0x7fd6981f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:25.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd696ffd700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6980b3ff0 0x7fd6980cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:25.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd697fff700 1 -- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6980b3ff0 msgr2=0x7fd6980cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd697fff700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6980b3ff0 0x7fd6980cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd697fff700 1 -- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6980b0e20 msgr2=0x7fd6981f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd697fff700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6980b0e20 0x7fd6981f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd697fff700 1 -- 172.21.15.53:0/2418845203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c0094a0 con 0x7fd6980d1220 2023-07-09T21:51:25.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.679+0000 7fd6977fe700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6980b0e20 0x7fd6981f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:25.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.680+0000 7fd697fff700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980d1220 0x7fd6980ccab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd69000cc80 tx=0x7fd69000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:25.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.680+0000 7fd67ffff700 1 -- 172.21.15.53:0/2418845203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690003c00 con 0x7fd6980d1220 2023-07-09T21:51:25.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.680+0000 7fd67ffff700 1 -- 172.21.15.53:0/2418845203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd690003d60 con 0x7fd6980d1220 2023-07-09T21:51:25.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.680+0000 7fd67ffff700 1 -- 172.21.15.53:0/2418845203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69000ab50 con 0x7fd6980d1220 2023-07-09T21:51:25.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.680+0000 7fd69ddff700 1 -- 172.21.15.53:0/2418845203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6980c73b0 con 0x7fd6980d1220 2023-07-09T21:51:25.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.680+0000 7fd69ddff700 1 -- 172.21.15.53:0/2418845203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6980c7970 con 0x7fd6980d1220 2023-07-09T21:51:25.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.681+0000 7fd69ddff700 1 -- 172.21.15.53:0/2418845203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6980ca230 con 0x7fd6980d1220 2023-07-09T21:51:25.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.682+0000 7fd67ffff700 1 -- 172.21.15.53:0/2418845203 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd69000acb0 con 0x7fd6980d1220 2023-07-09T21:51:25.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.683+0000 7fd67ffff700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd68406ad10 0x7fd68406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:25.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.683+0000 7fd67ffff700 1 -- 172.21.15.53:0/2418845203 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd690089600 con 0x7fd6980d1220 2023-07-09T21:51:25.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.684+0000 7fd6977fe700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd68406ad10 0x7fd68406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:25.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.684+0000 7fd6977fe700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd68406ad10 0x7fd68406d1c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd688001270 tx=0x7fd688009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:25.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.688+0000 7fd67ffff700 1 -- 172.21.15.53:0/2418845203 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd6980ca230 con 0x7fd6980d1220 2023-07-09T21:51:25.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.895+0000 7fd69ddff700 1 -- 172.21.15.53:0/2418845203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6980ca1d0 con 0x7fd6980d1220 2023-07-09T21:51:25.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.895+0000 7fd67ffff700 1 -- 172.21.15.53:0/2418845203 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6900545d0 con 0x7fd6980d1220 2023-07-09T21:51:25.897 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:51:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.898+0000 7fd69ddff700 1 -- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd68406ad10 msgr2=0x7fd68406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.898+0000 7fd69ddff700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd68406ad10 0x7fd68406d1c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd688001270 tx=0x7fd688009040 comp rx=0 tx=0).stop 2023-07-09T21:51:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.898+0000 7fd69ddff700 1 -- 172.21.15.53:0/2418845203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980d1220 msgr2=0x7fd6980ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.898+0000 7fd69ddff700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980d1220 0x7fd6980ccab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd69000cc80 tx=0x7fd69000cf90 comp rx=0 tx=0).stop 2023-07-09T21:51:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.898+0000 7fd69ddff700 1 -- 172.21.15.53:0/2418845203 shutdown_connections 2023-07-09T21:51:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.898+0000 7fd69ddff700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd68406ad10 0x7fd68406d1c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.898+0000 7fd69ddff700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980d1220 0x7fd6980ccab0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.898+0000 7fd69ddff700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6980b0e20 0x7fd6981f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.898+0000 7fd69ddff700 1 --2- 172.21.15.53:0/2418845203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6980b3ff0 0x7fd6980cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.898+0000 7fd69ddff700 1 -- 172.21.15.53:0/2418845203 >> 172.21.15.53:0/2418845203 conn(0x7fd69809c1b0 msgr2=0x7fd6980b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.898+0000 7fd69ddff700 1 -- 172.21.15.53:0/2418845203 shutdown_connections 2023-07-09T21:51:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:25.898+0000 7fd69ddff700 1 -- 172.21.15.53:0/2418845203 wait complete. 2023-07-09T21:51:25.917 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:51:26.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.120+0000 7ff6df1ff700 1 Processor -- start 2023-07-09T21:51:26.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.120+0000 7ff6df1ff700 1 -- start start 2023-07-09T21:51:26.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.121+0000 7ff6df1ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff6d80d1220 0x7ff6d80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:26.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.122+0000 7ff6df1ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80b8e80 con 0x7ff6d80b3ff0 2023-07-09T21:51:26.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.122+0000 7ff6df1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80afaa0 con 0x7ff6d80b0e20 2023-07-09T21:51:26.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.122+0000 7ff6df1ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d80afd80 con 0x7ff6d80d1220 2023-07-09T21:51:26.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.122+0000 7ff6dcf9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff6d80b3ff0 0x7ff6d80d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59034/0 (socket says 172.21.15.53:59034) 2023-07-09T21:51:26.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.122+0000 7ff6dcf9b700 1 -- 172.21.15.53:0/1424034885 learned_addr learned my addr 172.21.15.53:0/1424034885 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:26.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.122+0000 7ff6d7fff700 1 --2- 172.21.15.53:0/1424034885 >> v2:172.21.15.53:3300/0 conn(0x7ff6d80d1220 0x7ff6d80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:26.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.122+0000 7ff6d77fe700 1 -- 172.21.15.53:0/1424034885 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211917158 0 0) 0x7ff6cc001110 con 0x7ff6d80b3ff0 2023-07-09T21:51:26.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.122+0000 7ff6d77fe700 1 -- 172.21.15.53:0/1424034885 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6c80035b0 con 0x7ff6d80b3ff0 2023-07-09T21:51:26.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.122+0000 7ff6d7fff700 1 -- 172.21.15.53:0/1424034885 >> v1:172.21.15.184:6789/0 conn(0x7ff6d80b0e20 legacy=0x7ff6d80b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:26.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.122+0000 7ff6d7fff700 1 -- 172.21.15.53:0/1424034885 >> v1:172.21.15.53:6789/0 conn(0x7ff6d80b3ff0 legacy=0x7ff6d80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:26.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.122+0000 7ff6d7fff700 1 -- 172.21.15.53:0/1424034885 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d80b0060 con 0x7ff6d80d1220 2023-07-09T21:51:26.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.123+0000 7ff6d7fff700 1 --2- 172.21.15.53:0/1424034885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6d80d1220 0x7ff6d80b43c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009840 tx=0x7ff6c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb8f5140717da server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:26.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.123+0000 7ff6d77fe700 1 -- 172.21.15.53:0/1424034885 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4004230 con 0x7ff6d80d1220 2023-07-09T21:51:26.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.123+0000 7ff6d77fe700 1 -- 172.21.15.53:0/1424034885 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c4004390 con 0x7ff6d80d1220 2023-07-09T21:51:26.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.123+0000 7ff6d77fe700 1 -- 172.21.15.53:0/1424034885 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40036c0 con 0x7ff6d80d1220 2023-07-09T21:51:26.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.123+0000 7ff6df1ff700 1 -- 172.21.15.53:0/1424034885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6d80d1220 msgr2=0x7ff6d80b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:26.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.123+0000 7ff6df1ff700 1 --2- 172.21.15.53:0/1424034885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6d80d1220 0x7ff6d80b43c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009840 tx=0x7ff6c4009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:26.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.123+0000 7ff6df1ff700 1 -- 172.21.15.53:0/1424034885 shutdown_connections 2023-07-09T21:51:26.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.123+0000 7ff6df1ff700 1 --2- 172.21.15.53:0/1424034885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6d80d1220 0x7ff6d80b43c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.123+0000 7ff6df1ff700 1 -- 172.21.15.53:0/1424034885 >> 172.21.15.53:0/1424034885 conn(0x7ff6d809c1b0 msgr2=0x7ff6d80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:26.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.124+0000 7ff6df1ff700 1 -- 172.21.15.53:0/1424034885 shutdown_connections 2023-07-09T21:51:26.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.124+0000 7ff6df1ff700 1 -- 172.21.15.53:0/1424034885 wait complete. 2023-07-09T21:51:26.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.126+0000 7ff6df1ff700 1 Processor -- start 2023-07-09T21:51:26.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.126+0000 7ff6df1ff700 1 -- start start 2023-07-09T21:51:26.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.127+0000 7ff6df1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d80b0e20 0x7ff6d80cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:26.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.127+0000 7ff6df1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6d80b3ff0 0x7ff6d80c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:26.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.127+0000 7ff6df1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6d80d1220 0x7ff6d815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:26.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.127+0000 7ff6df1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d815d6c0 con 0x7ff6d80d1220 2023-07-09T21:51:26.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.127+0000 7ff6df1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80d06d0 con 0x7ff6d80b0e20 2023-07-09T21:51:26.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.127+0000 7ff6df1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d815cdb0 con 0x7ff6d80b3ff0 2023-07-09T21:51:26.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.128+0000 7ff6dd79c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6d80d1220 0x7ff6d815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:26.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.128+0000 7ff6dd79c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6d80d1220 0x7ff6d815c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53360/0 (socket says 172.21.15.53:53360) 2023-07-09T21:51:26.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.128+0000 7ff6dd79c700 1 -- 172.21.15.53:0/3358149366 learned_addr learned my addr 172.21.15.53:0/3358149366 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:26.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.128+0000 7ff6d7fff700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6d80b3ff0 0x7ff6d80c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:26.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.128+0000 7ff6dcf9b700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d80b0e20 0x7ff6d80cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:26.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.128+0000 7ff6dd79c700 1 -- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6d80b3ff0 msgr2=0x7ff6d80c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:26.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.128+0000 7ff6dd79c700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6d80b3ff0 0x7ff6d80c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.128+0000 7ff6dd79c700 1 -- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d80b0e20 msgr2=0x7ff6d80cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:26.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.128+0000 7ff6dd79c700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d80b0e20 0x7ff6d80cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.128+0000 7ff6dd79c700 1 -- 172.21.15.53:0/3358149366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40094a0 con 0x7ff6d80d1220 2023-07-09T21:51:26.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.128+0000 7ff6dd79c700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6d80d1220 0x7ff6d815c3e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000cc10 tx=0x7ff6d000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:26.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.129+0000 7ff6d57fa700 1 -- 172.21.15.53:0/3358149366 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000aa60 con 0x7ff6d80d1220 2023-07-09T21:51:26.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.129+0000 7ff6d57fa700 1 -- 172.21.15.53:0/3358149366 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d000abc0 con 0x7ff6d80d1220 2023-07-09T21:51:26.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.129+0000 7ff6df1ff700 1 -- 172.21.15.53:0/3358149366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d80cf690 con 0x7ff6d80d1220 2023-07-09T21:51:26.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.129+0000 7ff6d57fa700 1 -- 172.21.15.53:0/3358149366 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0012420 con 0x7ff6d80d1220 2023-07-09T21:51:26.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.129+0000 7ff6df1ff700 1 -- 172.21.15.53:0/3358149366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d80c6d50 con 0x7ff6d80d1220 2023-07-09T21:51:26.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.130+0000 7ff6df1ff700 1 -- 172.21.15.53:0/3358149366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d8074350 con 0x7ff6d80d1220 2023-07-09T21:51:26.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.131+0000 7ff6d57fa700 1 -- 172.21.15.53:0/3358149366 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6d0012580 con 0x7ff6d80d1220 2023-07-09T21:51:26.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.132+0000 7ff6d57fa700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff6bc06ace0 0x7ff6bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:26.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.132+0000 7ff6d57fa700 1 -- 172.21.15.53:0/3358149366 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff6d00897f0 con 0x7ff6d80d1220 2023-07-09T21:51:26.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.133+0000 7ff6dcf9b700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff6bc06ace0 0x7ff6bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:26.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.134+0000 7ff6dcf9b700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff6bc06ace0 0x7ff6bc06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc007fd0 tx=0x7ff6cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:26.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.136+0000 7ff6d57fa700 1 -- 172.21.15.53:0/3358149366 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff6d00547c0 con 0x7ff6d80d1220 2023-07-09T21:51:26.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.344+0000 7ff6df1ff700 1 -- 172.21.15.53:0/3358149366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6d80d23e0 con 0x7ff6d80d1220 2023-07-09T21:51:26.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.345+0000 7ff6d57fa700 1 -- 172.21.15.53:0/3358149366 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff6d0057de0 con 0x7ff6d80d1220 2023-07-09T21:51:26.346 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:51:26.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.347+0000 7ff6df1ff700 1 -- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff6bc06ace0 msgr2=0x7ff6bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:26.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.347+0000 7ff6df1ff700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff6bc06ace0 0x7ff6bc06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc007fd0 tx=0x7ff6cc009040 comp rx=0 tx=0).stop 2023-07-09T21:51:26.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.347+0000 7ff6df1ff700 1 -- 172.21.15.53:0/3358149366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6d80d1220 msgr2=0x7ff6d815c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:26.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.347+0000 7ff6df1ff700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6d80d1220 0x7ff6d815c3e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000cc10 tx=0x7ff6d000cf20 comp rx=0 tx=0).stop 2023-07-09T21:51:26.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.347+0000 7ff6df1ff700 1 -- 172.21.15.53:0/3358149366 shutdown_connections 2023-07-09T21:51:26.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.347+0000 7ff6df1ff700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff6bc06ace0 0x7ff6bc06d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.347+0000 7ff6df1ff700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6d80d1220 0x7ff6d815c3e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.347+0000 7ff6df1ff700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d80b0e20 0x7ff6d80cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.347+0000 7ff6df1ff700 1 --2- 172.21.15.53:0/3358149366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6d80b3ff0 0x7ff6d80c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.347+0000 7ff6df1ff700 1 -- 172.21.15.53:0/3358149366 >> 172.21.15.53:0/3358149366 conn(0x7ff6d809c1b0 msgr2=0x7ff6d80b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:26.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.348+0000 7ff6df1ff700 1 -- 172.21.15.53:0/3358149366 shutdown_connections 2023-07-09T21:51:26.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.348+0000 7ff6df1ff700 1 -- 172.21.15.53:0/3358149366 wait complete. 2023-07-09T21:51:26.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:51:26.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.567+0000 7ff2227ff700 1 Processor -- start 2023-07-09T21:51:26.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.568+0000 7ff2227ff700 1 -- start start 2023-07-09T21:51:26.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.569+0000 7ff2227ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff21c0d1220 0x7ff21c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:26.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.569+0000 7ff2227ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21c0d2ce0 con 0x7ff21c0b1e00 2023-07-09T21:51:26.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.569+0000 7ff2227ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21c0b3350 con 0x7ff21c0b2350 2023-07-09T21:51:26.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.569+0000 7ff2227ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c0b3630 con 0x7ff21c0d1220 2023-07-09T21:51:26.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.569+0000 7ff21bfff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff21c0b1e00 0x7ff21c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59036/0 (socket says 172.21.15.53:59036) 2023-07-09T21:51:26.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.569+0000 7ff21bfff700 1 -- 172.21.15.53:0/2117864184 learned_addr learned my addr 172.21.15.53:0/2117864184 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.569+0000 7ff21b7fe700 1 --2- 172.21.15.53:0/2117864184 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff21c0d1220 0x7ff21c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.569+0000 7ff21affd700 1 -- 172.21.15.53:0/2117864184 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573109668 0 0) 0x7ff21c0d2ce0 con 0x7ff21c0b1e00 2023-07-09T21:51:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.570+0000 7ff21affd700 1 -- 172.21.15.53:0/2117864184 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2040035b0 con 0x7ff21c0b1e00 2023-07-09T21:51:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.570+0000 7ff21affd700 1 -- 172.21.15.53:0/2117864184 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413347418 0 0) 0x7ff21c0b3350 con 0x7ff21c0b2350 2023-07-09T21:51:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.570+0000 7ff21affd700 1 -- 172.21.15.53:0/2117864184 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff21c0d2ce0 con 0x7ff21c0b2350 2023-07-09T21:51:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.570+0000 7ff21affd700 1 -- 172.21.15.53:0/2117864184 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3579190962 0 0) 0x7ff2040035b0 con 0x7ff21c0b1e00 2023-07-09T21:51:26.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.570+0000 7ff21b7fe700 1 -- 172.21.15.53:0/2117864184 >> v1:172.21.15.184:6789/0 conn(0x7ff21c0b2350 legacy=0x7ff21c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:26.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.570+0000 7ff21b7fe700 1 -- 172.21.15.53:0/2117864184 >> v1:172.21.15.53:6789/0 conn(0x7ff21c0b1e00 legacy=0x7ff21c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:26.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.570+0000 7ff21b7fe700 1 -- 172.21.15.53:0/2117864184 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c0b3910 con 0x7ff21c0d1220 2023-07-09T21:51:26.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.570+0000 7ff21b7fe700 1 --2- 172.21.15.53:0/2117864184 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff21c0d1220 0x7ff21c0b43f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff210009870 tx=0x7ff210009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfbff95eea1d2876 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:26.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.571+0000 7ff21affd700 1 -- 172.21.15.53:0/2117864184 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c005120 con 0x7ff21c0d1220 2023-07-09T21:51:26.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.571+0000 7ff21affd700 1 -- 172.21.15.53:0/2117864184 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff210004030 con 0x7ff21c0d1220 2023-07-09T21:51:26.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.571+0000 7ff21affd700 1 -- 172.21.15.53:0/2117864184 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2100043c0 con 0x7ff21c0d1220 2023-07-09T21:51:26.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.571+0000 7ff2227ff700 1 -- 172.21.15.53:0/2117864184 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff21c0d1220 msgr2=0x7ff21c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:26.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.571+0000 7ff2227ff700 1 --2- 172.21.15.53:0/2117864184 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff21c0d1220 0x7ff21c0b43f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff210009870 tx=0x7ff210009b80 comp rx=0 tx=0).stop 2023-07-09T21:51:26.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.571+0000 7ff2227ff700 1 -- 172.21.15.53:0/2117864184 shutdown_connections 2023-07-09T21:51:26.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.571+0000 7ff2227ff700 1 --2- 172.21.15.53:0/2117864184 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff21c0d1220 0x7ff21c0b43f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.571+0000 7ff2227ff700 1 -- 172.21.15.53:0/2117864184 >> 172.21.15.53:0/2117864184 conn(0x7ff21c09c1d0 msgr2=0x7ff21c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:26.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.571+0000 7ff2227ff700 1 -- 172.21.15.53:0/2117864184 shutdown_connections 2023-07-09T21:51:26.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.571+0000 7ff2227ff700 1 -- 172.21.15.53:0/2117864184 wait complete. 2023-07-09T21:51:26.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.573+0000 7ff2227ff700 1 Processor -- start 2023-07-09T21:51:26.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.573+0000 7ff2227ff700 1 -- start start 2023-07-09T21:51:26.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.574+0000 7ff2227ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff21c0b1e00 0x7ff21c0cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:26.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.574+0000 7ff2227ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff21c0b2350 0x7ff21c1513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:26.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.574+0000 7ff2227ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff21c0d1220 0x7ff21c15d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:26.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.574+0000 7ff2227ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c0ce020 con 0x7ff21c0b1e00 2023-07-09T21:51:26.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.574+0000 7ff2227ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c0ce2c0 con 0x7ff21c0b2350 2023-07-09T21:51:26.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.574+0000 7ff2227ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c0ce5a0 con 0x7ff21c0d1220 2023-07-09T21:51:26.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.574+0000 7ff21bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff21c0b1e00 0x7ff21c0cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:26.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.574+0000 7ff21bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff21c0b1e00 0x7ff21c0cffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53366/0 (socket says 172.21.15.53:53366) 2023-07-09T21:51:26.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.574+0000 7ff21bfff700 1 -- 172.21.15.53:0/3447635726 learned_addr learned my addr 172.21.15.53:0/3447635726 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:26.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.575+0000 7ff21b7fe700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff21c0b2350 0x7ff21c1513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:26.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.575+0000 7ff220d9c700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff21c0d1220 0x7ff21c15d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:26.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.575+0000 7ff21bfff700 1 -- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff21c0d1220 msgr2=0x7ff21c15d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:26.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.575+0000 7ff21bfff700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff21c0d1220 0x7ff21c15d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.575+0000 7ff21bfff700 1 -- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff21c0b2350 msgr2=0x7ff21c1513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:26.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.575+0000 7ff21bfff700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff21c0b2350 0x7ff21c1513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.575+0000 7ff21bfff700 1 -- 172.21.15.53:0/3447635726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100094a0 con 0x7ff21c0b1e00 2023-07-09T21:51:26.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.575+0000 7ff21bfff700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff21c0b1e00 0x7ff21c0cffc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00c750 tx=0x7ff20c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:26.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.575+0000 7ff218ff9700 1 -- 172.21.15.53:0/3447635726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0057f0 con 0x7ff21c0b1e00 2023-07-09T21:51:26.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.575+0000 7ff218ff9700 1 -- 172.21.15.53:0/3447635726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c005950 con 0x7ff21c0b1e00 2023-07-09T21:51:26.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.575+0000 7ff218ff9700 1 -- 172.21.15.53:0/3447635726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c005d00 con 0x7ff21c0b1e00 2023-07-09T21:51:26.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.575+0000 7ff2227ff700 1 -- 172.21.15.53:0/3447635726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21c0ce880 con 0x7ff21c0b1e00 2023-07-09T21:51:26.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.576+0000 7ff2227ff700 1 -- 172.21.15.53:0/3447635726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21c0cbef0 con 0x7ff21c0b1e00 2023-07-09T21:51:26.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.577+0000 7ff2227ff700 1 -- 172.21.15.53:0/3447635726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21c0b3eb0 con 0x7ff21c0b1e00 2023-07-09T21:51:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.577+0000 7ff218ff9700 1 -- 172.21.15.53:0/3447635726 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff20c01c460 con 0x7ff21c0b1e00 2023-07-09T21:51:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.578+0000 7ff218ff9700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff20806ace0 0x7ff20806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.578+0000 7ff218ff9700 1 -- 172.21.15.53:0/3447635726 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff20c089870 con 0x7ff21c0b1e00 2023-07-09T21:51:26.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.579+0000 7ff21b7fe700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff20806ace0 0x7ff20806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:26.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.580+0000 7ff21b7fe700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff20806ace0 0x7ff20806d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0d1610 tx=0x7ff210013040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:26.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.583+0000 7ff218ff9700 1 -- 172.21.15.53:0/3447635726 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff21c0b3eb0 con 0x7ff21c0b1e00 2023-07-09T21:51:26.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.840+0000 7ff2227ff700 1 -- 172.21.15.53:0/3447635726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff21c0b3eb0 con 0x7ff21c0b1e00 2023-07-09T21:51:26.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.840+0000 7ff218ff9700 1 -- 172.21.15.53:0/3447635726 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7ff21c0b3eb0 con 0x7ff21c0b1e00 2023-07-09T21:51:26.842 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:26.842 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3421374491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3421374491},{"type":"v1","addr":"172.21.15.53:6835","nonce":3421374491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1569539203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":1569539203},{"type":"v1","addr":"172.21.15.184:6837","nonce":1569539203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3569510065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3569510065},{"type":"v1","addr":"172.21.15.53:6834","nonce":3569510065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:50:23.272725+0000","modified":"2023-07-09T21:50:26.798670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/3002520227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3002520227},{"type":"v1","addr":"172.21.15.184:6836","nonce":3002520227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:51:26.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.843+0000 7ff2227ff700 1 -- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff20806ace0 msgr2=0x7ff20806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:26.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.843+0000 7ff2227ff700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff20806ace0 0x7ff20806d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0d1610 tx=0x7ff210013040 comp rx=0 tx=0).stop 2023-07-09T21:51:26.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.843+0000 7ff2227ff700 1 -- 172.21.15.53:0/3447635726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff21c0b1e00 msgr2=0x7ff21c0cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:26.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.843+0000 7ff2227ff700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff21c0b1e00 0x7ff21c0cffc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00c750 tx=0x7ff20c00cb10 comp rx=0 tx=0).stop 2023-07-09T21:51:26.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.843+0000 7ff2227ff700 1 -- 172.21.15.53:0/3447635726 shutdown_connections 2023-07-09T21:51:26.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.843+0000 7ff2227ff700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff20806ace0 0x7ff20806d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.843+0000 7ff2227ff700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff21c0d1220 0x7ff21c15d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.843+0000 7ff2227ff700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff21c0b1e00 0x7ff21c0cffc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.843+0000 7ff2227ff700 1 --2- 172.21.15.53:0/3447635726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff21c0b2350 0x7ff21c1513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:26.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.843+0000 7ff2227ff700 1 -- 172.21.15.53:0/3447635726 >> 172.21.15.53:0/3447635726 conn(0x7ff21c09c1d0 msgr2=0x7ff21c0d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:26.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.843+0000 7ff2227ff700 1 -- 172.21.15.53:0/3447635726 shutdown_connections 2023-07-09T21:51:26.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:26.843+0000 7ff2227ff700 1 -- 172.21.15.53:0/3447635726 wait complete. 2023-07-09T21:51:26.846 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 8 2023-07-09T21:51:26.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.061+0000 7fe39e3ff700 1 Processor -- start 2023-07-09T21:51:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.061+0000 7fe39e3ff700 1 -- start start 2023-07-09T21:51:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.063+0000 7fe39e3ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3980b3e90 0x7fe39815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.063+0000 7fe39e3ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3980ce110 con 0x7fe39815ae00 2023-07-09T21:51:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.063+0000 7fe39e3ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39815b660 con 0x7fe39815e890 2023-07-09T21:51:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.063+0000 7fe39e3ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3980ce360 con 0x7fe3980b3e90 2023-07-09T21:51:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.063+0000 7fe3977fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3980b3e90 0x7fe39815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.063+0000 7fe39c99c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe39815ae00 0x7fe398150c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59046/0 (socket says 172.21.15.53:59046) 2023-07-09T21:51:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.063+0000 7fe39c99c700 1 -- 172.21.15.53:0/1674260944 learned_addr learned my addr 172.21.15.53:0/1674260944 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.063+0000 7fe3977fe700 1 -- 172.21.15.53:0/1674260944 >> v1:172.21.15.184:6789/0 conn(0x7fe39815e890 legacy=0x7fe3980b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.063+0000 7fe3977fe700 1 -- 172.21.15.53:0/1674260944 >> v1:172.21.15.53:6789/0 conn(0x7fe39815ae00 legacy=0x7fe398150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.064+0000 7fe3977fe700 1 -- 172.21.15.53:0/1674260944 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3980ce640 con 0x7fe3980b3e90 2023-07-09T21:51:27.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.064+0000 7fe396ffd700 1 -- 172.21.15.53:0/1674260944 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005481888 0 0) 0x7fe3980ce110 con 0x7fe39815ae00 2023-07-09T21:51:27.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.064+0000 7fe3977fe700 1 --2- 172.21.15.53:0/1674260944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3980b3e90 0x7fe39815a8c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009840 tx=0x7fe38c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4697e6ba22fb2ec6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:27.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.064+0000 7fe396ffd700 1 -- 172.21.15.53:0/1674260944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c011830 con 0x7fe3980b3e90 2023-07-09T21:51:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.064+0000 7fe396ffd700 1 -- 172.21.15.53:0/1674260944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c011990 con 0x7fe3980b3e90 2023-07-09T21:51:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.064+0000 7fe396ffd700 1 -- 172.21.15.53:0/1674260944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c011d20 con 0x7fe3980b3e90 2023-07-09T21:51:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.065+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1674260944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3980b3e90 msgr2=0x7fe39815a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.065+0000 7fe39e3ff700 1 --2- 172.21.15.53:0/1674260944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3980b3e90 0x7fe39815a8c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009840 tx=0x7fe38c009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:27.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.065+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1674260944 shutdown_connections 2023-07-09T21:51:27.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.065+0000 7fe39e3ff700 1 --2- 172.21.15.53:0/1674260944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3980b3e90 0x7fe39815a8c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.065+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1674260944 >> 172.21.15.53:0/1674260944 conn(0x7fe398069f30 msgr2=0x7fe39806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:27.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.065+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1674260944 shutdown_connections 2023-07-09T21:51:27.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.065+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1674260944 wait complete. 2023-07-09T21:51:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.066+0000 7fe39e3ff700 1 Processor -- start 2023-07-09T21:51:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.067+0000 7fe39e3ff700 1 -- start start 2023-07-09T21:51:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe39e3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3980b3e90 0x7fe39814ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe39e3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe39815ae00 0x7fe3980af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe39e3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe39815e890 0x7fe398152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe39e3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39814fef0 con 0x7fe39815ae00 2023-07-09T21:51:27.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe39e3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980afab0 con 0x7fe3980b3e90 2023-07-09T21:51:27.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe39e3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980afd90 con 0x7fe39815e890 2023-07-09T21:51:27.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe3977fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe39815ae00 0x7fe3980af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:27.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe397fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3980b3e90 0x7fe39814ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:27.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe3977fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe39815ae00 0x7fe3980af0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53372/0 (socket says 172.21.15.53:53372) 2023-07-09T21:51:27.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe3977fe700 1 -- 172.21.15.53:0/1493791023 learned_addr learned my addr 172.21.15.53:0/1493791023 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:27.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe39c99c700 1 --2- 172.21.15.53:0/1493791023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe39815e890 0x7fe398152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:27.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe3977fe700 1 -- 172.21.15.53:0/1493791023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe39815e890 msgr2=0x7fe398152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:27.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe3977fe700 1 --2- 172.21.15.53:0/1493791023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe39815e890 0x7fe398152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe3977fe700 1 -- 172.21.15.53:0/1493791023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3980b3e90 msgr2=0x7fe39814ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:27.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe3977fe700 1 --2- 172.21.15.53:0/1493791023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3980b3e90 0x7fe39814ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.068+0000 7fe3977fe700 1 -- 172.21.15.53:0/1493791023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c0094a0 con 0x7fe39815ae00 2023-07-09T21:51:27.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.069+0000 7fe3977fe700 1 --2- 172.21.15.53:0/1493791023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe39815ae00 0x7fe3980af0f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0090b0 tx=0x7fe38c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:27.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.069+0000 7fe394ff9700 1 -- 172.21.15.53:0/1493791023 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0045d0 con 0x7fe39815ae00 2023-07-09T21:51:27.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.069+0000 7fe394ff9700 1 -- 172.21.15.53:0/1493791023 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c01f070 con 0x7fe39815ae00 2023-07-09T21:51:27.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.069+0000 7fe394ff9700 1 -- 172.21.15.53:0/1493791023 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0038a0 con 0x7fe39815ae00 2023-07-09T21:51:27.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.069+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1493791023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe398150190 con 0x7fe39815ae00 2023-07-09T21:51:27.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.069+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1493791023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39814ef70 con 0x7fe39815ae00 2023-07-09T21:51:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.070+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1493791023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39804e280 con 0x7fe39815ae00 2023-07-09T21:51:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.071+0000 7fe394ff9700 1 -- 172.21.15.53:0/1493791023 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe38c003a00 con 0x7fe39815ae00 2023-07-09T21:51:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.072+0000 7fe394ff9700 1 --2- 172.21.15.53:0/1493791023 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe38406ace0 0x7fe38406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.073+0000 7fe394ff9700 1 -- 172.21.15.53:0/1493791023 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe38c021070 con 0x7fe39815ae00 2023-07-09T21:51:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.073+0000 7fe397fff700 1 --2- 172.21.15.53:0/1493791023 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe38406ace0 0x7fe38406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.074+0000 7fe397fff700 1 --2- 172.21.15.53:0/1493791023 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe38406ace0 0x7fe38406d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe388007fd0 tx=0x7fe388009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.077+0000 7fe394ff9700 1 -- 172.21.15.53:0/1493791023 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe38c090020 con 0x7fe39815ae00 2023-07-09T21:51:27.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.286+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1493791023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe39806d240 con 0x7fe39815ae00 2023-07-09T21:51:27.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.288+0000 7fe394ff9700 1 -- 172.21.15.53:0/1493791023 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fe38c055f30 con 0x7fe39815ae00 2023-07-09T21:51:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:27.290 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:04.650456+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.290+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1493791023 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe38406ace0 msgr2=0x7fe38406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.290+0000 7fe39e3ff700 1 --2- 172.21.15.53:0/1493791023 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe38406ace0 0x7fe38406d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe388007fd0 tx=0x7fe388009040 comp rx=0 tx=0).stop 2023-07-09T21:51:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.290+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1493791023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe39815ae00 msgr2=0x7fe3980af0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.290+0000 7fe39e3ff700 1 --2- 172.21.15.53:0/1493791023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe39815ae00 0x7fe3980af0f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0090b0 tx=0x7fe38c004750 comp rx=0 tx=0).stop 2023-07-09T21:51:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.290+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1493791023 shutdown_connections 2023-07-09T21:51:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.290+0000 7fe39e3ff700 1 --2- 172.21.15.53:0/1493791023 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe38406ace0 0x7fe38406d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.290+0000 7fe39e3ff700 1 --2- 172.21.15.53:0/1493791023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe39815e890 0x7fe398152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.290+0000 7fe39e3ff700 1 --2- 172.21.15.53:0/1493791023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3980b3e90 0x7fe39814ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.290+0000 7fe39e3ff700 1 --2- 172.21.15.53:0/1493791023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe39815ae00 0x7fe3980af0f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.290+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1493791023 >> 172.21.15.53:0/1493791023 conn(0x7fe398069f30 msgr2=0x7fe3980ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:27.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.290+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1493791023 shutdown_connections 2023-07-09T21:51:27.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.290+0000 7fe39e3ff700 1 -- 172.21.15.53:0/1493791023 wait complete. 2023-07-09T21:51:27.310 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T21:51:27.310 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:51:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.509+0000 7fe7d27ff700 1 Processor -- start 2023-07-09T21:51:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.509+0000 7fe7d27ff700 1 -- start start 2023-07-09T21:51:27.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.510+0000 7fe7d27ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe7cc0b3e90 0x7fe7cc15a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:27.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.510+0000 7fe7d27ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7cc0ce110 con 0x7fe7cc15ae00 2023-07-09T21:51:27.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.511+0000 7fe7d27ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7cc15b660 con 0x7fe7cc15e890 2023-07-09T21:51:27.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.511+0000 7fe7d27ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7cc0ce360 con 0x7fe7cc0b3e90 2023-07-09T21:51:27.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.511+0000 7fe7cb7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe7cc0b3e90 0x7fe7cc15a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:27.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.511+0000 7fe7d0d9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe7cc15ae00 0x7fe7cc150c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59052/0 (socket says 172.21.15.53:59052) 2023-07-09T21:51:27.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.511+0000 7fe7d0d9c700 1 -- 172.21.15.53:0/1877072979 learned_addr learned my addr 172.21.15.53:0/1877072979 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.511+0000 7fe7caffd700 1 -- 172.21.15.53:0/1877072979 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240367099 0 0) 0x7fe7cc0ce110 con 0x7fe7cc15ae00 2023-07-09T21:51:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.511+0000 7fe7cb7fe700 1 -- 172.21.15.53:0/1877072979 >> v1:172.21.15.184:6789/0 conn(0x7fe7cc15e890 legacy=0x7fe7cc0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.511+0000 7fe7cb7fe700 1 -- 172.21.15.53:0/1877072979 >> v1:172.21.15.53:6789/0 conn(0x7fe7cc15ae00 legacy=0x7fe7cc150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.511+0000 7fe7cb7fe700 1 -- 172.21.15.53:0/1877072979 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc0ce640 con 0x7fe7cc0b3e90 2023-07-09T21:51:27.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.512+0000 7fe7cb7fe700 1 --2- 172.21.15.53:0/1877072979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7cc0b3e90 0x7fe7cc15a8c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009840 tx=0x7fe7c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d88044e23c24f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:27.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.512+0000 7fe7caffd700 1 -- 172.21.15.53:0/1877072979 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0011830 con 0x7fe7cc0b3e90 2023-07-09T21:51:27.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.512+0000 7fe7caffd700 1 -- 172.21.15.53:0/1877072979 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c0011990 con 0x7fe7cc0b3e90 2023-07-09T21:51:27.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.512+0000 7fe7caffd700 1 -- 172.21.15.53:0/1877072979 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0011d20 con 0x7fe7cc0b3e90 2023-07-09T21:51:27.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.512+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1877072979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7cc0b3e90 msgr2=0x7fe7cc15a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:27.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.512+0000 7fe7d27ff700 1 --2- 172.21.15.53:0/1877072979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7cc0b3e90 0x7fe7cc15a8c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009840 tx=0x7fe7c0009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:27.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.512+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1877072979 shutdown_connections 2023-07-09T21:51:27.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.512+0000 7fe7d27ff700 1 --2- 172.21.15.53:0/1877072979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7cc0b3e90 0x7fe7cc15a8c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.512+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1877072979 >> 172.21.15.53:0/1877072979 conn(0x7fe7cc069f30 msgr2=0x7fe7cc06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:27.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.513+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1877072979 shutdown_connections 2023-07-09T21:51:27.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.513+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1877072979 wait complete. 2023-07-09T21:51:27.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.514+0000 7fe7d27ff700 1 Processor -- start 2023-07-09T21:51:27.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.515+0000 7fe7d27ff700 1 -- start start 2023-07-09T21:51:27.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.515+0000 7fe7d27ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7cc0b3e90 0x7fe7cc13b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:27.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.515+0000 7fe7d27ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7cc15ae00 0x7fe7cc1e5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:27.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7d27ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc15e890 0x7fe7cc159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:27.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7d27ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc1e6bf0 con 0x7fe7cc15ae00 2023-07-09T21:51:27.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7d27ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc1e6630 con 0x7fe7cc15e890 2023-07-09T21:51:27.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7d27ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc1e6910 con 0x7fe7cc0b3e90 2023-07-09T21:51:27.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7cb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7cc15ae00 0x7fe7cc1e5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:27.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7cb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7cc15ae00 0x7fe7cc1e5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53394/0 (socket says 172.21.15.53:53394) 2023-07-09T21:51:27.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7cb7fe700 1 -- 172.21.15.53:0/1078920122 learned_addr learned my addr 172.21.15.53:0/1078920122 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:27.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7cbfff700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7cc0b3e90 0x7fe7cc13b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:27.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7d0d9c700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc15e890 0x7fe7cc159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:27.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7cb7fe700 1 -- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7cc0b3e90 msgr2=0x7fe7cc13b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:27.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7cb7fe700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7cc0b3e90 0x7fe7cc13b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7cb7fe700 1 -- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc15e890 msgr2=0x7fe7cc159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:27.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7cb7fe700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc15e890 0x7fe7cc159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.516+0000 7fe7cb7fe700 1 -- 172.21.15.53:0/1078920122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c00094a0 con 0x7fe7cc15ae00 2023-07-09T21:51:27.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.517+0000 7fe7cb7fe700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7cc15ae00 0x7fe7cc1e5d50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00090b0 tx=0x7fe7c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:27.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.517+0000 7fe7c8ff9700 1 -- 172.21.15.53:0/1078920122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c001a7e0 con 0x7fe7cc15ae00 2023-07-09T21:51:27.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.517+0000 7fe7c8ff9700 1 -- 172.21.15.53:0/1078920122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c001a940 con 0x7fe7cc15ae00 2023-07-09T21:51:27.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.517+0000 7fe7c8ff9700 1 -- 172.21.15.53:0/1078920122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c001acb0 con 0x7fe7cc15ae00 2023-07-09T21:51:27.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.517+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1078920122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7cc13a930 con 0x7fe7cc15ae00 2023-07-09T21:51:27.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.517+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1078920122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7cc13b670 con 0x7fe7cc15ae00 2023-07-09T21:51:27.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.518+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1078920122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7cc13ae50 con 0x7fe7cc15ae00 2023-07-09T21:51:27.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.519+0000 7fe7c8ff9700 1 -- 172.21.15.53:0/1078920122 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe7c0022070 con 0x7fe7cc15ae00 2023-07-09T21:51:27.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.521+0000 7fe7c8ff9700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe7b806ace0 0x7fe7b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:27.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.521+0000 7fe7c8ff9700 1 -- 172.21.15.53:0/1078920122 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe7c008a2c0 con 0x7fe7cc15ae00 2023-07-09T21:51:27.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.521+0000 7fe7cbfff700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe7b806ace0 0x7fe7b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:27.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.522+0000 7fe7cbfff700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe7b806ace0 0x7fe7b806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc007fd0 tx=0x7fe7bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:27.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.525+0000 7fe7c8ff9700 1 -- 172.21.15.53:0/1078920122 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe7cc13ae50 con 0x7fe7cc15ae00 2023-07-09T21:51:27.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.783+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1078920122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7cc13ae50 con 0x7fe7cc15ae00 2023-07-09T21:51:27.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.783+0000 7fe7c8ff9700 1 -- 172.21.15.53:0/1078920122 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7fe7cc13ae50 con 0x7fe7cc15ae00 2023-07-09T21:51:27.785 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:27.785 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3421374491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3421374491},{"type":"v1","addr":"172.21.15.53:6835","nonce":3421374491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1569539203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":1569539203},{"type":"v1","addr":"172.21.15.184:6837","nonce":1569539203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3569510065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3569510065},{"type":"v1","addr":"172.21.15.53:6834","nonce":3569510065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:50:23.272725+0000","modified":"2023-07-09T21:50:26.798670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/3002520227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3002520227},{"type":"v1","addr":"172.21.15.184:6836","nonce":3002520227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:51:27.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.786+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe7b806ace0 msgr2=0x7fe7b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:27.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.786+0000 7fe7d27ff700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe7b806ace0 0x7fe7b806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc007fd0 tx=0x7fe7bc009040 comp rx=0 tx=0).stop 2023-07-09T21:51:27.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.786+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1078920122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7cc15ae00 msgr2=0x7fe7cc1e5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:27.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.786+0000 7fe7d27ff700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7cc15ae00 0x7fe7cc1e5d50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00090b0 tx=0x7fe7c0004750 comp rx=0 tx=0).stop 2023-07-09T21:51:27.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.786+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1078920122 shutdown_connections 2023-07-09T21:51:27.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.786+0000 7fe7d27ff700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe7b806ace0 0x7fe7b806d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.786+0000 7fe7d27ff700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc15e890 0x7fe7cc159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.786+0000 7fe7d27ff700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7cc0b3e90 0x7fe7cc13b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.786+0000 7fe7d27ff700 1 --2- 172.21.15.53:0/1078920122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7cc15ae00 0x7fe7cc1e5d50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:27.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.786+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1078920122 >> 172.21.15.53:0/1078920122 conn(0x7fe7cc069f30 msgr2=0x7fe7cc15ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:27.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.786+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1078920122 shutdown_connections 2023-07-09T21:51:27.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:27.786+0000 7fe7d27ff700 1 -- 172.21.15.53:0/1078920122 wait complete. 2023-07-09T21:51:27.789 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 8 2023-07-09T21:51:27.807 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:51:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.006+0000 7f13115ff700 1 Processor -- start 2023-07-09T21:51:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.006+0000 7f13115ff700 1 -- start start 2023-07-09T21:51:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.007+0000 7f13115ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f130c0b1e00 0x7f130c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.007+0000 7f13115ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f130c0b2350 0x7f130c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.008+0000 7f13115ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130c0d2ce0 con 0x7f130c0d1050 2023-07-09T21:51:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.008+0000 7f13115ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130c0d14d0 con 0x7f130c0b1e00 2023-07-09T21:51:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.008+0000 7f13115ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130c0b3350 con 0x7f130c0b2350 2023-07-09T21:51:28.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.008+0000 7f130affd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f130c0b1e00 0x7f130c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.008+0000 7f130affd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f130c0b1e00 0x7f130c0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53406/0 (socket says 172.21.15.53:53406) 2023-07-09T21:51:28.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.008+0000 7f130affd700 1 -- 172.21.15.53:0/105507506 learned_addr learned my addr 172.21.15.53:0/105507506 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:28.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.008+0000 7f130a7fc700 1 --2- 172.21.15.53:0/105507506 >> v2:172.21.15.184:3300/0 conn(0x7f130c0b2350 0x7f130c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.008+0000 7f130affd700 1 -- 172.21.15.53:0/105507506 >> v2:172.21.15.184:3300/0 conn(0x7f130c0b2350 msgr2=0x7f130c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:28.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.008+0000 7f130affd700 1 --2- 172.21.15.53:0/105507506 >> v2:172.21.15.184:3300/0 conn(0x7f130c0b2350 0x7f130c0d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.008+0000 7f130affd700 1 -- 172.21.15.53:0/105507506 >> v1:172.21.15.184:6789/0 conn(0x7f130c0d1050 legacy=0x7f130c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.008+0000 7f130affd700 1 -- 172.21.15.53:0/105507506 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c0b3630 con 0x7f130c0b1e00 2023-07-09T21:51:28.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.009+0000 7f130affd700 1 --2- 172.21.15.53:0/105507506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f130c0b1e00 0x7f130c0b43f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f130c072140 tx=0x7f12fc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede926c2943e81e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:28.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.009+0000 7f1309ffb700 1 -- 172.21.15.53:0/105507506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc005e30 con 0x7f130c0b1e00 2023-07-09T21:51:28.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.009+0000 7f1309ffb700 1 -- 172.21.15.53:0/105507506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc004030 con 0x7f130c0b1e00 2023-07-09T21:51:28.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.009+0000 7f1309ffb700 1 -- 172.21.15.53:0/105507506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0043e0 con 0x7f130c0b1e00 2023-07-09T21:51:28.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.009+0000 7f13115ff700 1 -- 172.21.15.53:0/105507506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f130c0b1e00 msgr2=0x7f130c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.009+0000 7f13115ff700 1 --2- 172.21.15.53:0/105507506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f130c0b1e00 0x7f130c0b43f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f130c072140 tx=0x7f12fc009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.009+0000 7f13115ff700 1 -- 172.21.15.53:0/105507506 shutdown_connections 2023-07-09T21:51:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.009+0000 7f13115ff700 1 --2- 172.21.15.53:0/105507506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f130c0b1e00 0x7f130c0b43f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.009+0000 7f13115ff700 1 --2- 172.21.15.53:0/105507506 >> v2:172.21.15.184:3300/0 conn(0x7f130c0b2350 0x7f130c0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.009+0000 7f13115ff700 1 -- 172.21.15.53:0/105507506 >> 172.21.15.53:0/105507506 conn(0x7f130c09c1d0 msgr2=0x7f130c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.009+0000 7f13115ff700 1 -- 172.21.15.53:0/105507506 shutdown_connections 2023-07-09T21:51:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.010+0000 7f13115ff700 1 -- 172.21.15.53:0/105507506 wait complete. 2023-07-09T21:51:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.011+0000 7f13115ff700 1 Processor -- start 2023-07-09T21:51:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.011+0000 7f13115ff700 1 -- start start 2023-07-09T21:51:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.012+0000 7f13115ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f130c0b1e00 0x7f130c15b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.012+0000 7f13115ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f130c0b2350 0x7f130c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.012+0000 7f13115ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f130c0d1050 0x7f130c0b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.012+0000 7f13115ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c0d0390 con 0x7f130c0b1e00 2023-07-09T21:51:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.012+0000 7f13115ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c0c92e0 con 0x7f130c0b2350 2023-07-09T21:51:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.012+0000 7f13115ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c15bcb0 con 0x7f130c0d1050 2023-07-09T21:51:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f130affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f130c0b1e00 0x7f130c15b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f130affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f130c0b1e00 0x7f130c15b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53410/0 (socket says 172.21.15.53:53410) 2023-07-09T21:51:28.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f130affd700 1 -- 172.21.15.53:0/568388469 learned_addr learned my addr 172.21.15.53:0/568388469 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:28.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f130a7fc700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f130c0b2350 0x7f130c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f130b7fe700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f130c0d1050 0x7f130c0b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f130affd700 1 -- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f130c0d1050 msgr2=0x7f130c0b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f130affd700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f130c0d1050 0x7f130c0b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f130affd700 1 -- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f130c0b2350 msgr2=0x7f130c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f130affd700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f130c0b2350 0x7f130c0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f130affd700 1 -- 172.21.15.53:0/568388469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc009500 con 0x7f130c0b1e00 2023-07-09T21:51:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f130a7fc700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f130c0b2350 0x7f130c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f130affd700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f130c0b1e00 0x7f130c15b770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f12fc004000 tx=0x7f12fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f12f37fe700 1 -- 172.21.15.53:0/568388469 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc003e10 con 0x7f130c0b1e00 2023-07-09T21:51:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f12f37fe700 1 -- 172.21.15.53:0/568388469 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc01d430 con 0x7f130c0b1e00 2023-07-09T21:51:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f12f37fe700 1 -- 172.21.15.53:0/568388469 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc01d7e0 con 0x7f130c0b1e00 2023-07-09T21:51:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.013+0000 7f13115ff700 1 -- 172.21.15.53:0/568388469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130c0c8240 con 0x7f130c0b1e00 2023-07-09T21:51:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.014+0000 7f13115ff700 1 -- 172.21.15.53:0/568388469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c0c8800 con 0x7f130c0b1e00 2023-07-09T21:51:28.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.015+0000 7f13115ff700 1 -- 172.21.15.53:0/568388469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130c0b38f0 con 0x7f130c0b1e00 2023-07-09T21:51:28.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.015+0000 7f12f37fe700 1 -- 172.21.15.53:0/568388469 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f12fc01d940 con 0x7f130c0b1e00 2023-07-09T21:51:28.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.016+0000 7f12f37fe700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f12f806ace0 0x7f12f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.016+0000 7f12f37fe700 1 -- 172.21.15.53:0/568388469 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f12fc08aa40 con 0x7f130c0b1e00 2023-07-09T21:51:28.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.017+0000 7f130a7fc700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f12f806ace0 0x7f12f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.018+0000 7f130a7fc700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f12f806ace0 0x7f12f806d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f130000ba70 tx=0x7f1300008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:28.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.020+0000 7f12f37fe700 1 -- 172.21.15.53:0/568388469 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f130c0b38f0 con 0x7f130c0b1e00 2023-07-09T21:51:28.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.271+0000 7f13115ff700 1 -- 172.21.15.53:0/568388469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f130c0b38f0 con 0x7f130c0b1e00 2023-07-09T21:51:28.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.271+0000 7f12f37fe700 1 -- 172.21.15.53:0/568388469 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7f130c0b38f0 con 0x7f130c0b1e00 2023-07-09T21:51:28.273 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:28.273 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3421374491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3421374491},{"type":"v1","addr":"172.21.15.53:6835","nonce":3421374491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1569539203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":1569539203},{"type":"v1","addr":"172.21.15.184:6837","nonce":1569539203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3569510065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3569510065},{"type":"v1","addr":"172.21.15.53:6834","nonce":3569510065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:50:23.272725+0000","modified":"2023-07-09T21:50:26.798670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/3002520227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3002520227},{"type":"v1","addr":"172.21.15.184:6836","nonce":3002520227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:51:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.273+0000 7f13115ff700 1 -- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f12f806ace0 msgr2=0x7f12f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.274+0000 7f13115ff700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f12f806ace0 0x7f12f806d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f130000ba70 tx=0x7f1300008040 comp rx=0 tx=0).stop 2023-07-09T21:51:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.274+0000 7f13115ff700 1 -- 172.21.15.53:0/568388469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f130c0b1e00 msgr2=0x7f130c15b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.274+0000 7f13115ff700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f130c0b1e00 0x7f130c15b770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f12fc004000 tx=0x7f12fc004750 comp rx=0 tx=0).stop 2023-07-09T21:51:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.274+0000 7f13115ff700 1 -- 172.21.15.53:0/568388469 shutdown_connections 2023-07-09T21:51:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.274+0000 7f13115ff700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f12f806ace0 0x7f12f806d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.274+0000 7f13115ff700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f130c0d1050 0x7f130c0b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.274+0000 7f13115ff700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f130c0b1e00 0x7f130c15b770 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.274+0000 7f13115ff700 1 --2- 172.21.15.53:0/568388469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f130c0b2350 0x7f130c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.274+0000 7f13115ff700 1 -- 172.21.15.53:0/568388469 >> 172.21.15.53:0/568388469 conn(0x7f130c09c1d0 msgr2=0x7f130c0b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.274+0000 7f13115ff700 1 -- 172.21.15.53:0/568388469 shutdown_connections 2023-07-09T21:51:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.274+0000 7f13115ff700 1 -- 172.21.15.53:0/568388469 wait complete. 2023-07-09T21:51:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 8 2023-07-09T21:51:28.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:28.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.491+0000 7f67819ff700 1 Processor -- start 2023-07-09T21:51:28.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.491+0000 7f67819ff700 1 -- start start 2023-07-09T21:51:28.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.492+0000 7f67819ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c0b1e00 0x7f677c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.492+0000 7f67819ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f677c0d1220 0x7f677c0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.492+0000 7f67819ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677c0d2ce0 con 0x7f677c0b2350 2023-07-09T21:51:28.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.492+0000 7f67819ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677c0b3350 con 0x7f677c0d1220 2023-07-09T21:51:28.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.492+0000 7f67819ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c0b3630 con 0x7f677c0b1e00 2023-07-09T21:51:28.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.493+0000 7f677b7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f677c0d1220 0x7f677c0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.493+0000 7f677a7fc700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f677c0b2350 0x7f677c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59058/0 (socket says 172.21.15.53:59058) 2023-07-09T21:51:28.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.493+0000 7f677a7fc700 1 -- 172.21.15.53:0/3298299711 learned_addr learned my addr 172.21.15.53:0/3298299711 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:28.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.493+0000 7f677affd700 1 --2- 172.21.15.53:0/3298299711 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c0b1e00 0x7f677c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.493+0000 7f677b7fe700 1 -- 172.21.15.53:0/3298299711 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c0b1e00 msgr2=0x7f677c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:28.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.493+0000 7f677b7fe700 1 --2- 172.21.15.53:0/3298299711 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c0b1e00 0x7f677c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.493+0000 7f677b7fe700 1 -- 172.21.15.53:0/3298299711 >> v1:172.21.15.53:6789/0 conn(0x7f677c0b2350 legacy=0x7f677c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.493+0000 7f677b7fe700 1 -- 172.21.15.53:0/3298299711 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c0b3910 con 0x7f677c0d1220 2023-07-09T21:51:28.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.493+0000 7f6779ffb700 1 -- 172.21.15.53:0/3298299711 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609730716 0 0) 0x7f677c0d2ce0 con 0x7f677c0b2350 2023-07-09T21:51:28.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.493+0000 7f677b7fe700 1 --2- 172.21.15.53:0/3298299711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677c0d1220 0x7f677c0afac0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6774009d90 tx=0x7f677400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7317c2476d4a7d78 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:28.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.494+0000 7f6779ffb700 1 -- 172.21.15.53:0/3298299711 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400e070 con 0x7f677c0d1220 2023-07-09T21:51:28.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.494+0000 7f6779ffb700 1 -- 172.21.15.53:0/3298299711 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677400bbd0 con 0x7f677c0d1220 2023-07-09T21:51:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.494+0000 7f6779ffb700 1 -- 172.21.15.53:0/3298299711 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774012430 con 0x7f677c0d1220 2023-07-09T21:51:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.494+0000 7f67819ff700 1 -- 172.21.15.53:0/3298299711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677c0d1220 msgr2=0x7f677c0afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.494+0000 7f67819ff700 1 --2- 172.21.15.53:0/3298299711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677c0d1220 0x7f677c0afac0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6774009d90 tx=0x7f677400b330 comp rx=0 tx=0).stop 2023-07-09T21:51:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.494+0000 7f67819ff700 1 -- 172.21.15.53:0/3298299711 shutdown_connections 2023-07-09T21:51:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.494+0000 7f67819ff700 1 --2- 172.21.15.53:0/3298299711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677c0d1220 0x7f677c0afac0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.494+0000 7f67819ff700 1 --2- 172.21.15.53:0/3298299711 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c0b1e00 0x7f677c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.494+0000 7f67819ff700 1 -- 172.21.15.53:0/3298299711 >> 172.21.15.53:0/3298299711 conn(0x7f677c09c1d0 msgr2=0x7f677c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:28.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.494+0000 7f67819ff700 1 -- 172.21.15.53:0/3298299711 shutdown_connections 2023-07-09T21:51:28.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.494+0000 7f67819ff700 1 -- 172.21.15.53:0/3298299711 wait complete. 2023-07-09T21:51:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.497+0000 7f67819ff700 1 Processor -- start 2023-07-09T21:51:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.497+0000 7f67819ff700 1 -- start start 2023-07-09T21:51:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.498+0000 7f67819ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f677c0b1e00 0x7f677c0c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.498+0000 7f67819ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677c0b2350 0x7f677c0c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.498+0000 7f67819ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c0d1220 0x7f677c0cf250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.498+0000 7f67819ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c0c8d60 con 0x7f677c0b2350 2023-07-09T21:51:28.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.498+0000 7f67819ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c0c8830 con 0x7f677c0b1e00 2023-07-09T21:51:28.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.498+0000 7f67819ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c0cedc0 con 0x7f677c0d1220 2023-07-09T21:51:28.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f677a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677c0b2350 0x7f677c0c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f677a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677c0b2350 0x7f677c0c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53428/0 (socket says 172.21.15.53:53428) 2023-07-09T21:51:28.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f677a7fc700 1 -- 172.21.15.53:0/1725543258 learned_addr learned my addr 172.21.15.53:0/1725543258 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:28.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f677affd700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f677c0b1e00 0x7f677c0c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f677b7fe700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c0d1220 0x7f677c0cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f677a7fc700 1 -- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c0d1220 msgr2=0x7f677c0cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f677a7fc700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c0d1220 0x7f677c0cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f677a7fc700 1 -- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f677c0b1e00 msgr2=0x7f677c0c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f677a7fc700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f677c0b1e00 0x7f677c0c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f677a7fc700 1 -- 172.21.15.53:0/1725543258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774009a70 con 0x7f677c0b2350 2023-07-09T21:51:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f677affd700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f677c0b1e00 0x7f677c0c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f677b7fe700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c0d1220 0x7f677c0cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f677a7fc700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677c0b2350 0x7f677c0c7480 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f67700011e0 tx=0x7f677000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.499+0000 7f6763fff700 1 -- 172.21.15.53:0/1725543258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770004c80 con 0x7f677c0b2350 2023-07-09T21:51:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.500+0000 7f6763fff700 1 -- 172.21.15.53:0/1725543258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6770004e00 con 0x7f677c0b2350 2023-07-09T21:51:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.500+0000 7f6763fff700 1 -- 172.21.15.53:0/1725543258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770007310 con 0x7f677c0b2350 2023-07-09T21:51:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.500+0000 7f67819ff700 1 -- 172.21.15.53:0/1725543258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677c152260 con 0x7f677c0b2350 2023-07-09T21:51:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.500+0000 7f67819ff700 1 -- 172.21.15.53:0/1725543258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c0c8a80 con 0x7f677c0b2350 2023-07-09T21:51:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.501+0000 7f67819ff700 1 -- 172.21.15.53:0/1725543258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677c04e280 con 0x7f677c0b2350 2023-07-09T21:51:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.502+0000 7f6763fff700 1 -- 172.21.15.53:0/1725543258 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6770007470 con 0x7f677c0b2350 2023-07-09T21:51:28.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.502+0000 7f6763fff700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f676806ace0 0x7f676806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.503+0000 7f6763fff700 1 -- 172.21.15.53:0/1725543258 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f67700892e0 con 0x7f677c0b2350 2023-07-09T21:51:28.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.503+0000 7f677affd700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f676806ace0 0x7f676806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.504+0000 7f677affd700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f676806ace0 0x7f676806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f676c006fd0 tx=0x7f676c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:28.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.507+0000 7f6763fff700 1 -- 172.21.15.53:0/1725543258 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f67700542b0 con 0x7f677c0b2350 2023-07-09T21:51:28.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.717+0000 7f67819ff700 1 -- 172.21.15.53:0/1725543258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f677c0b3bc0 con 0x7f677c0b2350 2023-07-09T21:51:28.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.718+0000 7f6763fff700 1 -- 172.21.15.53:0/1725543258 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f67700578d0 con 0x7f677c0b2350 2023-07-09T21:51:28.720 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:28.720 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:04.650456+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:50:21.703759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:50:22.243698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:28.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.721+0000 7f67819ff700 1 -- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f676806ace0 msgr2=0x7f676806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.721+0000 7f67819ff700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f676806ace0 0x7f676806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f676c006fd0 tx=0x7f676c008040 comp rx=0 tx=0).stop 2023-07-09T21:51:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.721+0000 7f67819ff700 1 -- 172.21.15.53:0/1725543258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677c0b2350 msgr2=0x7f677c0c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.721+0000 7f67819ff700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677c0b2350 0x7f677c0c7480 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f67700011e0 tx=0x7f677000cae0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.721+0000 7f67819ff700 1 -- 172.21.15.53:0/1725543258 shutdown_connections 2023-07-09T21:51:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.721+0000 7f67819ff700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f676806ace0 0x7f676806d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.721+0000 7f67819ff700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c0d1220 0x7f677c0cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.721+0000 7f67819ff700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f677c0b1e00 0x7f677c0c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.721+0000 7f67819ff700 1 --2- 172.21.15.53:0/1725543258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677c0b2350 0x7f677c0c7480 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.721+0000 7f67819ff700 1 -- 172.21.15.53:0/1725543258 >> 172.21.15.53:0/1725543258 conn(0x7f677c09c1d0 msgr2=0x7f677c0b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:28.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.721+0000 7f67819ff700 1 -- 172.21.15.53:0/1725543258 shutdown_connections 2023-07-09T21:51:28.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.721+0000 7f67819ff700 1 -- 172.21.15.53:0/1725543258 wait complete. 2023-07-09T21:51:28.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T21:51:28.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.941+0000 7f17ca5ff700 1 Processor -- start 2023-07-09T21:51:28.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.941+0000 7f17ca5ff700 1 -- start start 2023-07-09T21:51:28.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.942+0000 7f17ca5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c40b3ff0 0x7f17c40b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.942+0000 7f17ca5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f17c40d0f60 0x7f17c40b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.942+0000 7f17ca5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c40b8e80 con 0x7f17c40d0b10 2023-07-09T21:51:28.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.942+0000 7f17ca5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c40b1e30 con 0x7f17c40d0f60 2023-07-09T21:51:28.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.942+0000 7f17ca5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40afaa0 con 0x7f17c40b3ff0 2023-07-09T21:51:28.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.943+0000 7f17c8b9c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f17c40d0f60 0x7f17c40b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.943+0000 7f17c3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c40b3ff0 0x7f17c40b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.943+0000 7f17c8b9c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f17c40d0f60 0x7f17c40b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:58904/0 (socket says 172.21.15.53:58904) 2023-07-09T21:51:28.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.943+0000 7f17c8b9c700 1 -- 172.21.15.53:0/2536045926 learned_addr learned my addr 172.21.15.53:0/2536045926 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:28.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.943+0000 7f17c3fff700 1 -- 172.21.15.53:0/2536045926 >> v2:172.21.15.184:3300/0 conn(0x7f17c40d0f60 msgr2=0x7f17c40b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:28.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.943+0000 7f17c3fff700 1 --2- 172.21.15.53:0/2536045926 >> v2:172.21.15.184:3300/0 conn(0x7f17c40d0f60 0x7f17c40b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.943+0000 7f17c3fff700 1 -- 172.21.15.53:0/2536045926 >> v1:172.21.15.184:6789/0 conn(0x7f17c40d0b10 legacy=0x7f17c40b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.943+0000 7f17c2ffd700 1 -- 172.21.15.53:0/2536045926 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825428248 0 0) 0x7f17b8001110 con 0x7f17c40d0b10 2023-07-09T21:51:28.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.943+0000 7f17c3fff700 1 -- 172.21.15.53:0/2536045926 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c40afd80 con 0x7f17c40b3ff0 2023-07-09T21:51:28.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.943+0000 7f17c8b9c700 1 --2- 172.21.15.53:0/2536045926 >> v2:172.21.15.184:3300/0 conn(0x7f17c40d0f60 0x7f17c40b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:28.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.944+0000 7f17c3fff700 1 --2- 172.21.15.53:0/2536045926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c40b3ff0 0x7f17c40b43c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009840 tx=0x7f17b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f99ba3f6cc00f93 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:28.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.944+0000 7f17c2ffd700 1 -- 172.21.15.53:0/2536045926 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4011830 con 0x7f17c40b3ff0 2023-07-09T21:51:28.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.944+0000 7f17c2ffd700 1 -- 172.21.15.53:0/2536045926 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b4011990 con 0x7f17c40b3ff0 2023-07-09T21:51:28.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.944+0000 7f17c2ffd700 1 -- 172.21.15.53:0/2536045926 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4011d20 con 0x7f17c40b3ff0 2023-07-09T21:51:28.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.944+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2536045926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c40b3ff0 msgr2=0x7f17c40b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.944+0000 7f17ca5ff700 1 --2- 172.21.15.53:0/2536045926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c40b3ff0 0x7f17c40b43c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009840 tx=0x7f17b4009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:28.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.944+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2536045926 shutdown_connections 2023-07-09T21:51:28.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.944+0000 7f17ca5ff700 1 --2- 172.21.15.53:0/2536045926 >> v2:172.21.15.184:3300/0 conn(0x7f17c40d0f60 0x7f17c40b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.944+0000 7f17ca5ff700 1 --2- 172.21.15.53:0/2536045926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c40b3ff0 0x7f17c40b43c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.945+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2536045926 >> 172.21.15.53:0/2536045926 conn(0x7f17c409c1b0 msgr2=0x7f17c40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:28.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.945+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2536045926 shutdown_connections 2023-07-09T21:51:28.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.945+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2536045926 wait complete. 2023-07-09T21:51:28.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.946+0000 7f17ca5ff700 1 Processor -- start 2023-07-09T21:51:28.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.946+0000 7f17ca5ff700 1 -- start start 2023-07-09T21:51:28.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.947+0000 7f17ca5ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17c40b3ff0 0x7f17c4151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.947+0000 7f17ca5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c40d0b10 0x7f17c40cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.947+0000 7f17ca5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c40d0f60 0x7f17c40b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.947+0000 7f17ca5ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40a0c80 con 0x7f17c40b3ff0 2023-07-09T21:51:28.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.947+0000 7f17ca5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c415dc30 con 0x7f17c40d0f60 2023-07-09T21:51:28.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.947+0000 7f17ca5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c415df10 con 0x7f17c40d0b10 2023-07-09T21:51:28.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.948+0000 7f17c3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17c40b3ff0 0x7f17c4151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.948+0000 7f17c3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17c40b3ff0 0x7f17c4151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53442/0 (socket says 172.21.15.53:53442) 2023-07-09T21:51:28.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.948+0000 7f17c3fff700 1 -- 172.21.15.53:0/2611417154 learned_addr learned my addr 172.21.15.53:0/2611417154 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:28.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.948+0000 7f17c8b9c700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c40d0f60 0x7f17c40b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.948+0000 7f17c37fe700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c40d0b10 0x7f17c40cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.948+0000 7f17c3fff700 1 -- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c40d0b10 msgr2=0x7f17c40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.948+0000 7f17c3fff700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c40d0b10 0x7f17c40cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.948+0000 7f17c3fff700 1 -- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c40d0f60 msgr2=0x7f17c40b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:28.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.948+0000 7f17c3fff700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c40d0f60 0x7f17c40b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:28.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.948+0000 7f17c3fff700 1 -- 172.21.15.53:0/2611417154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc009b30 con 0x7f17c40b3ff0 2023-07-09T21:51:28.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.948+0000 7f17c3fff700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17c40b3ff0 0x7f17c4151f80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009b90 tx=0x7f17b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:28.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.949+0000 7f17c0ff9700 1 -- 172.21.15.53:0/2611417154 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40036a0 con 0x7f17c40b3ff0 2023-07-09T21:51:28.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.949+0000 7f17c0ff9700 1 -- 172.21.15.53:0/2611417154 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b401f070 con 0x7f17c40b3ff0 2023-07-09T21:51:28.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.949+0000 7f17c0ff9700 1 -- 172.21.15.53:0/2611417154 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4003a20 con 0x7f17c40b3ff0 2023-07-09T21:51:28.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.949+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2611417154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b40094a0 con 0x7f17c40b3ff0 2023-07-09T21:51:28.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.949+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2611417154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c415e4d0 con 0x7f17c40b3ff0 2023-07-09T21:51:28.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.950+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2611417154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c4074350 con 0x7f17c40b3ff0 2023-07-09T21:51:28.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.951+0000 7f17c0ff9700 1 -- 172.21.15.53:0/2611417154 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f17b4003b80 con 0x7f17c40b3ff0 2023-07-09T21:51:28.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.952+0000 7f17c0ff9700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f17b006ace0 0x7f17b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:28.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.952+0000 7f17c0ff9700 1 -- 172.21.15.53:0/2611417154 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f17b4021070 con 0x7f17c40b3ff0 2023-07-09T21:51:28.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.952+0000 7f17c37fe700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f17b006ace0 0x7f17b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:28.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.953+0000 7f17c37fe700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f17b006ace0 0x7f17b006d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f17b8007fd0 tx=0x7f17b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:28.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:28.956+0000 7f17c0ff9700 1 -- 172.21.15.53:0/2611417154 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f17b4055ea0 con 0x7f17c40b3ff0 2023-07-09T21:51:29.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.208+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2611417154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f17c40c96b0 con 0x7f17c40b3ff0 2023-07-09T21:51:29.209 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-07-09T21:51:29.208+0000 7f231e3f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T21:51:29.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.213+0000 7f17c0ff9700 1 -- 172.21.15.53:0/2611417154 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f17b402b090 con 0x7f17c40b3ff0 2023-07-09T21:51:29.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.216+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f17b006ace0 msgr2=0x7f17b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:29.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.216+0000 7f17ca5ff700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f17b006ace0 0x7f17b006d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f17b8007fd0 tx=0x7f17b8009040 comp rx=0 tx=0).stop 2023-07-09T21:51:29.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.216+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2611417154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17c40b3ff0 msgr2=0x7f17c4151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:29.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.216+0000 7f17ca5ff700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17c40b3ff0 0x7f17c4151f80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009b90 tx=0x7f17b4004750 comp rx=0 tx=0).stop 2023-07-09T21:51:29.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.216+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2611417154 shutdown_connections 2023-07-09T21:51:29.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.216+0000 7f17ca5ff700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f17b006ace0 0x7f17b006d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:29.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.216+0000 7f17ca5ff700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c40d0f60 0x7f17c40b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:29.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.216+0000 7f17ca5ff700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17c40b3ff0 0x7f17c4151f80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:29.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.216+0000 7f17ca5ff700 1 --2- 172.21.15.53:0/2611417154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c40d0b10 0x7f17c40cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:29.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.216+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2611417154 >> 172.21.15.53:0/2611417154 conn(0x7f17c409c1b0 msgr2=0x7f17c40d1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:29.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.216+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2611417154 shutdown_connections 2023-07-09T21:51:29.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.216+0000 7f17ca5ff700 1 -- 172.21.15.53:0/2611417154 wait complete. 2023-07-09T21:51:29.219 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T21:51:29.236 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T21:51:29.284 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-07-09T21:51:29.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.440+0000 7f6a4afff700 1 Processor -- start 2023-07-09T21:51:29.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.440+0000 7f6a4afff700 1 -- start start 2023-07-09T21:51:29.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.442+0000 7f6a4afff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a440b3ff0 0x7f6a440b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:29.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.442+0000 7f6a4afff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6a440d0b10 0x7f6a440d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.442+0000 7f6a4afff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a440b8e80 con 0x7f6a440b25d0 2023-07-09T21:51:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.442+0000 7f6a4afff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440d14d0 con 0x7f6a440b3ff0 2023-07-09T21:51:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.442+0000 7f6a4afff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440b1e30 con 0x7f6a440d0b10 2023-07-09T21:51:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.442+0000 7f6a48d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a440b3ff0 0x7f6a440b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.442+0000 7f6a48d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a440b3ff0 0x7f6a440b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53458/0 (socket says 172.21.15.53:53458) 2023-07-09T21:51:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.442+0000 7f6a48d9b700 1 -- 172.21.15.53:0/1823816555 learned_addr learned my addr 172.21.15.53:0/1823816555 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.442+0000 7f6a43fff700 1 --2- 172.21.15.53:0/1823816555 >> v2:172.21.15.184:3300/0 conn(0x7f6a440d0b10 0x7f6a440d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.442+0000 7f6a48d9b700 1 -- 172.21.15.53:0/1823816555 >> v2:172.21.15.184:3300/0 conn(0x7f6a440d0b10 msgr2=0x7f6a440d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.442+0000 7f6a48d9b700 1 --2- 172.21.15.53:0/1823816555 >> v2:172.21.15.184:3300/0 conn(0x7f6a440d0b10 0x7f6a440d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.442+0000 7f6a48d9b700 1 -- 172.21.15.53:0/1823816555 >> v1:172.21.15.184:6789/0 conn(0x7f6a440b25d0 legacy=0x7f6a440b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.443+0000 7f6a48d9b700 1 -- 172.21.15.53:0/1823816555 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440afaa0 con 0x7f6a440b3ff0 2023-07-09T21:51:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.443+0000 7f6a48d9b700 1 --2- 172.21.15.53:0/1823816555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a440b3ff0 0x7f6a440b43c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6a4409c8e0 tx=0x7f6a38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a233f6307a02af17 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.443+0000 7f6a437fe700 1 -- 172.21.15.53:0/1823816555 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38004230 con 0x7f6a440b3ff0 2023-07-09T21:51:29.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.443+0000 7f6a437fe700 1 -- 172.21.15.53:0/1823816555 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a38004390 con 0x7f6a440b3ff0 2023-07-09T21:51:29.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.443+0000 7f6a437fe700 1 -- 172.21.15.53:0/1823816555 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a380036a0 con 0x7f6a440b3ff0 2023-07-09T21:51:29.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.443+0000 7f6a4afff700 1 -- 172.21.15.53:0/1823816555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a440b3ff0 msgr2=0x7f6a440b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:29.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.443+0000 7f6a4afff700 1 --2- 172.21.15.53:0/1823816555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a440b3ff0 0x7f6a440b43c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6a4409c8e0 tx=0x7f6a38009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.444+0000 7f6a4afff700 1 -- 172.21.15.53:0/1823816555 shutdown_connections 2023-07-09T21:51:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.444+0000 7f6a4afff700 1 --2- 172.21.15.53:0/1823816555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a440b3ff0 0x7f6a440b43c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.444+0000 7f6a4afff700 1 --2- 172.21.15.53:0/1823816555 >> v2:172.21.15.184:3300/0 conn(0x7f6a440d0b10 0x7f6a440d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.444+0000 7f6a4afff700 1 -- 172.21.15.53:0/1823816555 >> 172.21.15.53:0/1823816555 conn(0x7f6a4409c1b0 msgr2=0x7f6a440d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.444+0000 7f6a4afff700 1 -- 172.21.15.53:0/1823816555 shutdown_connections 2023-07-09T21:51:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.444+0000 7f6a4afff700 1 -- 172.21.15.53:0/1823816555 wait complete. 2023-07-09T21:51:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.445+0000 7f6a4afff700 1 Processor -- start 2023-07-09T21:51:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.446+0000 7f6a4afff700 1 -- start start 2023-07-09T21:51:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.447+0000 7f6a4afff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a440b25d0 0x7f6a441513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.447+0000 7f6a4afff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a440b3ff0 0x7f6a4415cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.447+0000 7f6a4afff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a440d0b10 0x7f6a440b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.447+0000 7f6a4afff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a441f21c0 con 0x7f6a440d0b10 2023-07-09T21:51:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.447+0000 7f6a4afff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4415e7a0 con 0x7f6a440b3ff0 2023-07-09T21:51:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.447+0000 7f6a4afff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a441518e0 con 0x7f6a440b25d0 2023-07-09T21:51:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.447+0000 7f6a4959c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a440d0b10 0x7f6a440b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.447+0000 7f6a4959c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a440d0b10 0x7f6a440b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53466/0 (socket says 172.21.15.53:53466) 2023-07-09T21:51:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.447+0000 7f6a4959c700 1 -- 172.21.15.53:0/2430476053 learned_addr learned my addr 172.21.15.53:0/2430476053 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.447+0000 7f6a48d9b700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a440b25d0 0x7f6a441513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.447+0000 7f6a43fff700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a440b3ff0 0x7f6a4415cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.448+0000 7f6a4959c700 1 -- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a440b25d0 msgr2=0x7f6a441513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.448+0000 7f6a4959c700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a440b25d0 0x7f6a441513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.448+0000 7f6a4959c700 1 -- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a440b3ff0 msgr2=0x7f6a4415cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.448+0000 7f6a4959c700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a440b3ff0 0x7f6a4415cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.448+0000 7f6a4959c700 1 -- 172.21.15.53:0/2430476053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a38009550 con 0x7f6a440d0b10 2023-07-09T21:51:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.448+0000 7f6a4959c700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a440d0b10 0x7f6a440b6560 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00cc10 tx=0x7f6a3c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.448+0000 7f6a417fa700 1 -- 172.21.15.53:0/2430476053 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00aa60 con 0x7f6a440d0b10 2023-07-09T21:51:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.448+0000 7f6a417fa700 1 -- 172.21.15.53:0/2430476053 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c00abc0 con 0x7f6a440d0b10 2023-07-09T21:51:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.448+0000 7f6a417fa700 1 -- 172.21.15.53:0/2430476053 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c012420 con 0x7f6a440d0b10 2023-07-09T21:51:29.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.448+0000 7f6a4afff700 1 -- 172.21.15.53:0/2430476053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4415dc70 con 0x7f6a440d0b10 2023-07-09T21:51:29.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.448+0000 7f6a4afff700 1 -- 172.21.15.53:0/2430476053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4415d990 con 0x7f6a440d0b10 2023-07-09T21:51:29.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.449+0000 7f6a4afff700 1 -- 172.21.15.53:0/2430476053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4415e910 con 0x7f6a440d0b10 2023-07-09T21:51:29.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.450+0000 7f6a417fa700 1 -- 172.21.15.53:0/2430476053 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a3c012580 con 0x7f6a440d0b10 2023-07-09T21:51:29.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.452+0000 7f6a417fa700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6a2806ace0 0x7f6a2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:29.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.452+0000 7f6a417fa700 1 -- 172.21.15.53:0/2430476053 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f6a3c089860 con 0x7f6a440d0b10 2023-07-09T21:51:29.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.452+0000 7f6a48d9b700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6a2806ace0 0x7f6a2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:29.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.453+0000 7f6a48d9b700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6a2806ace0 0x7f6a2806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009130 tx=0x7f6a38008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.456+0000 7f6a417fa700 1 -- 172.21.15.53:0/2430476053 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6a3c0547e0 con 0x7f6a440d0b10 2023-07-09T21:51:29.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:29.709+0000 7f6a4afff700 1 -- 172.21.15.53:0/2430476053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6a44074350 con 0x7f6a440d0b10 2023-07-09T21:51:30.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.214+0000 7f6a417fa700 1 -- 172.21.15.53:0/2430476053 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6a3c057e00 con 0x7f6a440d0b10 2023-07-09T21:51:30.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.217+0000 7f6a4afff700 1 -- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6a2806ace0 msgr2=0x7f6a2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:30.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.217+0000 7f6a4afff700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6a2806ace0 0x7f6a2806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009130 tx=0x7f6a38008030 comp rx=0 tx=0).stop 2023-07-09T21:51:30.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.217+0000 7f6a4afff700 1 -- 172.21.15.53:0/2430476053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a440d0b10 msgr2=0x7f6a440b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:30.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.217+0000 7f6a4afff700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a440d0b10 0x7f6a440b6560 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00cc10 tx=0x7f6a3c00cf20 comp rx=0 tx=0).stop 2023-07-09T21:51:30.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.217+0000 7f6a4afff700 1 -- 172.21.15.53:0/2430476053 shutdown_connections 2023-07-09T21:51:30.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.217+0000 7f6a4afff700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6a2806ace0 0x7f6a2806d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:30.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.217+0000 7f6a4afff700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a440d0b10 0x7f6a440b6560 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:30.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.217+0000 7f6a4afff700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a440b25d0 0x7f6a441513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:30.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.217+0000 7f6a4afff700 1 --2- 172.21.15.53:0/2430476053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a440b3ff0 0x7f6a4415cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:30.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.217+0000 7f6a4afff700 1 -- 172.21.15.53:0/2430476053 >> 172.21.15.53:0/2430476053 conn(0x7f6a4409c1b0 msgr2=0x7f6a440b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:30.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.217+0000 7f6a4afff700 1 -- 172.21.15.53:0/2430476053 shutdown_connections 2023-07-09T21:51:30.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.217+0000 7f6a4afff700 1 -- 172.21.15.53:0/2430476053 wait complete. 2023-07-09T21:51:30.238 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T21:51:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.444+0000 7f83003ff700 1 Processor -- start 2023-07-09T21:51:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.444+0000 7f83003ff700 1 -- start start 2023-07-09T21:51:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.445+0000 7f83003ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82f80cc2c0 0x7f82f80cc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.445+0000 7f83003ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f82f80b1400 0x7f82f80b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.445+0000 7f83003ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f80ad830 con 0x7f82f806b040 2023-07-09T21:51:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.445+0000 7f83003ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f80b0f70 con 0x7f82f80b1400 2023-07-09T21:51:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.445+0000 7f83003ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f815cd10 con 0x7f82f80cc2c0 2023-07-09T21:51:30.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.446+0000 7f82fd99a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82f80cc2c0 0x7f82f80cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:30.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.446+0000 7f82fe99c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f82f80b1400 0x7f82f80b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:30.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.446+0000 7f82fe19b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f82f806b040 0x7f82f806b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:44654/0 (socket says 172.21.15.53:44654) 2023-07-09T21:51:30.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.446+0000 7f82fe19b700 1 -- 172.21.15.53:0/4242880320 learned_addr learned my addr 172.21.15.53:0/4242880320 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:30.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.446+0000 7f82fd199700 1 -- 172.21.15.53:0/4242880320 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481679890 0 0) 0x7f82f80ad830 con 0x7f82f806b040 2023-07-09T21:51:30.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.446+0000 7f82fd99a700 1 -- 172.21.15.53:0/4242880320 >> v2:172.21.15.184:3300/0 conn(0x7f82f80b1400 msgr2=0x7f82f80b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:30.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.446+0000 7f82fd99a700 1 --2- 172.21.15.53:0/4242880320 >> v2:172.21.15.184:3300/0 conn(0x7f82f80b1400 0x7f82f80b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:30.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.446+0000 7f82fd99a700 1 -- 172.21.15.53:0/4242880320 >> v1:172.21.15.184:6789/0 conn(0x7f82f806b040 legacy=0x7f82f806b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:30.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.446+0000 7f82fd99a700 1 -- 172.21.15.53:0/4242880320 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f80cd090 con 0x7f82f80cc2c0 2023-07-09T21:51:30.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.446+0000 7f82fe99c700 1 --2- 172.21.15.53:0/4242880320 >> v2:172.21.15.184:3300/0 conn(0x7f82f80b1400 0x7f82f80b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:30.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.447+0000 7f82fd99a700 1 --2- 172.21.15.53:0/4242880320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82f80cc2c0 0x7f82f80cc730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009840 tx=0x7f82e8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=656ff04e1a5510d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:30.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.447+0000 7f82fd199700 1 -- 172.21.15.53:0/4242880320 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8011830 con 0x7f82f80cc2c0 2023-07-09T21:51:30.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.447+0000 7f82fd199700 1 -- 172.21.15.53:0/4242880320 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e8011990 con 0x7f82f80cc2c0 2023-07-09T21:51:30.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.447+0000 7f82fd199700 1 -- 172.21.15.53:0/4242880320 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8011d20 con 0x7f82f80cc2c0 2023-07-09T21:51:30.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.447+0000 7f83003ff700 1 -- 172.21.15.53:0/4242880320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82f80cc2c0 msgr2=0x7f82f80cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:30.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.447+0000 7f83003ff700 1 --2- 172.21.15.53:0/4242880320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82f80cc2c0 0x7f82f80cc730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009840 tx=0x7f82e8009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.447+0000 7f83003ff700 1 -- 172.21.15.53:0/4242880320 shutdown_connections 2023-07-09T21:51:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.447+0000 7f83003ff700 1 --2- 172.21.15.53:0/4242880320 >> v2:172.21.15.184:3300/0 conn(0x7f82f80b1400 0x7f82f80b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.447+0000 7f83003ff700 1 --2- 172.21.15.53:0/4242880320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82f80cc2c0 0x7f82f80cc730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.447+0000 7f83003ff700 1 -- 172.21.15.53:0/4242880320 >> 172.21.15.53:0/4242880320 conn(0x7f82f80664f0 msgr2=0x7f82f8099f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.448+0000 7f83003ff700 1 -- 172.21.15.53:0/4242880320 shutdown_connections 2023-07-09T21:51:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.448+0000 7f83003ff700 1 -- 172.21.15.53:0/4242880320 wait complete. 2023-07-09T21:51:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.449+0000 7f83003ff700 1 Processor -- start 2023-07-09T21:51:30.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.449+0000 7f83003ff700 1 -- start start 2023-07-09T21:51:30.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.450+0000 7f83003ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82f806b040 0x7f82f815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:30.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.450+0000 7f83003ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f80b1400 0x7f82f80b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:30.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.450+0000 7f83003ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82f80cc2c0 0x7f82f80b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:30.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.450+0000 7f83003ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80c5120 con 0x7f82f80b1400 2023-07-09T21:51:30.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.450+0000 7f83003ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f814b8a0 con 0x7f82f806b040 2023-07-09T21:51:30.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.450+0000 7f83003ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80c47f0 con 0x7f82f80cc2c0 2023-07-09T21:51:30.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.451+0000 7f82fd99a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f80b1400 0x7f82f80b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:30.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.451+0000 7f82fd99a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f80b1400 0x7f82f80b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53480/0 (socket says 172.21.15.53:53480) 2023-07-09T21:51:30.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.451+0000 7f82fd99a700 1 -- 172.21.15.53:0/4212825448 learned_addr learned my addr 172.21.15.53:0/4212825448 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:30.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.451+0000 7f82fe19b700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82f806b040 0x7f82f815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:30.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.451+0000 7f82fe99c700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82f80cc2c0 0x7f82f80b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:30.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.451+0000 7f82fd99a700 1 -- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82f80cc2c0 msgr2=0x7f82f80b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:30.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.451+0000 7f82fd99a700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82f80cc2c0 0x7f82f80b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:30.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.451+0000 7f82fd99a700 1 -- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82f806b040 msgr2=0x7f82f815b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:30.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.451+0000 7f82fd99a700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82f806b040 0x7f82f815b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:30.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.451+0000 7f82fd99a700 1 -- 172.21.15.53:0/4212825448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f0009a70 con 0x7f82f80b1400 2023-07-09T21:51:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.452+0000 7f82fd99a700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f80b1400 0x7f82f80b3a90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009fd0 tx=0x7f82e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.452+0000 7f82eeffd700 1 -- 172.21.15.53:0/4212825448 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e80036a0 con 0x7f82f80b1400 2023-07-09T21:51:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.452+0000 7f82eeffd700 1 -- 172.21.15.53:0/4212825448 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e8003800 con 0x7f82f80b1400 2023-07-09T21:51:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.452+0000 7f82eeffd700 1 -- 172.21.15.53:0/4212825448 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8003bb0 con 0x7f82f80b1400 2023-07-09T21:51:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.452+0000 7f83003ff700 1 -- 172.21.15.53:0/4212825448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e80094a0 con 0x7f82f80b1400 2023-07-09T21:51:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.452+0000 7f83003ff700 1 -- 172.21.15.53:0/4212825448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f80c4db0 con 0x7f82f80b1400 2023-07-09T21:51:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.453+0000 7f83003ff700 1 -- 172.21.15.53:0/4212825448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f8074350 con 0x7f82f80b1400 2023-07-09T21:51:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.454+0000 7f82eeffd700 1 -- 172.21.15.53:0/4212825448 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f82e8003d10 con 0x7f82f80b1400 2023-07-09T21:51:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.455+0000 7f82eeffd700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f82dc06ace0 0x7f82dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.455+0000 7f82eeffd700 1 -- 172.21.15.53:0/4212825448 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f82e808a8f0 con 0x7f82f80b1400 2023-07-09T21:51:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.456+0000 7f82fe19b700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f82dc06ace0 0x7f82dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.456+0000 7f82fe19b700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f82dc06ace0 0x7f82dc06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f82f4000f60 tx=0x7f82f4007e70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:30.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.459+0000 7f82eeffd700 1 -- 172.21.15.53:0/4212825448 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f82e8055900 con 0x7f82f80b1400 2023-07-09T21:51:30.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:30.667+0000 7f83003ff700 1 -- 172.21.15.53:0/4212825448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f82f80afc10 con 0x7f82f80b1400 2023-07-09T21:51:31.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.547+0000 7f82eeffd700 1 -- 172.21.15.53:0/4212825448 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f82e8058f20 con 0x7f82f80b1400 2023-07-09T21:51:31.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.553+0000 7f83003ff700 1 -- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f82dc06ace0 msgr2=0x7f82dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:31.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.553+0000 7f83003ff700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f82dc06ace0 0x7f82dc06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f82f4000f60 tx=0x7f82f4007e70 comp rx=0 tx=0).stop 2023-07-09T21:51:31.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.553+0000 7f83003ff700 1 -- 172.21.15.53:0/4212825448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f80b1400 msgr2=0x7f82f80b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:31.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.553+0000 7f83003ff700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f80b1400 0x7f82f80b3a90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009fd0 tx=0x7f82e8004750 comp rx=0 tx=0).stop 2023-07-09T21:51:31.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.554+0000 7f83003ff700 1 -- 172.21.15.53:0/4212825448 shutdown_connections 2023-07-09T21:51:31.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.554+0000 7f83003ff700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f82dc06ace0 0x7f82dc06d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:31.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.554+0000 7f83003ff700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82f80cc2c0 0x7f82f80b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:31.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.554+0000 7f83003ff700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82f806b040 0x7f82f815b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:31.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.554+0000 7f83003ff700 1 --2- 172.21.15.53:0/4212825448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f80b1400 0x7f82f80b3a90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:31.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.554+0000 7f83003ff700 1 -- 172.21.15.53:0/4212825448 >> 172.21.15.53:0/4212825448 conn(0x7f82f80664f0 msgr2=0x7f82f806f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:31.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.555+0000 7f83003ff700 1 -- 172.21.15.53:0/4212825448 shutdown_connections 2023-07-09T21:51:31.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.555+0000 7f83003ff700 1 -- 172.21.15.53:0/4212825448 wait complete. 2023-07-09T21:51:31.558 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-07-09T21:51:31.578 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T21:51:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.787+0000 7f2b847ff700 1 Processor -- start 2023-07-09T21:51:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.787+0000 7f2b847ff700 1 -- start start 2023-07-09T21:51:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.788+0000 7f2b847ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b7c15c7b0 0x7f2b7c0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.788+0000 7f2b847ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c0d2c70 con 0x7f2b7c0d1140 2023-07-09T21:51:31.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.788+0000 7f2b847ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c0d0190 con 0x7f2b7c0d28a0 2023-07-09T21:51:31.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.788+0000 7f2b847ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0d3de0 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.788+0000 7f2b81d9a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2b7c0d1140 0x7f2b7c0ce030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59072/0 (socket says 172.21.15.53:59072) 2023-07-09T21:51:31.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.789+0000 7f2b81d9a700 1 -- 172.21.15.53:0/3920503098 learned_addr learned my addr 172.21.15.53:0/3920503098 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.789+0000 7f2b82d9c700 1 --2- 172.21.15.53:0/3920503098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b7c15c7b0 0x7f2b7c0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.789+0000 7f2b81599700 1 -- 172.21.15.53:0/3920503098 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362096718 0 0) 0x7f2b7c0d2c70 con 0x7f2b7c0d1140 2023-07-09T21:51:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.789+0000 7f2b81599700 1 -- 172.21.15.53:0/3920503098 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b680035b0 con 0x7f2b7c0d1140 2023-07-09T21:51:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.789+0000 7f2b81599700 1 -- 172.21.15.53:0/3920503098 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509634734 0 0) 0x7f2b7c0d0190 con 0x7f2b7c0d28a0 2023-07-09T21:51:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.789+0000 7f2b81599700 1 -- 172.21.15.53:0/3920503098 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b7c0d2c70 con 0x7f2b7c0d28a0 2023-07-09T21:51:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.789+0000 7f2b82d9c700 1 -- 172.21.15.53:0/3920503098 >> v1:172.21.15.184:6789/0 conn(0x7f2b7c0d28a0 legacy=0x7f2b7c0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.789+0000 7f2b82d9c700 1 -- 172.21.15.53:0/3920503098 >> v1:172.21.15.53:6789/0 conn(0x7f2b7c0d1140 legacy=0x7f2b7c0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.789+0000 7f2b82d9c700 1 -- 172.21.15.53:0/3920503098 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0d0470 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.790+0000 7f2b82d9c700 1 --2- 172.21.15.53:0/3920503098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b7c15c7b0 0x7f2b7c0ce740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009dc0 tx=0x7f2b7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1526d0c2fa0c78b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.790+0000 7f2b81599700 1 -- 172.21.15.53:0/3920503098 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400e070 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.790+0000 7f2b81599700 1 -- 172.21.15.53:0/3920503098 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7400bb20 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.790+0000 7f2b81599700 1 -- 172.21.15.53:0/3920503098 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400be90 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.791+0000 7f2b847ff700 1 -- 172.21.15.53:0/3920503098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b7c15c7b0 msgr2=0x7f2b7c0ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.791+0000 7f2b847ff700 1 --2- 172.21.15.53:0/3920503098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b7c15c7b0 0x7f2b7c0ce740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009dc0 tx=0x7f2b7400b330 comp rx=0 tx=0).stop 2023-07-09T21:51:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.791+0000 7f2b847ff700 1 -- 172.21.15.53:0/3920503098 shutdown_connections 2023-07-09T21:51:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.791+0000 7f2b847ff700 1 --2- 172.21.15.53:0/3920503098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b7c15c7b0 0x7f2b7c0ce740 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.791+0000 7f2b847ff700 1 -- 172.21.15.53:0/3920503098 >> 172.21.15.53:0/3920503098 conn(0x7f2b7c09c1b0 msgr2=0x7f2b7c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.791+0000 7f2b847ff700 1 -- 172.21.15.53:0/3920503098 shutdown_connections 2023-07-09T21:51:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.791+0000 7f2b847ff700 1 -- 172.21.15.53:0/3920503098 wait complete. 2023-07-09T21:51:31.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.793+0000 7f2b847ff700 1 Processor -- start 2023-07-09T21:51:31.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.793+0000 7f2b847ff700 1 -- start start 2023-07-09T21:51:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.794+0000 7f2b847ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b7c0d1140 0x7f2b7c154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b847ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b7c0d28a0 0x7f2b7c1547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b847ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b7c15c7b0 0x7f2b7c0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b847ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0c8710 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b847ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0b8990 con 0x7f2b7c0d1140 2023-07-09T21:51:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b847ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c154d30 con 0x7f2b7c0d28a0 2023-07-09T21:51:31.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b82d9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b7c15c7b0 0x7f2b7c0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:31.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b82d9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b7c15c7b0 0x7f2b7c0c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53484/0 (socket says 172.21.15.53:53484) 2023-07-09T21:51:31.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b82d9c700 1 -- 172.21.15.53:0/3239467584 learned_addr learned my addr 172.21.15.53:0/3239467584 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:31.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b8259b700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b7c0d1140 0x7f2b7c154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:31.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b81d9a700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b7c0d28a0 0x7f2b7c1547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:31.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b82d9c700 1 -- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b7c0d28a0 msgr2=0x7f2b7c1547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:31.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b82d9c700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b7c0d28a0 0x7f2b7c1547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:31.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b82d9c700 1 -- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b7c0d1140 msgr2=0x7f2b7c154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:31.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b82d9c700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b7c0d1140 0x7f2b7c154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:31.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.795+0000 7f2b82d9c700 1 -- 172.21.15.53:0/3239467584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b74009a70 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.796+0000 7f2b82d9c700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b7c15c7b0 0x7f2b7c0c8b30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009fd0 tx=0x7f2b74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:31.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.796+0000 7f2b72ffd700 1 -- 172.21.15.53:0/3239467584 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74003c20 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.796+0000 7f2b847ff700 1 -- 172.21.15.53:0/3239467584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c06b8b0 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.796+0000 7f2b72ffd700 1 -- 172.21.15.53:0/3239467584 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7401f070 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.796+0000 7f2b72ffd700 1 -- 172.21.15.53:0/3239467584 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b740098f0 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.796+0000 7f2b847ff700 1 -- 172.21.15.53:0/3239467584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c0c8330 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.797+0000 7f2b847ff700 1 -- 172.21.15.53:0/3239467584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c0c8850 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.798+0000 7f2b72ffd700 1 -- 172.21.15.53:0/3239467584 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b74004030 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.799+0000 7f2b72ffd700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2b6006ace0 0x7f2b6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:31.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.799+0000 7f2b72ffd700 1 -- 172.21.15.53:0/3239467584 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f2b7408ad20 con 0x7f2b7c15c7b0 2023-07-09T21:51:31.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.800+0000 7f2b8259b700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2b6006ace0 0x7f2b6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:31.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.800+0000 7f2b8259b700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2b6006ace0 0x7f2b6006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2b780016f0 tx=0x7f2b78009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:31.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:31.804+0000 7f2b72ffd700 1 -- 172.21.15.53:0/3239467584 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2b7c0c8850 con 0x7f2b7c15c7b0 2023-07-09T21:51:32.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.014+0000 7f2b847ff700 1 -- 172.21.15.53:0/3239467584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2b7c0c8850 con 0x7f2b7c15c7b0 2023-07-09T21:51:32.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.760+0000 7f2b72ffd700 1 -- 172.21.15.53:0/3239467584 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2b7c0c8850 con 0x7f2b7c15c7b0 2023-07-09T21:51:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.764+0000 7f2b847ff700 1 -- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2b6006ace0 msgr2=0x7f2b6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.764+0000 7f2b847ff700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2b6006ace0 0x7f2b6006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2b780016f0 tx=0x7f2b78009040 comp rx=0 tx=0).stop 2023-07-09T21:51:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.764+0000 7f2b847ff700 1 -- 172.21.15.53:0/3239467584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b7c15c7b0 msgr2=0x7f2b7c0c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.764+0000 7f2b847ff700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b7c15c7b0 0x7f2b7c0c8b30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009fd0 tx=0x7f2b74004ad0 comp rx=0 tx=0).stop 2023-07-09T21:51:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.764+0000 7f2b847ff700 1 -- 172.21.15.53:0/3239467584 shutdown_connections 2023-07-09T21:51:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.764+0000 7f2b847ff700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2b6006ace0 0x7f2b6006d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:32.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.764+0000 7f2b847ff700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b7c15c7b0 0x7f2b7c0c8b30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:32.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.764+0000 7f2b847ff700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b7c0d1140 0x7f2b7c154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:32.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.764+0000 7f2b847ff700 1 --2- 172.21.15.53:0/3239467584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b7c0d28a0 0x7f2b7c1547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:32.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.764+0000 7f2b847ff700 1 -- 172.21.15.53:0/3239467584 >> 172.21.15.53:0/3239467584 conn(0x7f2b7c09c1b0 msgr2=0x7f2b7c0cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:32.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.764+0000 7f2b847ff700 1 -- 172.21.15.53:0/3239467584 shutdown_connections 2023-07-09T21:51:32.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:32.764+0000 7f2b847ff700 1 -- 172.21.15.53:0/3239467584 wait complete. 2023-07-09T21:51:32.771 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-07-09T21:51:32.792 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T21:51:32.793 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T21:51:32.793 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T21:51:32.793 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:51:32.793 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T21:51:32.794 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T21:51:32.794 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T21:51:32.794 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:51:32.794 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T21:51:32.794 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T21:51:32.795 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T21:51:32.795 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:51:32.795 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T21:51:32.795 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T21:51:32.796 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T21:51:32.796 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:51:32.809 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T21:51:32.809 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T21:51:32.811 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T21:51:32.811 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T21:51:32.814 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T21:51:32.815 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T21:51:32.815 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T21:51:32.816 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T21:51:32.853 INFO:tasks.ceph.mds.c:Started 2023-07-09T21:51:32.854 DEBUG:teuthology.parallel:result is None 2023-07-09T21:51:32.856 INFO:tasks.ceph.mds.a:Started 2023-07-09T21:51:32.857 DEBUG:teuthology.parallel:result is None 2023-07-09T21:51:32.859 INFO:tasks.ceph.mds.b:Started 2023-07-09T21:51:32.859 DEBUG:teuthology.parallel:result is None 2023-07-09T21:51:32.862 INFO:tasks.ceph.mds.d:Started 2023-07-09T21:51:32.862 DEBUG:teuthology.parallel:result is None 2023-07-09T21:51:32.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T21:51:33.009 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-07-09T21:51:33.010 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-07-09T21:51:33.011 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-07-09T21:51:33.011 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-07-09T21:51:33.012 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-07-09T21:51:33.011+0000 7fb29effd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-07-09T21:51:33.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.075+0000 7fb8dc5ff700 1 Processor -- start 2023-07-09T21:51:33.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.076+0000 7fb8dc5ff700 1 -- start start 2023-07-09T21:51:33.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.077+0000 7fb8dc5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb8d40b12f0 0x7fb8d40ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:33.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.077+0000 7fb8dc5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8d40adea0 0x7fb8d40c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:33.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.077+0000 7fb8dc5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d415ce70 con 0x7fb8d40c9810 2023-07-09T21:51:33.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.077+0000 7fb8dc5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d415da60 con 0x7fb8d40b12f0 2023-07-09T21:51:33.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.077+0000 7fb8dc5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d40c9c50 con 0x7fb8d40adea0 2023-07-09T21:51:33.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.077+0000 7fb8d9b9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8d40adea0 0x7fb8d40c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:33.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.077+0000 7fb8da39b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb8d40b12f0 0x7fb8d40ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:33.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.077+0000 7fb8dab9c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb8d40c9810 0x7fb8d406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:56678/0 (socket says 172.21.15.53:56678) 2023-07-09T21:51:33.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.077+0000 7fb8dab9c700 1 -- 172.21.15.53:0/2736395789 learned_addr learned my addr 172.21.15.53:0/2736395789 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:33.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.078+0000 7fb8d9399700 1 -- 172.21.15.53:0/2736395789 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60376948 0 0) 0x7fb8d415ce70 con 0x7fb8d40c9810 2023-07-09T21:51:33.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.078+0000 7fb8d9b9a700 1 -- 172.21.15.53:0/2736395789 >> v2:172.21.15.184:3300/0 conn(0x7fb8d40b12f0 msgr2=0x7fb8d40ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:33.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.078+0000 7fb8d9b9a700 1 --2- 172.21.15.53:0/2736395789 >> v2:172.21.15.184:3300/0 conn(0x7fb8d40b12f0 0x7fb8d40ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:33.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.078+0000 7fb8d9b9a700 1 -- 172.21.15.53:0/2736395789 >> v1:172.21.15.184:6789/0 conn(0x7fb8d40c9810 legacy=0x7fb8d406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:33.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.078+0000 7fb8d9b9a700 1 -- 172.21.15.53:0/2736395789 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d415d0c0 con 0x7fb8d40adea0 2023-07-09T21:51:33.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.078+0000 7fb8da39b700 1 --2- 172.21.15.53:0/2736395789 >> v2:172.21.15.184:3300/0 conn(0x7fb8d40b12f0 0x7fb8d40ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.078+0000 7fb8d9b9a700 1 --2- 172.21.15.53:0/2736395789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8d40adea0 0x7fb8d40c92d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009840 tx=0x7fb8c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=365177f363f0cd8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.078+0000 7fb8d9399700 1 -- 172.21.15.53:0/2736395789 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4011830 con 0x7fb8d40adea0 2023-07-09T21:51:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.078+0000 7fb8d9399700 1 -- 172.21.15.53:0/2736395789 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c4011990 con 0x7fb8d40adea0 2023-07-09T21:51:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.078+0000 7fb8d9399700 1 -- 172.21.15.53:0/2736395789 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4011d20 con 0x7fb8d40adea0 2023-07-09T21:51:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.079+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2736395789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8d40adea0 msgr2=0x7fb8d40c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.079+0000 7fb8dc5ff700 1 --2- 172.21.15.53:0/2736395789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8d40adea0 0x7fb8d40c92d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009840 tx=0x7fb8c4009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.079+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2736395789 shutdown_connections 2023-07-09T21:51:33.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.079+0000 7fb8dc5ff700 1 --2- 172.21.15.53:0/2736395789 >> v2:172.21.15.184:3300/0 conn(0x7fb8d40b12f0 0x7fb8d40ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:33.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.079+0000 7fb8dc5ff700 1 --2- 172.21.15.53:0/2736395789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8d40adea0 0x7fb8d40c92d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:33.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.079+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2736395789 >> 172.21.15.53:0/2736395789 conn(0x7fb8d40b05d0 msgr2=0x7fb8d40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:33.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.079+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2736395789 shutdown_connections 2023-07-09T21:51:33.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.079+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2736395789 wait complete. 2023-07-09T21:51:33.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.081+0000 7fb8dc5ff700 1 Processor -- start 2023-07-09T21:51:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.081+0000 7fb8dc5ff700 1 -- start start 2023-07-09T21:51:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8dc5ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8d40adea0 0x7fb8d4150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8dc5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8d40b12f0 0x7fb8d40b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8dc5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8d40c9810 0x7fb8d406c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8dc5ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d406c340 con 0x7fb8d40adea0 2023-07-09T21:51:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8dc5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d406b6c0 con 0x7fb8d40c9810 2023-07-09T21:51:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8dc5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d406b9a0 con 0x7fb8d40b12f0 2023-07-09T21:51:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8da39b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8d40adea0 0x7fb8d4150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8da39b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8d40adea0 0x7fb8d4150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35606/0 (socket says 172.21.15.53:35606) 2023-07-09T21:51:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8da39b700 1 -- 172.21.15.53:0/2624230719 learned_addr learned my addr 172.21.15.53:0/2624230719 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8dab9c700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8d40c9810 0x7fb8d406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8d9b9a700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8d40b12f0 0x7fb8d40b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8da39b700 1 -- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8d40b12f0 msgr2=0x7fb8d40b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8da39b700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8d40b12f0 0x7fb8d40b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8da39b700 1 -- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8d40c9810 msgr2=0x7fb8d406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8da39b700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8d40c9810 0x7fb8d406c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.083+0000 7fb8da39b700 1 -- 172.21.15.53:0/2624230719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d000b740 con 0x7fb8d40adea0 2023-07-09T21:51:33.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.084+0000 7fb8da39b700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8d40adea0 0x7fb8d4150390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0010f50 tx=0x7fb8d000e6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:33.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.084+0000 7fb8caffd700 1 -- 172.21.15.53:0/2624230719 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0011650 con 0x7fb8d40adea0 2023-07-09T21:51:33.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.084+0000 7fb8caffd700 1 -- 172.21.15.53:0/2624230719 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d00117b0 con 0x7fb8d40adea0 2023-07-09T21:51:33.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.084+0000 7fb8caffd700 1 -- 172.21.15.53:0/2624230719 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0011b40 con 0x7fb8d40adea0 2023-07-09T21:51:33.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.085+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2624230719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c40094a0 con 0x7fb8d40adea0 2023-07-09T21:51:33.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.085+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2624230719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d406bf60 con 0x7fb8d40adea0 2023-07-09T21:51:33.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.086+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2624230719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d4074350 con 0x7fb8d40adea0 2023-07-09T21:51:33.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.088+0000 7fb8caffd700 1 -- 172.21.15.53:0/2624230719 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8d0011ca0 con 0x7fb8d40adea0 2023-07-09T21:51:33.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.089+0000 7fb8caffd700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb8b806ace0 0x7fb8b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:33.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.089+0000 7fb8caffd700 1 -- 172.21.15.53:0/2624230719 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb8d008bf20 con 0x7fb8d40adea0 2023-07-09T21:51:33.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.090+0000 7fb8d9b9a700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb8b806ace0 0x7fb8b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:33.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.094+0000 7fb8d9b9a700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb8b806ace0 0x7fb8b806d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40090b0 tx=0x7fb8c4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:33.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.095+0000 7fb8caffd700 1 -- 172.21.15.53:0/2624230719 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb8d0057360 con 0x7fb8d40adea0 2023-07-09T21:51:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.320+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2624230719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb8d40b4a40 con 0x7fb8d40adea0 2023-07-09T21:51:33.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.775+0000 7fb8caffd700 1 -- 172.21.15.53:0/2624230719 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb8d001e020 con 0x7fb8d40adea0 2023-07-09T21:51:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.778+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb8b806ace0 msgr2=0x7fb8b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.778+0000 7fb8dc5ff700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb8b806ace0 0x7fb8b806d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40090b0 tx=0x7fb8c4008030 comp rx=0 tx=0).stop 2023-07-09T21:51:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.778+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2624230719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8d40adea0 msgr2=0x7fb8d4150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.778+0000 7fb8dc5ff700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8d40adea0 0x7fb8d4150390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0010f50 tx=0x7fb8d000e6f0 comp rx=0 tx=0).stop 2023-07-09T21:51:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.778+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2624230719 shutdown_connections 2023-07-09T21:51:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.778+0000 7fb8dc5ff700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb8b806ace0 0x7fb8b806d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:33.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.778+0000 7fb8dc5ff700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8d40c9810 0x7fb8d406c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:33.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.778+0000 7fb8dc5ff700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8d40adea0 0x7fb8d4150390 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:33.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.778+0000 7fb8dc5ff700 1 --2- 172.21.15.53:0/2624230719 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8d40b12f0 0x7fb8d40b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:33.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.778+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2624230719 >> 172.21.15.53:0/2624230719 conn(0x7fb8d40b05d0 msgr2=0x7fb8d40ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:33.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.778+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2624230719 shutdown_connections 2023-07-09T21:51:33.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:33.778+0000 7fb8dc5ff700 1 -- 172.21.15.53:0/2624230719 wait complete. 2023-07-09T21:51:33.782 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2023-07-09T21:51:33.800 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T21:51:34.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.000+0000 7f91573ff700 1 Processor -- start 2023-07-09T21:51:34.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.000+0000 7f91573ff700 1 -- start start 2023-07-09T21:51:34.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.001+0000 7f91573ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500b1e00 0x7f91500b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.001+0000 7f91573ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91500d2ce0 con 0x7f91500b2350 2023-07-09T21:51:34.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.001+0000 7f91573ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91500b3350 con 0x7f91500d1220 2023-07-09T21:51:34.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.001+0000 7f91573ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91500b3630 con 0x7f91500b1e00 2023-07-09T21:51:34.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f915499a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f91500b2350 0x7f91500d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50036/0 (socket says 172.21.15.53:50036) 2023-07-09T21:51:34.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f915499a700 1 -- 172.21.15.53:0/3378538486 learned_addr learned my addr 172.21.15.53:0/3378538486 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:34.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f915519b700 1 --2- 172.21.15.53:0/3378538486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500b1e00 0x7f91500b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:34.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495830541 0 0) 0x7f91500d2ce0 con 0x7f91500b2350 2023-07-09T21:51:34.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f913c0035b0 con 0x7f91500b2350 2023-07-09T21:51:34.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000606902 0 0) 0x7f91500b3350 con 0x7f91500d1220 2023-07-09T21:51:34.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91500d2ce0 con 0x7f91500d1220 2023-07-09T21:51:34.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3289623326 0 0) 0x7f913c0035b0 con 0x7f91500b2350 2023-07-09T21:51:34.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500b1e00 msgr2=0x7f91500b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 --2- 172.21.15.53:0/3378538486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500b1e00 0x7f91500b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 >> v1:172.21.15.184:6789/0 conn(0x7f91500d1220 legacy=0x7f91500afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91500b3910 con 0x7f91500b2350 2023-07-09T21:51:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f91400015f0 con 0x7f91500b2350 2023-07-09T21:51:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 >> v1:172.21.15.53:6789/0 conn(0x7f91500b2350 legacy=0x7f91500d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 --2- 172.21.15.53:0/3378538486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500b1e00 0x7f913c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 --2- 172.21.15.53:0/3378538486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c004170 0x7f913c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 --2- 172.21.15.53:0/3378538486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f913c004d90 0x7f913c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91500b3630 con 0x7f913c004170 2023-07-09T21:51:34.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c00bba0 con 0x7f913c004d90 2023-07-09T21:51:34.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.002+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c00bd60 con 0x7f91500b1e00 2023-07-09T21:51:34.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.003+0000 7f915499a700 1 --2- 172.21.15.53:0/3378538486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c004170 0x7f913c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:34.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.003+0000 7f915519b700 1 --2- 172.21.15.53:0/3378538486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500b1e00 0x7f913c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:34.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.003+0000 7f915599c700 1 --2- 172.21.15.53:0/3378538486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f913c004d90 0x7f913c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:34.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.003+0000 7f915519b700 1 -- 172.21.15.53:0/3378538486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f913c004d90 msgr2=0x7f913c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:34.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.003+0000 7f915519b700 1 --2- 172.21.15.53:0/3378538486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f913c004d90 0x7f913c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.003+0000 7f915519b700 1 -- 172.21.15.53:0/3378538486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c004170 msgr2=0x7f913c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:34.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.003+0000 7f915519b700 1 --2- 172.21.15.53:0/3378538486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c004170 0x7f913c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.003+0000 7f915519b700 1 -- 172.21.15.53:0/3378538486 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c0035b0 con 0x7f91500b1e00 2023-07-09T21:51:34.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.003+0000 7f915499a700 1 --2- 172.21.15.53:0/3378538486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c004170 0x7f913c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:34.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.003+0000 7f915519b700 1 --2- 172.21.15.53:0/3378538486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500b1e00 0x7f913c003bc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f914c009b40 tx=0x7f913c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa750f842cc9c431 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.004+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c005a20 con 0x7f91500b1e00 2023-07-09T21:51:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.004+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c005b80 con 0x7f91500b1e00 2023-07-09T21:51:34.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.004+0000 7f9147fff700 1 -- 172.21.15.53:0/3378538486 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c00e6c0 con 0x7f91500b1e00 2023-07-09T21:51:34.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.004+0000 7f91573ff700 1 -- 172.21.15.53:0/3378538486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500b1e00 msgr2=0x7f913c003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:34.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.004+0000 7f91573ff700 1 --2- 172.21.15.53:0/3378538486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500b1e00 0x7f913c003bc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f914c009b40 tx=0x7f913c005880 comp rx=0 tx=0).stop 2023-07-09T21:51:34.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.004+0000 7f915599c700 1 -- 172.21.15.53:0/3378538486 reap_dead start 2023-07-09T21:51:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.004+0000 7f91573ff700 1 -- 172.21.15.53:0/3378538486 shutdown_connections 2023-07-09T21:51:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.004+0000 7f91573ff700 1 -- 172.21.15.53:0/3378538486 >> 172.21.15.53:0/3378538486 conn(0x7f915009c1d0 msgr2=0x7f91500d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.004+0000 7f91573ff700 1 -- 172.21.15.53:0/3378538486 shutdown_connections 2023-07-09T21:51:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.004+0000 7f91573ff700 1 -- 172.21.15.53:0/3378538486 wait complete. 2023-07-09T21:51:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.006+0000 7f91573ff700 1 Processor -- start 2023-07-09T21:51:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.006+0000 7f91573ff700 1 -- start start 2023-07-09T21:51:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.007+0000 7f91573ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91500b1e00 0x7f91500c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.007+0000 7f91573ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91500c8ae0 0x7f91500c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.007+0000 7f91573ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500c6ae0 0x7f91500c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.007+0000 7f91573ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91500c9490 con 0x7f91500b1e00 2023-07-09T21:51:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.007+0000 7f91573ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91500c7850 con 0x7f91500c8ae0 2023-07-09T21:51:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.007+0000 7f91573ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91500c7b30 con 0x7f91500c6ae0 2023-07-09T21:51:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.007+0000 7f915519b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91500b1e00 0x7f91500c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.007+0000 7f915519b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91500b1e00 0x7f91500c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35624/0 (socket says 172.21.15.53:35624) 2023-07-09T21:51:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.007+0000 7f915519b700 1 -- 172.21.15.53:0/1613058966 learned_addr learned my addr 172.21.15.53:0/1613058966 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:34.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.008+0000 7f915599c700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500c6ae0 0x7f91500c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:34.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.008+0000 7f915499a700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91500c8ae0 0x7f91500c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:34.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.008+0000 7f915519b700 1 -- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500c6ae0 msgr2=0x7f91500c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:34.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.008+0000 7f915519b700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500c6ae0 0x7f91500c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.008+0000 7f915519b700 1 -- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91500c8ae0 msgr2=0x7f91500c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:34.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.008+0000 7f915519b700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91500c8ae0 0x7f91500c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.008+0000 7f915519b700 1 -- 172.21.15.53:0/1613058966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91500c7e10 con 0x7f91500b1e00 2023-07-09T21:51:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.008+0000 7f915519b700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91500b1e00 0x7f91500c5c80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f913c00bef0 tx=0x7f914c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.008+0000 7f9145ffb700 1 -- 172.21.15.53:0/1613058966 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c020070 con 0x7f91500b1e00 2023-07-09T21:51:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.008+0000 7f9145ffb700 1 -- 172.21.15.53:0/1613058966 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c006030 con 0x7f91500b1e00 2023-07-09T21:51:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.008+0000 7f9145ffb700 1 -- 172.21.15.53:0/1613058966 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c0063a0 con 0x7f91500b1e00 2023-07-09T21:51:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.009+0000 7f91573ff700 1 -- 172.21.15.53:0/1613058966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91500c80f0 con 0x7f91500b1e00 2023-07-09T21:51:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.009+0000 7f91573ff700 1 -- 172.21.15.53:0/1613058966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91500c61c0 con 0x7f91500b1e00 2023-07-09T21:51:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.010+0000 7f91573ff700 1 -- 172.21.15.53:0/1613058966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915004e280 con 0x7f91500b1e00 2023-07-09T21:51:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.010+0000 7f9145ffb700 1 -- 172.21.15.53:0/1613058966 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f914c006500 con 0x7f91500b1e00 2023-07-09T21:51:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.011+0000 7f9145ffb700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f913406ace0 0x7f913406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.012+0000 7f9145ffb700 1 -- 172.21.15.53:0/1613058966 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f914c08a3a0 con 0x7f91500b1e00 2023-07-09T21:51:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.012+0000 7f915499a700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f913406ace0 0x7f913406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.012+0000 7f915499a700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f913406ace0 0x7f913406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9140000c00 tx=0x7f9140007a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.016+0000 7f9145ffb700 1 -- 172.21.15.53:0/1613058966 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f914c055840 con 0x7f91500b1e00 2023-07-09T21:51:34.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.302+0000 7f91573ff700 1 -- 172.21.15.53:0/1613058966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f91500b1b90 con 0x7f91500b1e00 2023-07-09T21:51:34.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.303+0000 7f9145ffb700 1 -- 172.21.15.53:0/1613058966 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f914c058e60 con 0x7f91500b1e00 2023-07-09T21:51:34.304 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:34.305 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-07-09T21:51:34.305 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2023-07-09T21:51:34.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.305 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2023-07-09T21:51:34.305 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBaK6tkzRxYDRAAimNrYVSgnlKa/LcrJM21Og==", 2023-07-09T21:51:34.305 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.305 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:51:34.306 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-07-09T21:51:34.306 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-07-09T21:51:34.306 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.306 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.306 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2023-07-09T21:51:34.306 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBaK6tkki/UJRAAsJcmnMjVZOJNndECUAkiVg==", 2023-07-09T21:51:34.307 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.307 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:51:34.307 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-07-09T21:51:34.307 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-07-09T21:51:34.308 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.308 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.308 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2023-07-09T21:51:34.308 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBaK6tkhe7KGRAAoeCtYxjFHSSnSUZwu4nZ9A==", 2023-07-09T21:51:34.309 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.309 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:51:34.309 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-07-09T21:51:34.309 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-07-09T21:51:34.309 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.309 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.310 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2023-07-09T21:51:34.310 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBaK6tkRxOwMRAA+WhKRURpXJz9LaBKWuzEJw==", 2023-07-09T21:51:34.310 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.310 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:51:34.310 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-07-09T21:51:34.310 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-07-09T21:51:34.310 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.311 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.311 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2023-07-09T21:51:34.311 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBdK6tkdB3PGBAAFoeYIhy2uqAJUSbLbJdRTQ==", 2023-07-09T21:51:34.311 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.311 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:51:34.312 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:51:34.312 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.312 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.312 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2023-07-09T21:51:34.312 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBgK6tk19Y+HxAA91lQzKiiljQEMVmfr2bxWw==", 2023-07-09T21:51:34.313 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.313 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:51:34.313 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:51:34.313 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.313 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.314 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2023-07-09T21:51:34.314 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBjK6tkNiE1JhAAWcZYxoAyD+PVfSI/0KnFfA==", 2023-07-09T21:51:34.314 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.314 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:51:34.315 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:51:34.315 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.315 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.316 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2023-07-09T21:51:34.317 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBmK6tkPAJJLhAARFLACX0SY7u+6K1BOmSmdA==", 2023-07-09T21:51:34.317 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.318 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:51:34.318 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:51:34.318 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.318 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.319 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2023-07-09T21:51:34.320 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBtK6tksG3BDRAARy/avAmY0FyArpZdnZY/sQ==", 2023-07-09T21:51:34.320 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.320 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:51:34.321 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:51:34.321 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.321 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.322 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2023-07-09T21:51:34.322 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBwK6tkAHBNFBAA7ikYVig77uKzs7LWtMS8WA==", 2023-07-09T21:51:34.322 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.323 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:51:34.323 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:51:34.323 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.323 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.324 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2023-07-09T21:51:34.324 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBzK6tk9g9sGxAA//58pDJnkGJ32EBykgrJiA==", 2023-07-09T21:51:34.325 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.325 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:51:34.325 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:51:34.325 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.325 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.326 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.326 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2023-07-09T21:51:34.326 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQB2K6tkBBQ0IRAACJjUm5wbHKWR6p6ILZCCww==", 2023-07-09T21:51:34.326 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.326 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:51:34.326 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:51:34.327 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.327 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.327 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2023-07-09T21:51:34.327 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBbK6tkVu19ABAApbFrRRJdrT0qBJ/fG9bEVA==", 2023-07-09T21:51:34.327 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.327 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:51:34.328 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-07-09T21:51:34.328 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-07-09T21:51:34.328 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-07-09T21:51:34.328 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.328 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2023-07-09T21:51:34.329 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBbK6tksBxtEBAAqiQuZQNUaBcgRM4F/pgJXg==", 2023-07-09T21:51:34.329 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.329 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:51:34.329 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-07-09T21:51:34.329 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-07-09T21:51:34.329 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-07-09T21:51:34.329 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.330 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.330 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2023-07-09T21:51:34.330 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBbK6tkuTXHCBAAygsg7Xz9oRO8nT8glKJU4Q==", 2023-07-09T21:51:34.330 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.330 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:51:34.330 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-07-09T21:51:34.330 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-07-09T21:51:34.331 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-07-09T21:51:34.331 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.331 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2023-07-09T21:51:34.331 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBbK6tkiMUjGBAADn+j9WGS506PTPaSG9MJGA==", 2023-07-09T21:51:34.331 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.331 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:51:34.332 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-07-09T21:51:34.332 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-07-09T21:51:34.332 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-07-09T21:51:34.332 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.332 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.332 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2023-07-09T21:51:34.333 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBZK6tkUtHVDxAASQNCwvv3CraD6lYBpWf8vQ==", 2023-07-09T21:51:34.333 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.333 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-07-09T21:51:34.333 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-07-09T21:51:34.333 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-07-09T21:51:34.333 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.333 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.334 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.334 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-mds", 2023-07-09T21:51:34.334 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQCDK6tk4861LBAAjtQLTq4k1FLVNOBH4FDc8Q==", 2023-07-09T21:51:34.334 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.334 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-mds" 2023-07-09T21:51:34.334 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.335 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-mgr", 2023-07-09T21:51:34.335 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQCDK6tkd9y1LBAA3xN+pWMw/xNGPWDG9vHi1Q==", 2023-07-09T21:51:34.335 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.335 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-09T21:51:34.335 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.336 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-osd", 2023-07-09T21:51:34.336 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQCDK6tkWeW1LBAAQWPLaGUdwlBlNFRVvx75VQ==", 2023-07-09T21:51:34.336 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.336 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-osd" 2023-07-09T21:51:34.336 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.337 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.337 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-rbd", 2023-07-09T21:51:34.337 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQCDK6tkku61LBAApDZTcVgY59oaOJMPx6oeIw==", 2023-07-09T21:51:34.337 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.337 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-09T21:51:34.337 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.338 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.338 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-09T21:51:34.338 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQCDK6tkoPe1LBAAyhTdW03LRDrnIBMUmEyjeQ==", 2023-07-09T21:51:34.338 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.338 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-09T21:51:34.338 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.339 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.339 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-rgw", 2023-07-09T21:51:34.339 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQCDK6tkzwC2LBAA0+G22dWtxCrcX0KkUcDagQ==", 2023-07-09T21:51:34.339 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.339 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-09T21:51:34.339 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.339 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.340 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2023-07-09T21:51:34.340 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBaK6tkwFBVBRAACJgXwd/fdCczDXJ/14KcKQ==", 2023-07-09T21:51:34.340 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.340 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-07-09T21:51:34.340 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-07-09T21:51:34.340 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.341 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:34.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:34.341 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2023-07-09T21:51:34.341 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBZK6tkteqHNxAA4inbbYz6IZ2Yc+cfFCe7hQ==", 2023-07-09T21:51:34.341 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:51:34.341 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-07-09T21:51:34.341 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-07-09T21:51:34.342 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:51:34.342 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.342 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:34.342 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-07-09T21:51:34.342 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-07-09T21:51:34.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.305+0000 7f91573ff700 1 -- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f913406ace0 msgr2=0x7f913406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:34.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.305+0000 7f91573ff700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f913406ace0 0x7f913406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9140000c00 tx=0x7f9140007a80 comp rx=0 tx=0).stop 2023-07-09T21:51:34.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.305+0000 7f91573ff700 1 -- 172.21.15.53:0/1613058966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91500b1e00 msgr2=0x7f91500c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:34.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.305+0000 7f91573ff700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91500b1e00 0x7f91500c5c80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f913c00bef0 tx=0x7f914c0047c0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.305+0000 7f91573ff700 1 -- 172.21.15.53:0/1613058966 shutdown_connections 2023-07-09T21:51:34.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.305+0000 7f91573ff700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f913406ace0 0x7f913406d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.305+0000 7f91573ff700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91500c6ae0 0x7f91500c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.305+0000 7f91573ff700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91500b1e00 0x7f91500c5c80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.305+0000 7f91573ff700 1 --2- 172.21.15.53:0/1613058966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91500c8ae0 0x7f91500c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.305+0000 7f91573ff700 1 -- 172.21.15.53:0/1613058966 >> 172.21.15.53:0/1613058966 conn(0x7f915009c1d0 msgr2=0x7f915006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:34.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.306+0000 7f91573ff700 1 -- 172.21.15.53:0/1613058966 shutdown_connections 2023-07-09T21:51:34.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.306+0000 7f91573ff700 1 -- 172.21.15.53:0/1613058966 wait complete. 2023-07-09T21:51:34.346 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-09T21:51:34.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.545+0000 7f2ccf9ff700 1 Processor -- start 2023-07-09T21:51:34.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.545+0000 7f2ccf9ff700 1 -- start start 2023-07-09T21:51:34.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.546+0000 7f2ccf9ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2cc806c9f0 0x7f2cc806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.546+0000 7f2ccf9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2cc8071880 0x7f2cc80cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.546+0000 7f2ccf9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc815ddf0 con 0x7f2cc80b1910 2023-07-09T21:51:34.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.546+0000 7f2ccf9ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc806c4e0 con 0x7f2cc806c9f0 2023-07-09T21:51:34.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.546+0000 7f2ccf9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc806bf20 con 0x7f2cc8071880 2023-07-09T21:51:34.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.546+0000 7f2ccd79b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2cc806c9f0 0x7f2cc806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:34.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.546+0000 7f2ccd79b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2cc806c9f0 0x7f2cc806b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35634/0 (socket says 172.21.15.53:35634) 2023-07-09T21:51:34.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.546+0000 7f2ccd79b700 1 -- 172.21.15.53:0/3869693086 learned_addr learned my addr 172.21.15.53:0/3869693086 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:34.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.547+0000 7f2ccd79b700 1 -- 172.21.15.53:0/3869693086 >> v2:172.21.15.184:3300/0 conn(0x7f2cc8071880 msgr2=0x7f2cc80cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:34.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.547+0000 7f2ccd79b700 1 --2- 172.21.15.53:0/3869693086 >> v2:172.21.15.184:3300/0 conn(0x7f2cc8071880 0x7f2cc80cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.547+0000 7f2ccd79b700 1 -- 172.21.15.53:0/3869693086 >> v1:172.21.15.184:6789/0 conn(0x7f2cc80b1910 legacy=0x7f2cc8071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:34.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.547+0000 7f2ccd79b700 1 -- 172.21.15.53:0/3869693086 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc806c200 con 0x7f2cc806c9f0 2023-07-09T21:51:34.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.547+0000 7f2ccd79b700 1 --2- 172.21.15.53:0/3869693086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc806c9f0 0x7f2cc806b5b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80c2590 tx=0x7f2cc4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab38bd1d876b3ff server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:34.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.547+0000 7f2cbffff700 1 -- 172.21.15.53:0/3869693086 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4004230 con 0x7f2cc806c9f0 2023-07-09T21:51:34.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.547+0000 7f2cbffff700 1 -- 172.21.15.53:0/3869693086 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc4004390 con 0x7f2cc806c9f0 2023-07-09T21:51:34.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.547+0000 7f2cbffff700 1 -- 172.21.15.53:0/3869693086 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40036a0 con 0x7f2cc806c9f0 2023-07-09T21:51:34.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.548+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/3869693086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc806c9f0 msgr2=0x7f2cc806b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:34.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.548+0000 7f2ccf9ff700 1 --2- 172.21.15.53:0/3869693086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc806c9f0 0x7f2cc806b5b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80c2590 tx=0x7f2cc4009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.548+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/3869693086 shutdown_connections 2023-07-09T21:51:34.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.548+0000 7f2ccf9ff700 1 --2- 172.21.15.53:0/3869693086 >> v2:172.21.15.184:3300/0 conn(0x7f2cc8071880 0x7f2cc80cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.548+0000 7f2ccf9ff700 1 --2- 172.21.15.53:0/3869693086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc806c9f0 0x7f2cc806b5b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.548+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/3869693086 >> 172.21.15.53:0/3869693086 conn(0x7f2cc80b05d0 msgr2=0x7f2cc80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:34.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.548+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/3869693086 shutdown_connections 2023-07-09T21:51:34.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.548+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/3869693086 wait complete. 2023-07-09T21:51:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.550+0000 7f2ccf9ff700 1 Processor -- start 2023-07-09T21:51:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.550+0000 7f2ccf9ff700 1 -- start start 2023-07-09T21:51:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.551+0000 7f2ccf9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2cc806c9f0 0x7f2cc8158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.551+0000 7f2ccf9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc8071880 0x7f2cc8157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.551+0000 7f2ccf9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cc80b1910 0x7f2cc80ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.551+0000 7f2ccf9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc80ccd50 con 0x7f2cc8071880 2023-07-09T21:51:34.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.551+0000 7f2ccf9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc81585e0 con 0x7f2cc80b1910 2023-07-09T21:51:34.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.551+0000 7f2ccf9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8159710 con 0x7f2cc806c9f0 2023-07-09T21:51:34.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.551+0000 7f2cccf9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc8071880 0x7f2cc8157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:34.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.551+0000 7f2cccf9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc8071880 0x7f2cc8157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35636/0 (socket says 172.21.15.53:35636) 2023-07-09T21:51:34.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.551+0000 7f2cccf9a700 1 -- 172.21.15.53:0/1045543656 learned_addr learned my addr 172.21.15.53:0/1045543656 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:34.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.551+0000 7f2ccd79b700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2cc806c9f0 0x7f2cc8158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:34.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.551+0000 7f2ccdf9c700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cc80b1910 0x7f2cc80ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:34.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.552+0000 7f2cccf9a700 1 -- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2cc806c9f0 msgr2=0x7f2cc8158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:34.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.552+0000 7f2cccf9a700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2cc806c9f0 0x7f2cc8158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.552+0000 7f2cccf9a700 1 -- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cc80b1910 msgr2=0x7f2cc80ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:34.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.552+0000 7f2cccf9a700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cc80b1910 0x7f2cc80ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.552+0000 7f2cccf9a700 1 -- 172.21.15.53:0/1045543656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4009550 con 0x7f2cc8071880 2023-07-09T21:51:34.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.552+0000 7f2cccf9a700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc8071880 0x7f2cc8157a80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800b470 tx=0x7f2cb800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:34.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.552+0000 7f2cbdffb700 1 -- 172.21.15.53:0/1045543656 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8011830 con 0x7f2cc8071880 2023-07-09T21:51:34.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.552+0000 7f2cbdffb700 1 -- 172.21.15.53:0/1045543656 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb80119b0 con 0x7f2cc8071880 2023-07-09T21:51:34.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.552+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/1045543656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc81599f0 con 0x7f2cc8071880 2023-07-09T21:51:34.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.552+0000 7f2cbdffb700 1 -- 172.21.15.53:0/1045543656 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8011d60 con 0x7f2cc8071880 2023-07-09T21:51:34.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.552+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/1045543656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc80cc970 con 0x7f2cc8071880 2023-07-09T21:51:34.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.553+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/1045543656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc80cce90 con 0x7f2cc8071880 2023-07-09T21:51:34.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.554+0000 7f2cbdffb700 1 -- 172.21.15.53:0/1045543656 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2cb801a400 con 0x7f2cc8071880 2023-07-09T21:51:34.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.555+0000 7f2cbdffb700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2cac06ace0 0x7f2cac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:34.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.555+0000 7f2cbdffb700 1 -- 172.21.15.53:0/1045543656 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2cb80890d0 con 0x7f2cc8071880 2023-07-09T21:51:34.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.556+0000 7f2ccd79b700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2cac06ace0 0x7f2cac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:34.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.556+0000 7f2ccd79b700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2cac06ace0 0x7f2cac06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009130 tx=0x7f2cc4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:34.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.560+0000 7f2cbdffb700 1 -- 172.21.15.53:0/1045543656 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2cc80cce90 con 0x7f2cc8071880 2023-07-09T21:51:34.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.851+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/1045543656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f2cc80ccb00 con 0x7f2cc8071880 2023-07-09T21:51:34.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.855+0000 7f2cbdffb700 1 -- 172.21.15.53:0/1045543656 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2cb8054430 con 0x7f2cc8071880 2023-07-09T21:51:34.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.858+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2cac06ace0 msgr2=0x7f2cac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:34.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.858+0000 7f2ccf9ff700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2cac06ace0 0x7f2cac06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009130 tx=0x7f2cc4008030 comp rx=0 tx=0).stop 2023-07-09T21:51:34.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.858+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/1045543656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc8071880 msgr2=0x7f2cc8157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:34.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.858+0000 7f2ccf9ff700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc8071880 0x7f2cc8157a80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800b470 tx=0x7f2cb800b780 comp rx=0 tx=0).stop 2023-07-09T21:51:34.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.858+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/1045543656 shutdown_connections 2023-07-09T21:51:34.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.858+0000 7f2ccf9ff700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2cac06ace0 0x7f2cac06d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.858+0000 7f2ccf9ff700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cc80b1910 0x7f2cc80ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.858+0000 7f2ccf9ff700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2cc806c9f0 0x7f2cc8158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.858+0000 7f2ccf9ff700 1 --2- 172.21.15.53:0/1045543656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc8071880 0x7f2cc8157a80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:34.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.858+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/1045543656 >> 172.21.15.53:0/1045543656 conn(0x7f2cc80b05d0 msgr2=0x7f2cc80c45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:34.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.858+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/1045543656 shutdown_connections 2023-07-09T21:51:34.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:34.858+0000 7f2ccf9ff700 1 -- 172.21.15.53:0/1045543656 wait complete. 2023-07-09T21:51:34.877 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-09T21:51:35.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.077+0000 7f63845ff700 1 Processor -- start 2023-07-09T21:51:35.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.077+0000 7f63845ff700 1 -- start start 2023-07-09T21:51:35.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.078+0000 7f63845ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f637c0cd430 0x7f637c0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:35.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.078+0000 7f63845ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f637c0d22d0 0x7f637c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:35.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.078+0000 7f63845ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637c0d02a0 con 0x7f637c0b4860 2023-07-09T21:51:35.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.078+0000 7f63845ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637c0b5240 con 0x7f637c0cd430 2023-07-09T21:51:35.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.078+0000 7f63845ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637c0cfce0 con 0x7f637c0d22d0 2023-07-09T21:51:35.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.079+0000 7f638239b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f637c0cd430 0x7f637c0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:35.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.079+0000 7f6381b9a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f637c0b4860 0x7f637c1601f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50052/0 (socket says 172.21.15.53:50052) 2023-07-09T21:51:35.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.079+0000 7f638239b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f637c0cd430 0x7f637c0cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35644/0 (socket says 172.21.15.53:35644) 2023-07-09T21:51:35.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.079+0000 7f6381b9a700 1 -- 172.21.15.53:0/1211397219 learned_addr learned my addr 172.21.15.53:0/1211397219 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.079+0000 7f6382b9c700 1 --2- 172.21.15.53:0/1211397219 >> v2:172.21.15.184:3300/0 conn(0x7f637c0d22d0 0x7f637c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.079+0000 7f638239b700 1 -- 172.21.15.53:0/1211397219 >> v2:172.21.15.184:3300/0 conn(0x7f637c0d22d0 msgr2=0x7f637c0b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.079+0000 7f638239b700 1 --2- 172.21.15.53:0/1211397219 >> v2:172.21.15.184:3300/0 conn(0x7f637c0d22d0 0x7f637c0b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.079+0000 7f638239b700 1 -- 172.21.15.53:0/1211397219 >> v1:172.21.15.53:6789/0 conn(0x7f637c0b4860 legacy=0x7f637c1601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.079+0000 7f638239b700 1 -- 172.21.15.53:0/1211397219 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c0cffc0 con 0x7f637c0cd430 2023-07-09T21:51:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.079+0000 7f6382b9c700 1 --2- 172.21.15.53:0/1211397219 >> v2:172.21.15.184:3300/0 conn(0x7f637c0d22d0 0x7f637c0b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.079+0000 7f6381399700 1 -- 172.21.15.53:0/1211397219 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863855739 0 0) 0x7f637c0d02a0 con 0x7f637c0b4860 2023-07-09T21:51:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.079+0000 7f638239b700 1 --2- 172.21.15.53:0/1211397219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f637c0cd430 0x7f637c0cd800 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f637c0d0630 tx=0x7f6378009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8fbe435becc98 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.080+0000 7f6381399700 1 -- 172.21.15.53:0/1211397219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378011830 con 0x7f637c0cd430 2023-07-09T21:51:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.080+0000 7f6381399700 1 -- 172.21.15.53:0/1211397219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6378011990 con 0x7f637c0cd430 2023-07-09T21:51:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.080+0000 7f6381399700 1 -- 172.21.15.53:0/1211397219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378011d20 con 0x7f637c0cd430 2023-07-09T21:51:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.080+0000 7f63845ff700 1 -- 172.21.15.53:0/1211397219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f637c0cd430 msgr2=0x7f637c0cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.080+0000 7f63845ff700 1 --2- 172.21.15.53:0/1211397219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f637c0cd430 0x7f637c0cd800 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f637c0d0630 tx=0x7f6378009b20 comp rx=0 tx=0).stop 2023-07-09T21:51:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.080+0000 7f63845ff700 1 -- 172.21.15.53:0/1211397219 shutdown_connections 2023-07-09T21:51:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.080+0000 7f63845ff700 1 --2- 172.21.15.53:0/1211397219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f637c0cd430 0x7f637c0cd800 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.080+0000 7f63845ff700 1 --2- 172.21.15.53:0/1211397219 >> v2:172.21.15.184:3300/0 conn(0x7f637c0d22d0 0x7f637c0b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.080+0000 7f63845ff700 1 -- 172.21.15.53:0/1211397219 >> 172.21.15.53:0/1211397219 conn(0x7f637c066860 msgr2=0x7f637c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.080+0000 7f63845ff700 1 -- 172.21.15.53:0/1211397219 shutdown_connections 2023-07-09T21:51:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.080+0000 7f63845ff700 1 -- 172.21.15.53:0/1211397219 wait complete. 2023-07-09T21:51:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.082+0000 7f63845ff700 1 Processor -- start 2023-07-09T21:51:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.082+0000 7f63845ff700 1 -- start start 2023-07-09T21:51:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.083+0000 7f63845ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f637c0b4860 0x7f637c0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.083+0000 7f63845ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f637c0cd430 0x7f637c14a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.083+0000 7f63845ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f637c0d22d0 0x7f637c0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.083+0000 7f63845ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c0c8bb0 con 0x7f637c0b4860 2023-07-09T21:51:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.083+0000 7f63845ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c0c69b0 con 0x7f637c0cd430 2023-07-09T21:51:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.083+0000 7f63845ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c0c6c90 con 0x7f637c0d22d0 2023-07-09T21:51:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.083+0000 7f638239b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f637c0b4860 0x7f637c0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.084+0000 7f638239b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f637c0b4860 0x7f637c0c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35660/0 (socket says 172.21.15.53:35660) 2023-07-09T21:51:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.084+0000 7f638239b700 1 -- 172.21.15.53:0/837921743 learned_addr learned my addr 172.21.15.53:0/837921743 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.084+0000 7f6381b9a700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f637c0cd430 0x7f637c14a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.084+0000 7f6382b9c700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f637c0d22d0 0x7f637c0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.084+0000 7f638239b700 1 -- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f637c0d22d0 msgr2=0x7f637c0c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.084+0000 7f638239b700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f637c0d22d0 0x7f637c0c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.084+0000 7f638239b700 1 -- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f637c0cd430 msgr2=0x7f637c14a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.084+0000 7f638239b700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f637c0cd430 0x7f637c14a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.084+0000 7f638239b700 1 -- 172.21.15.53:0/837921743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63780094a0 con 0x7f637c0b4860 2023-07-09T21:51:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.084+0000 7f6382b9c700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f637c0d22d0 0x7f637c0c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.084+0000 7f638239b700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f637c0b4860 0x7f637c0c7490 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6378000c00 tx=0x7f6378004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.084+0000 7f6372ffd700 1 -- 172.21.15.53:0/837921743 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780038a0 con 0x7f637c0b4860 2023-07-09T21:51:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.084+0000 7f6372ffd700 1 -- 172.21.15.53:0/837921743 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637801f070 con 0x7f637c0b4860 2023-07-09T21:51:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.085+0000 7f6372ffd700 1 -- 172.21.15.53:0/837921743 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378003c40 con 0x7f637c0b4860 2023-07-09T21:51:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.085+0000 7f63845ff700 1 -- 172.21.15.53:0/837921743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c0c6f70 con 0x7f637c0b4860 2023-07-09T21:51:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.085+0000 7f63845ff700 1 -- 172.21.15.53:0/837921743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c0c8e90 con 0x7f637c0b4860 2023-07-09T21:51:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.086+0000 7f63845ff700 1 -- 172.21.15.53:0/837921743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637c0c7160 con 0x7f637c0b4860 2023-07-09T21:51:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.087+0000 7f6372ffd700 1 -- 172.21.15.53:0/837921743 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6378026480 con 0x7f637c0b4860 2023-07-09T21:51:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.088+0000 7f6372ffd700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f636006ace0 0x7f636006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.088+0000 7f6372ffd700 1 -- 172.21.15.53:0/837921743 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6378021070 con 0x7f637c0b4860 2023-07-09T21:51:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.088+0000 7f6381b9a700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f636006ace0 0x7f636006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.089+0000 7f6381b9a700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f636006ace0 0x7f636006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f637c0cc1b0 tx=0x7f636c007be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:35.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.092+0000 7f6372ffd700 1 -- 172.21.15.53:0/837921743 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6378055fd0 con 0x7f637c0b4860 2023-07-09T21:51:35.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.380+0000 7f63845ff700 1 -- 172.21.15.53:0/837921743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f637c074350 con 0x7f637c0b4860 2023-07-09T21:51:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.384+0000 7f6372ffd700 1 -- 172.21.15.53:0/837921743 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f637802b0a0 con 0x7f637c0b4860 2023-07-09T21:51:35.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.386+0000 7f63845ff700 1 -- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f636006ace0 msgr2=0x7f636006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:35.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.386+0000 7f63845ff700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f636006ace0 0x7f636006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f637c0cc1b0 tx=0x7f636c007be0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.386+0000 7f63845ff700 1 -- 172.21.15.53:0/837921743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f637c0b4860 msgr2=0x7f637c0c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:35.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.386+0000 7f63845ff700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f637c0b4860 0x7f637c0c7490 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6378000c00 tx=0x7f6378004750 comp rx=0 tx=0).stop 2023-07-09T21:51:35.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.386+0000 7f63845ff700 1 -- 172.21.15.53:0/837921743 shutdown_connections 2023-07-09T21:51:35.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.386+0000 7f63845ff700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f636006ace0 0x7f636006d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.386+0000 7f63845ff700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f637c0d22d0 0x7f637c0c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.386+0000 7f63845ff700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f637c0b4860 0x7f637c0c7490 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.386+0000 7f63845ff700 1 --2- 172.21.15.53:0/837921743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f637c0cd430 0x7f637c14a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.386+0000 7f63845ff700 1 -- 172.21.15.53:0/837921743 >> 172.21.15.53:0/837921743 conn(0x7f637c066860 msgr2=0x7f637c0cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:35.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.386+0000 7f63845ff700 1 -- 172.21.15.53:0/837921743 shutdown_connections 2023-07-09T21:51:35.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.386+0000 7f63845ff700 1 -- 172.21.15.53:0/837921743 wait complete. 2023-07-09T21:51:35.406 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-09T21:51:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.607+0000 7f9d80fff700 1 Processor -- start 2023-07-09T21:51:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.607+0000 7f9d80fff700 1 -- start start 2023-07-09T21:51:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.608+0000 7f9d80fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d7c0d0430 0x7f9d7c0b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.608+0000 7f9d80fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9d7c0b6430 0x7f9d7c0b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.608+0000 7f9d80fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c15cd60 con 0x7f9d7c0b4600 2023-07-09T21:51:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.608+0000 7f9d80fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c0d1550 con 0x7f9d7c0b6430 2023-07-09T21:51:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.608+0000 7f9d80fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0d2d90 con 0x7f9d7c0d0430 2023-07-09T21:51:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.609+0000 7f9d7ad9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9d7c0b6430 0x7f9d7c0b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.609+0000 7f9d7ad9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9d7c0b6430 0x7f9d7c0b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35676/0 (socket says 172.21.15.53:35676) 2023-07-09T21:51:35.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.609+0000 7f9d7ad9d700 1 -- 172.21.15.53:0/1185282003 learned_addr learned my addr 172.21.15.53:0/1185282003 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:35.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.609+0000 7f9d79d9b700 1 --2- 172.21.15.53:0/1185282003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d7c0d0430 0x7f9d7c0b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:35.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.609+0000 7f9d7ad9d700 1 -- 172.21.15.53:0/1185282003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d7c0d0430 msgr2=0x7f9d7c0b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:35.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.609+0000 7f9d7ad9d700 1 --2- 172.21.15.53:0/1185282003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d7c0d0430 0x7f9d7c0b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.609+0000 7f9d7ad9d700 1 -- 172.21.15.53:0/1185282003 >> v1:172.21.15.184:6789/0 conn(0x7f9d7c0b4600 legacy=0x7f9d7c0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:35.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.609+0000 7f9d7ad9d700 1 -- 172.21.15.53:0/1185282003 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c0cf340 con 0x7f9d7c0b6430 2023-07-09T21:51:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.609+0000 7f9d7ad9d700 1 --2- 172.21.15.53:0/1185282003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c0b6430 0x7f9d7c0b68b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009e80 tx=0x7f9d7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698f0e51b7af8c94 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.610+0000 7f9d7959a700 1 -- 172.21.15.53:0/1185282003 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7400e070 con 0x7f9d7c0b6430 2023-07-09T21:51:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.610+0000 7f9d7959a700 1 -- 172.21.15.53:0/1185282003 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7400b8d0 con 0x7f9d7c0b6430 2023-07-09T21:51:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.610+0000 7f9d7959a700 1 -- 172.21.15.53:0/1185282003 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7400bc80 con 0x7f9d7c0b6430 2023-07-09T21:51:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.610+0000 7f9d80fff700 1 -- 172.21.15.53:0/1185282003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c0b6430 msgr2=0x7f9d7c0b68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.610+0000 7f9d80fff700 1 --2- 172.21.15.53:0/1185282003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c0b6430 0x7f9d7c0b68b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009e80 tx=0x7f9d7400b330 comp rx=0 tx=0).stop 2023-07-09T21:51:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.610+0000 7f9d80fff700 1 -- 172.21.15.53:0/1185282003 shutdown_connections 2023-07-09T21:51:35.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.610+0000 7f9d80fff700 1 --2- 172.21.15.53:0/1185282003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c0b6430 0x7f9d7c0b68b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.610+0000 7f9d80fff700 1 --2- 172.21.15.53:0/1185282003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d7c0d0430 0x7f9d7c0b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.610+0000 7f9d80fff700 1 -- 172.21.15.53:0/1185282003 >> 172.21.15.53:0/1185282003 conn(0x7f9d7c09c200 msgr2=0x7f9d7c0d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:35.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.610+0000 7f9d80fff700 1 -- 172.21.15.53:0/1185282003 shutdown_connections 2023-07-09T21:51:35.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.610+0000 7f9d80fff700 1 -- 172.21.15.53:0/1185282003 wait complete. 2023-07-09T21:51:35.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.612+0000 7f9d80fff700 1 Processor -- start 2023-07-09T21:51:35.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.612+0000 7f9d80fff700 1 -- start start 2023-07-09T21:51:35.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.613+0000 7f9d80fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d7c0b6430 0x7f9d7c157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:35.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.613+0000 7f9d80fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d7c0d0430 0x7f9d7c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:35.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.613+0000 7f9d80fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c159370 0x7f9d7c0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.613+0000 7f9d80fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c158ee0 con 0x7f9d7c159370 2023-07-09T21:51:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.613+0000 7f9d80fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c1582d0 con 0x7f9d7c0d0430 2023-07-09T21:51:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.613+0000 7f9d80fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c1585b0 con 0x7f9d7c0b6430 2023-07-09T21:51:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.614+0000 7f9d7ad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c159370 0x7f9d7c0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.614+0000 7f9d7ad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c159370 0x7f9d7c0b7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35678/0 (socket says 172.21.15.53:35678) 2023-07-09T21:51:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.614+0000 7f9d7ad9d700 1 -- 172.21.15.53:0/3129164562 learned_addr learned my addr 172.21.15.53:0/3129164562 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.614+0000 7f9d7a59c700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d7c0b6430 0x7f9d7c157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.614+0000 7f9d79d9b700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d7c0d0430 0x7f9d7c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.614+0000 7f9d7ad9d700 1 -- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d7c0b6430 msgr2=0x7f9d7c157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.614+0000 7f9d7ad9d700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d7c0b6430 0x7f9d7c157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.614+0000 7f9d7ad9d700 1 -- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d7c0d0430 msgr2=0x7f9d7c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.614+0000 7f9d7ad9d700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d7c0d0430 0x7f9d7c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.614+0000 7f9d7ad9d700 1 -- 172.21.15.53:0/3129164562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d74009b30 con 0x7f9d7c159370 2023-07-09T21:51:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.614+0000 7f9d7ad9d700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c159370 0x7f9d7c0b7850 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0b5ae0 tx=0x7f9d74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.615+0000 7f9d6affd700 1 -- 172.21.15.53:0/3129164562 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74004800 con 0x7f9d7c159370 2023-07-09T21:51:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.615+0000 7f9d6affd700 1 -- 172.21.15.53:0/3129164562 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d74004960 con 0x7f9d7c159370 2023-07-09T21:51:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.615+0000 7f9d80fff700 1 -- 172.21.15.53:0/3129164562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c158890 con 0x7f9d7c159370 2023-07-09T21:51:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.615+0000 7f9d6affd700 1 -- 172.21.15.53:0/3129164562 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7401c680 con 0x7f9d7c159370 2023-07-09T21:51:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.615+0000 7f9d80fff700 1 -- 172.21.15.53:0/3129164562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c1578b0 con 0x7f9d7c159370 2023-07-09T21:51:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.616+0000 7f9d80fff700 1 -- 172.21.15.53:0/3129164562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c159090 con 0x7f9d7c159370 2023-07-09T21:51:35.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.617+0000 7f9d6affd700 1 -- 172.21.15.53:0/3129164562 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9d7401c7e0 con 0x7f9d7c159370 2023-07-09T21:51:35.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.618+0000 7f9d6affd700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9d5c06ace0 0x7f9d5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:35.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.618+0000 7f9d6affd700 1 -- 172.21.15.53:0/3129164562 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9d7408aa80 con 0x7f9d7c159370 2023-07-09T21:51:35.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.618+0000 7f9d7a59c700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9d5c06ace0 0x7f9d5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:35.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.619+0000 7f9d7a59c700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9d5c06ace0 0x7f9d5c06d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0a0cf0 tx=0x7f9d6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:35.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.622+0000 7f9d6affd700 1 -- 172.21.15.53:0/3129164562 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9d7c159090 con 0x7f9d7c159370 2023-07-09T21:51:35.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.912+0000 7f9d80fff700 1 -- 172.21.15.53:0/3129164562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f9d7c074350 con 0x7f9d7c159370 2023-07-09T21:51:35.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.916+0000 7f9d6affd700 1 -- 172.21.15.53:0/3129164562 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9d74055e70 con 0x7f9d7c159370 2023-07-09T21:51:35.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.918+0000 7f9d80fff700 1 -- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9d5c06ace0 msgr2=0x7f9d5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:35.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.918+0000 7f9d80fff700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9d5c06ace0 0x7f9d5c06d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0a0cf0 tx=0x7f9d6c009040 comp rx=0 tx=0).stop 2023-07-09T21:51:35.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.918+0000 7f9d80fff700 1 -- 172.21.15.53:0/3129164562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c159370 msgr2=0x7f9d7c0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:35.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.918+0000 7f9d80fff700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c159370 0x7f9d7c0b7850 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0b5ae0 tx=0x7f9d74004ad0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.918+0000 7f9d80fff700 1 -- 172.21.15.53:0/3129164562 shutdown_connections 2023-07-09T21:51:35.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.918+0000 7f9d80fff700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9d5c06ace0 0x7f9d5c06d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.918+0000 7f9d80fff700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c159370 0x7f9d7c0b7850 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.918+0000 7f9d80fff700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d7c0b6430 0x7f9d7c157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.918+0000 7f9d80fff700 1 --2- 172.21.15.53:0/3129164562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d7c0d0430 0x7f9d7c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:35.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.918+0000 7f9d80fff700 1 -- 172.21.15.53:0/3129164562 >> 172.21.15.53:0/3129164562 conn(0x7f9d7c09c200 msgr2=0x7f9d7c06b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:35.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.918+0000 7f9d80fff700 1 -- 172.21.15.53:0/3129164562 shutdown_connections 2023-07-09T21:51:35.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:35.918+0000 7f9d80fff700 1 -- 172.21.15.53:0/3129164562 wait complete. 2023-07-09T21:51:35.938 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-09T21:51:36.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.139+0000 7f92cadff700 1 Processor -- start 2023-07-09T21:51:36.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.139+0000 7f92cadff700 1 -- start start 2023-07-09T21:51:36.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.140+0000 7f92cadff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f92c40d1220 0x7f92c40b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:36.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.140+0000 7f92cadff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c40b0e20 0x7f92c40b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:36.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.140+0000 7f92cadff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c40b8e80 con 0x7f92c40b3ff0 2023-07-09T21:51:36.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.140+0000 7f92cadff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c40afaa0 con 0x7f92c40d1220 2023-07-09T21:51:36.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.140+0000 7f92cadff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40afd80 con 0x7f92c40b0e20 2023-07-09T21:51:36.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.141+0000 7f92c939c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c40b0e20 0x7f92c40b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:36.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.141+0000 7f92c939c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c40b0e20 0x7f92c40b1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:49030/0 (socket says 172.21.15.53:49030) 2023-07-09T21:51:36.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.141+0000 7f92c8b9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f92c40b3ff0 0x7f92c40d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:56706/0 (socket says 172.21.15.53:56706) 2023-07-09T21:51:36.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.141+0000 7f92c3fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f92c40d1220 0x7f92c40b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:36.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.141+0000 7f92c939c700 1 -- 172.21.15.53:0/55723615 learned_addr learned my addr 172.21.15.53:0/55723615 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:36.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.141+0000 7f92c37fe700 1 -- 172.21.15.53:0/55723615 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200840153 0 0) 0x7f92b8001110 con 0x7f92c40b3ff0 2023-07-09T21:51:36.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.141+0000 7f92c37fe700 1 -- 172.21.15.53:0/55723615 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92b40035b0 con 0x7f92c40b3ff0 2023-07-09T21:51:36.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.141+0000 7f92c3fff700 1 -- 172.21.15.53:0/55723615 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c40b0e20 msgr2=0x7f92c40b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:36.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.141+0000 7f92c3fff700 1 --2- 172.21.15.53:0/55723615 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c40b0e20 0x7f92c40b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.141+0000 7f92c3fff700 1 -- 172.21.15.53:0/55723615 >> v1:172.21.15.184:6789/0 conn(0x7f92c40b3ff0 legacy=0x7f92c40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:36.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.141+0000 7f92c3fff700 1 -- 172.21.15.53:0/55723615 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c40b0060 con 0x7f92c40d1220 2023-07-09T21:51:36.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.142+0000 7f92c3fff700 1 --2- 172.21.15.53:0/55723615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c40d1220 0x7f92c40b43c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009840 tx=0x7f92b0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b3efd25bbc0d20 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:36.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.142+0000 7f92c37fe700 1 -- 172.21.15.53:0/55723615 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0011830 con 0x7f92c40d1220 2023-07-09T21:51:36.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.142+0000 7f92c37fe700 1 -- 172.21.15.53:0/55723615 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b0011990 con 0x7f92c40d1220 2023-07-09T21:51:36.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.142+0000 7f92c37fe700 1 -- 172.21.15.53:0/55723615 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0011d00 con 0x7f92c40d1220 2023-07-09T21:51:36.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.142+0000 7f92cadff700 1 -- 172.21.15.53:0/55723615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c40d1220 msgr2=0x7f92c40b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:36.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.142+0000 7f92cadff700 1 --2- 172.21.15.53:0/55723615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c40d1220 0x7f92c40b43c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009840 tx=0x7f92b0009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:36.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.142+0000 7f92cadff700 1 -- 172.21.15.53:0/55723615 shutdown_connections 2023-07-09T21:51:36.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.142+0000 7f92cadff700 1 --2- 172.21.15.53:0/55723615 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c40b0e20 0x7f92c40b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.142+0000 7f92cadff700 1 --2- 172.21.15.53:0/55723615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c40d1220 0x7f92c40b43c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.142+0000 7f92cadff700 1 -- 172.21.15.53:0/55723615 >> 172.21.15.53:0/55723615 conn(0x7f92c409c1b0 msgr2=0x7f92c40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:36.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.143+0000 7f92cadff700 1 -- 172.21.15.53:0/55723615 shutdown_connections 2023-07-09T21:51:36.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.143+0000 7f92cadff700 1 -- 172.21.15.53:0/55723615 wait complete. 2023-07-09T21:51:36.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.144+0000 7f92cadff700 1 Processor -- start 2023-07-09T21:51:36.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.145+0000 7f92cadff700 1 -- start start 2023-07-09T21:51:36.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.145+0000 7f92cadff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c40b0e20 0x7f92c415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:36.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.145+0000 7f92cadff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c40b3ff0 0x7f92c415f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:36.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92cadff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c40d1220 0x7f92c40b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:36.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92cadff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c415e2e0 con 0x7f92c40b0e20 2023-07-09T21:51:36.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92cadff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c415e5c0 con 0x7f92c40d1220 2023-07-09T21:51:36.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92cadff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c415e8a0 con 0x7f92c40b3ff0 2023-07-09T21:51:36.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92c8b9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c40b0e20 0x7f92c415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:36.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92c8b9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c40b0e20 0x7f92c415f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35690/0 (socket says 172.21.15.53:35690) 2023-07-09T21:51:36.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92c8b9b700 1 -- 172.21.15.53:0/666453660 learned_addr learned my addr 172.21.15.53:0/666453660 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:36.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92c939c700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c40d1220 0x7f92c40b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:36.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92c3fff700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c40b3ff0 0x7f92c415f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:36.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92c8b9b700 1 -- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c40b3ff0 msgr2=0x7f92c415f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:36.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92c8b9b700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c40b3ff0 0x7f92c415f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92c8b9b700 1 -- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c40d1220 msgr2=0x7f92c40b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:36.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92c8b9b700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c40d1220 0x7f92c40b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92c8b9b700 1 -- 172.21.15.53:0/666453660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00094a0 con 0x7f92c40b0e20 2023-07-09T21:51:36.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.146+0000 7f92c3fff700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c40b3ff0 0x7f92c415f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:36.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.147+0000 7f92c8b9b700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c40b0e20 0x7f92c415f380 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f92b800c730 tx=0x7f92b800caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:36.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.147+0000 7f92c17fa700 1 -- 172.21.15.53:0/666453660 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8005cb0 con 0x7f92c40b0e20 2023-07-09T21:51:36.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.147+0000 7f92c17fa700 1 -- 172.21.15.53:0/666453660 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8005e10 con 0x7f92c40b0e20 2023-07-09T21:51:36.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.147+0000 7f92cadff700 1 -- 172.21.15.53:0/666453660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c415eb80 con 0x7f92c40b0e20 2023-07-09T21:51:36.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.147+0000 7f92c17fa700 1 -- 172.21.15.53:0/666453660 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80072f0 con 0x7f92c40b0e20 2023-07-09T21:51:36.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.147+0000 7f92cadff700 1 -- 172.21.15.53:0/666453660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c40b4900 con 0x7f92c40b0e20 2023-07-09T21:51:36.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.148+0000 7f92cadff700 1 -- 172.21.15.53:0/666453660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c415f0a0 con 0x7f92c40b0e20 2023-07-09T21:51:36.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.149+0000 7f92c17fa700 1 -- 172.21.15.53:0/666453660 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f92b8007450 con 0x7f92c40b0e20 2023-07-09T21:51:36.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.151+0000 7f92c17fa700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f92a806ace0 0x7f92a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:36.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.151+0000 7f92c17fa700 1 -- 172.21.15.53:0/666453660 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f92b80885e0 con 0x7f92c40b0e20 2023-07-09T21:51:36.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.151+0000 7f92c3fff700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f92a806ace0 0x7f92a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:36.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.152+0000 7f92c3fff700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f92a806ace0 0x7f92a806d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009fd0 tx=0x7f92b0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:36.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.155+0000 7f92c17fa700 1 -- 172.21.15.53:0/666453660 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f92c415f0a0 con 0x7f92c40b0e20 2023-07-09T21:51:36.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.448+0000 7f92cadff700 1 -- 172.21.15.53:0/666453660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f92c40b8e80 con 0x7f92c40b0e20 2023-07-09T21:51:36.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.452+0000 7f92c17fa700 1 -- 172.21.15.53:0/666453660 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f92c40b8e80 con 0x7f92c40b0e20 2023-07-09T21:51:36.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.455+0000 7f92cadff700 1 -- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f92a806ace0 msgr2=0x7f92a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:36.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.455+0000 7f92cadff700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f92a806ace0 0x7f92a806d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009fd0 tx=0x7f92b0008030 comp rx=0 tx=0).stop 2023-07-09T21:51:36.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.455+0000 7f92cadff700 1 -- 172.21.15.53:0/666453660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c40b0e20 msgr2=0x7f92c415f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:36.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.455+0000 7f92cadff700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c40b0e20 0x7f92c415f380 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f92b800c730 tx=0x7f92b800caf0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.455+0000 7f92cadff700 1 -- 172.21.15.53:0/666453660 shutdown_connections 2023-07-09T21:51:36.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.455+0000 7f92cadff700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f92a806ace0 0x7f92a806d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.455+0000 7f92cadff700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92c40d1220 0x7f92c40b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.455+0000 7f92cadff700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c40b0e20 0x7f92c415f380 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.455+0000 7f92cadff700 1 --2- 172.21.15.53:0/666453660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92c40b3ff0 0x7f92c415f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.455+0000 7f92cadff700 1 -- 172.21.15.53:0/666453660 >> 172.21.15.53:0/666453660 conn(0x7f92c409c1b0 msgr2=0x7f92c40d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:36.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.455+0000 7f92cadff700 1 -- 172.21.15.53:0/666453660 shutdown_connections 2023-07-09T21:51:36.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.455+0000 7f92cadff700 1 -- 172.21.15.53:0/666453660 wait complete. 2023-07-09T21:51:36.475 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-09T21:51:36.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.674+0000 7f7b58dff700 1 Processor -- start 2023-07-09T21:51:36.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.675+0000 7f7b58dff700 1 -- start start 2023-07-09T21:51:36.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.676+0000 7f7b58dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b540b43c0 0x7f7b540b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:36.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.676+0000 7f7b58dff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b540b8e80 con 0x7f7b540d1220 2023-07-09T21:51:36.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.676+0000 7f7b58dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b540afaa0 con 0x7f7b540b3ff0 2023-07-09T21:51:36.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.676+0000 7f7b58dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b540afd80 con 0x7f7b540b43c0 2023-07-09T21:51:36.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.676+0000 7f7b52d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b540b43c0 0x7f7b540b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:36.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.676+0000 7f7b52d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b540b43c0 0x7f7b540b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35706/0 (socket says 172.21.15.53:35706) 2023-07-09T21:51:36.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.676+0000 7f7b52d9d700 1 -- 172.21.15.53:0/1429008552 learned_addr learned my addr 172.21.15.53:0/1429008552 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:36.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.676+0000 7f7b4bfff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7b540d1220 0x7f7b540b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50062/0 (socket says 172.21.15.53:50062) 2023-07-09T21:51:36.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.677+0000 7f7b52d9d700 1 -- 172.21.15.53:0/1429008552 >> v1:172.21.15.184:6789/0 conn(0x7f7b540b3ff0 legacy=0x7f7b540d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:36.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.677+0000 7f7b52d9d700 1 -- 172.21.15.53:0/1429008552 >> v1:172.21.15.53:6789/0 conn(0x7f7b540d1220 legacy=0x7f7b540b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:36.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.677+0000 7f7b52d9d700 1 -- 172.21.15.53:0/1429008552 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b540b0060 con 0x7f7b540b43c0 2023-07-09T21:51:36.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.677+0000 7f7b51d9b700 1 -- 172.21.15.53:0/1429008552 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672533633 0 0) 0x7f7b3c001110 con 0x7f7b540d1220 2023-07-09T21:51:36.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.677+0000 7f7b52d9d700 1 --2- 172.21.15.53:0/1429008552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b540b43c0 0x7f7b540b1530 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009e50 tx=0x7f7b4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464d4dfde142927c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:36.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.677+0000 7f7b51d9b700 1 -- 172.21.15.53:0/1429008552 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c00e070 con 0x7f7b540b43c0 2023-07-09T21:51:36.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.677+0000 7f7b51d9b700 1 -- 172.21.15.53:0/1429008552 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4c003a20 con 0x7f7b540b43c0 2023-07-09T21:51:36.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.677+0000 7f7b51d9b700 1 -- 172.21.15.53:0/1429008552 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c003dd0 con 0x7f7b540b43c0 2023-07-09T21:51:36.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.678+0000 7f7b58dff700 1 -- 172.21.15.53:0/1429008552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b540b43c0 msgr2=0x7f7b540b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:36.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.678+0000 7f7b58dff700 1 --2- 172.21.15.53:0/1429008552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b540b43c0 0x7f7b540b1530 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009e50 tx=0x7f7b4c00b330 comp rx=0 tx=0).stop 2023-07-09T21:51:36.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.678+0000 7f7b58dff700 1 -- 172.21.15.53:0/1429008552 shutdown_connections 2023-07-09T21:51:36.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.678+0000 7f7b58dff700 1 --2- 172.21.15.53:0/1429008552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b540b43c0 0x7f7b540b1530 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.678+0000 7f7b58dff700 1 -- 172.21.15.53:0/1429008552 >> 172.21.15.53:0/1429008552 conn(0x7f7b5409c1b0 msgr2=0x7f7b540d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:36.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.678+0000 7f7b58dff700 1 -- 172.21.15.53:0/1429008552 shutdown_connections 2023-07-09T21:51:36.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.678+0000 7f7b58dff700 1 -- 172.21.15.53:0/1429008552 wait complete. 2023-07-09T21:51:36.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.680+0000 7f7b58dff700 1 Processor -- start 2023-07-09T21:51:36.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.680+0000 7f7b58dff700 1 -- start start 2023-07-09T21:51:36.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b58dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b540b3ff0 0x7f7b5415d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:36.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b58dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b540b43c0 0x7f7b541566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:36.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b58dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b540d1220 0x7f7b540b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:36.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b58dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5415b1c0 con 0x7f7b540b3ff0 2023-07-09T21:51:36.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b58dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b54159c10 con 0x7f7b540d1220 2023-07-09T21:51:36.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b58dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5415e830 con 0x7f7b540b43c0 2023-07-09T21:51:36.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b5259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b540b3ff0 0x7f7b5415d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:36.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b5259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b540b3ff0 0x7f7b5415d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35712/0 (socket says 172.21.15.53:35712) 2023-07-09T21:51:36.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b5259c700 1 -- 172.21.15.53:0/185976227 learned_addr learned my addr 172.21.15.53:0/185976227 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:36.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b52d9d700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b540d1220 0x7f7b540b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:36.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b5259c700 1 -- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b540b43c0 msgr2=0x7f7b541566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:36.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b4bfff700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b540b43c0 0x7f7b541566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:36.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b5259c700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b540b43c0 0x7f7b541566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b5259c700 1 -- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b540d1220 msgr2=0x7f7b540b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:36.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b5259c700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b540d1220 0x7f7b540b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b5259c700 1 -- 172.21.15.53:0/185976227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c009b30 con 0x7f7b540b3ff0 2023-07-09T21:51:36.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b52d9d700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b540d1220 0x7f7b540b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:36.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.681+0000 7f7b4bfff700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b540b43c0 0x7f7b541566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:36.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.682+0000 7f7b5259c700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b540b3ff0 0x7f7b5415d7c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400c4d0 tx=0x7f7b4400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:36.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.682+0000 7f7b4affd700 1 -- 172.21.15.53:0/185976227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44011790 con 0x7f7b540b3ff0 2023-07-09T21:51:36.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.682+0000 7f7b4affd700 1 -- 172.21.15.53:0/185976227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b440118f0 con 0x7f7b540b3ff0 2023-07-09T21:51:36.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.682+0000 7f7b4affd700 1 -- 172.21.15.53:0/185976227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44011ca0 con 0x7f7b540b3ff0 2023-07-09T21:51:36.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.682+0000 7f7b58dff700 1 -- 172.21.15.53:0/185976227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5415aee0 con 0x7f7b540b3ff0 2023-07-09T21:51:36.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.682+0000 7f7b58dff700 1 -- 172.21.15.53:0/185976227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5415e4c0 con 0x7f7b540b3ff0 2023-07-09T21:51:36.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.683+0000 7f7b58dff700 1 -- 172.21.15.53:0/185976227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5415e650 con 0x7f7b540b3ff0 2023-07-09T21:51:36.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.684+0000 7f7b4affd700 1 -- 172.21.15.53:0/185976227 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b4401c460 con 0x7f7b540b3ff0 2023-07-09T21:51:36.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.685+0000 7f7b4affd700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7b3406ace0 0x7f7b3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.685+0000 7f7b4affd700 1 -- 172.21.15.53:0/185976227 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7b44088ff0 con 0x7f7b540b3ff0 2023-07-09T21:51:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.686+0000 7f7b4bfff700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7b3406ace0 0x7f7b3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.686+0000 7f7b4bfff700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7b3406ace0 0x7f7b3406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c007fd0 tx=0x7f7b3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.689+0000 7f7b4affd700 1 -- 172.21.15.53:0/185976227 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7b440543e0 con 0x7f7b540b3ff0 2023-07-09T21:51:36.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.977+0000 7f7b58dff700 1 -- 172.21.15.53:0/185976227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f7b5415e040 con 0x7f7b540b3ff0 2023-07-09T21:51:36.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.981+0000 7f7b4affd700 1 -- 172.21.15.53:0/185976227 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7b5415e040 con 0x7f7b540b3ff0 2023-07-09T21:51:36.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.983+0000 7f7b58dff700 1 -- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7b3406ace0 msgr2=0x7f7b3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:36.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.983+0000 7f7b58dff700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7b3406ace0 0x7f7b3406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c007fd0 tx=0x7f7b3c009040 comp rx=0 tx=0).stop 2023-07-09T21:51:36.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.983+0000 7f7b58dff700 1 -- 172.21.15.53:0/185976227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b540b3ff0 msgr2=0x7f7b5415d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:36.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.983+0000 7f7b58dff700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b540b3ff0 0x7f7b5415d7c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400c4d0 tx=0x7f7b4400c890 comp rx=0 tx=0).stop 2023-07-09T21:51:36.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.983+0000 7f7b58dff700 1 -- 172.21.15.53:0/185976227 shutdown_connections 2023-07-09T21:51:36.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.983+0000 7f7b58dff700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7b3406ace0 0x7f7b3406d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.983+0000 7f7b58dff700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b540d1220 0x7f7b540b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.983+0000 7f7b58dff700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b540b3ff0 0x7f7b5415d7c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.983+0000 7f7b58dff700 1 --2- 172.21.15.53:0/185976227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b540b43c0 0x7f7b541566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:36.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.983+0000 7f7b58dff700 1 -- 172.21.15.53:0/185976227 >> 172.21.15.53:0/185976227 conn(0x7f7b5409c1b0 msgr2=0x7f7b540b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:36.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.983+0000 7f7b58dff700 1 -- 172.21.15.53:0/185976227 shutdown_connections 2023-07-09T21:51:36.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:36.983+0000 7f7b58dff700 1 -- 172.21.15.53:0/185976227 wait complete. 2023-07-09T21:51:37.002 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-09T21:51:37.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.201+0000 7feeb21ff700 1 Processor -- start 2023-07-09T21:51:37.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.201+0000 7feeb21ff700 1 -- start start 2023-07-09T21:51:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.202+0000 7feeb21ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7feeac0d1220 0x7feeac0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.202+0000 7feeb21ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeac0b0e20 0x7feeac0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.203+0000 7feeb21ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac0b8e80 con 0x7feeac0b3ff0 2023-07-09T21:51:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.203+0000 7feeb21ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac0afaa0 con 0x7feeac0d1220 2023-07-09T21:51:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.203+0000 7feeb21ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0afd80 con 0x7feeac0b0e20 2023-07-09T21:51:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.203+0000 7feeab7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7feeac0b3ff0 0x7feeac0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50076/0 (socket says 172.21.15.53:50076) 2023-07-09T21:51:37.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.203+0000 7feeab7fe700 1 -- 172.21.15.53:0/266603234 learned_addr learned my addr 172.21.15.53:0/266603234 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.203+0000 7feea3fff700 1 --2- 172.21.15.53:0/266603234 >> v2:172.21.15.184:3300/0 conn(0x7feeac0d1220 0x7feeac0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.203+0000 7feeabfff700 1 --2- 172.21.15.53:0/266603234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeac0b0e20 0x7feeac0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.203+0000 7feeaaffd700 1 -- 172.21.15.53:0/266603234 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666725994 0 0) 0x7fee9c001110 con 0x7feeac0b3ff0 2023-07-09T21:51:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.203+0000 7feeaaffd700 1 -- 172.21.15.53:0/266603234 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee980035b0 con 0x7feeac0b3ff0 2023-07-09T21:51:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.204+0000 7feeaaffd700 1 -- 172.21.15.53:0/266603234 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 326763316 0 0) 0x7fee980035b0 con 0x7feeac0b3ff0 2023-07-09T21:51:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.204+0000 7feea3fff700 1 -- 172.21.15.53:0/266603234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeac0b0e20 msgr2=0x7feeac0b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.204+0000 7feea3fff700 1 --2- 172.21.15.53:0/266603234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeac0b0e20 0x7feeac0b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.204+0000 7feea3fff700 1 -- 172.21.15.53:0/266603234 >> v1:172.21.15.53:6789/0 conn(0x7feeac0b3ff0 legacy=0x7feeac0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.204+0000 7feea3fff700 1 -- 172.21.15.53:0/266603234 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac0b0060 con 0x7feeac0d1220 2023-07-09T21:51:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.204+0000 7feea3fff700 1 --2- 172.21.15.53:0/266603234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeac0d1220 0x7feeac0b43c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fee94009840 tx=0x7fee94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b94cc5cc596b9de0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.204+0000 7feeaaffd700 1 -- 172.21.15.53:0/266603234 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c001800 con 0x7feeac0d1220 2023-07-09T21:51:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.204+0000 7feeaaffd700 1 -- 172.21.15.53:0/266603234 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee94004030 con 0x7feeac0d1220 2023-07-09T21:51:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.204+0000 7feeaaffd700 1 -- 172.21.15.53:0/266603234 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940043c0 con 0x7feeac0d1220 2023-07-09T21:51:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.205+0000 7feeb21ff700 1 -- 172.21.15.53:0/266603234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeac0d1220 msgr2=0x7feeac0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.205+0000 7feeb21ff700 1 --2- 172.21.15.53:0/266603234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeac0d1220 0x7feeac0b43c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fee94009840 tx=0x7fee94009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.205+0000 7feeb21ff700 1 -- 172.21.15.53:0/266603234 shutdown_connections 2023-07-09T21:51:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.205+0000 7feeb21ff700 1 --2- 172.21.15.53:0/266603234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeac0b0e20 0x7feeac0b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.205+0000 7feeb21ff700 1 --2- 172.21.15.53:0/266603234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeac0d1220 0x7feeac0b43c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.205+0000 7feeb21ff700 1 -- 172.21.15.53:0/266603234 >> 172.21.15.53:0/266603234 conn(0x7feeac09c1b0 msgr2=0x7feeac0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.205+0000 7feeb21ff700 1 -- 172.21.15.53:0/266603234 shutdown_connections 2023-07-09T21:51:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.205+0000 7feeb21ff700 1 -- 172.21.15.53:0/266603234 wait complete. 2023-07-09T21:51:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.207+0000 7feeb21ff700 1 Processor -- start 2023-07-09T21:51:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.207+0000 7feeb21ff700 1 -- start start 2023-07-09T21:51:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.208+0000 7feeb21ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeac0b0e20 0x7feeac156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.208+0000 7feeb21ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeac0b3ff0 0x7feeac0cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.208+0000 7feeb21ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeac0d1220 0x7feeac15ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.208+0000 7feeb21ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0cffa0 con 0x7feeac0b0e20 2023-07-09T21:51:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.208+0000 7feeb21ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0d0280 con 0x7feeac0b3ff0 2023-07-09T21:51:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.208+0000 7feeb21ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0d0560 con 0x7feeac0d1220 2023-07-09T21:51:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.208+0000 7feeab7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeac0b0e20 0x7feeac156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.208+0000 7feeab7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeac0b0e20 0x7feeac156e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35728/0 (socket says 172.21.15.53:35728) 2023-07-09T21:51:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.208+0000 7feeab7fe700 1 -- 172.21.15.53:0/1603700480 learned_addr learned my addr 172.21.15.53:0/1603700480 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.209+0000 7feea3fff700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeac0b3ff0 0x7feeac0cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.209+0000 7feeabfff700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeac0d1220 0x7feeac15ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.209+0000 7feeab7fe700 1 -- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeac0d1220 msgr2=0x7feeac15ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.209+0000 7feeab7fe700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeac0d1220 0x7feeac15ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.209+0000 7feeab7fe700 1 -- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeac0b3ff0 msgr2=0x7feeac0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.209+0000 7feeab7fe700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeac0b3ff0 0x7feeac0cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.209+0000 7feeab7fe700 1 -- 172.21.15.53:0/1603700480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee940094a0 con 0x7feeac0b0e20 2023-07-09T21:51:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.209+0000 7feeab7fe700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeac0b0e20 0x7feeac156e40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c750 tx=0x7fee9c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.209+0000 7feea8ff9700 1 -- 172.21.15.53:0/1603700480 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c004c80 con 0x7feeac0b0e20 2023-07-09T21:51:37.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.209+0000 7feea8ff9700 1 -- 172.21.15.53:0/1603700480 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c004de0 con 0x7feeac0b0e20 2023-07-09T21:51:37.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.209+0000 7feea8ff9700 1 -- 172.21.15.53:0/1603700480 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c0072f0 con 0x7feeac0b0e20 2023-07-09T21:51:37.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.209+0000 7feeb21ff700 1 -- 172.21.15.53:0/1603700480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac0ca8e0 con 0x7feeac0b0e20 2023-07-09T21:51:37.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.210+0000 7feeb21ff700 1 -- 172.21.15.53:0/1603700480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac157380 con 0x7feeac0b0e20 2023-07-09T21:51:37.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.211+0000 7feeb21ff700 1 -- 172.21.15.53:0/1603700480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac0cae00 con 0x7feeac0b0e20 2023-07-09T21:51:37.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.212+0000 7feea8ff9700 1 -- 172.21.15.53:0/1603700480 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee9c007450 con 0x7feeac0b0e20 2023-07-09T21:51:37.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.212+0000 7feea8ff9700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fee8c06ad10 0x7fee8c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:37.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.213+0000 7feea8ff9700 1 -- 172.21.15.53:0/1603700480 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fee9c088d30 con 0x7feeac0b0e20 2023-07-09T21:51:37.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.213+0000 7feea3fff700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fee8c06ad10 0x7fee8c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:37.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.214+0000 7feea3fff700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fee8c06ad10 0x7fee8c06d1c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fee940090b0 tx=0x7fee94008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:37.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.217+0000 7feea8ff9700 1 -- 172.21.15.53:0/1603700480 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feeac0cae00 con 0x7feeac0b0e20 2023-07-09T21:51:37.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.506+0000 7feeb21ff700 1 -- 172.21.15.53:0/1603700480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7feeac0b8e80 con 0x7feeac0b0e20 2023-07-09T21:51:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.510+0000 7feea8ff9700 1 -- 172.21.15.53:0/1603700480 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7feeac0b8e80 con 0x7feeac0b0e20 2023-07-09T21:51:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.513+0000 7feeb21ff700 1 -- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fee8c06ad10 msgr2=0x7fee8c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.513+0000 7feeb21ff700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fee8c06ad10 0x7fee8c06d1c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fee940090b0 tx=0x7fee94008030 comp rx=0 tx=0).stop 2023-07-09T21:51:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.513+0000 7feeb21ff700 1 -- 172.21.15.53:0/1603700480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeac0b0e20 msgr2=0x7feeac156e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.513+0000 7feeb21ff700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeac0b0e20 0x7feeac156e40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c750 tx=0x7fee9c00ca60 comp rx=0 tx=0).stop 2023-07-09T21:51:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.513+0000 7feeb21ff700 1 -- 172.21.15.53:0/1603700480 shutdown_connections 2023-07-09T21:51:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.513+0000 7feeb21ff700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fee8c06ad10 0x7fee8c06d1c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.513+0000 7feeb21ff700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeac0d1220 0x7feeac15ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.513+0000 7feeb21ff700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeac0b0e20 0x7feeac156e40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.513+0000 7feeb21ff700 1 --2- 172.21.15.53:0/1603700480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeac0b3ff0 0x7feeac0cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.513+0000 7feeb21ff700 1 -- 172.21.15.53:0/1603700480 >> 172.21.15.53:0/1603700480 conn(0x7feeac09c1b0 msgr2=0x7feeac0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:37.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.513+0000 7feeb21ff700 1 -- 172.21.15.53:0/1603700480 shutdown_connections 2023-07-09T21:51:37.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.513+0000 7feeb21ff700 1 -- 172.21.15.53:0/1603700480 wait complete. 2023-07-09T21:51:37.532 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:37.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.732+0000 7f4bc67ff700 1 Processor -- start 2023-07-09T21:51:37.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.733+0000 7f4bc67ff700 1 -- start start 2023-07-09T21:51:37.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.734+0000 7f4bc67ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4bc00b1e00 0x7f4bc00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:37.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.734+0000 7f4bc67ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4bc00d1220 0x7f4bc00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:37.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.734+0000 7f4bc67ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc00d2ce0 con 0x7f4bc00b2350 2023-07-09T21:51:37.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.734+0000 7f4bc67ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc00b3350 con 0x7f4bc00d1220 2023-07-09T21:51:37.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.734+0000 7f4bc67ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc00b3630 con 0x7f4bc00b1e00 2023-07-09T21:51:37.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.734+0000 7f4bc4d9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4bc00d1220 0x7f4bc00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:37.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.734+0000 7f4bbf7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4bc00b2350 0x7f4bc00d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50084/0 (socket says 172.21.15.53:50084) 2023-07-09T21:51:37.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.734+0000 7f4bbf7fe700 1 -- 172.21.15.53:0/1952325230 learned_addr learned my addr 172.21.15.53:0/1952325230 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:37.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.734+0000 7f4bbffff700 1 --2- 172.21.15.53:0/1952325230 >> v2:172.21.15.184:3300/0 conn(0x7f4bc00b1e00 0x7f4bc00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:37.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.735+0000 7f4bc4d9c700 1 -- 172.21.15.53:0/1952325230 >> v2:172.21.15.184:3300/0 conn(0x7f4bc00b1e00 msgr2=0x7f4bc00b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:37.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.735+0000 7f4bc4d9c700 1 --2- 172.21.15.53:0/1952325230 >> v2:172.21.15.184:3300/0 conn(0x7f4bc00b1e00 0x7f4bc00b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.735+0000 7f4bc4d9c700 1 -- 172.21.15.53:0/1952325230 >> v1:172.21.15.53:6789/0 conn(0x7f4bc00b2350 legacy=0x7f4bc00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:37.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.735+0000 7f4bc4d9c700 1 -- 172.21.15.53:0/1952325230 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc00b3910 con 0x7f4bc00d1220 2023-07-09T21:51:37.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.735+0000 7f4bbeffd700 1 -- 172.21.15.53:0/1952325230 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018486398 0 0) 0x7f4bc00d2ce0 con 0x7f4bc00b2350 2023-07-09T21:51:37.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.735+0000 7f4bc4d9c700 1 --2- 172.21.15.53:0/1952325230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bc00d1220 0x7f4bc00afac0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4bc008d170 tx=0x7f4bb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0907ab33890772a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:37.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.735+0000 7f4bbeffd700 1 -- 172.21.15.53:0/1952325230 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb800e070 con 0x7f4bc00d1220 2023-07-09T21:51:37.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.735+0000 7f4bbeffd700 1 -- 172.21.15.53:0/1952325230 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb800bb20 con 0x7f4bc00d1220 2023-07-09T21:51:37.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.735+0000 7f4bbeffd700 1 -- 172.21.15.53:0/1952325230 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8012430 con 0x7f4bc00d1220 2023-07-09T21:51:37.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.736+0000 7f4bc67ff700 1 -- 172.21.15.53:0/1952325230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bc00d1220 msgr2=0x7f4bc00afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:37.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.736+0000 7f4bc67ff700 1 --2- 172.21.15.53:0/1952325230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bc00d1220 0x7f4bc00afac0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4bc008d170 tx=0x7f4bb800b330 comp rx=0 tx=0).stop 2023-07-09T21:51:37.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.736+0000 7f4bc67ff700 1 -- 172.21.15.53:0/1952325230 shutdown_connections 2023-07-09T21:51:37.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.736+0000 7f4bc67ff700 1 --2- 172.21.15.53:0/1952325230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bc00d1220 0x7f4bc00afac0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.736+0000 7f4bc67ff700 1 --2- 172.21.15.53:0/1952325230 >> v2:172.21.15.184:3300/0 conn(0x7f4bc00b1e00 0x7f4bc00b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.736+0000 7f4bc67ff700 1 -- 172.21.15.53:0/1952325230 >> 172.21.15.53:0/1952325230 conn(0x7f4bc009c1d0 msgr2=0x7f4bc00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:37.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.736+0000 7f4bc67ff700 1 -- 172.21.15.53:0/1952325230 shutdown_connections 2023-07-09T21:51:37.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.736+0000 7f4bc67ff700 1 -- 172.21.15.53:0/1952325230 wait complete. 2023-07-09T21:51:37.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.738+0000 7f4bc67ff700 1 Processor -- start 2023-07-09T21:51:37.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.738+0000 7f4bc67ff700 1 -- start start 2023-07-09T21:51:37.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.739+0000 7f4bc67ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bc00b1e00 0x7f4bc00cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:37.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.739+0000 7f4bc67ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bc00b2350 0x7f4bc00c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:37.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.739+0000 7f4bc67ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4bc00d1220 0x7f4bc00c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:37.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.739+0000 7f4bc67ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00b7b30 con 0x7f4bc00b1e00 2023-07-09T21:51:37.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.739+0000 7f4bc67ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00b6f20 con 0x7f4bc00b2350 2023-07-09T21:51:37.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.739+0000 7f4bc67ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00b7200 con 0x7f4bc00d1220 2023-07-09T21:51:37.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.739+0000 7f4bbffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bc00b1e00 0x7f4bc00cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:37.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.739+0000 7f4bbffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bc00b1e00 0x7f4bc00cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35750/0 (socket says 172.21.15.53:35750) 2023-07-09T21:51:37.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.739+0000 7f4bbffff700 1 -- 172.21.15.53:0/2430916727 learned_addr learned my addr 172.21.15.53:0/2430916727 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:37.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.739+0000 7f4bbf7fe700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bc00b2350 0x7f4bc00c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:37.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.739+0000 7f4bc4d9c700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4bc00d1220 0x7f4bc00c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:37.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.740+0000 7f4bbffff700 1 -- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4bc00d1220 msgr2=0x7f4bc00c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:37.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.740+0000 7f4bbffff700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4bc00d1220 0x7f4bc00c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.740+0000 7f4bbffff700 1 -- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bc00b2350 msgr2=0x7f4bc00c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:37.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.740+0000 7f4bbffff700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bc00b2350 0x7f4bc00c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.740+0000 7f4bbffff700 1 -- 172.21.15.53:0/2430916727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb8009a70 con 0x7f4bc00b1e00 2023-07-09T21:51:37.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.740+0000 7f4bbffff700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bc00b1e00 0x7f4bc00cf7f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000e990 tx=0x7f4bb000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:37.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.740+0000 7f4bbcff9700 1 -- 172.21.15.53:0/2430916727 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb00096f0 con 0x7f4bc00b1e00 2023-07-09T21:51:37.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.740+0000 7f4bbcff9700 1 -- 172.21.15.53:0/2430916727 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb000c690 con 0x7f4bc00b1e00 2023-07-09T21:51:37.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.740+0000 7f4bbcff9700 1 -- 172.21.15.53:0/2430916727 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000ca00 con 0x7f4bc00b1e00 2023-07-09T21:51:37.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.740+0000 7f4bc67ff700 1 -- 172.21.15.53:0/2430916727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc00b74e0 con 0x7f4bc00b1e00 2023-07-09T21:51:37.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.740+0000 7f4bc67ff700 1 -- 172.21.15.53:0/2430916727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc00cfd30 con 0x7f4bc00b1e00 2023-07-09T21:51:37.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.741+0000 7f4bc67ff700 1 -- 172.21.15.53:0/2430916727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc004e280 con 0x7f4bc00b1e00 2023-07-09T21:51:37.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.742+0000 7f4bbcff9700 1 -- 172.21.15.53:0/2430916727 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4bb000cb60 con 0x7f4bc00b1e00 2023-07-09T21:51:37.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.743+0000 7f4bbcff9700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ba006ace0 0x7f4ba006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:37.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.743+0000 7f4bbcff9700 1 -- 172.21.15.53:0/2430916727 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4bb0089410 con 0x7f4bc00b1e00 2023-07-09T21:51:37.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.744+0000 7f4bbf7fe700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ba006ace0 0x7f4ba006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:37.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.745+0000 7f4bbf7fe700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ba006ace0 0x7f4ba006d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00b1160 tx=0x7f4ba8007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:37.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.748+0000 7f4bbcff9700 1 -- 172.21.15.53:0/2430916727 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4bb0058330 con 0x7f4bc00b1e00 2023-07-09T21:51:37.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.964+0000 7f4bc67ff700 1 -- 172.21.15.53:0/2430916727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bc008c5a0 con 0x7f4bc00b1e00 2023-07-09T21:51:37.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.965+0000 7f4bbcff9700 1 -- 172.21.15.53:0/2430916727 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+14615 (secure 0 0 0) 0x7f4bb0057ec0 con 0x7f4bc00b1e00 2023-07-09T21:51:37.967 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:37.967 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":34,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:33.779722+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.967+0000 7f4bc67ff700 1 -- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ba006ace0 msgr2=0x7f4ba006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.967+0000 7f4bc67ff700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ba006ace0 0x7f4ba006d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00b1160 tx=0x7f4ba8007de0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.967+0000 7f4bc67ff700 1 -- 172.21.15.53:0/2430916727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bc00b1e00 msgr2=0x7f4bc00cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.967+0000 7f4bc67ff700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bc00b1e00 0x7f4bc00cf7f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000e990 tx=0x7f4bb000eca0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.968+0000 7f4bc67ff700 1 -- 172.21.15.53:0/2430916727 shutdown_connections 2023-07-09T21:51:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.968+0000 7f4bc67ff700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ba006ace0 0x7f4ba006d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.968+0000 7f4bc67ff700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4bc00d1220 0x7f4bc00c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.968+0000 7f4bc67ff700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bc00b1e00 0x7f4bc00cf7f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.968+0000 7f4bc67ff700 1 --2- 172.21.15.53:0/2430916727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bc00b2350 0x7f4bc00c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.968+0000 7f4bc67ff700 1 -- 172.21.15.53:0/2430916727 >> 172.21.15.53:0/2430916727 conn(0x7f4bc009c1d0 msgr2=0x7f4bc006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.968+0000 7f4bc67ff700 1 -- 172.21.15.53:0/2430916727 shutdown_connections 2023-07-09T21:51:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:37.968+0000 7f4bc67ff700 1 -- 172.21.15.53:0/2430916727 wait complete. 2023-07-09T21:51:37.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:51:37.987 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:51:38.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.189+0000 7fac1d7ff700 1 Processor -- start 2023-07-09T21:51:38.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.189+0000 7fac1d7ff700 1 -- start start 2023-07-09T21:51:38.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.190+0000 7fac1d7ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac180b43c0 0x7fac180b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:38.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.190+0000 7fac1d7ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac180b8e80 con 0x7fac180d1220 2023-07-09T21:51:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.190+0000 7fac1d7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac180afaa0 con 0x7fac180b3ff0 2023-07-09T21:51:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.190+0000 7fac1d7ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac180afd80 con 0x7fac180b43c0 2023-07-09T21:51:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.190+0000 7fac167fc700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fac180d1220 0x7fac180b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50090/0 (socket says 172.21.15.53:50090) 2023-07-09T21:51:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.190+0000 7fac167fc700 1 -- 172.21.15.53:0/2495974730 learned_addr learned my addr 172.21.15.53:0/2495974730 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.190+0000 7fac177fe700 1 --2- 172.21.15.53:0/2495974730 >> v2:172.21.15.53:3300/0 conn(0x7fac180b43c0 0x7fac180b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.191+0000 7fac15ffb700 1 -- 172.21.15.53:0/2495974730 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693432442 0 0) 0x7fac0c001110 con 0x7fac180d1220 2023-07-09T21:51:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.191+0000 7fac15ffb700 1 -- 172.21.15.53:0/2495974730 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac000035b0 con 0x7fac180d1220 2023-07-09T21:51:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.191+0000 7fac177fe700 1 -- 172.21.15.53:0/2495974730 >> v1:172.21.15.184:6789/0 conn(0x7fac180b3ff0 legacy=0x7fac180d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.191+0000 7fac177fe700 1 -- 172.21.15.53:0/2495974730 >> v1:172.21.15.53:6789/0 conn(0x7fac180d1220 legacy=0x7fac180b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.191+0000 7fac177fe700 1 -- 172.21.15.53:0/2495974730 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac180b0060 con 0x7fac180b43c0 2023-07-09T21:51:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.191+0000 7fac177fe700 1 --2- 172.21.15.53:0/2495974730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac180b43c0 0x7fac180b1530 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fac10009d90 tx=0x7fac1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3d71f22715885c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.191+0000 7fac15ffb700 1 -- 172.21.15.53:0/2495974730 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1000e070 con 0x7fac180b43c0 2023-07-09T21:51:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.192+0000 7fac15ffb700 1 -- 172.21.15.53:0/2495974730 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1000bb20 con 0x7fac180b43c0 2023-07-09T21:51:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.192+0000 7fac15ffb700 1 -- 172.21.15.53:0/2495974730 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10012430 con 0x7fac180b43c0 2023-07-09T21:51:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.192+0000 7fac1d7ff700 1 -- 172.21.15.53:0/2495974730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac180b43c0 msgr2=0x7fac180b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.192+0000 7fac1d7ff700 1 --2- 172.21.15.53:0/2495974730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac180b43c0 0x7fac180b1530 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fac10009d90 tx=0x7fac1000b330 comp rx=0 tx=0).stop 2023-07-09T21:51:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.192+0000 7fac1d7ff700 1 -- 172.21.15.53:0/2495974730 shutdown_connections 2023-07-09T21:51:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.192+0000 7fac1d7ff700 1 --2- 172.21.15.53:0/2495974730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac180b43c0 0x7fac180b1530 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.192+0000 7fac1d7ff700 1 -- 172.21.15.53:0/2495974730 >> 172.21.15.53:0/2495974730 conn(0x7fac1809c1b0 msgr2=0x7fac180d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.192+0000 7fac1d7ff700 1 -- 172.21.15.53:0/2495974730 shutdown_connections 2023-07-09T21:51:38.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.192+0000 7fac1d7ff700 1 -- 172.21.15.53:0/2495974730 wait complete. 2023-07-09T21:51:38.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.194+0000 7fac1d7ff700 1 Processor -- start 2023-07-09T21:51:38.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.194+0000 7fac1d7ff700 1 -- start start 2023-07-09T21:51:38.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.195+0000 7fac1d7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac180b3ff0 0x7fac1815f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:38.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.195+0000 7fac1d7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac180b43c0 0x7fac18146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:38.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.195+0000 7fac1d7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac180d1220 0x7fac180cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:38.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.195+0000 7fac1d7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1815e740 con 0x7fac180b43c0 2023-07-09T21:51:38.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.195+0000 7fac1d7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac180ce200 con 0x7fac180b3ff0 2023-07-09T21:51:38.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.195+0000 7fac1d7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac18146e70 con 0x7fac180d1220 2023-07-09T21:51:38.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.195+0000 7fac167fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac180b43c0 0x7fac18146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:38.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.196+0000 7fac167fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac180b43c0 0x7fac18146930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35768/0 (socket says 172.21.15.53:35768) 2023-07-09T21:51:38.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.196+0000 7fac167fc700 1 -- 172.21.15.53:0/3309487958 learned_addr learned my addr 172.21.15.53:0/3309487958 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:38.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.196+0000 7fac16ffd700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac180b3ff0 0x7fac1815f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:38.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.196+0000 7fac177fe700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac180d1220 0x7fac180cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:38.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.196+0000 7fac167fc700 1 -- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac180d1220 msgr2=0x7fac180cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:38.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.196+0000 7fac167fc700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac180d1220 0x7fac180cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.196+0000 7fac167fc700 1 -- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac180b3ff0 msgr2=0x7fac1815f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:38.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.196+0000 7fac167fc700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac180b3ff0 0x7fac1815f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.196+0000 7fac167fc700 1 -- 172.21.15.53:0/3309487958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac10009a70 con 0x7fac180b43c0 2023-07-09T21:51:38.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.196+0000 7fac167fc700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac180b43c0 0x7fac18146930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fac0c007fd0 tx=0x7fac0c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:38.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.197+0000 7fabff7fe700 1 -- 172.21.15.53:0/3309487958 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c005d70 con 0x7fac180b43c0 2023-07-09T21:51:38.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.197+0000 7fabff7fe700 1 -- 172.21.15.53:0/3309487958 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c0070d0 con 0x7fac180b43c0 2023-07-09T21:51:38.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.197+0000 7fabff7fe700 1 -- 172.21.15.53:0/3309487958 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c007460 con 0x7fac180b43c0 2023-07-09T21:51:38.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.197+0000 7fac1d7ff700 1 -- 172.21.15.53:0/3309487958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1815e950 con 0x7fac180b43c0 2023-07-09T21:51:38.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.197+0000 7fac1d7ff700 1 -- 172.21.15.53:0/3309487958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1815ef10 con 0x7fac180b43c0 2023-07-09T21:51:38.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.198+0000 7fac1d7ff700 1 -- 172.21.15.53:0/3309487958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac18074350 con 0x7fac180b43c0 2023-07-09T21:51:38.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.199+0000 7fabff7fe700 1 -- 172.21.15.53:0/3309487958 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac0c0075c0 con 0x7fac180b43c0 2023-07-09T21:51:38.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.200+0000 7fabff7fe700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fac0406ace0 0x7fac0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:38.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.200+0000 7fabff7fe700 1 -- 172.21.15.53:0/3309487958 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fac0c0883d0 con 0x7fac180b43c0 2023-07-09T21:51:38.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.200+0000 7fac16ffd700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fac0406ace0 0x7fac0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:38.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.201+0000 7fac16ffd700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fac0406ace0 0x7fac0406d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fac08007fd0 tx=0x7fac08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:38.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.204+0000 7fabff7fe700 1 -- 172.21.15.53:0/3309487958 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fac0c0537c0 con 0x7fac180b43c0 2023-07-09T21:51:38.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.412+0000 7fac1d7ff700 1 -- 172.21.15.53:0/3309487958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac180b8e80 con 0x7fac180b43c0 2023-07-09T21:51:38.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.412+0000 7fabff7fe700 1 -- 172.21.15.53:0/3309487958 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac180b8e80 con 0x7fac180b43c0 2023-07-09T21:51:38.413 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:51:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.414+0000 7fac1d7ff700 1 -- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fac0406ace0 msgr2=0x7fac0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:38.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.414+0000 7fac1d7ff700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fac0406ace0 0x7fac0406d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fac08007fd0 tx=0x7fac08009040 comp rx=0 tx=0).stop 2023-07-09T21:51:38.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.414+0000 7fac1d7ff700 1 -- 172.21.15.53:0/3309487958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac180b43c0 msgr2=0x7fac18146930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:38.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.414+0000 7fac1d7ff700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac180b43c0 0x7fac18146930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fac0c007fd0 tx=0x7fac0c00c7b0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.414+0000 7fac1d7ff700 1 -- 172.21.15.53:0/3309487958 shutdown_connections 2023-07-09T21:51:38.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.414+0000 7fac1d7ff700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fac0406ace0 0x7fac0406d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.414+0000 7fac1d7ff700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac180d1220 0x7fac180cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.414+0000 7fac1d7ff700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac180b3ff0 0x7fac1815f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.414+0000 7fac1d7ff700 1 --2- 172.21.15.53:0/3309487958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac180b43c0 0x7fac18146930 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.414+0000 7fac1d7ff700 1 -- 172.21.15.53:0/3309487958 >> 172.21.15.53:0/3309487958 conn(0x7fac1809c1b0 msgr2=0x7fac180b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:38.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.414+0000 7fac1d7ff700 1 -- 172.21.15.53:0/3309487958 shutdown_connections 2023-07-09T21:51:38.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.414+0000 7fac1d7ff700 1 -- 172.21.15.53:0/3309487958 wait complete. 2023-07-09T21:51:38.433 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:51:38.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.634+0000 7f6529dff700 1 Processor -- start 2023-07-09T21:51:38.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.634+0000 7f6529dff700 1 -- start start 2023-07-09T21:51:38.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f6529dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f652415c6c0 0x7f65240b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:38.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f6529dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65240b2b70 0x7f65240b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:38.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f6529dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652415ca90 con 0x7f6524160150 2023-07-09T21:51:38.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f6529dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652406b0e0 con 0x7f65240b2b70 2023-07-09T21:51:38.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f6529dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65240d0370 con 0x7f652415c6c0 2023-07-09T21:51:38.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f651bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65240b2b70 0x7f65240b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:38.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f651bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65240b2b70 0x7f65240b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35784/0 (socket says 172.21.15.53:35784) 2023-07-09T21:51:38.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f651bfff700 1 -- 172.21.15.53:0/3399334221 learned_addr learned my addr 172.21.15.53:0/3399334221 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:38.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f651bfff700 1 -- 172.21.15.53:0/3399334221 >> v2:172.21.15.184:3300/0 conn(0x7f652415c6c0 msgr2=0x7f65240b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:38.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f65237fe700 1 --2- 172.21.15.53:0/3399334221 >> v2:172.21.15.184:3300/0 conn(0x7f652415c6c0 0x7f65240b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:38.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f651bfff700 1 --2- 172.21.15.53:0/3399334221 >> v2:172.21.15.184:3300/0 conn(0x7f652415c6c0 0x7f65240b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f651bfff700 1 -- 172.21.15.53:0/3399334221 >> v1:172.21.15.184:6789/0 conn(0x7f6524160150 legacy=0x7f6524160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:38.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f651bfff700 1 -- 172.21.15.53:0/3399334221 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65240d0650 con 0x7f65240b2b70 2023-07-09T21:51:38.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.636+0000 7f65237fe700 1 --2- 172.21.15.53:0/3399334221 >> v2:172.21.15.184:3300/0 conn(0x7f652415c6c0 0x7f65240b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:38.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.637+0000 7f651bfff700 1 --2- 172.21.15.53:0/3399334221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65240b2b70 0x7f65240b3010 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f65240d1c80 tx=0x7f650c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6b04641a32358c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:38.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.637+0000 7f6522ffd700 1 -- 172.21.15.53:0/3399334221 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c004230 con 0x7f65240b2b70 2023-07-09T21:51:38.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.637+0000 7f6522ffd700 1 -- 172.21.15.53:0/3399334221 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c004390 con 0x7f65240b2b70 2023-07-09T21:51:38.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.637+0000 7f6522ffd700 1 -- 172.21.15.53:0/3399334221 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c0036a0 con 0x7f65240b2b70 2023-07-09T21:51:38.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.637+0000 7f6529dff700 1 -- 172.21.15.53:0/3399334221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65240b2b70 msgr2=0x7f65240b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:38.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.637+0000 7f6529dff700 1 --2- 172.21.15.53:0/3399334221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65240b2b70 0x7f65240b3010 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f65240d1c80 tx=0x7f650c009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.637+0000 7f6529dff700 1 -- 172.21.15.53:0/3399334221 shutdown_connections 2023-07-09T21:51:38.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.638+0000 7f6529dff700 1 --2- 172.21.15.53:0/3399334221 >> v2:172.21.15.184:3300/0 conn(0x7f652415c6c0 0x7f65240b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.638+0000 7f6529dff700 1 --2- 172.21.15.53:0/3399334221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65240b2b70 0x7f65240b3010 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.638+0000 7f6529dff700 1 -- 172.21.15.53:0/3399334221 >> 172.21.15.53:0/3399334221 conn(0x7f652406d980 msgr2=0x7f652406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:38.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.638+0000 7f6529dff700 1 -- 172.21.15.53:0/3399334221 shutdown_connections 2023-07-09T21:51:38.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.638+0000 7f6529dff700 1 -- 172.21.15.53:0/3399334221 wait complete. 2023-07-09T21:51:38.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.639+0000 7f6529dff700 1 Processor -- start 2023-07-09T21:51:38.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.639+0000 7f6529dff700 1 -- start start 2023-07-09T21:51:38.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.640+0000 7f6529dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65240b2b70 0x7f6524157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:38.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.640+0000 7f6529dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f652415c6c0 0x7f65240c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:38.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.640+0000 7f6529dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6524160150 0x7f65240ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:38.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.640+0000 7f6529dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65240c9680 con 0x7f65240b2b70 2023-07-09T21:51:38.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.640+0000 7f6529dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65240ca940 con 0x7f6524160150 2023-07-09T21:51:38.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.640+0000 7f6529dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65240c8a00 con 0x7f652415c6c0 2023-07-09T21:51:38.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.641+0000 7f65237fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65240b2b70 0x7f6524157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:38.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.641+0000 7f65237fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65240b2b70 0x7f6524157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35790/0 (socket says 172.21.15.53:35790) 2023-07-09T21:51:38.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.641+0000 7f65237fe700 1 -- 172.21.15.53:0/3229980750 learned_addr learned my addr 172.21.15.53:0/3229980750 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:38.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.641+0000 7f651bfff700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f652415c6c0 0x7f65240c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:38.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.641+0000 7f6523fff700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6524160150 0x7f65240ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:38.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.641+0000 7f65237fe700 1 -- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f652415c6c0 msgr2=0x7f65240c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:38.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.641+0000 7f65237fe700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f652415c6c0 0x7f65240c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.641+0000 7f65237fe700 1 -- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6524160150 msgr2=0x7f65240ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:38.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.641+0000 7f65237fe700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6524160150 0x7f65240ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.641+0000 7f65237fe700 1 -- 172.21.15.53:0/3229980750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c009550 con 0x7f65240b2b70 2023-07-09T21:51:38.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.641+0000 7f651bfff700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f652415c6c0 0x7f65240c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:38.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.641+0000 7f65237fe700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65240b2b70 0x7f6524157690 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f651400c750 tx=0x7f651400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:38.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.642+0000 7f6520ff9700 1 -- 172.21.15.53:0/3229980750 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6514011800 con 0x7f65240b2b70 2023-07-09T21:51:38.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.642+0000 7f6520ff9700 1 -- 172.21.15.53:0/3229980750 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6514011960 con 0x7f65240b2b70 2023-07-09T21:51:38.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.642+0000 7f6529dff700 1 -- 172.21.15.53:0/3229980750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65240c8ce0 con 0x7f65240b2b70 2023-07-09T21:51:38.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.642+0000 7f6520ff9700 1 -- 172.21.15.53:0/3229980750 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6514011cd0 con 0x7f65240b2b70 2023-07-09T21:51:38.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.642+0000 7f6529dff700 1 -- 172.21.15.53:0/3229980750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65240c92a0 con 0x7f65240b2b70 2023-07-09T21:51:38.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.643+0000 7f6529dff700 1 -- 172.21.15.53:0/3229980750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65240d08f0 con 0x7f65240b2b70 2023-07-09T21:51:38.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.644+0000 7f6520ff9700 1 -- 172.21.15.53:0/3229980750 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6514021350 con 0x7f65240b2b70 2023-07-09T21:51:38.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.645+0000 7f6520ff9700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f650406ace0 0x7f650406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:38.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.645+0000 7f6520ff9700 1 -- 172.21.15.53:0/3229980750 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6514089120 con 0x7f65240b2b70 2023-07-09T21:51:38.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.645+0000 7f651bfff700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f650406ace0 0x7f650406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:38.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.646+0000 7f651bfff700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f650406ace0 0x7f650406d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f650c009130 tx=0x7f650c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:38.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.649+0000 7f6520ff9700 1 -- 172.21.15.53:0/3229980750 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6514054520 con 0x7f65240b2b70 2023-07-09T21:51:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.858+0000 7f6529dff700 1 -- 172.21.15.53:0/3229980750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6524074350 con 0x7f65240b2b70 2023-07-09T21:51:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.858+0000 7f6520ff9700 1 -- 172.21.15.53:0/3229980750 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6514057b40 con 0x7f65240b2b70 2023-07-09T21:51:38.860 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:51:38.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.860+0000 7f6529dff700 1 -- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f650406ace0 msgr2=0x7f650406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:38.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.860+0000 7f6529dff700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f650406ace0 0x7f650406d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f650c009130 tx=0x7f650c008030 comp rx=0 tx=0).stop 2023-07-09T21:51:38.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.860+0000 7f6529dff700 1 -- 172.21.15.53:0/3229980750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65240b2b70 msgr2=0x7f6524157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:38.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.860+0000 7f6529dff700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65240b2b70 0x7f6524157690 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f651400c750 tx=0x7f651400cb10 comp rx=0 tx=0).stop 2023-07-09T21:51:38.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.861+0000 7f6529dff700 1 -- 172.21.15.53:0/3229980750 shutdown_connections 2023-07-09T21:51:38.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.861+0000 7f6529dff700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f650406ace0 0x7f650406d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.861+0000 7f6529dff700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6524160150 0x7f65240ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.861+0000 7f6529dff700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65240b2b70 0x7f6524157690 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.861+0000 7f6529dff700 1 --2- 172.21.15.53:0/3229980750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f652415c6c0 0x7f65240c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:38.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.861+0000 7f6529dff700 1 -- 172.21.15.53:0/3229980750 >> 172.21.15.53:0/3229980750 conn(0x7f652406d980 msgr2=0x7f65240d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:38.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.861+0000 7f6529dff700 1 -- 172.21.15.53:0/3229980750 shutdown_connections 2023-07-09T21:51:38.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:38.861+0000 7f6529dff700 1 -- 172.21.15.53:0/3229980750 wait complete. 2023-07-09T21:51:38.880 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T21:51:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.079+0000 7f76165ff700 1 Processor -- start 2023-07-09T21:51:39.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.079+0000 7f76165ff700 1 -- start start 2023-07-09T21:51:39.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.081+0000 7f76165ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76100b4510 0x7f76100b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:39.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.081+0000 7f76165ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f76100d1220 0x7f76100b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:39.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.081+0000 7f76165ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76100b7f50 con 0x7f76100cd590 2023-07-09T21:51:39.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.081+0000 7f76165ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76100b48e0 con 0x7f76100d1220 2023-07-09T21:51:39.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.081+0000 7f76165ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76100b7340 con 0x7f76100b4510 2023-07-09T21:51:39.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.081+0000 7f7614b9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f76100d1220 0x7f76100b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:39.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.081+0000 7f7614b9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f76100d1220 0x7f76100b83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35798/0 (socket says 172.21.15.53:35798) 2023-07-09T21:51:39.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.081+0000 7f7614b9c700 1 -- 172.21.15.53:0/3055474146 learned_addr learned my addr 172.21.15.53:0/3055474146 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:39.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.081+0000 7f760ffff700 1 --2- 172.21.15.53:0/3055474146 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76100b4510 0x7f76100b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:39.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.081+0000 7f7614b9c700 1 -- 172.21.15.53:0/3055474146 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76100b4510 msgr2=0x7f76100b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:39.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.081+0000 7f7614b9c700 1 --2- 172.21.15.53:0/3055474146 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76100b4510 0x7f76100b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.081+0000 7f7614b9c700 1 -- 172.21.15.53:0/3055474146 >> v1:172.21.15.184:6789/0 conn(0x7f76100cd590 legacy=0x7f76100d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:39.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.081+0000 7f7614b9c700 1 -- 172.21.15.53:0/3055474146 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76100b7620 con 0x7f76100d1220 2023-07-09T21:51:39.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.082+0000 7f7614b9c700 1 --2- 172.21.15.53:0/3055474146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76100d1220 0x7f76100b83e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7608009e50 tx=0x7f760800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e521e7f498e08b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:39.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.082+0000 7f760effd700 1 -- 172.21.15.53:0/3055474146 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760800e070 con 0x7f76100d1220 2023-07-09T21:51:39.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.082+0000 7f760effd700 1 -- 172.21.15.53:0/3055474146 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760800b9c0 con 0x7f76100d1220 2023-07-09T21:51:39.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.082+0000 7f760effd700 1 -- 172.21.15.53:0/3055474146 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760800bd70 con 0x7f76100d1220 2023-07-09T21:51:39.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.082+0000 7f76165ff700 1 -- 172.21.15.53:0/3055474146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76100d1220 msgr2=0x7f76100b83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:39.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.082+0000 7f76165ff700 1 --2- 172.21.15.53:0/3055474146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76100d1220 0x7f76100b83e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7608009e50 tx=0x7f760800b330 comp rx=0 tx=0).stop 2023-07-09T21:51:39.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.083+0000 7f76165ff700 1 -- 172.21.15.53:0/3055474146 shutdown_connections 2023-07-09T21:51:39.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.083+0000 7f76165ff700 1 --2- 172.21.15.53:0/3055474146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76100d1220 0x7f76100b83e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.083+0000 7f76165ff700 1 --2- 172.21.15.53:0/3055474146 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76100b4510 0x7f76100b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.083+0000 7f76165ff700 1 -- 172.21.15.53:0/3055474146 >> 172.21.15.53:0/3055474146 conn(0x7f761009c1d0 msgr2=0x7f76100d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:39.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.083+0000 7f76165ff700 1 -- 172.21.15.53:0/3055474146 shutdown_connections 2023-07-09T21:51:39.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.083+0000 7f76165ff700 1 -- 172.21.15.53:0/3055474146 wait complete. 2023-07-09T21:51:39.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.084+0000 7f76165ff700 1 Processor -- start 2023-07-09T21:51:39.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.085+0000 7f76165ff700 1 -- start start 2023-07-09T21:51:39.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.085+0000 7f76165ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76100b4510 0x7f76101ebfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:39.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.085+0000 7f76165ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76100cd590 0x7f76100c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:39.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f76165ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76100d1220 0x7f76100c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f76165ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76100c9720 con 0x7f76100b4510 2023-07-09T21:51:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f76165ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76100cd060 con 0x7f76100cd590 2023-07-09T21:51:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f76165ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76100c8df0 con 0x7f76100d1220 2023-07-09T21:51:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f760ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76100b4510 0x7f76101ebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f760ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76100b4510 0x7f76101ebfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35812/0 (socket says 172.21.15.53:35812) 2023-07-09T21:51:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f760ffff700 1 -- 172.21.15.53:0/601527414 learned_addr learned my addr 172.21.15.53:0/601527414 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f760f7fe700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76100cd590 0x7f76100c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:39.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f760ffff700 1 -- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76100d1220 msgr2=0x7f76100c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:39.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f7614b9c700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76100d1220 0x7f76100c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:39.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f760ffff700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76100d1220 0x7f76100c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f760ffff700 1 -- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76100cd590 msgr2=0x7f76100c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:39.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f760ffff700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76100cd590 0x7f76100c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f760ffff700 1 -- 172.21.15.53:0/601527414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7608009b30 con 0x7f76100b4510 2023-07-09T21:51:39.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f760f7fe700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76100cd590 0x7f76100c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:39.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f7614b9c700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76100d1220 0x7f76100c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:39.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.086+0000 7f760ffff700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76100b4510 0x7f76101ebfc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f760000e760 tx=0x7f760000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:39.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.087+0000 7f760cff9700 1 -- 172.21.15.53:0/601527414 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600005c20 con 0x7f76100b4510 2023-07-09T21:51:39.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.087+0000 7f760cff9700 1 -- 172.21.15.53:0/601527414 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7600005da0 con 0x7f76100b4510 2023-07-09T21:51:39.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.087+0000 7f76165ff700 1 -- 172.21.15.53:0/601527414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76100c90d0 con 0x7f76100b4510 2023-07-09T21:51:39.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.087+0000 7f760cff9700 1 -- 172.21.15.53:0/601527414 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600006260 con 0x7f76100b4510 2023-07-09T21:51:39.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.087+0000 7f76165ff700 1 -- 172.21.15.53:0/601527414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76100c8aa0 con 0x7f76100b4510 2023-07-09T21:51:39.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.088+0000 7f76165ff700 1 -- 172.21.15.53:0/601527414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761004e280 con 0x7f76100b4510 2023-07-09T21:51:39.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.089+0000 7f760cff9700 1 -- 172.21.15.53:0/601527414 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76000063c0 con 0x7f76100b4510 2023-07-09T21:51:39.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.090+0000 7f760cff9700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f75fc06ace0 0x7f75fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:39.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.090+0000 7f760cff9700 1 -- 172.21.15.53:0/601527414 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7600088b20 con 0x7f76100b4510 2023-07-09T21:51:39.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.090+0000 7f760f7fe700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f75fc06ace0 0x7f75fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:39.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.091+0000 7f760f7fe700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f75fc06ace0 0x7f75fc06d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7604000f60 tx=0x7f7604009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:39.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.094+0000 7f760cff9700 1 -- 172.21.15.53:0/601527414 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7600053f10 con 0x7f76100b4510 2023-07-09T21:51:39.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.307+0000 7f76165ff700 1 -- 172.21.15.53:0/601527414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f76100d3690 con 0x7f76100b4510 2023-07-09T21:51:39.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.307+0000 7f760cff9700 1 -- 172.21.15.53:0/601527414 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7600020090 con 0x7f76100b4510 2023-07-09T21:51:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:39.309 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-07-09T21:51:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-07-09T21:51:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-07-09T21:51:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:51:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-07-09T21:51:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-07-09T21:51:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:39.310 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-07-09T21:51:39.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.310+0000 7f76165ff700 1 -- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f75fc06ace0 msgr2=0x7f75fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:39.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.310+0000 7f76165ff700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f75fc06ace0 0x7f75fc06d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7604000f60 tx=0x7f7604009040 comp rx=0 tx=0).stop 2023-07-09T21:51:39.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.310+0000 7f76165ff700 1 -- 172.21.15.53:0/601527414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76100b4510 msgr2=0x7f76101ebfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:39.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.310+0000 7f76165ff700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76100b4510 0x7f76101ebfc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f760000e760 tx=0x7f760000eb20 comp rx=0 tx=0).stop 2023-07-09T21:51:39.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.310+0000 7f76165ff700 1 -- 172.21.15.53:0/601527414 shutdown_connections 2023-07-09T21:51:39.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.310+0000 7f76165ff700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f75fc06ace0 0x7f75fc06d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.310+0000 7f76165ff700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76100d1220 0x7f76100c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.310+0000 7f76165ff700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76100b4510 0x7f76101ebfc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.310+0000 7f76165ff700 1 --2- 172.21.15.53:0/601527414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76100cd590 0x7f76100c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.310+0000 7f76165ff700 1 -- 172.21.15.53:0/601527414 >> 172.21.15.53:0/601527414 conn(0x7f761009c1d0 msgr2=0x7f76100cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:39.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.310+0000 7f76165ff700 1 -- 172.21.15.53:0/601527414 shutdown_connections 2023-07-09T21:51:39.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.310+0000 7f76165ff700 1 -- 172.21.15.53:0/601527414 wait complete. 2023-07-09T21:51:39.329 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T21:51:39.329 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T21:51:39.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.531+0000 7febe93ff700 1 Processor -- start 2023-07-09T21:51:39.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.531+0000 7febe93ff700 1 -- start start 2023-07-09T21:51:39.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.532+0000 7febe93ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe40d28a0 0x7febe415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:39.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe93ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7febe40cf040 0x7febe40d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:39.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe93ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe40d2c70 con 0x7febe40d0a30 2023-07-09T21:51:39.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe93ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe40d3de0 con 0x7febe40cf040 2023-07-09T21:51:39.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe93ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe415ccf0 con 0x7febe40d28a0 2023-07-09T21:51:39.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe37fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7febe40cf040 0x7febe40d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:39.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe27fc700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7febe40d0a30 0x7febe4160350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50092/0 (socket says 172.21.15.53:50092) 2023-07-09T21:51:39.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe37fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7febe40cf040 0x7febe40d0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35814/0 (socket says 172.21.15.53:35814) 2023-07-09T21:51:39.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe27fc700 1 -- 172.21.15.53:0/1398763086 learned_addr learned my addr 172.21.15.53:0/1398763086 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:39.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe2ffd700 1 --2- 172.21.15.53:0/1398763086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe40d28a0 0x7febe415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:39.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe37fe700 1 -- 172.21.15.53:0/1398763086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe40d28a0 msgr2=0x7febe415c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:39.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe37fe700 1 --2- 172.21.15.53:0/1398763086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe40d28a0 0x7febe415c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe37fe700 1 -- 172.21.15.53:0/1398763086 >> v1:172.21.15.53:6789/0 conn(0x7febe40d0a30 legacy=0x7febe4160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:39.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe37fe700 1 -- 172.21.15.53:0/1398763086 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe40d0190 con 0x7febe40cf040 2023-07-09T21:51:39.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.533+0000 7febe1ffb700 1 -- 172.21.15.53:0/1398763086 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037472072 0 0) 0x7febe40d2c70 con 0x7febe40d0a30 2023-07-09T21:51:39.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.534+0000 7febe37fe700 1 --2- 172.21.15.53:0/1398763086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febe40cf040 0x7febe40d0ea0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7febdc009d90 tx=0x7febdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86027c478252d82c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:39.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.534+0000 7febe1ffb700 1 -- 172.21.15.53:0/1398763086 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc00e070 con 0x7febe40cf040 2023-07-09T21:51:39.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.534+0000 7febe1ffb700 1 -- 172.21.15.53:0/1398763086 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc00bb20 con 0x7febe40cf040 2023-07-09T21:51:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.534+0000 7febe1ffb700 1 -- 172.21.15.53:0/1398763086 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc012430 con 0x7febe40cf040 2023-07-09T21:51:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.534+0000 7febe93ff700 1 -- 172.21.15.53:0/1398763086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febe40cf040 msgr2=0x7febe40d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.534+0000 7febe93ff700 1 --2- 172.21.15.53:0/1398763086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febe40cf040 0x7febe40d0ea0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7febdc009d90 tx=0x7febdc00b330 comp rx=0 tx=0).stop 2023-07-09T21:51:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.534+0000 7febe93ff700 1 -- 172.21.15.53:0/1398763086 shutdown_connections 2023-07-09T21:51:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.534+0000 7febe93ff700 1 --2- 172.21.15.53:0/1398763086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febe40cf040 0x7febe40d0ea0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.534+0000 7febe93ff700 1 --2- 172.21.15.53:0/1398763086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe40d28a0 0x7febe415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.534+0000 7febe93ff700 1 -- 172.21.15.53:0/1398763086 >> 172.21.15.53:0/1398763086 conn(0x7febe409c1b0 msgr2=0x7febe40d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.535+0000 7febe93ff700 1 -- 172.21.15.53:0/1398763086 shutdown_connections 2023-07-09T21:51:39.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.535+0000 7febe93ff700 1 -- 172.21.15.53:0/1398763086 wait complete. 2023-07-09T21:51:39.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.536+0000 7febe93ff700 1 Processor -- start 2023-07-09T21:51:39.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.536+0000 7febe93ff700 1 -- start start 2023-07-09T21:51:39.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.537+0000 7febe93ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febe40cf040 0x7febe41f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.537+0000 7febe93ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febe40d0a30 0x7febe415f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.537+0000 7febe93ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe40d28a0 0x7febe415fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.537+0000 7febe93ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe415d480 con 0x7febe40cf040 2023-07-09T21:51:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.537+0000 7febe93ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe40cc420 con 0x7febe40d0a30 2023-07-09T21:51:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.537+0000 7febe93ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe40cc700 con 0x7febe40d28a0 2023-07-09T21:51:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.538+0000 7febe2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febe40cf040 0x7febe41f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.538+0000 7febe2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febe40cf040 0x7febe41f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35820/0 (socket says 172.21.15.53:35820) 2023-07-09T21:51:39.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.538+0000 7febe2ffd700 1 -- 172.21.15.53:0/2013199649 learned_addr learned my addr 172.21.15.53:0/2013199649 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:39.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.538+0000 7febe27fc700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febe40d0a30 0x7febe415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:39.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.538+0000 7febe2ffd700 1 -- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe40d28a0 msgr2=0x7febe415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:39.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.538+0000 7febe2ffd700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe40d28a0 0x7febe415fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.538+0000 7febe2ffd700 1 -- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febe40d0a30 msgr2=0x7febe415f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:39.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.538+0000 7febe2ffd700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febe40d0a30 0x7febe415f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.538+0000 7febe2ffd700 1 -- 172.21.15.53:0/2013199649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc009a70 con 0x7febe40cf040 2023-07-09T21:51:39.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.538+0000 7febe27fc700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febe40d0a30 0x7febe415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.538+0000 7febe2ffd700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febe40cf040 0x7febe41f1700 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7febd400e9b0 tx=0x7febd400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.538+0000 7febcb7fe700 1 -- 172.21.15.53:0/2013199649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4009710 con 0x7febe40cf040 2023-07-09T21:51:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.538+0000 7febcb7fe700 1 -- 172.21.15.53:0/2013199649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd400c850 con 0x7febe40cf040 2023-07-09T21:51:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.539+0000 7febe93ff700 1 -- 172.21.15.53:0/2013199649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe415ce30 con 0x7febe40cf040 2023-07-09T21:51:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.539+0000 7febcb7fe700 1 -- 172.21.15.53:0/2013199649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd400cbc0 con 0x7febe40cf040 2023-07-09T21:51:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.539+0000 7febe93ff700 1 -- 172.21.15.53:0/2013199649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe41f1c40 con 0x7febe40cf040 2023-07-09T21:51:39.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.540+0000 7febe93ff700 1 -- 172.21.15.53:0/2013199649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe4074350 con 0x7febe40cf040 2023-07-09T21:51:39.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.541+0000 7febcb7fe700 1 -- 172.21.15.53:0/2013199649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7febd400cd20 con 0x7febe40cf040 2023-07-09T21:51:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.541+0000 7febcb7fe700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7febd006ace0 0x7febd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.542+0000 7febcb7fe700 1 -- 172.21.15.53:0/2013199649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7febd40892b0 con 0x7febe40cf040 2023-07-09T21:51:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.542+0000 7febe27fc700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7febd006ace0 0x7febd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.543+0000 7febe27fc700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7febd006ace0 0x7febd006d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7febe40c9c80 tx=0x7febd8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:39.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.546+0000 7febcb7fe700 1 -- 172.21.15.53:0/2013199649 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7febd4058130 con 0x7febe40cf040 2023-07-09T21:51:39.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.752+0000 7febe93ff700 1 -- 172.21.15.53:0/2013199649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7febe41600c0 con 0x7febe40cf040 2023-07-09T21:51:39.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.846+0000 7febcb7fe700 1 -- 172.21.15.53:0/2013199649 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7febd4057cc0 con 0x7febe40cf040 2023-07-09T21:51:39.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.851+0000 7febe93ff700 1 -- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7febd006ace0 msgr2=0x7febd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:39.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.851+0000 7febe93ff700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7febd006ace0 0x7febd006d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7febe40c9c80 tx=0x7febd8009040 comp rx=0 tx=0).stop 2023-07-09T21:51:39.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.851+0000 7febe93ff700 1 -- 172.21.15.53:0/2013199649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febe40cf040 msgr2=0x7febe41f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:39.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.851+0000 7febe93ff700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febe40cf040 0x7febe41f1700 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7febd400e9b0 tx=0x7febd400ed70 comp rx=0 tx=0).stop 2023-07-09T21:51:39.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.852+0000 7febe93ff700 1 -- 172.21.15.53:0/2013199649 shutdown_connections 2023-07-09T21:51:39.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.852+0000 7febe93ff700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7febd006ace0 0x7febd006d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.852+0000 7febe93ff700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe40d28a0 0x7febe415fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.852+0000 7febe93ff700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febe40cf040 0x7febe41f1700 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.852+0000 7febe93ff700 1 --2- 172.21.15.53:0/2013199649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febe40d0a30 0x7febe415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:39.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.852+0000 7febe93ff700 1 -- 172.21.15.53:0/2013199649 >> 172.21.15.53:0/2013199649 conn(0x7febe409c1b0 msgr2=0x7febe40ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:39.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.852+0000 7febe93ff700 1 -- 172.21.15.53:0/2013199649 shutdown_connections 2023-07-09T21:51:39.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:39.852+0000 7febe93ff700 1 -- 172.21.15.53:0/2013199649 wait complete. 2023-07-09T21:51:39.855 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-07-09T21:51:39.873 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T21:51:40.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.079+0000 7fb4441ff700 1 Processor -- start 2023-07-09T21:51:40.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.079+0000 7fb4441ff700 1 -- start start 2023-07-09T21:51:40.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.080+0000 7fb4441ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb43c0d1220 0x7fb43c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.080+0000 7fb4441ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c0b8e80 con 0x7fb43c0b0e20 2023-07-09T21:51:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.080+0000 7fb4441ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c0afaa0 con 0x7fb43c0b3ff0 2023-07-09T21:51:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.080+0000 7fb4441ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c0afd80 con 0x7fb43c0d1220 2023-07-09T21:51:40.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.080+0000 7fb44179a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb43c0d1220 0x7fb43c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:40.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.080+0000 7fb44279c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb43c0b0e20 0x7fb43c0b1220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50102/0 (socket says 172.21.15.53:50102) 2023-07-09T21:51:40.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.080+0000 7fb44279c700 1 -- 172.21.15.53:0/494565532 learned_addr learned my addr 172.21.15.53:0/494565532 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:40.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.080+0000 7fb44179a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb43c0d1220 0x7fb43c0b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35826/0 (socket says 172.21.15.53:35826) 2023-07-09T21:51:40.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.081+0000 7fb44179a700 1 -- 172.21.15.53:0/494565532 >> v1:172.21.15.184:6789/0 conn(0x7fb43c0b3ff0 legacy=0x7fb43c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:40.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.081+0000 7fb44179a700 1 -- 172.21.15.53:0/494565532 >> v1:172.21.15.53:6789/0 conn(0x7fb43c0b0e20 legacy=0x7fb43c0b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:40.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.081+0000 7fb44179a700 1 -- 172.21.15.53:0/494565532 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0b0060 con 0x7fb43c0d1220 2023-07-09T21:51:40.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.081+0000 7fb44179a700 1 --2- 172.21.15.53:0/494565532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43c0d1220 0x7fb43c0b43c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb42c009840 tx=0x7fb42c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c140c8af036ee64e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:40.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.081+0000 7fb440f99700 1 -- 172.21.15.53:0/494565532 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c011830 con 0x7fb43c0d1220 2023-07-09T21:51:40.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.082+0000 7fb440f99700 1 -- 172.21.15.53:0/494565532 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c011990 con 0x7fb43c0d1220 2023-07-09T21:51:40.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.082+0000 7fb440f99700 1 -- 172.21.15.53:0/494565532 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c011d20 con 0x7fb43c0d1220 2023-07-09T21:51:40.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.082+0000 7fb4441ff700 1 -- 172.21.15.53:0/494565532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43c0d1220 msgr2=0x7fb43c0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:40.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.082+0000 7fb4441ff700 1 --2- 172.21.15.53:0/494565532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43c0d1220 0x7fb43c0b43c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb42c009840 tx=0x7fb42c009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:40.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.082+0000 7fb4441ff700 1 -- 172.21.15.53:0/494565532 shutdown_connections 2023-07-09T21:51:40.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.082+0000 7fb4441ff700 1 --2- 172.21.15.53:0/494565532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43c0d1220 0x7fb43c0b43c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:40.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.082+0000 7fb4441ff700 1 -- 172.21.15.53:0/494565532 >> 172.21.15.53:0/494565532 conn(0x7fb43c09c1b0 msgr2=0x7fb43c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:40.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.082+0000 7fb4441ff700 1 -- 172.21.15.53:0/494565532 shutdown_connections 2023-07-09T21:51:40.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.082+0000 7fb4441ff700 1 -- 172.21.15.53:0/494565532 wait complete. 2023-07-09T21:51:40.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.084+0000 7fb4441ff700 1 Processor -- start 2023-07-09T21:51:40.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.084+0000 7fb4441ff700 1 -- start start 2023-07-09T21:51:40.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.085+0000 7fb4441ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43c0b0e20 0x7fb43c1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:40.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.085+0000 7fb4441ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb43c0b3ff0 0x7fb43c15b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:40.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.085+0000 7fb4441ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb43c0d1220 0x7fb43c15bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:40.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.085+0000 7fb4441ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0ca010 con 0x7fb43c0b0e20 2023-07-09T21:51:40.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.085+0000 7fb4441ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0ca2f0 con 0x7fb43c0b3ff0 2023-07-09T21:51:40.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.085+0000 7fb4441ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0ca5d0 con 0x7fb43c0d1220 2023-07-09T21:51:40.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.085+0000 7fb441f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43c0b0e20 0x7fb43c1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:40.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.085+0000 7fb441f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43c0b0e20 0x7fb43c1548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35828/0 (socket says 172.21.15.53:35828) 2023-07-09T21:51:40.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.085+0000 7fb441f9b700 1 -- 172.21.15.53:0/1234681790 learned_addr learned my addr 172.21.15.53:0/1234681790 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:40.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb44279c700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb43c0d1220 0x7fb43c15bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:40.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb44179a700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb43c0b3ff0 0x7fb43c15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:40.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb441f9b700 1 -- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb43c0d1220 msgr2=0x7fb43c15bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:40.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb441f9b700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb43c0d1220 0x7fb43c15bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:40.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb441f9b700 1 -- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb43c0b3ff0 msgr2=0x7fb43c15b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:40.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb441f9b700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb43c0b3ff0 0x7fb43c15b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:40.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb441f9b700 1 -- 172.21.15.53:0/1234681790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c0094a0 con 0x7fb43c0b0e20 2023-07-09T21:51:40.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb44179a700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb43c0b3ff0 0x7fb43c15b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:40.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb44279c700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb43c0d1220 0x7fb43c15bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:40.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb441f9b700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43c0b0e20 0x7fb43c1548d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c4e0 tx=0x7fb43800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:40.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb4327fc700 1 -- 172.21.15.53:0/1234681790 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380052d0 con 0x7fb43c0b0e20 2023-07-09T21:51:40.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb4327fc700 1 -- 172.21.15.53:0/1234681790 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb438005430 con 0x7fb43c0b0e20 2023-07-09T21:51:40.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb4327fc700 1 -- 172.21.15.53:0/1234681790 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380038c0 con 0x7fb43c0b0e20 2023-07-09T21:51:40.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.086+0000 7fb4441ff700 1 -- 172.21.15.53:0/1234681790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c0ca8b0 con 0x7fb43c0b0e20 2023-07-09T21:51:40.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.087+0000 7fb4441ff700 1 -- 172.21.15.53:0/1234681790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c0cf020 con 0x7fb43c0b0e20 2023-07-09T21:51:40.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.088+0000 7fb4441ff700 1 -- 172.21.15.53:0/1234681790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c074350 con 0x7fb43c0b0e20 2023-07-09T21:51:40.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.089+0000 7fb4327fc700 1 -- 172.21.15.53:0/1234681790 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb438003a20 con 0x7fb43c0b0e20 2023-07-09T21:51:40.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.090+0000 7fb4327fc700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb42006ace0 0x7fb42006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:40.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.090+0000 7fb4327fc700 1 -- 172.21.15.53:0/1234681790 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb4380887d0 con 0x7fb43c0b0e20 2023-07-09T21:51:40.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.090+0000 7fb44179a700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb42006ace0 0x7fb42006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:40.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.091+0000 7fb44179a700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb42006ace0 0x7fb42006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb43c157ee0 tx=0x7fb42c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:40.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.095+0000 7fb4327fc700 1 -- 172.21.15.53:0/1234681790 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb438053a50 con 0x7fb43c0b0e20 2023-07-09T21:51:40.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.302+0000 7fb4441ff700 1 -- 172.21.15.53:0/1234681790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb43c08d480 con 0x7fb43c0b0e20 2023-07-09T21:51:40.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.849+0000 7fb4327fc700 1 -- 172.21.15.53:0/1234681790 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb438057070 con 0x7fb43c0b0e20 2023-07-09T21:51:40.855 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:51:40.862 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:51:40.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.855+0000 7fb4441ff700 1 -- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb42006ace0 msgr2=0x7fb42006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:40.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.855+0000 7fb4441ff700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb42006ace0 0x7fb42006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb43c157ee0 tx=0x7fb42c008030 comp rx=0 tx=0).stop 2023-07-09T21:51:40.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.855+0000 7fb4441ff700 1 -- 172.21.15.53:0/1234681790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43c0b0e20 msgr2=0x7fb43c1548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:40.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.855+0000 7fb4441ff700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43c0b0e20 0x7fb43c1548d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c4e0 tx=0x7fb43800c8a0 comp rx=0 tx=0).stop 2023-07-09T21:51:40.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.856+0000 7fb4441ff700 1 -- 172.21.15.53:0/1234681790 shutdown_connections 2023-07-09T21:51:40.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.856+0000 7fb4441ff700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb42006ace0 0x7fb42006d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:40.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.856+0000 7fb4441ff700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb43c0d1220 0x7fb43c15bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:40.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.856+0000 7fb4441ff700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43c0b0e20 0x7fb43c1548d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:40.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.856+0000 7fb4441ff700 1 --2- 172.21.15.53:0/1234681790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb43c0b3ff0 0x7fb43c15b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:40.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.856+0000 7fb4441ff700 1 -- 172.21.15.53:0/1234681790 >> 172.21.15.53:0/1234681790 conn(0x7fb43c09c1b0 msgr2=0x7fb43c0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:40.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.858+0000 7fb4441ff700 1 -- 172.21.15.53:0/1234681790 shutdown_connections 2023-07-09T21:51:40.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:40.858+0000 7fb4441ff700 1 -- 172.21.15.53:0/1234681790 wait complete. 2023-07-09T21:51:40.868 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-07-09T21:51:40.891 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T21:51:41.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.135+0000 7f06b99ff700 1 Processor -- start 2023-07-09T21:51:41.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.135+0000 7f06b99ff700 1 -- start start 2023-07-09T21:51:41.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.136+0000 7f06b99ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06b40cb980 0x7f06b40c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:41.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.136+0000 7f06b99ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b415d320 con 0x7f06b4142430 2023-07-09T21:51:41.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.136+0000 7f06b99ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b415d600 con 0x7f06b415cd60 2023-07-09T21:51:41.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.136+0000 7f06b99ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b415d8e0 con 0x7f06b40cb980 2023-07-09T21:51:41.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.136+0000 7f06b27fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06b40cb980 0x7f06b40c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:41.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.136+0000 7f06b27fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06b40cb980 0x7f06b40c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35834/0 (socket says 172.21.15.53:35834) 2023-07-09T21:51:41.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.136+0000 7f06b2ffd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f06b4142430 0x7f06b40cb270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50116/0 (socket says 172.21.15.53:50116) 2023-07-09T21:51:41.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.137+0000 7f06b27fc700 1 -- 172.21.15.53:0/2602278521 learned_addr learned my addr 172.21.15.53:0/2602278521 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:41.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.137+0000 7f06b27fc700 1 -- 172.21.15.53:0/2602278521 >> v1:172.21.15.184:6789/0 conn(0x7f06b415cd60 legacy=0x7f06b40ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:41.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.137+0000 7f06b27fc700 1 -- 172.21.15.53:0/2602278521 >> v1:172.21.15.53:6789/0 conn(0x7f06b4142430 legacy=0x7f06b40cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:41.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.137+0000 7f06b27fc700 1 -- 172.21.15.53:0/2602278521 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b415dbc0 con 0x7f06b40cb980 2023-07-09T21:51:41.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.137+0000 7f06b27fc700 1 --2- 172.21.15.53:0/2602278521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b40cb980 0x7f06b40c9b20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f06a80098f0 tx=0x7f06a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61daa4e1ab94ba4d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:41.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.137+0000 7f06b1ffb700 1 -- 172.21.15.53:0/2602278521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a8004230 con 0x7f06b40cb980 2023-07-09T21:51:41.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.138+0000 7f06b1ffb700 1 -- 172.21.15.53:0/2602278521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a8004390 con 0x7f06b40cb980 2023-07-09T21:51:41.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.138+0000 7f06b1ffb700 1 -- 172.21.15.53:0/2602278521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a80036a0 con 0x7f06b40cb980 2023-07-09T21:51:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.138+0000 7f06b99ff700 1 -- 172.21.15.53:0/2602278521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b40cb980 msgr2=0x7f06b40c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.138+0000 7f06b99ff700 1 --2- 172.21.15.53:0/2602278521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b40cb980 0x7f06b40c9b20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f06a80098f0 tx=0x7f06a8009c00 comp rx=0 tx=0).stop 2023-07-09T21:51:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.138+0000 7f06b99ff700 1 -- 172.21.15.53:0/2602278521 shutdown_connections 2023-07-09T21:51:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.138+0000 7f06b99ff700 1 --2- 172.21.15.53:0/2602278521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b40cb980 0x7f06b40c9b20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.138+0000 7f06b99ff700 1 -- 172.21.15.53:0/2602278521 >> 172.21.15.53:0/2602278521 conn(0x7f06b40b0640 msgr2=0x7f06b40b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.138+0000 7f06b99ff700 1 -- 172.21.15.53:0/2602278521 shutdown_connections 2023-07-09T21:51:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.138+0000 7f06b99ff700 1 -- 172.21.15.53:0/2602278521 wait complete. 2023-07-09T21:51:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.140+0000 7f06b99ff700 1 Processor -- start 2023-07-09T21:51:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.140+0000 7f06b99ff700 1 -- start start 2023-07-09T21:51:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.141+0000 7f06b99ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06b40cb980 0x7f06b40b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.141+0000 7f06b99ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06b4142430 0x7f06b415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.141+0000 7f06b99ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b415cd60 0x7f06b413e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.141+0000 7f06b99ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b415a9c0 con 0x7f06b415cd60 2023-07-09T21:51:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.141+0000 7f06b99ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b40b3a90 con 0x7f06b40cb980 2023-07-09T21:51:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.141+0000 7f06b99ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b40b3d70 con 0x7f06b4142430 2023-07-09T21:51:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.141+0000 7f06b37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b415cd60 0x7f06b413e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.141+0000 7f06b37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b415cd60 0x7f06b413e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35840/0 (socket says 172.21.15.53:35840) 2023-07-09T21:51:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.141+0000 7f06b37fe700 1 -- 172.21.15.53:0/3317134493 learned_addr learned my addr 172.21.15.53:0/3317134493 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.142+0000 7f06b2ffd700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06b40cb980 0x7f06b40b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:41.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.142+0000 7f06b27fc700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06b4142430 0x7f06b415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:41.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.142+0000 7f06b37fe700 1 -- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06b4142430 msgr2=0x7f06b415ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:41.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.142+0000 7f06b37fe700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06b4142430 0x7f06b415ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:41.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.142+0000 7f06b37fe700 1 -- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06b40cb980 msgr2=0x7f06b40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:41.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.142+0000 7f06b37fe700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06b40cb980 0x7f06b40b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:41.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.142+0000 7f06b37fe700 1 -- 172.21.15.53:0/3317134493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8009550 con 0x7f06b415cd60 2023-07-09T21:51:41.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.142+0000 7f06b37fe700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b415cd60 0x7f06b413e0e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f06ac00cb50 tx=0x7f06ac00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:41.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.142+0000 7f069bfff700 1 -- 172.21.15.53:0/3317134493 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac003c00 con 0x7f06b415cd60 2023-07-09T21:51:41.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.143+0000 7f069bfff700 1 -- 172.21.15.53:0/3317134493 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac003d60 con 0x7f06b415cd60 2023-07-09T21:51:41.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.143+0000 7f06b99ff700 1 -- 172.21.15.53:0/3317134493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b415a650 con 0x7f06b415cd60 2023-07-09T21:51:41.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.143+0000 7f069bfff700 1 -- 172.21.15.53:0/3317134493 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac00aac0 con 0x7f06b415cd60 2023-07-09T21:51:41.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.143+0000 7f06b99ff700 1 -- 172.21.15.53:0/3317134493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b40b4050 con 0x7f06b415cd60 2023-07-09T21:51:41.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.144+0000 7f06b99ff700 1 -- 172.21.15.53:0/3317134493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b415ab30 con 0x7f06b415cd60 2023-07-09T21:51:41.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.145+0000 7f069bfff700 1 -- 172.21.15.53:0/3317134493 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06ac00ac20 con 0x7f06b415cd60 2023-07-09T21:51:41.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.146+0000 7f069bfff700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f06a006ace0 0x7f06a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:41.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.146+0000 7f069bfff700 1 -- 172.21.15.53:0/3317134493 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f06ac089380 con 0x7f06b415cd60 2023-07-09T21:51:41.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.146+0000 7f06b2ffd700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f06a006ace0 0x7f06a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:41.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.147+0000 7f06b2ffd700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f06a006ace0 0x7f06a006d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f06a4000f60 tx=0x7f06a4004a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:41.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.151+0000 7f069bfff700 1 -- 172.21.15.53:0/3317134493 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f06ac054520 con 0x7f06b415cd60 2023-07-09T21:51:41.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.405+0000 7f06b99ff700 1 -- 172.21.15.53:0/3317134493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f06b404e210 con 0x7f06b415cd60 2023-07-09T21:51:41.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.853+0000 7f069bfff700 1 -- 172.21.15.53:0/3317134493 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f06ac057b40 con 0x7f06b415cd60 2023-07-09T21:51:41.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.858+0000 7f06b99ff700 1 -- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f06a006ace0 msgr2=0x7f06a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:41.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.858+0000 7f06b99ff700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f06a006ace0 0x7f06a006d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f06a4000f60 tx=0x7f06a4004a50 comp rx=0 tx=0).stop 2023-07-09T21:51:41.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.858+0000 7f06b99ff700 1 -- 172.21.15.53:0/3317134493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b415cd60 msgr2=0x7f06b413e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:41.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.858+0000 7f06b99ff700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b415cd60 0x7f06b413e0e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f06ac00cb50 tx=0x7f06ac00ce60 comp rx=0 tx=0).stop 2023-07-09T21:51:41.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.859+0000 7f06b99ff700 1 -- 172.21.15.53:0/3317134493 shutdown_connections 2023-07-09T21:51:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.859+0000 7f06b99ff700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f06a006ace0 0x7f06a006d190 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f06a4000f60 tx=0x7f06a4004a50 comp rx=0 tx=0).stop 2023-07-09T21:51:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.859+0000 7f06b99ff700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b415cd60 0x7f06b413e0e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.859+0000 7f06b99ff700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06b40cb980 0x7f06b40b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.859+0000 7f06b99ff700 1 --2- 172.21.15.53:0/3317134493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06b4142430 0x7f06b415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.859+0000 7f06b99ff700 1 -- 172.21.15.53:0/3317134493 >> 172.21.15.53:0/3317134493 conn(0x7f06b40b0640 msgr2=0x7f06b4072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:41.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.864+0000 7f06b99ff700 1 -- 172.21.15.53:0/3317134493 shutdown_connections 2023-07-09T21:51:41.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:41.864+0000 7f06b99ff700 1 -- 172.21.15.53:0/3317134493 wait complete. 2023-07-09T21:51:41.872 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 5 and data pool 6 2023-07-09T21:51:41.899 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:42.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.098+0000 7f274fdff700 1 Processor -- start 2023-07-09T21:51:42.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.098+0000 7f274fdff700 1 -- start start 2023-07-09T21:51:42.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.099+0000 7f274fdff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27480d1220 0x7f27480b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:42.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.099+0000 7f274fdff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27480d2ce0 con 0x7f27480b2350 2023-07-09T21:51:42.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.099+0000 7f274fdff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27480b3350 con 0x7f27480b1e00 2023-07-09T21:51:42.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.099+0000 7f274fdff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27480b3630 con 0x7f27480d1220 2023-07-09T21:51:42.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.099+0000 7f274d39a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27480d1220 0x7f27480b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:42.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.099+0000 7f274d39a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27480d1220 0x7f27480b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35852/0 (socket says 172.21.15.53:35852) 2023-07-09T21:51:42.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.099+0000 7f274d39a700 1 -- 172.21.15.53:0/2743754353 learned_addr learned my addr 172.21.15.53:0/2743754353 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:42.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.099+0000 7f274e39c700 1 --1- 172.21.15.53:0/2743754353 >> v1:172.21.15.53:6789/0 conn(0x7f27480b2350 0x7f27480afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50118/0 (socket says 172.21.15.53:50118) 2023-07-09T21:51:42.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.100+0000 7f274d39a700 1 -- 172.21.15.53:0/2743754353 >> v1:172.21.15.184:6789/0 conn(0x7f27480b1e00 legacy=0x7f27480d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:42.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.100+0000 7f274d39a700 1 -- 172.21.15.53:0/2743754353 >> v1:172.21.15.53:6789/0 conn(0x7f27480b2350 legacy=0x7f27480afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:42.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.100+0000 7f274d39a700 1 -- 172.21.15.53:0/2743754353 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27480b3910 con 0x7f27480d1220 2023-07-09T21:51:42.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.100+0000 7f274cb99700 1 -- 172.21.15.53:0/2743754353 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111874637 0 0) 0x7f27480d2ce0 con 0x7f27480b2350 2023-07-09T21:51:42.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.100+0000 7f274d39a700 1 --2- 172.21.15.53:0/2743754353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480d1220 0x7f27480b43f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f27380098f0 tx=0x7f2738009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd195a46a2c3314 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:42.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.100+0000 7f274cb99700 1 -- 172.21.15.53:0/2743754353 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800b8a0 con 0x7f27480d1220 2023-07-09T21:51:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.100+0000 7f274cb99700 1 -- 172.21.15.53:0/2743754353 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273800ba00 con 0x7f27480d1220 2023-07-09T21:51:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.100+0000 7f274cb99700 1 -- 172.21.15.53:0/2743754353 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800bd90 con 0x7f27480d1220 2023-07-09T21:51:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.101+0000 7f274fdff700 1 -- 172.21.15.53:0/2743754353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480d1220 msgr2=0x7f27480b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.101+0000 7f274fdff700 1 --2- 172.21.15.53:0/2743754353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480d1220 0x7f27480b43f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f27380098f0 tx=0x7f2738009c00 comp rx=0 tx=0).stop 2023-07-09T21:51:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.101+0000 7f274fdff700 1 -- 172.21.15.53:0/2743754353 shutdown_connections 2023-07-09T21:51:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.101+0000 7f274fdff700 1 --2- 172.21.15.53:0/2743754353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480d1220 0x7f27480b43f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.101+0000 7f274fdff700 1 -- 172.21.15.53:0/2743754353 >> 172.21.15.53:0/2743754353 conn(0x7f274809c1d0 msgr2=0x7f27480d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.101+0000 7f274fdff700 1 -- 172.21.15.53:0/2743754353 shutdown_connections 2023-07-09T21:51:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.101+0000 7f274fdff700 1 -- 172.21.15.53:0/2743754353 wait complete. 2023-07-09T21:51:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.103+0000 7f274fdff700 1 Processor -- start 2023-07-09T21:51:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.103+0000 7f274fdff700 1 -- start start 2023-07-09T21:51:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.104+0000 7f274fdff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27480b1e00 0x7f27480cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.104+0000 7f274fdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27480b2350 0x7f27481f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.104+0000 7f274fdff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480d1220 0x7f274806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:42.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.104+0000 7f274fdff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27480cd380 con 0x7f27480d1220 2023-07-09T21:51:42.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.104+0000 7f274fdff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27480ca580 con 0x7f27480b1e00 2023-07-09T21:51:42.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.104+0000 7f274fdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27480c82d0 con 0x7f27480b2350 2023-07-09T21:51:42.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.104+0000 7f274e39c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480d1220 0x7f274806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:42.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.104+0000 7f274e39c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480d1220 0x7f274806aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35854/0 (socket says 172.21.15.53:35854) 2023-07-09T21:51:42.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.104+0000 7f274e39c700 1 -- 172.21.15.53:0/1836798754 learned_addr learned my addr 172.21.15.53:0/1836798754 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:42.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.105+0000 7f274db9b700 1 --2- 172.21.15.53:0/1836798754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27480b1e00 0x7f27480cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:42.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.105+0000 7f274e39c700 1 -- 172.21.15.53:0/1836798754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27480b2350 msgr2=0x7f27481f1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:42.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.105+0000 7f274e39c700 1 --2- 172.21.15.53:0/1836798754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27480b2350 0x7f27481f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.105+0000 7f274e39c700 1 -- 172.21.15.53:0/1836798754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27480b1e00 msgr2=0x7f27480cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:42.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.105+0000 7f274e39c700 1 --2- 172.21.15.53:0/1836798754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27480b1e00 0x7f27480cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.105+0000 7f274e39c700 1 -- 172.21.15.53:0/1836798754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2738009550 con 0x7f27480d1220 2023-07-09T21:51:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.105+0000 7f274e39c700 1 --2- 172.21.15.53:0/1836798754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480d1220 0x7f274806aee0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2740002230 tx=0x7f274000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.105+0000 7f273e7fc700 1 -- 172.21.15.53:0/1836798754 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274000ac20 con 0x7f27480d1220 2023-07-09T21:51:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.105+0000 7f273e7fc700 1 -- 172.21.15.53:0/1836798754 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274000ada0 con 0x7f27480d1220 2023-07-09T21:51:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.105+0000 7f273e7fc700 1 -- 172.21.15.53:0/1836798754 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740007310 con 0x7f27480d1220 2023-07-09T21:51:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.105+0000 7f274fdff700 1 -- 172.21.15.53:0/1836798754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27480c85b0 con 0x7f27480d1220 2023-07-09T21:51:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.106+0000 7f274fdff700 1 -- 172.21.15.53:0/1836798754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27480c8b70 con 0x7f27480d1220 2023-07-09T21:51:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.107+0000 7f274fdff700 1 -- 172.21.15.53:0/1836798754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27480c8d60 con 0x7f27480d1220 2023-07-09T21:51:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.108+0000 7f273e7fc700 1 -- 172.21.15.53:0/1836798754 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2740007470 con 0x7f27480d1220 2023-07-09T21:51:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.109+0000 7f273e7fc700 1 --2- 172.21.15.53:0/1836798754 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f272c06ace0 0x7f272c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.109+0000 7f273e7fc700 1 -- 172.21.15.53:0/1836798754 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27400890c0 con 0x7f27480d1220 2023-07-09T21:51:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.109+0000 7f274db9b700 1 --2- 172.21.15.53:0/1836798754 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f272c06ace0 0x7f272c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.110+0000 7f274db9b700 1 --2- 172.21.15.53:0/1836798754 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f272c06ace0 0x7f272c06d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2744000fb0 tx=0x7f2744009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.113+0000 7f273e7fc700 1 -- 172.21.15.53:0/1836798754 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f27400540d0 con 0x7f27480d1220 2023-07-09T21:51:42.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.321+0000 7f274fdff700 1 -- 172.21.15.53:0/1836798754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f274804e280 con 0x7f27480d1220 2023-07-09T21:51:42.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.322+0000 7f273e7fc700 1 -- 172.21.15.53:0/1836798754 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18340 (secure 0 0 0) 0x7f27400576f0 con 0x7f27480d1220 2023-07-09T21:51:42.323 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:42.324 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":37,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:41.406526+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:51:39.793448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:51:40.342794+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.324+0000 7f274fdff700 1 -- 172.21.15.53:0/1836798754 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f272c06ace0 msgr2=0x7f272c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.324+0000 7f274fdff700 1 --2- 172.21.15.53:0/1836798754 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f272c06ace0 0x7f272c06d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2744000fb0 tx=0x7f2744009040 comp rx=0 tx=0).stop 2023-07-09T21:51:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.324+0000 7f274fdff700 1 -- 172.21.15.53:0/1836798754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480d1220 msgr2=0x7f274806aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.324+0000 7f274fdff700 1 --2- 172.21.15.53:0/1836798754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480d1220 0x7f274806aee0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2740002230 tx=0x7f274000a060 comp rx=0 tx=0).stop 2023-07-09T21:51:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.325+0000 7f274fdff700 1 -- 172.21.15.53:0/1836798754 shutdown_connections 2023-07-09T21:51:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.325+0000 7f274fdff700 1 --2- 172.21.15.53:0/1836798754 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f272c06ace0 0x7f272c06d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.325+0000 7f274fdff700 1 --2- 172.21.15.53:0/1836798754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480d1220 0x7f274806aee0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.325+0000 7f274fdff700 1 --2- 172.21.15.53:0/1836798754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27480b1e00 0x7f27480cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.325+0000 7f274fdff700 1 --2- 172.21.15.53:0/1836798754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27480b2350 0x7f27481f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.325+0000 7f274fdff700 1 -- 172.21.15.53:0/1836798754 >> 172.21.15.53:0/1836798754 conn(0x7f274809c1d0 msgr2=0x7f27480d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.325+0000 7f274fdff700 1 -- 172.21.15.53:0/1836798754 shutdown_connections 2023-07-09T21:51:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.325+0000 7f274fdff700 1 -- 172.21.15.53:0/1836798754 wait complete. 2023-07-09T21:51:42.344 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:42.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.542+0000 7fba9cdff700 1 Processor -- start 2023-07-09T21:51:42.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.542+0000 7fba9cdff700 1 -- start start 2023-07-09T21:51:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.543+0000 7fba9cdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba980b1e00 0x7fba980b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.543+0000 7fba9cdff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fba980b2350 0x7fba980d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.543+0000 7fba9cdff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba980d14a0 con 0x7fba980d1050 2023-07-09T21:51:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.543+0000 7fba9cdff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba980d2ce0 con 0x7fba980b2350 2023-07-09T21:51:42.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.543+0000 7fba9cdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba980b3350 con 0x7fba980b1e00 2023-07-09T21:51:42.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.544+0000 7fba9659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba980b1e00 0x7fba980b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:42.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.544+0000 7fba9659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba980b1e00 0x7fba980b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:49174/0 (socket says 172.21.15.53:49174) 2023-07-09T21:51:42.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.544+0000 7fba9659c700 1 -- 172.21.15.53:0/3861823379 learned_addr learned my addr 172.21.15.53:0/3861823379 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:42.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.544+0000 7fba8ffff700 1 --2- 172.21.15.53:0/3861823379 >> v2:172.21.15.184:3300/0 conn(0x7fba980b2350 0x7fba980d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:42.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.544+0000 7fba95d9b700 1 -- 172.21.15.53:0/3861823379 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679188396 0 0) 0x7fba90001490 con 0x7fba980d1050 2023-07-09T21:51:42.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.544+0000 7fba95d9b700 1 -- 172.21.15.53:0/3861823379 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba840035b0 con 0x7fba980d1050 2023-07-09T21:51:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.544+0000 7fba8ffff700 1 -- 172.21.15.53:0/3861823379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba980b1e00 msgr2=0x7fba980b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.544+0000 7fba8ffff700 1 --2- 172.21.15.53:0/3861823379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba980b1e00 0x7fba980b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.544+0000 7fba8ffff700 1 -- 172.21.15.53:0/3861823379 >> v1:172.21.15.184:6789/0 conn(0x7fba980d1050 legacy=0x7fba980afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.544+0000 7fba8ffff700 1 -- 172.21.15.53:0/3861823379 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba980b3630 con 0x7fba980b2350 2023-07-09T21:51:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.544+0000 7fba9659c700 1 --2- 172.21.15.53:0/3861823379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba980b1e00 0x7fba980b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.545+0000 7fba8ffff700 1 --2- 172.21.15.53:0/3861823379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba980b2350 0x7fba980d0b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fba80009840 tx=0x7fba80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e35e547c7e83dcd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.545+0000 7fba95d9b700 1 -- 172.21.15.53:0/3861823379 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80011830 con 0x7fba980b2350 2023-07-09T21:51:42.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.545+0000 7fba95d9b700 1 -- 172.21.15.53:0/3861823379 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba80011990 con 0x7fba980b2350 2023-07-09T21:51:42.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.545+0000 7fba95d9b700 1 -- 172.21.15.53:0/3861823379 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80011d20 con 0x7fba980b2350 2023-07-09T21:51:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.545+0000 7fba9cdff700 1 -- 172.21.15.53:0/3861823379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba980b2350 msgr2=0x7fba980d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.545+0000 7fba9cdff700 1 --2- 172.21.15.53:0/3861823379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba980b2350 0x7fba980d0b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fba80009840 tx=0x7fba80009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.546+0000 7fba9cdff700 1 -- 172.21.15.53:0/3861823379 shutdown_connections 2023-07-09T21:51:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.546+0000 7fba9cdff700 1 --2- 172.21.15.53:0/3861823379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba980b1e00 0x7fba980b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.546+0000 7fba9cdff700 1 --2- 172.21.15.53:0/3861823379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba980b2350 0x7fba980d0b10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.546+0000 7fba9cdff700 1 -- 172.21.15.53:0/3861823379 >> 172.21.15.53:0/3861823379 conn(0x7fba9809c1d0 msgr2=0x7fba980d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.546+0000 7fba9cdff700 1 -- 172.21.15.53:0/3861823379 shutdown_connections 2023-07-09T21:51:42.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.546+0000 7fba9cdff700 1 -- 172.21.15.53:0/3861823379 wait complete. 2023-07-09T21:51:42.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.547+0000 7fba9cdff700 1 Processor -- start 2023-07-09T21:51:42.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.548+0000 7fba9cdff700 1 -- start start 2023-07-09T21:51:42.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.548+0000 7fba9cdff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba980b1e00 0x7fba980c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:42.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba9cdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba980b2350 0x7fba980c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:42.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba9cdff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba980d1050 0x7fba9806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:42.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba9cdff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba980c6270 con 0x7fba980b1e00 2023-07-09T21:51:42.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba9cdff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba980c94b0 con 0x7fba980d1050 2023-07-09T21:51:42.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba9cdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba980c9790 con 0x7fba980b2350 2023-07-09T21:51:42.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba9659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba980b1e00 0x7fba980c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:42.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba9659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba980b1e00 0x7fba980c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35868/0 (socket says 172.21.15.53:35868) 2023-07-09T21:51:42.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba9659c700 1 -- 172.21.15.53:0/2706623243 learned_addr learned my addr 172.21.15.53:0/2706623243 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:42.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba96d9d700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba980d1050 0x7fba9806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:42.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba8ffff700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba980b2350 0x7fba980c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:42.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba9659c700 1 -- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba980b2350 msgr2=0x7fba980c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:42.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba9659c700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba980b2350 0x7fba980c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba9659c700 1 -- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba980d1050 msgr2=0x7fba9806b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:42.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba9659c700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba980d1050 0x7fba9806b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.549+0000 7fba9659c700 1 -- 172.21.15.53:0/2706623243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88009500 con 0x7fba980b1e00 2023-07-09T21:51:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.550+0000 7fba9659c700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba980b1e00 0x7fba980c5d30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fba8800e9a0 tx=0x7fba8800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.550+0000 7fba8effd700 1 -- 172.21.15.53:0/2706623243 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88005a20 con 0x7fba980b1e00 2023-07-09T21:51:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.550+0000 7fba8effd700 1 -- 172.21.15.53:0/2706623243 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba88005b80 con 0x7fba980b1e00 2023-07-09T21:51:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.550+0000 7fba9cdff700 1 -- 172.21.15.53:0/2706623243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba800094a0 con 0x7fba980b1e00 2023-07-09T21:51:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.550+0000 7fba8effd700 1 -- 172.21.15.53:0/2706623243 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8800c690 con 0x7fba980b1e00 2023-07-09T21:51:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.550+0000 7fba9cdff700 1 -- 172.21.15.53:0/2706623243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba980c6d50 con 0x7fba980b1e00 2023-07-09T21:51:42.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.551+0000 7fba9cdff700 1 -- 172.21.15.53:0/2706623243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba980c73a0 con 0x7fba980b1e00 2023-07-09T21:51:42.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.552+0000 7fba8effd700 1 -- 172.21.15.53:0/2706623243 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba8800c7f0 con 0x7fba980b1e00 2023-07-09T21:51:42.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.553+0000 7fba8effd700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fba7806ace0 0x7fba7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:42.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.553+0000 7fba8effd700 1 -- 172.21.15.53:0/2706623243 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba880896f0 con 0x7fba980b1e00 2023-07-09T21:51:42.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.553+0000 7fba8ffff700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fba7806ace0 0x7fba7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:42.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.554+0000 7fba8ffff700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fba7806ace0 0x7fba7806d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fba80000c00 tx=0x7fba8001c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:42.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.557+0000 7fba8effd700 1 -- 172.21.15.53:0/2706623243 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fba88054700 con 0x7fba980b1e00 2023-07-09T21:51:42.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.768+0000 7fba9cdff700 1 -- 172.21.15.53:0/2706623243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba9804e280 con 0x7fba980b1e00 2023-07-09T21:51:42.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.769+0000 7fba8effd700 1 -- 172.21.15.53:0/2706623243 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18340 (secure 0 0 0) 0x7fba88057d20 con 0x7fba980b1e00 2023-07-09T21:51:42.771 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:42.771 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":37,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:41.406526+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:51:39.793448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:51:40.342794+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:42.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.772+0000 7fba9cdff700 1 -- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fba7806ace0 msgr2=0x7fba7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:42.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.772+0000 7fba9cdff700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fba7806ace0 0x7fba7806d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fba80000c00 tx=0x7fba8001c040 comp rx=0 tx=0).stop 2023-07-09T21:51:42.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.772+0000 7fba9cdff700 1 -- 172.21.15.53:0/2706623243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba980b1e00 msgr2=0x7fba980c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:42.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.772+0000 7fba9cdff700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba980b1e00 0x7fba980c5d30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fba8800e9a0 tx=0x7fba8800ecb0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.772+0000 7fba9cdff700 1 -- 172.21.15.53:0/2706623243 shutdown_connections 2023-07-09T21:51:42.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.772+0000 7fba9cdff700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fba7806ace0 0x7fba7806d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.772+0000 7fba9cdff700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba980d1050 0x7fba9806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.772+0000 7fba9cdff700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba980b1e00 0x7fba980c5d30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.772+0000 7fba9cdff700 1 --2- 172.21.15.53:0/2706623243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba980b2350 0x7fba980c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:42.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.772+0000 7fba9cdff700 1 -- 172.21.15.53:0/2706623243 >> 172.21.15.53:0/2706623243 conn(0x7fba9809c1d0 msgr2=0x7fba980afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:42.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.772+0000 7fba9cdff700 1 -- 172.21.15.53:0/2706623243 shutdown_connections 2023-07-09T21:51:42.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.772+0000 7fba9cdff700 1 -- 172.21.15.53:0/2706623243 wait complete. 2023-07-09T21:51:42.791 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T21:51:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.997+0000 7f54b53ff700 1 Processor -- start 2023-07-09T21:51:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.997+0000 7f54b53ff700 1 -- start start 2023-07-09T21:51:42.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.998+0000 7f54b53ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f54b00d1220 0x7f54b00b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:43.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.998+0000 7f54b53ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f54b00b0e20 0x7f54b00b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:43.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.998+0000 7f54b53ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b00b8e80 con 0x7f54b00b3ff0 2023-07-09T21:51:43.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.998+0000 7f54b53ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b00afaa0 con 0x7f54b00b0e20 2023-07-09T21:51:43.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.998+0000 7f54b53ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b00afd80 con 0x7f54b00d1220 2023-07-09T21:51:43.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.998+0000 7f54af7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f54b00b0e20 0x7f54b00b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:43.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.998+0000 7f54aeffd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f54b00b3ff0 0x7f54b00d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58342/0 (socket says 172.21.15.53:58342) 2023-07-09T21:51:43.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.999+0000 7f54aeffd700 1 -- 172.21.15.53:0/3014325231 learned_addr learned my addr 172.21.15.53:0/3014325231 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:43.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.999+0000 7f54ae7fc700 1 --2- 172.21.15.53:0/3014325231 >> v2:172.21.15.184:3300/0 conn(0x7f54b00d1220 0x7f54b00b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:43.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.999+0000 7f54af7fe700 1 -- 172.21.15.53:0/3014325231 >> v2:172.21.15.184:3300/0 conn(0x7f54b00d1220 msgr2=0x7f54b00b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:43.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.999+0000 7f54af7fe700 1 --2- 172.21.15.53:0/3014325231 >> v2:172.21.15.184:3300/0 conn(0x7f54b00d1220 0x7f54b00b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:43.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.999+0000 7f54af7fe700 1 -- 172.21.15.53:0/3014325231 >> v1:172.21.15.53:6789/0 conn(0x7f54b00b3ff0 legacy=0x7f54b00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:43.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.999+0000 7f54af7fe700 1 -- 172.21.15.53:0/3014325231 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b00b0060 con 0x7f54b00b0e20 2023-07-09T21:51:43.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.999+0000 7f54af7fe700 1 --2- 172.21.15.53:0/3014325231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54b00b0e20 0x7f54b00b1220 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f54b009c8e0 tx=0x7f54a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1ee1102e1b4e6d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:43.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.999+0000 7f54adffb700 1 -- 172.21.15.53:0/3014325231 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a800e070 con 0x7f54b00b0e20 2023-07-09T21:51:43.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:42.999+0000 7f54adffb700 1 -- 172.21.15.53:0/3014325231 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a800bbd0 con 0x7f54b00b0e20 2023-07-09T21:51:43.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.000+0000 7f54adffb700 1 -- 172.21.15.53:0/3014325231 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8012430 con 0x7f54b00b0e20 2023-07-09T21:51:43.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.000+0000 7f54b53ff700 1 -- 172.21.15.53:0/3014325231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54b00b0e20 msgr2=0x7f54b00b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:43.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.000+0000 7f54b53ff700 1 --2- 172.21.15.53:0/3014325231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54b00b0e20 0x7f54b00b1220 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f54b009c8e0 tx=0x7f54a800b330 comp rx=0 tx=0).stop 2023-07-09T21:51:43.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.000+0000 7f54b53ff700 1 -- 172.21.15.53:0/3014325231 shutdown_connections 2023-07-09T21:51:43.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.000+0000 7f54b53ff700 1 --2- 172.21.15.53:0/3014325231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54b00b0e20 0x7f54b00b1220 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:43.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.000+0000 7f54b53ff700 1 --2- 172.21.15.53:0/3014325231 >> v2:172.21.15.184:3300/0 conn(0x7f54b00d1220 0x7f54b00b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:43.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.000+0000 7f54b53ff700 1 -- 172.21.15.53:0/3014325231 >> 172.21.15.53:0/3014325231 conn(0x7f54b009c1b0 msgr2=0x7f54b00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:43.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.000+0000 7f54b53ff700 1 -- 172.21.15.53:0/3014325231 shutdown_connections 2023-07-09T21:51:43.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.000+0000 7f54b53ff700 1 -- 172.21.15.53:0/3014325231 wait complete. 2023-07-09T21:51:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.002+0000 7f54b53ff700 1 Processor -- start 2023-07-09T21:51:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.002+0000 7f54b53ff700 1 -- start start 2023-07-09T21:51:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.003+0000 7f54b53ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54b00b0e20 0x7f54b01f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.003+0000 7f54b53ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54b00b3ff0 0x7f54b015e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.003+0000 7f54b53ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54b00d1220 0x7f54b009e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.003+0000 7f54b53ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b01f2e90 con 0x7f54b00d1220 2023-07-09T21:51:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.003+0000 7f54b53ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b015f7f0 con 0x7f54b00b3ff0 2023-07-09T21:51:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.003+0000 7f54b53ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b009d050 con 0x7f54b00b0e20 2023-07-09T21:51:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.003+0000 7f54af7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54b00d1220 0x7f54b009e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.003+0000 7f54ae7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54b00b3ff0 0x7f54b015e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.003+0000 7f54af7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54b00d1220 0x7f54b009e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50070/0 (socket says 172.21.15.53:50070) 2023-07-09T21:51:43.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.003+0000 7f54af7fe700 1 -- 172.21.15.53:0/1845037037 learned_addr learned my addr 172.21.15.53:0/1845037037 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:43.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.004+0000 7f54aeffd700 1 --2- 172.21.15.53:0/1845037037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54b00b0e20 0x7f54b01f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:43.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.004+0000 7f54af7fe700 1 -- 172.21.15.53:0/1845037037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54b00b0e20 msgr2=0x7f54b01f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:43.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.004+0000 7f54af7fe700 1 --2- 172.21.15.53:0/1845037037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54b00b0e20 0x7f54b01f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:43.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.004+0000 7f54af7fe700 1 -- 172.21.15.53:0/1845037037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54b00b3ff0 msgr2=0x7f54b015e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:43.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.004+0000 7f54af7fe700 1 --2- 172.21.15.53:0/1845037037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54b00b3ff0 0x7f54b015e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.004+0000 7f54af7fe700 1 -- 172.21.15.53:0/1845037037 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8009a70 con 0x7f54b00d1220 2023-07-09T21:51:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.004+0000 7f54af7fe700 1 --2- 172.21.15.53:0/1845037037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54b00d1220 0x7f54b009e970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f54a8014040 tx=0x7f54a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.004+0000 7f54977fe700 1 -- 172.21.15.53:0/1845037037 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8012430 con 0x7f54b00d1220 2023-07-09T21:51:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.004+0000 7f54977fe700 1 -- 172.21.15.53:0/1845037037 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a8020070 con 0x7f54b00d1220 2023-07-09T21:51:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.004+0000 7f54977fe700 1 -- 172.21.15.53:0/1845037037 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a80098f0 con 0x7f54b00d1220 2023-07-09T21:51:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.004+0000 7f54b53ff700 1 -- 172.21.15.53:0/1845037037 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b009d330 con 0x7f54b00d1220 2023-07-09T21:51:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.005+0000 7f54b53ff700 1 -- 172.21.15.53:0/1845037037 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b009d8f0 con 0x7f54b00d1220 2023-07-09T21:51:43.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.006+0000 7f54b53ff700 1 -- 172.21.15.53:0/1845037037 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b00d1040 con 0x7f54b00d1220 2023-07-09T21:51:43.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.006+0000 7f54977fe700 1 -- 172.21.15.53:0/1845037037 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f54a8004040 con 0x7f54b00d1220 2023-07-09T21:51:43.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.008+0000 7f54977fe700 1 --2- 172.21.15.53:0/1845037037 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f549c06ace0 0x7f549c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:43.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.008+0000 7f54977fe700 1 -- 172.21.15.53:0/1845037037 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54a8022070 con 0x7f54b00d1220 2023-07-09T21:51:43.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.008+0000 7f54aeffd700 1 --2- 172.21.15.53:0/1845037037 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f549c06ace0 0x7f549c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:43.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.009+0000 7f54aeffd700 1 --2- 172.21.15.53:0/1845037037 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f549c06ace0 0x7f549c06d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54a0005910 tx=0x7f54a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:43.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.013+0000 7f54977fe700 1 -- 172.21.15.53:0/1845037037 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f54a80bd310 con 0x7f54b00d1220 2023-07-09T21:51:43.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.271+0000 7f54b53ff700 1 -- 172.21.15.53:0/1845037037 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f54b0074350 con 0x7f54b00d1220 2023-07-09T21:51:43.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.882+0000 7f54977fe700 1 -- 172.21.15.53:0/1845037037 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f54a8056250 con 0x7f54b00d1220 2023-07-09T21:51:43.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.885+0000 7f54b53ff700 1 -- 172.21.15.53:0/1845037037 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f549c06ace0 msgr2=0x7f549c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:43.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.885+0000 7f54b53ff700 1 --2- 172.21.15.53:0/1845037037 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f549c06ace0 0x7f549c06d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54a0005910 tx=0x7f54a0009040 comp rx=0 tx=0).stop 2023-07-09T21:51:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.885+0000 7f54b53ff700 1 -- 172.21.15.53:0/1845037037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54b00d1220 msgr2=0x7f54b009e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.885+0000 7f54b53ff700 1 --2- 172.21.15.53:0/1845037037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54b00d1220 0x7f54b009e970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f54a8014040 tx=0x7f54a8004ad0 comp rx=0 tx=0).stop 2023-07-09T21:51:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.885+0000 7f54b53ff700 1 -- 172.21.15.53:0/1845037037 shutdown_connections 2023-07-09T21:51:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.885+0000 7f54b53ff700 1 --2- 172.21.15.53:0/1845037037 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f549c06ace0 0x7f549c06d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.885+0000 7f54b53ff700 1 --2- 172.21.15.53:0/1845037037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54b00d1220 0x7f54b009e970 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.885+0000 7f54b53ff700 1 --2- 172.21.15.53:0/1845037037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54b00b0e20 0x7f54b01f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:43.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.885+0000 7f54b53ff700 1 --2- 172.21.15.53:0/1845037037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54b00b3ff0 0x7f54b015e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:43.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.885+0000 7f54b53ff700 1 -- 172.21.15.53:0/1845037037 >> 172.21.15.53:0/1845037037 conn(0x7f54b009c1b0 msgr2=0x7f54b006b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:43.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.885+0000 7f54b53ff700 1 -- 172.21.15.53:0/1845037037 shutdown_connections 2023-07-09T21:51:43.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:43.885+0000 7f54b53ff700 1 -- 172.21.15.53:0/1845037037 wait complete. 2023-07-09T21:51:43.907 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T21:51:43.907 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T21:51:44.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.110+0000 7f96299ff700 1 Processor -- start 2023-07-09T21:51:44.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.111+0000 7f96299ff700 1 -- start start 2023-07-09T21:51:44.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.112+0000 7f96299ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96240cda40 0x7f96240cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:44.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.112+0000 7f96299ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f962406ba00 0x7f962406be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:44.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.112+0000 7f96299ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96240ce3d0 con 0x7f96240cbe40 2023-07-09T21:51:44.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.112+0000 7f96299ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962406b5b0 con 0x7f962406ba00 2023-07-09T21:51:44.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.112+0000 7f96299ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9624071500 con 0x7f96240cda40 2023-07-09T21:51:44.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.112+0000 7f961bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96240cda40 0x7f96240cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:44.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.112+0000 7f9622ffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f96240cbe40 0x7f96240cd0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:41102/0 (socket says 172.21.15.53:41102) 2023-07-09T21:51:44.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.112+0000 7f9622ffd700 1 -- 172.21.15.53:0/1891594327 learned_addr learned my addr 172.21.15.53:0/1891594327 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:44.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.112+0000 7f96237fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f962406ba00 0x7f962406be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:44.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.113+0000 7f96227fc700 1 -- 172.21.15.53:0/1891594327 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095523815 0 0) 0x7f9614001110 con 0x7f96240cbe40 2023-07-09T21:51:44.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.113+0000 7f96227fc700 1 -- 172.21.15.53:0/1891594327 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96100057c0 con 0x7f96240cbe40 2023-07-09T21:51:44.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.113+0000 7f961bfff700 1 -- 172.21.15.53:0/1891594327 >> v2:172.21.15.184:3300/0 conn(0x7f962406ba00 msgr2=0x7f962406be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:44.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.113+0000 7f961bfff700 1 --2- 172.21.15.53:0/1891594327 >> v2:172.21.15.184:3300/0 conn(0x7f962406ba00 0x7f962406be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:44.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.113+0000 7f961bfff700 1 -- 172.21.15.53:0/1891594327 >> v1:172.21.15.184:6789/0 conn(0x7f96240cbe40 legacy=0x7f96240cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:44.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.113+0000 7f961bfff700 1 -- 172.21.15.53:0/1891594327 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96240ce8c0 con 0x7f96240cda40 2023-07-09T21:51:44.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.113+0000 7f96237fe700 1 --2- 172.21.15.53:0/1891594327 >> v2:172.21.15.184:3300/0 conn(0x7f962406ba00 0x7f962406be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:44.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.113+0000 7f961bfff700 1 --2- 172.21.15.53:0/1891594327 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96240cda40 0x7f96240cde90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f960c009840 tx=0x7f960c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=834bffb2d7d29351 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:44.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.114+0000 7f96227fc700 1 -- 172.21.15.53:0/1891594327 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c011830 con 0x7f96240cda40 2023-07-09T21:51:44.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.114+0000 7f96227fc700 1 -- 172.21.15.53:0/1891594327 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c011990 con 0x7f96240cda40 2023-07-09T21:51:44.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.114+0000 7f96227fc700 1 -- 172.21.15.53:0/1891594327 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c011d20 con 0x7f96240cda40 2023-07-09T21:51:44.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.114+0000 7f96299ff700 1 -- 172.21.15.53:0/1891594327 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96240cda40 msgr2=0x7f96240cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:44.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.114+0000 7f96299ff700 1 --2- 172.21.15.53:0/1891594327 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96240cda40 0x7f96240cde90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f960c009840 tx=0x7f960c009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:44.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.114+0000 7f96299ff700 1 -- 172.21.15.53:0/1891594327 shutdown_connections 2023-07-09T21:51:44.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.114+0000 7f96299ff700 1 --2- 172.21.15.53:0/1891594327 >> v2:172.21.15.184:3300/0 conn(0x7f962406ba00 0x7f962406be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:44.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.114+0000 7f96299ff700 1 --2- 172.21.15.53:0/1891594327 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96240cda40 0x7f96240cde90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:44.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.114+0000 7f96299ff700 1 -- 172.21.15.53:0/1891594327 >> 172.21.15.53:0/1891594327 conn(0x7f96240b05d0 msgr2=0x7f96240b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:44.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.114+0000 7f96299ff700 1 -- 172.21.15.53:0/1891594327 shutdown_connections 2023-07-09T21:51:44.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.114+0000 7f96299ff700 1 -- 172.21.15.53:0/1891594327 wait complete. 2023-07-09T21:51:44.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.117+0000 7f96299ff700 1 Processor -- start 2023-07-09T21:51:44.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.117+0000 7f96299ff700 1 -- start start 2023-07-09T21:51:44.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.118+0000 7f96299ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f962406ba00 0x7f96240c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:44.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.118+0000 7f96299ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96240cbe40 0x7f96240b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:44.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.118+0000 7f96299ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96240cda40 0x7f96240afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:44.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.118+0000 7f96299ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962414ba40 con 0x7f96240cbe40 2023-07-09T21:51:44.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.118+0000 7f96299ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240b4120 con 0x7f96240cda40 2023-07-09T21:51:44.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.118+0000 7f96299ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96240b0370 con 0x7f962406ba00 2023-07-09T21:51:44.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.119+0000 7f961bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96240cbe40 0x7f96240b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:44.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.119+0000 7f961bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96240cbe40 0x7f96240b3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50078/0 (socket says 172.21.15.53:50078) 2023-07-09T21:51:44.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.119+0000 7f961bfff700 1 -- 172.21.15.53:0/3443433122 learned_addr learned my addr 172.21.15.53:0/3443433122 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:44.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.119+0000 7f9622ffd700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f962406ba00 0x7f96240c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:44.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.119+0000 7f96237fe700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96240cda40 0x7f96240afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:44.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.119+0000 7f961bfff700 1 -- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f962406ba00 msgr2=0x7f96240c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:44.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.119+0000 7f961bfff700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f962406ba00 0x7f96240c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:44.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.119+0000 7f961bfff700 1 -- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96240cda40 msgr2=0x7f96240afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:44.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.119+0000 7f961bfff700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96240cda40 0x7f96240afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:44.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.119+0000 7f961bfff700 1 -- 172.21.15.53:0/3443433122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c009a70 con 0x7f96240cbe40 2023-07-09T21:51:44.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.119+0000 7f96237fe700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96240cda40 0x7f96240afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:44.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.119+0000 7f961bfff700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96240cbe40 0x7f96240b3be0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f960c000c00 tx=0x7f960c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:44.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.120+0000 7f9620ff9700 1 -- 172.21.15.53:0/3443433122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c0036a0 con 0x7f96240cbe40 2023-07-09T21:51:44.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.120+0000 7f9620ff9700 1 -- 172.21.15.53:0/3443433122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c01f070 con 0x7f96240cbe40 2023-07-09T21:51:44.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.120+0000 7f9620ff9700 1 -- 172.21.15.53:0/3443433122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c003a60 con 0x7f96240cbe40 2023-07-09T21:51:44.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.120+0000 7f96299ff700 1 -- 172.21.15.53:0/3443433122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c0094a0 con 0x7f96240cbe40 2023-07-09T21:51:44.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.120+0000 7f96299ff700 1 -- 172.21.15.53:0/3443433122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96240c5180 con 0x7f96240cbe40 2023-07-09T21:51:44.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.121+0000 7f96299ff700 1 -- 172.21.15.53:0/3443433122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9624074350 con 0x7f96240cbe40 2023-07-09T21:51:44.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.122+0000 7f9620ff9700 1 -- 172.21.15.53:0/3443433122 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f960c003bc0 con 0x7f96240cbe40 2023-07-09T21:51:44.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.122+0000 7f9620ff9700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f960406ace0 0x7f960406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:44.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.123+0000 7f9620ff9700 1 -- 172.21.15.53:0/3443433122 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f960c021070 con 0x7f96240cbe40 2023-07-09T21:51:44.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.123+0000 7f9622ffd700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f960406ace0 0x7f960406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:44.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.124+0000 7f9622ffd700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f960406ace0 0x7f960406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9614001270 tx=0x7f9614009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:44.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.127+0000 7f9620ff9700 1 -- 172.21.15.53:0/3443433122 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f960c055e00 con 0x7f96240cbe40 2023-07-09T21:51:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.377+0000 7f96299ff700 1 -- 172.21.15.53:0/3443433122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f96240b4a40 con 0x7f96240cbe40 2023-07-09T21:51:44.784 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-07-09T21:51:44.783+0000 7f89559f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:51:44.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.888+0000 7f9620ff9700 1 -- 172.21.15.53:0/3443433122 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f960c059420 con 0x7f96240cbe40 2023-07-09T21:51:44.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.891+0000 7f96299ff700 1 -- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f960406ace0 msgr2=0x7f960406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:44.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.891+0000 7f96299ff700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f960406ace0 0x7f960406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9614001270 tx=0x7f9614009040 comp rx=0 tx=0).stop 2023-07-09T21:51:44.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.891+0000 7f96299ff700 1 -- 172.21.15.53:0/3443433122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96240cbe40 msgr2=0x7f96240b3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:44.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.891+0000 7f96299ff700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96240cbe40 0x7f96240b3be0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f960c000c00 tx=0x7f960c004750 comp rx=0 tx=0).stop 2023-07-09T21:51:44.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.891+0000 7f96299ff700 1 -- 172.21.15.53:0/3443433122 shutdown_connections 2023-07-09T21:51:44.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.891+0000 7f96299ff700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f960406ace0 0x7f960406d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:44.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.891+0000 7f96299ff700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96240cda40 0x7f96240afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:44.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.891+0000 7f96299ff700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f962406ba00 0x7f96240c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:44.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.891+0000 7f96299ff700 1 --2- 172.21.15.53:0/3443433122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96240cbe40 0x7f96240b3be0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:44.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.891+0000 7f96299ff700 1 -- 172.21.15.53:0/3443433122 >> 172.21.15.53:0/3443433122 conn(0x7f96240b05d0 msgr2=0x7f96240cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:44.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.891+0000 7f96299ff700 1 -- 172.21.15.53:0/3443433122 shutdown_connections 2023-07-09T21:51:44.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:44.891+0000 7f96299ff700 1 -- 172.21.15.53:0/3443433122 wait complete. 2023-07-09T21:51:44.912 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T21:51:44.913 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:51:45.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.115+0000 7f0fba1ff700 1 Processor -- start 2023-07-09T21:51:45.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.115+0000 7f0fba1ff700 1 -- start start 2023-07-09T21:51:45.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.116+0000 7f0fba1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fb40b1e00 0x7f0fb40b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:45.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.116+0000 7f0fba1ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fb40d1220 0x7f0fb40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:45.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.116+0000 7f0fba1ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb40d2ce0 con 0x7f0fb40b2350 2023-07-09T21:51:45.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.116+0000 7f0fba1ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb40b3350 con 0x7f0fb40d1220 2023-07-09T21:51:45.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.116+0000 7f0fba1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40b3630 con 0x7f0fb40b1e00 2023-07-09T21:51:45.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.116+0000 7f0fb3fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fb40d1220 0x7f0fb40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:45.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.116+0000 7f0fb3fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fb40d1220 0x7f0fb40afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50092/0 (socket says 172.21.15.53:50092) 2023-07-09T21:51:45.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.116+0000 7f0fb3fff700 1 -- 172.21.15.53:0/1541617430 learned_addr learned my addr 172.21.15.53:0/1541617430 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:45.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.117+0000 7f0fb37fe700 1 --2- 172.21.15.53:0/1541617430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fb40b1e00 0x7f0fb40b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:45.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.117+0000 7f0fb3fff700 1 -- 172.21.15.53:0/1541617430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fb40b1e00 msgr2=0x7f0fb40b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:45.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.117+0000 7f0fb3fff700 1 --2- 172.21.15.53:0/1541617430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fb40b1e00 0x7f0fb40b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.117+0000 7f0fb3fff700 1 -- 172.21.15.53:0/1541617430 >> v1:172.21.15.53:6789/0 conn(0x7f0fb40b2350 legacy=0x7f0fb40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:45.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.117+0000 7f0fb3fff700 1 -- 172.21.15.53:0/1541617430 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb40b3910 con 0x7f0fb40d1220 2023-07-09T21:51:45.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.117+0000 7f0fb2ffd700 1 -- 172.21.15.53:0/1541617430 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246889489 0 0) 0x7f0fb40d2ce0 con 0x7f0fb40b2350 2023-07-09T21:51:45.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.117+0000 7f0fb3fff700 1 --2- 172.21.15.53:0/1541617430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fb40d1220 0x7f0fb40afac0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009e50 tx=0x7f0fac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91db37db572277f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:45.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.117+0000 7f0fb2ffd700 1 -- 172.21.15.53:0/1541617430 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac00e070 con 0x7f0fb40d1220 2023-07-09T21:51:45.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.117+0000 7f0fb2ffd700 1 -- 172.21.15.53:0/1541617430 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac00b9c0 con 0x7f0fb40d1220 2023-07-09T21:51:45.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.117+0000 7f0fb2ffd700 1 -- 172.21.15.53:0/1541617430 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac00bd70 con 0x7f0fb40d1220 2023-07-09T21:51:45.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.118+0000 7f0fba1ff700 1 -- 172.21.15.53:0/1541617430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fb40d1220 msgr2=0x7f0fb40afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:45.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.118+0000 7f0fba1ff700 1 --2- 172.21.15.53:0/1541617430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fb40d1220 0x7f0fb40afac0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009e50 tx=0x7f0fac00b330 comp rx=0 tx=0).stop 2023-07-09T21:51:45.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.118+0000 7f0fba1ff700 1 -- 172.21.15.53:0/1541617430 shutdown_connections 2023-07-09T21:51:45.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.118+0000 7f0fba1ff700 1 --2- 172.21.15.53:0/1541617430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fb40d1220 0x7f0fb40afac0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.118+0000 7f0fba1ff700 1 --2- 172.21.15.53:0/1541617430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fb40b1e00 0x7f0fb40b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.118+0000 7f0fba1ff700 1 -- 172.21.15.53:0/1541617430 >> 172.21.15.53:0/1541617430 conn(0x7f0fb409c1d0 msgr2=0x7f0fb40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.118+0000 7f0fba1ff700 1 -- 172.21.15.53:0/1541617430 shutdown_connections 2023-07-09T21:51:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.118+0000 7f0fba1ff700 1 -- 172.21.15.53:0/1541617430 wait complete. 2023-07-09T21:51:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.120+0000 7f0fba1ff700 1 Processor -- start 2023-07-09T21:51:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.120+0000 7f0fba1ff700 1 -- start start 2023-07-09T21:51:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.121+0000 7f0fba1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fb40b1e00 0x7f0fb4155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.121+0000 7f0fba1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fb40b2350 0x7f0fb41f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.121+0000 7f0fba1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fb40d1220 0x7f0fb41f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.121+0000 7f0fba1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4156420 con 0x7f0fb40b2350 2023-07-09T21:51:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.121+0000 7f0fba1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4156700 con 0x7f0fb40d1220 2023-07-09T21:51:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.121+0000 7f0fba1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb41569e0 con 0x7f0fb40b1e00 2023-07-09T21:51:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.121+0000 7f0fabfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fb40b2350 0x7f0fb41f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.121+0000 7f0fabfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fb40b2350 0x7f0fb41f2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50098/0 (socket says 172.21.15.53:50098) 2023-07-09T21:51:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.121+0000 7f0fabfff700 1 -- 172.21.15.53:0/206547518 learned_addr learned my addr 172.21.15.53:0/206547518 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fb3fff700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fb40d1220 0x7f0fb41f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fb37fe700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fb40b1e00 0x7f0fb4155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fabfff700 1 -- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fb40b1e00 msgr2=0x7f0fb4155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fabfff700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fb40b1e00 0x7f0fb4155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fabfff700 1 -- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fb40d1220 msgr2=0x7f0fb41f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fabfff700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fb40d1220 0x7f0fb41f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fabfff700 1 -- 172.21.15.53:0/206547518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac009b30 con 0x7f0fb40b2350 2023-07-09T21:51:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fb3fff700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fb40d1220 0x7f0fb41f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fabfff700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fb40b2350 0x7f0fb41f2020 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0011e0 tx=0x7f0f9c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fb0ff9700 1 -- 172.21.15.53:0/206547518 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0054e0 con 0x7f0fb40b2350 2023-07-09T21:51:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fb0ff9700 1 -- 172.21.15.53:0/206547518 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c003680 con 0x7f0fb40b2350 2023-07-09T21:51:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fb0ff9700 1 -- 172.21.15.53:0/206547518 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c003a30 con 0x7f0fb40b2350 2023-07-09T21:51:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fba1ff700 1 -- 172.21.15.53:0/206547518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb4156cc0 con 0x7f0fb40b2350 2023-07-09T21:51:45.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.122+0000 7f0fba1ff700 1 -- 172.21.15.53:0/206547518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb41f35e0 con 0x7f0fb40b2350 2023-07-09T21:51:45.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.123+0000 7f0fba1ff700 1 -- 172.21.15.53:0/206547518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb404e280 con 0x7f0fb40b2350 2023-07-09T21:51:45.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.124+0000 7f0fb0ff9700 1 -- 172.21.15.53:0/206547518 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f9c003b90 con 0x7f0fb40b2350 2023-07-09T21:51:45.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.125+0000 7f0fb0ff9700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0f9406ace0 0x7f0f9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:45.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.125+0000 7f0fb0ff9700 1 -- 172.21.15.53:0/206547518 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f9c088a90 con 0x7f0fb40b2350 2023-07-09T21:51:45.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.126+0000 7f0fb37fe700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0f9406ace0 0x7f0f9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:45.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.126+0000 7f0fb37fe700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0f9406ace0 0x7f0f9406d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4006fd0 tx=0x7f0fa4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.129+0000 7f0fb0ff9700 1 -- 172.21.15.53:0/206547518 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f9c053aa0 con 0x7f0fb40b2350 2023-07-09T21:51:45.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.383+0000 7f0fba1ff700 1 -- 172.21.15.53:0/206547518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fb40d1f50 con 0x7f0fb40b2350 2023-07-09T21:51:45.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.384+0000 7f0fb0ff9700 1 -- 172.21.15.53:0/206547518 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f0f9c017020 con 0x7f0fb40b2350 2023-07-09T21:51:45.385 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:45.386 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2100879728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2100879728},{"type":"v1","addr":"172.21.15.184:6837","nonce":2100879728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3650266673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3650266673},{"type":"v1","addr":"172.21.15.53:6834","nonce":3650266673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1905516924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1905516924},{"type":"v1","addr":"172.21.15.53:6835","nonce":1905516924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:51:41.406886+0000","modified":"2023-07-09T21:51:44.882338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5107},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5107":{"gid":5107,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6836/3388102458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3388102458},{"type":"v1","addr":"172.21.15.184:6836","nonce":3388102458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T21:51:45.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.387+0000 7f0fba1ff700 1 -- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0f9406ace0 msgr2=0x7f0f9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:45.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.387+0000 7f0fba1ff700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0f9406ace0 0x7f0f9406d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4006fd0 tx=0x7f0fa4008040 comp rx=0 tx=0).stop 2023-07-09T21:51:45.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.387+0000 7f0fba1ff700 1 -- 172.21.15.53:0/206547518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fb40b2350 msgr2=0x7f0fb41f2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:45.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.387+0000 7f0fba1ff700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fb40b2350 0x7f0fb41f2020 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0011e0 tx=0x7f0f9c00cae0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.387+0000 7f0fba1ff700 1 -- 172.21.15.53:0/206547518 shutdown_connections 2023-07-09T21:51:45.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.387+0000 7f0fba1ff700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0f9406ace0 0x7f0f9406d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.387+0000 7f0fba1ff700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fb40d1220 0x7f0fb41f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.387+0000 7f0fba1ff700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fb40b1e00 0x7f0fb4155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.387+0000 7f0fba1ff700 1 --2- 172.21.15.53:0/206547518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fb40b2350 0x7f0fb41f2020 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.387+0000 7f0fba1ff700 1 -- 172.21.15.53:0/206547518 >> 172.21.15.53:0/206547518 conn(0x7f0fb409c1d0 msgr2=0x7f0fb40b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:45.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.387+0000 7f0fba1ff700 1 -- 172.21.15.53:0/206547518 shutdown_connections 2023-07-09T21:51:45.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.387+0000 7f0fba1ff700 1 -- 172.21.15.53:0/206547518 wait complete. 2023-07-09T21:51:45.390 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 17 2023-07-09T21:51:45.407 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:45.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.609+0000 7f8f393ff700 1 Processor -- start 2023-07-09T21:51:45.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.609+0000 7f8f393ff700 1 -- start start 2023-07-09T21:51:45.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.610+0000 7f8f393ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f340b1e00 0x7f8f340b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:45.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.610+0000 7f8f393ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f340d1220 0x7f8f340afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:45.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.610+0000 7f8f393ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f340d2ce0 con 0x7f8f340b2350 2023-07-09T21:51:45.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.610+0000 7f8f393ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f340b3350 con 0x7f8f340b1e00 2023-07-09T21:51:45.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.610+0000 7f8f393ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340b3630 con 0x7f8f340d1220 2023-07-09T21:51:45.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.610+0000 7f8f32ffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f340b1e00 0x7f8f340b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:45.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.610+0000 7f8f327fc700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8f340b2350 0x7f8f340d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58362/0 (socket says 172.21.15.53:58362) 2023-07-09T21:51:45.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.610+0000 7f8f327fc700 1 -- 172.21.15.53:0/1230332052 learned_addr learned my addr 172.21.15.53:0/1230332052 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:45.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.611+0000 7f8f32ffd700 1 -- 172.21.15.53:0/1230332052 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f340d1220 msgr2=0x7f8f340afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:45.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.611+0000 7f8f337fe700 1 --2- 172.21.15.53:0/1230332052 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f340d1220 0x7f8f340afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:45.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.611+0000 7f8f32ffd700 1 --2- 172.21.15.53:0/1230332052 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f340d1220 0x7f8f340afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.611+0000 7f8f31ffb700 1 -- 172.21.15.53:0/1230332052 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889969559 0 0) 0x7f8f340d2ce0 con 0x7f8f340b2350 2023-07-09T21:51:45.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.611+0000 7f8f32ffd700 1 -- 172.21.15.53:0/1230332052 >> v1:172.21.15.53:6789/0 conn(0x7f8f340b2350 legacy=0x7f8f340d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:45.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.611+0000 7f8f32ffd700 1 -- 172.21.15.53:0/1230332052 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f340b3910 con 0x7f8f340b1e00 2023-07-09T21:51:45.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.611+0000 7f8f337fe700 1 --2- 172.21.15.53:0/1230332052 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f340d1220 0x7f8f340afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:45.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.611+0000 7f8f32ffd700 1 --2- 172.21.15.53:0/1230332052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f340b1e00 0x7f8f340b43f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009820 tx=0x7f8f24009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8639ee7071f9239 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:45.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.611+0000 7f8f31ffb700 1 -- 172.21.15.53:0/1230332052 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24005e30 con 0x7f8f340b1e00 2023-07-09T21:51:45.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.611+0000 7f8f31ffb700 1 -- 172.21.15.53:0/1230332052 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f24006030 con 0x7f8f340b1e00 2023-07-09T21:51:45.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.611+0000 7f8f31ffb700 1 -- 172.21.15.53:0/1230332052 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f240063e0 con 0x7f8f340b1e00 2023-07-09T21:51:45.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.612+0000 7f8f393ff700 1 -- 172.21.15.53:0/1230332052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f340b1e00 msgr2=0x7f8f340b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:45.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.612+0000 7f8f393ff700 1 --2- 172.21.15.53:0/1230332052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f340b1e00 0x7f8f340b43f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009820 tx=0x7f8f24009b30 comp rx=0 tx=0).stop 2023-07-09T21:51:45.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.612+0000 7f8f393ff700 1 -- 172.21.15.53:0/1230332052 shutdown_connections 2023-07-09T21:51:45.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.612+0000 7f8f393ff700 1 --2- 172.21.15.53:0/1230332052 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f340d1220 0x7f8f340afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.612+0000 7f8f393ff700 1 --2- 172.21.15.53:0/1230332052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f340b1e00 0x7f8f340b43f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.612+0000 7f8f393ff700 1 -- 172.21.15.53:0/1230332052 >> 172.21.15.53:0/1230332052 conn(0x7f8f3409c1d0 msgr2=0x7f8f340d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:45.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.612+0000 7f8f393ff700 1 -- 172.21.15.53:0/1230332052 shutdown_connections 2023-07-09T21:51:45.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.612+0000 7f8f393ff700 1 -- 172.21.15.53:0/1230332052 wait complete. 2023-07-09T21:51:45.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.614+0000 7f8f393ff700 1 Processor -- start 2023-07-09T21:51:45.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.614+0000 7f8f393ff700 1 -- start start 2023-07-09T21:51:45.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.615+0000 7f8f393ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f340b1e00 0x7f8f3415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:45.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.615+0000 7f8f393ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f340b2350 0x7f8f3415aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:45.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.615+0000 7f8f393ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f340d1220 0x7f8f340c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:45.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.615+0000 7f8f393ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340c6e30 con 0x7f8f340b2350 2023-07-09T21:51:45.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.615+0000 7f8f393ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340c7110 con 0x7f8f340d1220 2023-07-09T21:51:45.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.615+0000 7f8f393ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340c73f0 con 0x7f8f340b1e00 2023-07-09T21:51:45.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.615+0000 7f8f327fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f340b2350 0x7f8f3415aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:45.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.615+0000 7f8f327fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f340b2350 0x7f8f3415aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50112/0 (socket says 172.21.15.53:50112) 2023-07-09T21:51:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.615+0000 7f8f327fc700 1 -- 172.21.15.53:0/2725369616 learned_addr learned my addr 172.21.15.53:0/2725369616 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.616+0000 7f8f337fe700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f340d1220 0x7f8f340c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.616+0000 7f8f32ffd700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f340b1e00 0x7f8f3415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.616+0000 7f8f327fc700 1 -- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f340b1e00 msgr2=0x7f8f3415b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.616+0000 7f8f327fc700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f340b1e00 0x7f8f3415b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.616+0000 7f8f327fc700 1 -- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f340d1220 msgr2=0x7f8f340c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.616+0000 7f8f327fc700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f340d1220 0x7f8f340c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.616+0000 7f8f327fc700 1 -- 172.21.15.53:0/2725369616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f24009430 con 0x7f8f340b2350 2023-07-09T21:51:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.616+0000 7f8f327fc700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f340b2350 0x7f8f3415aba0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8f280011e0 tx=0x7f8f2800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.616+0000 7f8f1b7fe700 1 -- 172.21.15.53:0/2725369616 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28004c80 con 0x7f8f340b2350 2023-07-09T21:51:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.616+0000 7f8f1b7fe700 1 -- 172.21.15.53:0/2725369616 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f28004e00 con 0x7f8f340b2350 2023-07-09T21:51:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.616+0000 7f8f1b7fe700 1 -- 172.21.15.53:0/2725369616 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28007310 con 0x7f8f340b2350 2023-07-09T21:51:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.616+0000 7f8f393ff700 1 -- 172.21.15.53:0/2725369616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f340c76d0 con 0x7f8f340b2350 2023-07-09T21:51:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.617+0000 7f8f393ff700 1 -- 172.21.15.53:0/2725369616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f340c6a70 con 0x7f8f340b2350 2023-07-09T21:51:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.618+0000 7f8f393ff700 1 -- 172.21.15.53:0/2725369616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f340c7bf0 con 0x7f8f340b2350 2023-07-09T21:51:45.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.618+0000 7f8f1b7fe700 1 -- 172.21.15.53:0/2725369616 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8f28007470 con 0x7f8f340b2350 2023-07-09T21:51:45.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.619+0000 7f8f1b7fe700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8f2006ad10 0x7f8f2006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.619+0000 7f8f1b7fe700 1 -- 172.21.15.53:0/2725369616 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f280892b0 con 0x7f8f340b2350 2023-07-09T21:51:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.620+0000 7f8f32ffd700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8f2006ad10 0x7f8f2006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.620+0000 7f8f32ffd700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8f2006ad10 0x7f8f2006d1c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8f24013040 tx=0x7f8f24008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:45.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.624+0000 7f8f1b7fe700 1 -- 172.21.15.53:0/2725369616 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8f340c7bf0 con 0x7f8f340b2350 2023-07-09T21:51:45.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.833+0000 7f8f393ff700 1 -- 172.21.15.53:0/2725369616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f340c7bf0 con 0x7f8f340b2350 2023-07-09T21:51:45.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.834+0000 7f8f1b7fe700 1 -- 172.21.15.53:0/2725369616 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f8f340c7bf0 con 0x7f8f340b2350 2023-07-09T21:51:45.835 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:45.836 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:42.861246+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:51:39.793448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:51:40.342794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:45.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.836+0000 7f8f393ff700 1 -- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8f2006ad10 msgr2=0x7f8f2006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:45.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.836+0000 7f8f393ff700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8f2006ad10 0x7f8f2006d1c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8f24013040 tx=0x7f8f24008070 comp rx=0 tx=0).stop 2023-07-09T21:51:45.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.836+0000 7f8f393ff700 1 -- 172.21.15.53:0/2725369616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f340b2350 msgr2=0x7f8f3415aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:45.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.836+0000 7f8f393ff700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f340b2350 0x7f8f3415aba0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8f280011e0 tx=0x7f8f2800cae0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.837+0000 7f8f393ff700 1 -- 172.21.15.53:0/2725369616 shutdown_connections 2023-07-09T21:51:45.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.837+0000 7f8f393ff700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8f2006ad10 0x7f8f2006d1c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.837+0000 7f8f393ff700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f340d1220 0x7f8f340c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.837+0000 7f8f393ff700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f340b1e00 0x7f8f3415b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.837+0000 7f8f393ff700 1 --2- 172.21.15.53:0/2725369616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f340b2350 0x7f8f3415aba0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:45.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.837+0000 7f8f393ff700 1 -- 172.21.15.53:0/2725369616 >> 172.21.15.53:0/2725369616 conn(0x7f8f3409c1d0 msgr2=0x7f8f3406b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:45.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.837+0000 7f8f393ff700 1 -- 172.21.15.53:0/2725369616 shutdown_connections 2023-07-09T21:51:45.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:45.837+0000 7f8f393ff700 1 -- 172.21.15.53:0/2725369616 wait complete. 2023-07-09T21:51:45.856 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T21:51:45.857 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:51:46.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.056+0000 7fb2483ff700 1 Processor -- start 2023-07-09T21:51:46.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.056+0000 7fb2483ff700 1 -- start start 2023-07-09T21:51:46.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.057+0000 7fb2483ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb2400d1220 0x7fb2400b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.057+0000 7fb2483ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb2400b2350 0x7fb2400afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.057+0000 7fb2483ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2400d2ce0 con 0x7fb2400b1e00 2023-07-09T21:51:46.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.057+0000 7fb2483ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2400b3350 con 0x7fb2400d1220 2023-07-09T21:51:46.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.057+0000 7fb2483ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2400b3630 con 0x7fb2400b2350 2023-07-09T21:51:46.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.058+0000 7fb24599a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb2400d1220 0x7fb2400b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.058+0000 7fb24599a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb2400d1220 0x7fb2400b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50128/0 (socket says 172.21.15.53:50128) 2023-07-09T21:51:46.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.058+0000 7fb24599a700 1 -- 172.21.15.53:0/486242901 learned_addr learned my addr 172.21.15.53:0/486242901 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:46.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.058+0000 7fb24699c700 1 --2- 172.21.15.53:0/486242901 >> v2:172.21.15.184:3300/0 conn(0x7fb2400b2350 0x7fb2400afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.058+0000 7fb24599a700 1 -- 172.21.15.53:0/486242901 >> v2:172.21.15.184:3300/0 conn(0x7fb2400b2350 msgr2=0x7fb2400afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:46.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.058+0000 7fb24599a700 1 --2- 172.21.15.53:0/486242901 >> v2:172.21.15.184:3300/0 conn(0x7fb2400b2350 0x7fb2400afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.058+0000 7fb24599a700 1 -- 172.21.15.53:0/486242901 >> v1:172.21.15.184:6789/0 conn(0x7fb2400b1e00 legacy=0x7fb2400d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:46.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.058+0000 7fb24599a700 1 -- 172.21.15.53:0/486242901 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2400b3910 con 0x7fb2400d1220 2023-07-09T21:51:46.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.058+0000 7fb24599a700 1 --2- 172.21.15.53:0/486242901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2400d1220 0x7fb2400b43f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb24008d650 tx=0x7fb230009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f37101f332fc70 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:46.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.058+0000 7fb245199700 1 -- 172.21.15.53:0/486242901 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23000b870 con 0x7fb2400d1220 2023-07-09T21:51:46.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.059+0000 7fb245199700 1 -- 172.21.15.53:0/486242901 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23000b9d0 con 0x7fb2400d1220 2023-07-09T21:51:46.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.059+0000 7fb245199700 1 -- 172.21.15.53:0/486242901 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23000bd60 con 0x7fb2400d1220 2023-07-09T21:51:46.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.059+0000 7fb2483ff700 1 -- 172.21.15.53:0/486242901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2400d1220 msgr2=0x7fb2400b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:46.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.059+0000 7fb2483ff700 1 --2- 172.21.15.53:0/486242901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2400d1220 0x7fb2400b43f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb24008d650 tx=0x7fb230009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.059+0000 7fb2483ff700 1 -- 172.21.15.53:0/486242901 shutdown_connections 2023-07-09T21:51:46.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.059+0000 7fb2483ff700 1 --2- 172.21.15.53:0/486242901 >> v2:172.21.15.184:3300/0 conn(0x7fb2400b2350 0x7fb2400afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.059+0000 7fb2483ff700 1 --2- 172.21.15.53:0/486242901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2400d1220 0x7fb2400b43f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.059+0000 7fb2483ff700 1 -- 172.21.15.53:0/486242901 >> 172.21.15.53:0/486242901 conn(0x7fb24009c1d0 msgr2=0x7fb2400d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:46.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.059+0000 7fb2483ff700 1 -- 172.21.15.53:0/486242901 shutdown_connections 2023-07-09T21:51:46.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.059+0000 7fb2483ff700 1 -- 172.21.15.53:0/486242901 wait complete. 2023-07-09T21:51:46.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.061+0000 7fb2483ff700 1 Processor -- start 2023-07-09T21:51:46.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.061+0000 7fb2483ff700 1 -- start start 2023-07-09T21:51:46.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.062+0000 7fb2483ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2400b1e00 0x7fb240152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.062+0000 7fb2483ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2400b2350 0x7fb2400cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.062+0000 7fb2483ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2400d1220 0x7fb2400cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.062+0000 7fb2483ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2401533c0 con 0x7fb2400d1220 2023-07-09T21:51:46.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.062+0000 7fb2483ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400cf950 con 0x7fb2400b1e00 2023-07-09T21:51:46.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.062+0000 7fb2483ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400ce130 con 0x7fb2400b2350 2023-07-09T21:51:46.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.062+0000 7fb24699c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2400d1220 0x7fb2400cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.062+0000 7fb24699c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2400d1220 0x7fb2400cd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50138/0 (socket says 172.21.15.53:50138) 2023-07-09T21:51:46.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.062+0000 7fb24699c700 1 -- 172.21.15.53:0/465164903 learned_addr learned my addr 172.21.15.53:0/465164903 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:46.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.062+0000 7fb24619b700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2400b1e00 0x7fb240152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.062+0000 7fb24599a700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2400b2350 0x7fb2400cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.063+0000 7fb24699c700 1 -- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2400b2350 msgr2=0x7fb2400cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:46.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.063+0000 7fb24699c700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2400b2350 0x7fb2400cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.063+0000 7fb24699c700 1 -- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2400b1e00 msgr2=0x7fb240152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:46.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.063+0000 7fb24699c700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2400b1e00 0x7fb240152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.063+0000 7fb24699c700 1 -- 172.21.15.53:0/465164903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb230009550 con 0x7fb2400d1220 2023-07-09T21:51:46.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.063+0000 7fb24699c700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2400d1220 0x7fb2400cd550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb238007e40 tx=0x7fb23800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:46.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.063+0000 7fb236ffd700 1 -- 172.21.15.53:0/465164903 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23800ed30 con 0x7fb2400d1220 2023-07-09T21:51:46.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.063+0000 7fb236ffd700 1 -- 172.21.15.53:0/465164903 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb238014420 con 0x7fb2400d1220 2023-07-09T21:51:46.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.063+0000 7fb236ffd700 1 -- 172.21.15.53:0/465164903 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2380147d0 con 0x7fb2400d1220 2023-07-09T21:51:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.063+0000 7fb2483ff700 1 -- 172.21.15.53:0/465164903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2400ce410 con 0x7fb2400d1220 2023-07-09T21:51:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.063+0000 7fb2483ff700 1 -- 172.21.15.53:0/465164903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2400cec10 con 0x7fb2400d1220 2023-07-09T21:51:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.064+0000 7fb2483ff700 1 -- 172.21.15.53:0/465164903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24004e280 con 0x7fb2400d1220 2023-07-09T21:51:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.065+0000 7fb236ffd700 1 -- 172.21.15.53:0/465164903 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb238014930 con 0x7fb2400d1220 2023-07-09T21:51:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.067+0000 7fb236ffd700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb22406ace0 0x7fb22406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.067+0000 7fb236ffd700 1 -- 172.21.15.53:0/465164903 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb238089b80 con 0x7fb2400d1220 2023-07-09T21:51:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.067+0000 7fb24619b700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb22406ace0 0x7fb22406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.068+0000 7fb24619b700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb22406ace0 0x7fb22406d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb2400a0e10 tx=0x7fb23c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:46.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.072+0000 7fb236ffd700 1 -- 172.21.15.53:0/465164903 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb238054cd0 con 0x7fb2400d1220 2023-07-09T21:51:46.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.276+0000 7fb2483ff700 1 -- 172.21.15.53:0/465164903 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2400b3ed0 con 0x7fb22406ace0 2023-07-09T21:51:46.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.287+0000 7fb236ffd700 1 -- 172.21.15.53:0/465164903 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310797 (secure 0 0 0) 0x7fb23c001d70 con 0x7fb22406ace0 2023-07-09T21:51:46.291 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:46.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.291+0000 7fb2483ff700 1 -- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb22406ace0 msgr2=0x7fb22406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:46.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.291+0000 7fb2483ff700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb22406ace0 0x7fb22406d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb2400a0e10 tx=0x7fb23c009040 comp rx=0 tx=0).stop 2023-07-09T21:51:46.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.291+0000 7fb2483ff700 1 -- 172.21.15.53:0/465164903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2400d1220 msgr2=0x7fb2400cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:46.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.291+0000 7fb2483ff700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2400d1220 0x7fb2400cd550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb238007e40 tx=0x7fb23800e3c0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.291+0000 7fb2483ff700 1 -- 172.21.15.53:0/465164903 shutdown_connections 2023-07-09T21:51:46.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.291+0000 7fb2483ff700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb22406ace0 0x7fb22406d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.291+0000 7fb2483ff700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2400d1220 0x7fb2400cd550 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.291+0000 7fb2483ff700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2400b1e00 0x7fb240152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.291+0000 7fb2483ff700 1 --2- 172.21.15.53:0/465164903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2400b2350 0x7fb2400cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.291+0000 7fb2483ff700 1 -- 172.21.15.53:0/465164903 >> 172.21.15.53:0/465164903 conn(0x7fb24009c1d0 msgr2=0x7fb2400b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:46.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.291+0000 7fb2483ff700 1 -- 172.21.15.53:0/465164903 shutdown_connections 2023-07-09T21:51:46.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.292+0000 7fb2483ff700 1 -- 172.21.15.53:0/465164903 wait complete. 2023-07-09T21:51:46.295 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:51:46.311 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-07-09T21:51:44.871854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224180,"kb_used_data":4468,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750540,"statfs":{"total":773094113280,"available":772864552960,"internally_reserved":0,"allocated":4575232,"data_stored":2555833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.025417"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871538+0000","last_change":"2023-07-09T21:51:41.871416+0000","last_active":"2023-07-09T21:51:42.871538+0000","last_peered":"2023-07-09T21:51:42.871538+0000","last_clean":"2023-07-09T21:51:42.871538+0000","last_became_active":"2023-07-09T21:51:41.871120+0000","last_became_peered":"2023-07-09T21:51:41.871120+0000","last_unstale":"2023-07-09T21:51:42.871538+0000","last_undegraded":"2023-07-09T21:51:42.871538+0000","last_fullsized":"2023-07-09T21:51:42.871538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:15:56.790768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871012+0000","last_change":"2023-07-09T21:51:41.868145+0000","last_active":"2023-07-09T21:51:42.871012+0000","last_peered":"2023-07-09T21:51:42.871012+0000","last_clean":"2023-07-09T21:51:42.871012+0000","last_became_active":"2023-07-09T21:51:41.867845+0000","last_became_peered":"2023-07-09T21:51:41.867845+0000","last_unstale":"2023-07-09T21:51:42.871012+0000","last_undegraded":"2023-07-09T21:51:42.871012+0000","last_fullsized":"2023-07-09T21:51:42.871012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:40:00.303451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872676+0000","last_change":"2023-07-09T21:51:41.889943+0000","last_active":"2023-07-09T21:51:42.872676+0000","last_peered":"2023-07-09T21:51:42.872676+0000","last_clean":"2023-07-09T21:51:42.872676+0000","last_became_active":"2023-07-09T21:51:41.889671+0000","last_became_peered":"2023-07-09T21:51:41.889671+0000","last_unstale":"2023-07-09T21:51:42.872676+0000","last_undegraded":"2023-07-09T21:51:42.872676+0000","last_fullsized":"2023-07-09T21:51:42.872676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:40:00.303451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.890117+0000","last_change":"2023-07-09T21:51:41.879253+0000","last_active":"2023-07-09T21:51:41.890117+0000","last_peered":"2023-07-09T21:51:41.890117+0000","last_clean":"2023-07-09T21:51:41.890117+0000","last_became_active":"2023-07-09T21:51:41.878589+0000","last_became_peered":"2023-07-09T21:51:41.878589+0000","last_unstale":"2023-07-09T21:51:41.890117+0000","last_undegraded":"2023-07-09T21:51:41.890117+0000","last_fullsized":"2023-07-09T21:51:41.890117+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:16.689711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.890053+0000","last_change":"2023-07-09T21:51:41.878916+0000","last_active":"2023-07-09T21:51:41.890053+0000","last_peered":"2023-07-09T21:51:41.890053+0000","last_clean":"2023-07-09T21:51:41.890053+0000","last_became_active":"2023-07-09T21:51:41.878162+0000","last_became_peered":"2023-07-09T21:51:41.878162+0000","last_unstale":"2023-07-09T21:51:41.890053+0000","last_undegraded":"2023-07-09T21:51:41.890053+0000","last_fullsized":"2023-07-09T21:51:41.890053+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:05:49.494350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447940+0000","last_change":"2023-07-09T21:51:41.861306+0000","last_active":"2023-07-09T21:51:43.447940+0000","last_peered":"2023-07-09T21:51:43.447940+0000","last_clean":"2023-07-09T21:51:43.447940+0000","last_became_active":"2023-07-09T21:51:41.860361+0000","last_became_peered":"2023-07-09T21:51:41.860361+0000","last_unstale":"2023-07-09T21:51:43.447940+0000","last_undegraded":"2023-07-09T21:51:43.447940+0000","last_fullsized":"2023-07-09T21:51:43.447940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:58:44.201194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872554+0000","last_change":"2023-07-09T21:51:41.877625+0000","last_active":"2023-07-09T21:51:42.872554+0000","last_peered":"2023-07-09T21:51:42.872554+0000","last_clean":"2023-07-09T21:51:42.872554+0000","last_became_active":"2023-07-09T21:51:41.877324+0000","last_became_peered":"2023-07-09T21:51:41.877324+0000","last_unstale":"2023-07-09T21:51:42.872554+0000","last_undegraded":"2023-07-09T21:51:42.872554+0000","last_fullsized":"2023-07-09T21:51:42.872554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:30:30.221265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.870799+0000","last_change":"2023-07-09T21:51:41.891629+0000","last_active":"2023-07-09T21:51:42.870799+0000","last_peered":"2023-07-09T21:51:42.870799+0000","last_clean":"2023-07-09T21:51:42.870799+0000","last_became_active":"2023-07-09T21:51:41.891310+0000","last_became_peered":"2023-07-09T21:51:41.891310+0000","last_unstale":"2023-07-09T21:51:42.870799+0000","last_undegraded":"2023-07-09T21:51:42.870799+0000","last_fullsized":"2023-07-09T21:51:42.870799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:03:07.824109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872592+0000","last_change":"2023-07-09T21:51:41.890003+0000","last_active":"2023-07-09T21:51:42.872592+0000","last_peered":"2023-07-09T21:51:42.872592+0000","last_clean":"2023-07-09T21:51:42.872592+0000","last_became_active":"2023-07-09T21:51:41.889647+0000","last_became_peered":"2023-07-09T21:51:41.889647+0000","last_unstale":"2023-07-09T21:51:42.872592+0000","last_undegraded":"2023-07-09T21:51:42.872592+0000","last_fullsized":"2023-07-09T21:51:42.872592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:36.325955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872934+0000","last_change":"2023-07-09T21:51:41.892551+0000","last_active":"2023-07-09T21:51:42.872934+0000","last_peered":"2023-07-09T21:51:42.872934+0000","last_clean":"2023-07-09T21:51:42.872934+0000","last_became_active":"2023-07-09T21:51:41.891625+0000","last_became_peered":"2023-07-09T21:51:41.891625+0000","last_unstale":"2023-07-09T21:51:42.872934+0000","last_undegraded":"2023-07-09T21:51:42.872934+0000","last_fullsized":"2023-07-09T21:51:42.872934+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:03:48.676001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873414+0000","last_change":"2023-07-09T21:51:41.889304+0000","last_active":"2023-07-09T21:51:42.873414+0000","last_peered":"2023-07-09T21:51:42.873414+0000","last_clean":"2023-07-09T21:51:42.873414+0000","last_became_active":"2023-07-09T21:51:41.888860+0000","last_became_peered":"2023-07-09T21:51:41.888860+0000","last_unstale":"2023-07-09T21:51:42.873414+0000","last_undegraded":"2023-07-09T21:51:42.873414+0000","last_fullsized":"2023-07-09T21:51:42.873414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:36:10.313479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872505+0000","last_change":"2023-07-09T21:51:41.872482+0000","last_active":"2023-07-09T21:51:42.872505+0000","last_peered":"2023-07-09T21:51:42.872505+0000","last_clean":"2023-07-09T21:51:42.872505+0000","last_became_active":"2023-07-09T21:51:41.872184+0000","last_became_peered":"2023-07-09T21:51:41.872184+0000","last_unstale":"2023-07-09T21:51:42.872505+0000","last_undegraded":"2023-07-09T21:51:42.872505+0000","last_fullsized":"2023-07-09T21:51:42.872505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:03:07.824109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872666+0000","last_change":"2023-07-09T21:51:41.891763+0000","last_active":"2023-07-09T21:51:42.872666+0000","last_peered":"2023-07-09T21:51:42.872666+0000","last_clean":"2023-07-09T21:51:42.872666+0000","last_became_active":"2023-07-09T21:51:41.891374+0000","last_became_peered":"2023-07-09T21:51:41.891374+0000","last_unstale":"2023-07-09T21:51:42.872666+0000","last_undegraded":"2023-07-09T21:51:42.872666+0000","last_fullsized":"2023-07-09T21:51:42.872666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:23:42.260911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.891122+0000","last_change":"2023-07-09T21:51:41.882777+0000","last_active":"2023-07-09T21:51:42.891122+0000","last_peered":"2023-07-09T21:51:42.891122+0000","last_clean":"2023-07-09T21:51:42.891122+0000","last_became_active":"2023-07-09T21:51:41.882587+0000","last_became_peered":"2023-07-09T21:51:41.882587+0000","last_unstale":"2023-07-09T21:51:42.891122+0000","last_undegraded":"2023-07-09T21:51:42.891122+0000","last_fullsized":"2023-07-09T21:51:42.891122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:36:10.313479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872522+0000","last_change":"2023-07-09T21:51:41.891786+0000","last_active":"2023-07-09T21:51:42.872522+0000","last_peered":"2023-07-09T21:51:42.872522+0000","last_clean":"2023-07-09T21:51:42.872522+0000","last_became_active":"2023-07-09T21:51:41.891518+0000","last_became_peered":"2023-07-09T21:51:41.891518+0000","last_unstale":"2023-07-09T21:51:42.872522+0000","last_undegraded":"2023-07-09T21:51:42.872522+0000","last_fullsized":"2023-07-09T21:51:42.872522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:16.684694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.895575+0000","last_change":"2023-07-09T21:51:41.892723+0000","last_active":"2023-07-09T21:51:41.895575+0000","last_peered":"2023-07-09T21:51:41.895575+0000","last_clean":"2023-07-09T21:51:41.895575+0000","last_became_active":"2023-07-09T21:51:41.892092+0000","last_became_peered":"2023-07-09T21:51:41.892092+0000","last_unstale":"2023-07-09T21:51:41.895575+0000","last_undegraded":"2023-07-09T21:51:41.895575+0000","last_fullsized":"2023-07-09T21:51:41.895575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:21:13.131738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.898941+0000","last_change":"2023-07-09T21:51:41.895123+0000","last_active":"2023-07-09T21:51:41.898941+0000","last_peered":"2023-07-09T21:51:41.898941+0000","last_clean":"2023-07-09T21:51:41.898941+0000","last_became_active":"2023-07-09T21:51:41.894824+0000","last_became_peered":"2023-07-09T21:51:41.894824+0000","last_unstale":"2023-07-09T21:51:41.898941+0000","last_undegraded":"2023-07-09T21:51:41.898941+0000","last_fullsized":"2023-07-09T21:51:41.898941+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:22.999496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.886827+0000","last_change":"2023-07-09T21:51:41.882679+0000","last_active":"2023-07-09T21:51:41.886827+0000","last_peered":"2023-07-09T21:51:41.886827+0000","last_clean":"2023-07-09T21:51:41.886827+0000","last_became_active":"2023-07-09T21:51:41.882418+0000","last_became_peered":"2023-07-09T21:51:41.882418+0000","last_unstale":"2023-07-09T21:51:41.886827+0000","last_undegraded":"2023-07-09T21:51:41.886827+0000","last_fullsized":"2023-07-09T21:51:41.886827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:16.689711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.888074+0000","last_change":"2023-07-09T21:51:41.869470+0000","last_active":"2023-07-09T21:51:41.888074+0000","last_peered":"2023-07-09T21:51:41.888074+0000","last_clean":"2023-07-09T21:51:41.888074+0000","last_became_active":"2023-07-09T21:51:41.869054+0000","last_became_peered":"2023-07-09T21:51:41.869054+0000","last_unstale":"2023-07-09T21:51:41.888074+0000","last_undegraded":"2023-07-09T21:51:41.888074+0000","last_fullsized":"2023-07-09T21:51:41.888074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:41:03.556315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.883116+0000","last_change":"2023-07-09T21:51:41.879587+0000","last_active":"2023-07-09T21:51:41.883116+0000","last_peered":"2023-07-09T21:51:41.883116+0000","last_clean":"2023-07-09T21:51:41.883116+0000","last_became_active":"2023-07-09T21:51:41.879324+0000","last_became_peered":"2023-07-09T21:51:41.879324+0000","last_unstale":"2023-07-09T21:51:41.883116+0000","last_undegraded":"2023-07-09T21:51:41.883116+0000","last_fullsized":"2023-07-09T21:51:41.883116+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:22:40.033857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872738+0000","last_change":"2023-07-09T21:51:41.878411+0000","last_active":"2023-07-09T21:51:42.872738+0000","last_peered":"2023-07-09T21:51:42.872738+0000","last_clean":"2023-07-09T21:51:42.872738+0000","last_became_active":"2023-07-09T21:51:41.878109+0000","last_became_peered":"2023-07-09T21:51:41.878109+0000","last_unstale":"2023-07-09T21:51:42.872738+0000","last_undegraded":"2023-07-09T21:51:42.872738+0000","last_fullsized":"2023-07-09T21:51:42.872738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:55:21.685470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.890730+0000","last_change":"2023-07-09T21:51:41.890191+0000","last_active":"2023-07-09T21:51:42.890730+0000","last_peered":"2023-07-09T21:51:42.890730+0000","last_clean":"2023-07-09T21:51:42.890730+0000","last_became_active":"2023-07-09T21:51:41.889932+0000","last_became_peered":"2023-07-09T21:51:41.889932+0000","last_unstale":"2023-07-09T21:51:42.890730+0000","last_undegraded":"2023-07-09T21:51:42.890730+0000","last_fullsized":"2023-07-09T21:51:42.890730+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:59.522483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.881513+0000","last_change":"2023-07-09T21:51:41.876357+0000","last_active":"2023-07-09T21:51:41.881513+0000","last_peered":"2023-07-09T21:51:41.881513+0000","last_clean":"2023-07-09T21:51:41.881513+0000","last_became_active":"2023-07-09T21:51:41.876101+0000","last_became_peered":"2023-07-09T21:51:41.876101+0000","last_unstale":"2023-07-09T21:51:41.881513+0000","last_undegraded":"2023-07-09T21:51:41.881513+0000","last_fullsized":"2023-07-09T21:51:41.881513+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:12:07.546919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.889616+0000","last_change":"2023-07-09T21:51:41.875798+0000","last_active":"2023-07-09T21:51:41.889616+0000","last_peered":"2023-07-09T21:51:41.889616+0000","last_clean":"2023-07-09T21:51:41.889616+0000","last_became_active":"2023-07-09T21:51:41.875248+0000","last_became_peered":"2023-07-09T21:51:41.875248+0000","last_unstale":"2023-07-09T21:51:41.889616+0000","last_undegraded":"2023-07-09T21:51:41.889616+0000","last_fullsized":"2023-07-09T21:51:41.889616+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:01:50.492018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.886971+0000","last_change":"2023-07-09T21:51:41.878610+0000","last_active":"2023-07-09T21:51:41.886971+0000","last_peered":"2023-07-09T21:51:41.886971+0000","last_clean":"2023-07-09T21:51:41.886971+0000","last_became_active":"2023-07-09T21:51:41.878185+0000","last_became_peered":"2023-07-09T21:51:41.878185+0000","last_unstale":"2023-07-09T21:51:41.886971+0000","last_undegraded":"2023-07-09T21:51:41.886971+0000","last_fullsized":"2023-07-09T21:51:41.886971+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:15:17.123642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447883+0000","last_change":"2023-07-09T21:51:41.894543+0000","last_active":"2023-07-09T21:51:43.447883+0000","last_peered":"2023-07-09T21:51:43.447883+0000","last_clean":"2023-07-09T21:51:43.447883+0000","last_became_active":"2023-07-09T21:51:41.894181+0000","last_became_peered":"2023-07-09T21:51:41.894181+0000","last_unstale":"2023-07-09T21:51:43.447883+0000","last_undegraded":"2023-07-09T21:51:43.447883+0000","last_fullsized":"2023-07-09T21:51:43.447883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:09:55.730170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.881155+0000","last_change":"2023-07-09T21:51:41.868619+0000","last_active":"2023-07-09T21:51:41.881155+0000","last_peered":"2023-07-09T21:51:41.881155+0000","last_clean":"2023-07-09T21:51:41.881155+0000","last_became_active":"2023-07-09T21:51:41.868286+0000","last_became_peered":"2023-07-09T21:51:41.868286+0000","last_unstale":"2023-07-09T21:51:41.881155+0000","last_undegraded":"2023-07-09T21:51:41.881155+0000","last_fullsized":"2023-07-09T21:51:41.881155+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:01:50.492018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873030+0000","last_change":"2023-07-09T21:51:41.889323+0000","last_active":"2023-07-09T21:51:42.873030+0000","last_peered":"2023-07-09T21:51:42.873030+0000","last_clean":"2023-07-09T21:51:42.873030+0000","last_became_active":"2023-07-09T21:51:41.889023+0000","last_became_peered":"2023-07-09T21:51:41.889023+0000","last_unstale":"2023-07-09T21:51:42.873030+0000","last_undegraded":"2023-07-09T21:51:42.873030+0000","last_fullsized":"2023-07-09T21:51:42.873030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:44:46.265782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.878892+0000","last_change":"2023-07-09T21:51:41.864921+0000","last_active":"2023-07-09T21:51:41.878892+0000","last_peered":"2023-07-09T21:51:41.878892+0000","last_clean":"2023-07-09T21:51:41.878892+0000","last_became_active":"2023-07-09T21:51:41.864565+0000","last_became_peered":"2023-07-09T21:51:41.864565+0000","last_unstale":"2023-07-09T21:51:41.878892+0000","last_undegraded":"2023-07-09T21:51:41.878892+0000","last_fullsized":"2023-07-09T21:51:41.878892+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:05:49.494350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.877850+0000","last_change":"2023-07-09T21:51:41.864858+0000","last_active":"2023-07-09T21:51:41.877850+0000","last_peered":"2023-07-09T21:51:41.877850+0000","last_clean":"2023-07-09T21:51:41.877850+0000","last_became_active":"2023-07-09T21:51:41.864547+0000","last_became_peered":"2023-07-09T21:51:41.864547+0000","last_unstale":"2023-07-09T21:51:41.877850+0000","last_undegraded":"2023-07-09T21:51:41.877850+0000","last_fullsized":"2023-07-09T21:51:41.877850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:58:18.133083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.878947+0000","last_change":"2023-07-09T21:51:41.874914+0000","last_active":"2023-07-09T21:51:41.878947+0000","last_peered":"2023-07-09T21:51:41.878947+0000","last_clean":"2023-07-09T21:51:41.878947+0000","last_became_active":"2023-07-09T21:51:41.874586+0000","last_became_peered":"2023-07-09T21:51:41.874586+0000","last_unstale":"2023-07-09T21:51:41.878947+0000","last_undegraded":"2023-07-09T21:51:41.878947+0000","last_fullsized":"2023-07-09T21:51:41.878947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:50:14.894597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447576+0000","last_change":"2023-07-09T21:51:41.863742+0000","last_active":"2023-07-09T21:51:43.447576+0000","last_peered":"2023-07-09T21:51:43.447576+0000","last_clean":"2023-07-09T21:51:43.447576+0000","last_became_active":"2023-07-09T21:51:41.863432+0000","last_became_peered":"2023-07-09T21:51:41.863432+0000","last_unstale":"2023-07-09T21:51:43.447576+0000","last_undegraded":"2023-07-09T21:51:43.447576+0000","last_fullsized":"2023-07-09T21:51:43.447576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:06:55.495606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.893640+0000","last_change":"2023-07-09T21:51:41.890567+0000","last_active":"2023-07-09T21:51:41.893640+0000","last_peered":"2023-07-09T21:51:41.893640+0000","last_clean":"2023-07-09T21:51:41.893640+0000","last_became_active":"2023-07-09T21:51:41.890207+0000","last_became_peered":"2023-07-09T21:51:41.890207+0000","last_unstale":"2023-07-09T21:51:41.893640+0000","last_undegraded":"2023-07-09T21:51:41.893640+0000","last_fullsized":"2023-07-09T21:51:41.893640+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:38:36.332179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.883103+0000","last_change":"2023-07-09T21:51:40.873240+0000","last_active":"2023-07-09T21:51:41.883103+0000","last_peered":"2023-07-09T21:51:41.883103+0000","last_clean":"2023-07-09T21:51:41.883103+0000","last_became_active":"2023-07-09T21:51:40.872972+0000","last_became_peered":"2023-07-09T21:51:40.872972+0000","last_unstale":"2023-07-09T21:51:41.883103+0000","last_undegraded":"2023-07-09T21:51:41.883103+0000","last_fullsized":"2023-07-09T21:51:41.883103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:41:02.554046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.448050+0000","last_change":"2023-07-09T21:51:41.889554+0000","last_active":"2023-07-09T21:51:43.448050+0000","last_peered":"2023-07-09T21:51:43.448050+0000","last_clean":"2023-07-09T21:51:43.448050+0000","last_became_active":"2023-07-09T21:51:41.889033+0000","last_became_peered":"2023-07-09T21:51:41.889033+0000","last_unstale":"2023-07-09T21:51:43.448050+0000","last_undegraded":"2023-07-09T21:51:43.448050+0000","last_fullsized":"2023-07-09T21:51:43.448050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:31.765587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872495+0000","last_change":"2023-07-09T21:51:40.873411+0000","last_active":"2023-07-09T21:51:42.872495+0000","last_peered":"2023-07-09T21:51:42.872495+0000","last_clean":"2023-07-09T21:51:42.872495+0000","last_became_active":"2023-07-09T21:51:40.873125+0000","last_became_peered":"2023-07-09T21:51:40.873125+0000","last_unstale":"2023-07-09T21:51:42.872495+0000","last_undegraded":"2023-07-09T21:51:42.872495+0000","last_fullsized":"2023-07-09T21:51:42.872495+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:50:13.892329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.891072+0000","last_change":"2023-07-09T21:51:41.882565+0000","last_active":"2023-07-09T21:51:42.891072+0000","last_peered":"2023-07-09T21:51:42.891072+0000","last_clean":"2023-07-09T21:51:42.891072+0000","last_became_active":"2023-07-09T21:51:41.882229+0000","last_became_peered":"2023-07-09T21:51:41.882229+0000","last_unstale":"2023-07-09T21:51:42.891072+0000","last_undegraded":"2023-07-09T21:51:42.891072+0000","last_fullsized":"2023-07-09T21:51:42.891072+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:57:23.754598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.448047+0000","last_change":"2023-07-09T21:51:40.873157+0000","last_active":"2023-07-09T21:51:43.448047+0000","last_peered":"2023-07-09T21:51:43.448047+0000","last_clean":"2023-07-09T21:51:43.448047+0000","last_became_active":"2023-07-09T21:51:40.872799+0000","last_became_peered":"2023-07-09T21:51:40.872799+0000","last_unstale":"2023-07-09T21:51:43.448047+0000","last_undegraded":"2023-07-09T21:51:43.448047+0000","last_fullsized":"2023-07-09T21:51:43.448047+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:37:42.625329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871561+0000","last_change":"2023-07-09T21:51:41.861899+0000","last_active":"2023-07-09T21:51:42.871561+0000","last_peered":"2023-07-09T21:51:42.871561+0000","last_clean":"2023-07-09T21:51:42.871561+0000","last_became_active":"2023-07-09T21:51:41.861035+0000","last_became_peered":"2023-07-09T21:51:41.861035+0000","last_unstale":"2023-07-09T21:51:42.871561+0000","last_undegraded":"2023-07-09T21:51:42.871561+0000","last_fullsized":"2023-07-09T21:51:42.871561+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:35:30.427888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.890945+0000","last_change":"2023-07-09T21:51:40.872388+0000","last_active":"2023-07-09T21:51:42.890945+0000","last_peered":"2023-07-09T21:51:42.890945+0000","last_clean":"2023-07-09T21:51:42.890945+0000","last_became_active":"2023-07-09T21:51:40.872090+0000","last_became_peered":"2023-07-09T21:51:40.872090+0000","last_unstale":"2023-07-09T21:51:42.890945+0000","last_undegraded":"2023-07-09T21:51:42.890945+0000","last_fullsized":"2023-07-09T21:51:42.890945+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:44:45.263514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872023+0000","last_change":"2023-07-09T21:51:41.878056+0000","last_active":"2023-07-09T21:51:42.872023+0000","last_peered":"2023-07-09T21:51:42.872023+0000","last_clean":"2023-07-09T21:51:42.872023+0000","last_became_active":"2023-07-09T21:51:41.877761+0000","last_became_peered":"2023-07-09T21:51:41.877761+0000","last_unstale":"2023-07-09T21:51:42.872023+0000","last_undegraded":"2023-07-09T21:51:42.872023+0000","last_fullsized":"2023-07-09T21:51:42.872023+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:38:21.900858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872938+0000","last_change":"2023-07-09T21:51:40.872533+0000","last_active":"2023-07-09T21:51:42.872938+0000","last_peered":"2023-07-09T21:51:42.872938+0000","last_clean":"2023-07-09T21:51:42.872938+0000","last_became_active":"2023-07-09T21:51:40.872194+0000","last_became_peered":"2023-07-09T21:51:40.872194+0000","last_unstale":"2023-07-09T21:51:42.872938+0000","last_undegraded":"2023-07-09T21:51:42.872938+0000","last_fullsized":"2023-07-09T21:51:42.872938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:12.935793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872799+0000","last_change":"2023-07-09T21:51:41.880142+0000","last_active":"2023-07-09T21:51:42.872799+0000","last_peered":"2023-07-09T21:51:42.872799+0000","last_clean":"2023-07-09T21:51:42.872799+0000","last_became_active":"2023-07-09T21:51:41.879730+0000","last_became_peered":"2023-07-09T21:51:41.879730+0000","last_unstale":"2023-07-09T21:51:42.872799+0000","last_undegraded":"2023-07-09T21:51:42.872799+0000","last_fullsized":"2023-07-09T21:51:42.872799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:46:30.014505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.884294+0000","last_change":"2023-07-09T21:51:40.881132+0000","last_active":"2023-07-09T21:51:41.884294+0000","last_peered":"2023-07-09T21:51:41.884294+0000","last_clean":"2023-07-09T21:51:41.884294+0000","last_became_active":"2023-07-09T21:51:40.880823+0000","last_became_peered":"2023-07-09T21:51:40.880823+0000","last_unstale":"2023-07-09T21:51:41.884294+0000","last_undegraded":"2023-07-09T21:51:41.884294+0000","last_fullsized":"2023-07-09T21:51:41.884294+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:18.684235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.890837+0000","last_change":"2023-07-09T21:51:41.891998+0000","last_active":"2023-07-09T21:51:42.890837+0000","last_peered":"2023-07-09T21:51:42.890837+0000","last_clean":"2023-07-09T21:51:42.890837+0000","last_became_active":"2023-07-09T21:51:41.891686+0000","last_became_peered":"2023-07-09T21:51:41.891686+0000","last_unstale":"2023-07-09T21:51:42.890837+0000","last_undegraded":"2023-07-09T21:51:42.890837+0000","last_fullsized":"2023-07-09T21:51:42.890837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:13.938062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447671+0000","last_change":"2023-07-09T21:51:40.877834+0000","last_active":"2023-07-09T21:51:43.447671+0000","last_peered":"2023-07-09T21:51:43.447671+0000","last_clean":"2023-07-09T21:51:43.447671+0000","last_became_active":"2023-07-09T21:51:40.877499+0000","last_became_peered":"2023-07-09T21:51:40.877499+0000","last_unstale":"2023-07-09T21:51:43.447671+0000","last_undegraded":"2023-07-09T21:51:43.447671+0000","last_fullsized":"2023-07-09T21:51:43.447671+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:19:28.696471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871392+0000","last_change":"2023-07-09T21:51:41.870683+0000","last_active":"2023-07-09T21:51:42.871392+0000","last_peered":"2023-07-09T21:51:42.871392+0000","last_clean":"2023-07-09T21:51:42.871392+0000","last_became_active":"2023-07-09T21:51:41.870099+0000","last_became_peered":"2023-07-09T21:51:41.870099+0000","last_unstale":"2023-07-09T21:51:42.871392+0000","last_undegraded":"2023-07-09T21:51:42.871392+0000","last_fullsized":"2023-07-09T21:51:42.871392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:59:05.718629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.890696+0000","last_change":"2023-07-09T21:51:40.875164+0000","last_active":"2023-07-09T21:51:42.890696+0000","last_peered":"2023-07-09T21:51:42.890696+0000","last_clean":"2023-07-09T21:51:42.890696+0000","last_became_active":"2023-07-09T21:51:40.874892+0000","last_became_peered":"2023-07-09T21:51:40.874892+0000","last_unstale":"2023-07-09T21:51:42.890696+0000","last_undegraded":"2023-07-09T21:51:42.890696+0000","last_fullsized":"2023-07-09T21:51:42.890696+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:06.618826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.890138+0000","last_change":"2023-07-09T21:51:41.879449+0000","last_active":"2023-07-09T21:51:41.890138+0000","last_peered":"2023-07-09T21:51:41.890138+0000","last_clean":"2023-07-09T21:51:41.890138+0000","last_became_active":"2023-07-09T21:51:41.879076+0000","last_became_peered":"2023-07-09T21:51:41.879076+0000","last_unstale":"2023-07-09T21:51:41.890138+0000","last_undegraded":"2023-07-09T21:51:41.890138+0000","last_fullsized":"2023-07-09T21:51:41.890138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:49:25.349292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871679+0000","last_change":"2023-07-09T21:51:40.870300+0000","last_active":"2023-07-09T21:51:42.871679+0000","last_peered":"2023-07-09T21:51:42.871679+0000","last_clean":"2023-07-09T21:51:42.871679+0000","last_became_active":"2023-07-09T21:51:40.869967+0000","last_became_peered":"2023-07-09T21:51:40.869967+0000","last_unstale":"2023-07-09T21:51:42.871679+0000","last_undegraded":"2023-07-09T21:51:42.871679+0000","last_fullsized":"2023-07-09T21:51:42.871679+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:12:06.544651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.886622+0000","last_change":"2023-07-09T21:51:41.881011+0000","last_active":"2023-07-09T21:51:41.886622+0000","last_peered":"2023-07-09T21:51:41.886622+0000","last_clean":"2023-07-09T21:51:41.886622+0000","last_became_active":"2023-07-09T21:51:41.880719+0000","last_became_peered":"2023-07-09T21:51:41.880719+0000","last_unstale":"2023-07-09T21:51:41.886622+0000","last_undegraded":"2023-07-09T21:51:41.886622+0000","last_fullsized":"2023-07-09T21:51:41.886622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:53:40.197296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873189+0000","last_change":"2023-07-09T21:51:40.871543+0000","last_active":"2023-07-09T21:51:42.873189+0000","last_peered":"2023-07-09T21:51:42.873189+0000","last_clean":"2023-07-09T21:51:42.873189+0000","last_became_active":"2023-07-09T21:51:40.871212+0000","last_became_peered":"2023-07-09T21:51:40.871212+0000","last_unstale":"2023-07-09T21:51:42.873189+0000","last_undegraded":"2023-07-09T21:51:42.873189+0000","last_fullsized":"2023-07-09T21:51:42.873189+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:13.824964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872337+0000","last_change":"2023-07-09T21:51:41.880537+0000","last_active":"2023-07-09T21:51:42.872337+0000","last_peered":"2023-07-09T21:51:42.872337+0000","last_clean":"2023-07-09T21:51:42.872337+0000","last_became_active":"2023-07-09T21:51:41.880078+0000","last_became_peered":"2023-07-09T21:51:41.880078+0000","last_unstale":"2023-07-09T21:51:42.872337+0000","last_undegraded":"2023-07-09T21:51:42.872337+0000","last_fullsized":"2023-07-09T21:51:42.872337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:21:13.131738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873481+0000","last_change":"2023-07-09T21:51:40.878283+0000","last_active":"2023-07-09T21:51:42.873481+0000","last_peered":"2023-07-09T21:51:42.873481+0000","last_clean":"2023-07-09T21:51:42.873481+0000","last_became_active":"2023-07-09T21:51:40.878009+0000","last_became_peered":"2023-07-09T21:51:40.878009+0000","last_unstale":"2023-07-09T21:51:42.873481+0000","last_undegraded":"2023-07-09T21:51:42.873481+0000","last_fullsized":"2023-07-09T21:51:42.873481+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:55:56.800975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.891215+0000","last_change":"2023-07-09T21:51:41.890308+0000","last_active":"2023-07-09T21:51:42.891215+0000","last_peered":"2023-07-09T21:51:42.891215+0000","last_clean":"2023-07-09T21:51:42.891215+0000","last_became_active":"2023-07-09T21:51:41.890046+0000","last_became_peered":"2023-07-09T21:51:41.890046+0000","last_unstale":"2023-07-09T21:51:42.891215+0000","last_undegraded":"2023-07-09T21:51:42.891215+0000","last_fullsized":"2023-07-09T21:51:42.891215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:55:57.803243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871236+0000","last_change":"2023-07-09T21:51:40.874084+0000","last_active":"2023-07-09T21:51:42.871236+0000","last_peered":"2023-07-09T21:51:42.871236+0000","last_clean":"2023-07-09T21:51:42.871236+0000","last_became_active":"2023-07-09T21:51:40.873733+0000","last_became_peered":"2023-07-09T21:51:40.873733+0000","last_unstale":"2023-07-09T21:51:42.871236+0000","last_undegraded":"2023-07-09T21:51:42.871236+0000","last_fullsized":"2023-07-09T21:51:42.871236+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:53:39.195027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872194+0000","last_change":"2023-07-09T21:51:41.892022+0000","last_active":"2023-07-09T21:51:42.872194+0000","last_peered":"2023-07-09T21:51:42.872194+0000","last_clean":"2023-07-09T21:51:42.872194+0000","last_became_active":"2023-07-09T21:51:41.891558+0000","last_became_peered":"2023-07-09T21:51:41.891558+0000","last_unstale":"2023-07-09T21:51:42.872194+0000","last_undegraded":"2023-07-09T21:51:42.872194+0000","last_fullsized":"2023-07-09T21:51:42.872194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:45:15.924528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871503+0000","last_change":"2023-07-09T21:51:40.863260+0000","last_active":"2023-07-09T21:51:42.871503+0000","last_peered":"2023-07-09T21:51:42.871503+0000","last_clean":"2023-07-09T21:51:42.871503+0000","last_became_active":"2023-07-09T21:51:40.862906+0000","last_became_peered":"2023-07-09T21:51:40.862906+0000","last_unstale":"2023-07-09T21:51:42.871503+0000","last_undegraded":"2023-07-09T21:51:42.871503+0000","last_fullsized":"2023-07-09T21:51:42.871503+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:45.901695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871102+0000","last_change":"2023-07-09T21:51:41.873355+0000","last_active":"2023-07-09T21:51:42.871102+0000","last_peered":"2023-07-09T21:51:42.871102+0000","last_clean":"2023-07-09T21:51:42.871102+0000","last_became_active":"2023-07-09T21:51:41.873083+0000","last_became_peered":"2023-07-09T21:51:41.873083+0000","last_unstale":"2023-07-09T21:51:42.871102+0000","last_undegraded":"2023-07-09T21:51:42.871102+0000","last_fullsized":"2023-07-09T21:51:42.871102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:06.967696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447651+0000","last_change":"2023-07-09T21:51:40.871910+0000","last_active":"2023-07-09T21:51:43.447651+0000","last_peered":"2023-07-09T21:51:43.447651+0000","last_clean":"2023-07-09T21:51:43.447651+0000","last_became_active":"2023-07-09T21:51:40.871510+0000","last_became_peered":"2023-07-09T21:51:40.871510+0000","last_unstale":"2023-07-09T21:51:43.447651+0000","last_undegraded":"2023-07-09T21:51:43.447651+0000","last_fullsized":"2023-07-09T21:51:43.447651+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:21:30.343831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.878696+0000","last_change":"2023-07-09T21:51:41.874861+0000","last_active":"2023-07-09T21:51:41.878696+0000","last_peered":"2023-07-09T21:51:41.878696+0000","last_clean":"2023-07-09T21:51:41.878696+0000","last_became_active":"2023-07-09T21:51:41.874524+0000","last_became_peered":"2023-07-09T21:51:41.874524+0000","last_unstale":"2023-07-09T21:51:41.878696+0000","last_undegraded":"2023-07-09T21:51:41.878696+0000","last_fullsized":"2023-07-09T21:51:41.878696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:03:07.824109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.856524+0000","last_change":"2023-07-09T21:51:40.877594+0000","last_active":"2023-07-09T21:51:41.856524+0000","last_peered":"2023-07-09T21:51:41.856524+0000","last_clean":"2023-07-09T21:51:41.856524+0000","last_became_active":"2023-07-09T21:51:40.877309+0000","last_became_peered":"2023-07-09T21:51:40.877309+0000","last_unstale":"2023-07-09T21:51:41.856524+0000","last_undegraded":"2023-07-09T21:51:41.856524+0000","last_fullsized":"2023-07-09T21:51:41.856524+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:49:24.347023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871260+0000","last_change":"2023-07-09T21:51:41.873934+0000","last_active":"2023-07-09T21:51:42.871260+0000","last_peered":"2023-07-09T21:51:42.871260+0000","last_clean":"2023-07-09T21:51:42.871260+0000","last_became_active":"2023-07-09T21:51:41.873662+0000","last_became_peered":"2023-07-09T21:51:41.873662+0000","last_unstale":"2023-07-09T21:51:42.871260+0000","last_undegraded":"2023-07-09T21:51:42.871260+0000","last_fullsized":"2023-07-09T21:51:42.871260+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:04:22.112776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.883702+0000","last_change":"2023-07-09T21:51:40.881061+0000","last_active":"2023-07-09T21:51:41.883702+0000","last_peered":"2023-07-09T21:51:41.883702+0000","last_clean":"2023-07-09T21:51:41.883702+0000","last_became_active":"2023-07-09T21:51:40.880725+0000","last_became_peered":"2023-07-09T21:51:40.880725+0000","last_unstale":"2023-07-09T21:51:41.883702+0000","last_undegraded":"2023-07-09T21:51:41.883702+0000","last_fullsized":"2023-07-09T21:51:41.883702+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:04:21.110508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871084+0000","last_change":"2023-07-09T21:51:41.861242+0000","last_active":"2023-07-09T21:51:42.871084+0000","last_peered":"2023-07-09T21:51:42.871084+0000","last_clean":"2023-07-09T21:51:42.871084+0000","last_became_active":"2023-07-09T21:51:41.860930+0000","last_became_peered":"2023-07-09T21:51:41.860930+0000","last_unstale":"2023-07-09T21:51:42.871084+0000","last_undegraded":"2023-07-09T21:51:42.871084+0000","last_fullsized":"2023-07-09T21:51:42.871084+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:19.686504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873369+0000","last_change":"2023-07-09T21:51:40.877586+0000","last_active":"2023-07-09T21:51:42.873369+0000","last_peered":"2023-07-09T21:51:42.873369+0000","last_clean":"2023-07-09T21:51:42.873369+0000","last_became_active":"2023-07-09T21:51:40.877296+0000","last_became_peered":"2023-07-09T21:51:40.877296+0000","last_unstale":"2023-07-09T21:51:42.873369+0000","last_undegraded":"2023-07-09T21:51:42.873369+0000","last_fullsized":"2023-07-09T21:51:42.873369+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:17.549300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873255+0000","last_change":"2023-07-09T21:51:41.889077+0000","last_active":"2023-07-09T21:51:42.873255+0000","last_peered":"2023-07-09T21:51:42.873255+0000","last_clean":"2023-07-09T21:51:42.873255+0000","last_became_active":"2023-07-09T21:51:41.888799+0000","last_became_peered":"2023-07-09T21:51:41.888799+0000","last_unstale":"2023-07-09T21:51:42.873255+0000","last_undegraded":"2023-07-09T21:51:42.873255+0000","last_fullsized":"2023-07-09T21:51:42.873255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:57:23.754598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.891230+0000","last_change":"2023-07-09T21:51:40.876658+0000","last_active":"2023-07-09T21:51:42.891230+0000","last_peered":"2023-07-09T21:51:42.891230+0000","last_clean":"2023-07-09T21:51:42.891230+0000","last_became_active":"2023-07-09T21:51:40.876233+0000","last_became_peered":"2023-07-09T21:51:40.876233+0000","last_unstale":"2023-07-09T21:51:42.891230+0000","last_undegraded":"2023-07-09T21:51:42.891230+0000","last_fullsized":"2023-07-09T21:51:42.891230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:44.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.891099+0000","last_change":"2023-07-09T21:51:41.882270+0000","last_active":"2023-07-09T21:51:42.891099+0000","last_peered":"2023-07-09T21:51:42.891099+0000","last_clean":"2023-07-09T21:51:42.891099+0000","last_became_active":"2023-07-09T21:51:41.882002+0000","last_became_peered":"2023-07-09T21:51:41.882002+0000","last_unstale":"2023-07-09T21:51:42.891099+0000","last_undegraded":"2023-07-09T21:51:42.891099+0000","last_fullsized":"2023-07-09T21:51:42.891099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:18.551568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.889497+0000","last_change":"2023-07-09T21:51:40.874960+0000","last_active":"2023-07-09T21:51:41.889497+0000","last_peered":"2023-07-09T21:51:41.889497+0000","last_clean":"2023-07-09T21:51:41.889497+0000","last_became_active":"2023-07-09T21:51:40.874700+0000","last_became_peered":"2023-07-09T21:51:40.874700+0000","last_unstale":"2023-07-09T21:51:41.889497+0000","last_undegraded":"2023-07-09T21:51:41.889497+0000","last_fullsized":"2023-07-09T21:51:41.889497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:17:41.875052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.871338+0000","last_change":"2023-07-09T21:51:41.867307+0000","last_active":"2023-07-09T21:51:41.871338+0000","last_peered":"2023-07-09T21:51:41.871338+0000","last_clean":"2023-07-09T21:51:41.871338+0000","last_became_active":"2023-07-09T21:51:41.866997+0000","last_became_peered":"2023-07-09T21:51:41.866997+0000","last_unstale":"2023-07-09T21:51:41.871338+0000","last_undegraded":"2023-07-09T21:51:41.871338+0000","last_fullsized":"2023-07-09T21:51:41.871338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:37:24.984323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447876+0000","last_change":"2023-07-09T21:51:40.873109+0000","last_active":"2023-07-09T21:51:43.447876+0000","last_peered":"2023-07-09T21:51:43.447876+0000","last_clean":"2023-07-09T21:51:43.447876+0000","last_became_active":"2023-07-09T21:51:40.872829+0000","last_became_peered":"2023-07-09T21:51:40.872829+0000","last_unstale":"2023-07-09T21:51:43.447876+0000","last_undegraded":"2023-07-09T21:51:43.447876+0000","last_fullsized":"2023-07-09T21:51:43.447876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:41:43.063908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.886893+0000","last_change":"2023-07-09T21:51:41.878983+0000","last_active":"2023-07-09T21:51:41.886893+0000","last_peered":"2023-07-09T21:51:41.886893+0000","last_clean":"2023-07-09T21:51:41.886893+0000","last_became_active":"2023-07-09T21:51:41.878177+0000","last_became_peered":"2023-07-09T21:51:41.878177+0000","last_unstale":"2023-07-09T21:51:41.886893+0000","last_undegraded":"2023-07-09T21:51:41.886893+0000","last_fullsized":"2023-07-09T21:51:41.886893+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:06.967696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.889941+0000","last_change":"2023-07-09T21:51:40.874345+0000","last_active":"2023-07-09T21:51:41.889941+0000","last_peered":"2023-07-09T21:51:41.889941+0000","last_clean":"2023-07-09T21:51:41.889941+0000","last_became_active":"2023-07-09T21:51:40.874036+0000","last_became_peered":"2023-07-09T21:51:40.874036+0000","last_unstale":"2023-07-09T21:51:41.889941+0000","last_undegraded":"2023-07-09T21:51:41.889941+0000","last_fullsized":"2023-07-09T21:51:41.889941+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:24:44.854204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872090+0000","last_change":"2023-07-09T21:51:41.882884+0000","last_active":"2023-07-09T21:51:42.872090+0000","last_peered":"2023-07-09T21:51:42.872090+0000","last_clean":"2023-07-09T21:51:42.872090+0000","last_became_active":"2023-07-09T21:51:41.882565+0000","last_became_peered":"2023-07-09T21:51:41.882565+0000","last_unstale":"2023-07-09T21:51:42.872090+0000","last_undegraded":"2023-07-09T21:51:42.872090+0000","last_fullsized":"2023-07-09T21:51:42.872090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:18:27.589211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.858750+0000","last_change":"2023-07-09T21:51:40.877516+0000","last_active":"2023-07-09T21:51:41.858750+0000","last_peered":"2023-07-09T21:51:41.858750+0000","last_clean":"2023-07-09T21:51:41.858750+0000","last_became_active":"2023-07-09T21:51:40.877202+0000","last_became_peered":"2023-07-09T21:51:40.877202+0000","last_unstale":"2023-07-09T21:51:41.858750+0000","last_undegraded":"2023-07-09T21:51:41.858750+0000","last_fullsized":"2023-07-09T21:51:41.858750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:15:16.121374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872673+0000","last_change":"2023-07-09T21:51:41.889406+0000","last_active":"2023-07-09T21:51:42.872673+0000","last_peered":"2023-07-09T21:51:42.872673+0000","last_clean":"2023-07-09T21:51:42.872673+0000","last_became_active":"2023-07-09T21:51:41.889074+0000","last_became_peered":"2023-07-09T21:51:41.889074+0000","last_unstale":"2023-07-09T21:51:42.872673+0000","last_undegraded":"2023-07-09T21:51:42.872673+0000","last_fullsized":"2023-07-09T21:51:42.872673+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:35.984955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.863217+0000","last_change":"2023-07-09T21:51:40.880135+0000","last_active":"2023-07-09T21:51:41.863217+0000","last_peered":"2023-07-09T21:51:41.863217+0000","last_clean":"2023-07-09T21:51:41.863217+0000","last_became_active":"2023-07-09T21:51:40.879836+0000","last_became_peered":"2023-07-09T21:51:40.879836+0000","last_unstale":"2023-07-09T21:51:41.863217+0000","last_undegraded":"2023-07-09T21:51:41.863217+0000","last_fullsized":"2023-07-09T21:51:41.863217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:39:59.301182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871290+0000","last_change":"2023-07-09T21:51:41.870849+0000","last_active":"2023-07-09T21:51:42.871290+0000","last_peered":"2023-07-09T21:51:42.871290+0000","last_clean":"2023-07-09T21:51:42.871290+0000","last_became_active":"2023-07-09T21:51:41.870446+0000","last_became_peered":"2023-07-09T21:51:41.870446+0000","last_unstale":"2023-07-09T21:51:42.871290+0000","last_undegraded":"2023-07-09T21:51:42.871290+0000","last_fullsized":"2023-07-09T21:51:42.871290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:21.973253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.859287+0000","last_change":"2023-07-09T21:51:40.877584+0000","last_active":"2023-07-09T21:51:41.859287+0000","last_peered":"2023-07-09T21:51:41.859287+0000","last_clean":"2023-07-09T21:51:41.859287+0000","last_became_active":"2023-07-09T21:51:40.877309+0000","last_became_peered":"2023-07-09T21:51:40.877309+0000","last_unstale":"2023-07-09T21:51:41.859287+0000","last_undegraded":"2023-07-09T21:51:41.859287+0000","last_fullsized":"2023-07-09T21:51:41.859287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:28:35.695432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872102+0000","last_change":"2023-07-09T21:51:41.870707+0000","last_active":"2023-07-09T21:51:42.872102+0000","last_peered":"2023-07-09T21:51:42.872102+0000","last_clean":"2023-07-09T21:51:42.872102+0000","last_became_active":"2023-07-09T21:51:41.870372+0000","last_became_peered":"2023-07-09T21:51:41.870372+0000","last_unstale":"2023-07-09T21:51:42.872102+0000","last_undegraded":"2023-07-09T21:51:42.872102+0000","last_fullsized":"2023-07-09T21:51:42.872102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:02:41.735102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872378+0000","last_change":"2023-07-09T21:51:40.868856+0000","last_active":"2023-07-09T21:51:42.872378+0000","last_peered":"2023-07-09T21:51:42.872378+0000","last_clean":"2023-07-09T21:51:42.872378+0000","last_became_active":"2023-07-09T21:51:40.867987+0000","last_became_peered":"2023-07-09T21:51:40.867987+0000","last_unstale":"2023-07-09T21:51:42.872378+0000","last_undegraded":"2023-07-09T21:51:42.872378+0000","last_fullsized":"2023-07-09T21:51:42.872378+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:38:35.329910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447997+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:51:43.447997+0000","last_peered":"2023-07-09T21:51:43.447997+0000","last_clean":"2023-07-09T21:51:43.447997+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:51:43.447997+0000","last_undegraded":"2023-07-09T21:51:43.447997+0000","last_fullsized":"2023-07-09T21:51:43.447997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:01:59.129256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871160+0000","last_change":"2023-07-09T21:51:41.877326+0000","last_active":"2023-07-09T21:51:42.871160+0000","last_peered":"2023-07-09T21:51:42.871160+0000","last_clean":"2023-07-09T21:51:42.871160+0000","last_became_active":"2023-07-09T21:51:41.876867+0000","last_became_peered":"2023-07-09T21:51:41.876867+0000","last_unstale":"2023-07-09T21:51:42.871160+0000","last_undegraded":"2023-07-09T21:51:42.871160+0000","last_fullsized":"2023-07-09T21:51:42.871160+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:22.999496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872807+0000","last_change":"2023-07-09T21:51:40.867515+0000","last_active":"2023-07-09T21:51:42.872807+0000","last_peered":"2023-07-09T21:51:42.872807+0000","last_clean":"2023-07-09T21:51:42.872807+0000","last_became_active":"2023-07-09T21:51:40.867162+0000","last_became_peered":"2023-07-09T21:51:40.867162+0000","last_unstale":"2023-07-09T21:51:42.872807+0000","last_undegraded":"2023-07-09T21:51:42.872807+0000","last_fullsized":"2023-07-09T21:51:42.872807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:18.684235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872806+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:51:42.872806+0000","last_peered":"2023-07-09T21:51:42.872806+0000","last_clean":"2023-07-09T21:51:42.872806+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:51:42.872806+0000","last_undegraded":"2023-07-09T21:51:42.872806+0000","last_fullsized":"2023-07-09T21:51:42.872806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:15:43.299917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.889987+0000","last_change":"2023-07-09T21:51:41.881995+0000","last_active":"2023-07-09T21:51:41.889987+0000","last_peered":"2023-07-09T21:51:41.889987+0000","last_clean":"2023-07-09T21:51:41.889987+0000","last_became_active":"2023-07-09T21:51:41.881733+0000","last_became_peered":"2023-07-09T21:51:41.881733+0000","last_unstale":"2023-07-09T21:51:41.889987+0000","last_undegraded":"2023-07-09T21:51:41.889987+0000","last_fullsized":"2023-07-09T21:51:41.889987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:46.903963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.859715+0000","last_change":"2023-07-09T21:51:40.876279+0000","last_active":"2023-07-09T21:51:41.859715+0000","last_peered":"2023-07-09T21:51:41.859715+0000","last_clean":"2023-07-09T21:51:41.859715+0000","last_became_active":"2023-07-09T21:51:40.875909+0000","last_became_peered":"2023-07-09T21:51:40.875909+0000","last_unstale":"2023-07-09T21:51:41.859715+0000","last_undegraded":"2023-07-09T21:51:41.859715+0000","last_fullsized":"2023-07-09T21:51:41.859715+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:27:01.391231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.859094+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:51:41.859094+0000","last_peered":"2023-07-09T21:51:41.859094+0000","last_clean":"2023-07-09T21:51:41.859094+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:51:41.859094+0000","last_undegraded":"2023-07-09T21:51:41.859094+0000","last_fullsized":"2023-07-09T21:51:41.859094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:21:15.712679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873527+0000","last_change":"2023-07-09T21:51:41.886042+0000","last_active":"2023-07-09T21:51:42.873527+0000","last_peered":"2023-07-09T21:51:42.873527+0000","last_clean":"2023-07-09T21:51:42.873527+0000","last_became_active":"2023-07-09T21:51:41.885559+0000","last_became_peered":"2023-07-09T21:51:41.885559+0000","last_unstale":"2023-07-09T21:51:42.873527+0000","last_undegraded":"2023-07-09T21:51:42.873527+0000","last_fullsized":"2023-07-09T21:51:42.873527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:45.529766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.863153+0000","last_change":"2023-07-09T21:51:40.878610+0000","last_active":"2023-07-09T21:51:41.863153+0000","last_peered":"2023-07-09T21:51:41.863153+0000","last_clean":"2023-07-09T21:51:41.863153+0000","last_became_active":"2023-07-09T21:51:40.878339+0000","last_became_peered":"2023-07-09T21:51:40.878339+0000","last_unstale":"2023-07-09T21:51:41.863153+0000","last_undegraded":"2023-07-09T21:51:41.863153+0000","last_fullsized":"2023-07-09T21:51:41.863153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:35.323686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872835+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:51:42.872835+0000","last_peered":"2023-07-09T21:51:42.872835+0000","last_clean":"2023-07-09T21:51:42.872835+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:51:42.872835+0000","last_undegraded":"2023-07-09T21:51:42.872835+0000","last_fullsized":"2023-07-09T21:51:42.872835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:16:35.201305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.863908+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:51:41.863908+0000","last_peered":"2023-07-09T21:51:41.863908+0000","last_clean":"2023-07-09T21:51:41.863908+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:51:41.863908+0000","last_undegraded":"2023-07-09T21:51:41.863908+0000","last_fullsized":"2023-07-09T21:51:41.863908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:50.256852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447907+0000","last_change":"2023-07-09T21:51:41.889931+0000","last_active":"2023-07-09T21:51:43.447907+0000","last_peered":"2023-07-09T21:51:43.447907+0000","last_clean":"2023-07-09T21:51:43.447907+0000","last_became_active":"2023-07-09T21:51:41.889621+0000","last_became_peered":"2023-07-09T21:51:41.889621+0000","last_unstale":"2023-07-09T21:51:43.447907+0000","last_undegraded":"2023-07-09T21:51:43.447907+0000","last_fullsized":"2023-07-09T21:51:43.447907+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:46:15.758055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873563+0000","last_change":"2023-07-09T21:51:40.878258+0000","last_active":"2023-07-09T21:51:42.873563+0000","last_peered":"2023-07-09T21:51:42.873563+0000","last_clean":"2023-07-09T21:51:42.873563+0000","last_became_active":"2023-07-09T21:51:40.877804+0000","last_became_peered":"2023-07-09T21:51:40.877804+0000","last_unstale":"2023-07-09T21:51:42.873563+0000","last_undegraded":"2023-07-09T21:51:42.873563+0000","last_fullsized":"2023-07-09T21:51:42.873563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:04.791214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.863930+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:51:41.863930+0000","last_peered":"2023-07-09T21:51:41.863930+0000","last_clean":"2023-07-09T21:51:41.863930+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:51:41.863930+0000","last_undegraded":"2023-07-09T21:51:41.863930+0000","last_fullsized":"2023-07-09T21:51:41.863930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:57:41.397452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447853+0000","last_change":"2023-07-09T21:51:41.865234+0000","last_active":"2023-07-09T21:51:43.447853+0000","last_peered":"2023-07-09T21:51:43.447853+0000","last_clean":"2023-07-09T21:51:43.447853+0000","last_became_active":"2023-07-09T21:51:41.864978+0000","last_became_peered":"2023-07-09T21:51:41.864978+0000","last_unstale":"2023-07-09T21:51:43.447853+0000","last_undegraded":"2023-07-09T21:51:43.447853+0000","last_fullsized":"2023-07-09T21:51:43.447853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:55:06.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.856727+0000","last_change":"2023-07-09T21:51:40.866903+0000","last_active":"2023-07-09T21:51:41.856727+0000","last_peered":"2023-07-09T21:51:41.856727+0000","last_clean":"2023-07-09T21:51:41.856727+0000","last_became_active":"2023-07-09T21:51:40.866362+0000","last_became_peered":"2023-07-09T21:51:40.866362+0000","last_unstale":"2023-07-09T21:51:41.856727+0000","last_undegraded":"2023-07-09T21:51:41.856727+0000","last_fullsized":"2023-07-09T21:51:41.856727+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:24:44.854204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.864259+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:51:41.864259+0000","last_peered":"2023-07-09T21:51:41.864259+0000","last_clean":"2023-07-09T21:51:41.864259+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:51:41.864259+0000","last_undegraded":"2023-07-09T21:51:41.864259+0000","last_fullsized":"2023-07-09T21:51:41.864259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:14:32.469590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.891060+0000","last_change":"2023-07-09T21:51:41.877533+0000","last_active":"2023-07-09T21:51:42.891060+0000","last_peered":"2023-07-09T21:51:42.891060+0000","last_clean":"2023-07-09T21:51:42.891060+0000","last_became_active":"2023-07-09T21:51:41.877266+0000","last_became_peered":"2023-07-09T21:51:41.877266+0000","last_unstale":"2023-07-09T21:51:42.891060+0000","last_undegraded":"2023-07-09T21:51:42.891060+0000","last_fullsized":"2023-07-09T21:51:42.891060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:14.827232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.890841+0000","last_change":"2023-07-09T21:51:40.873357+0000","last_active":"2023-07-09T21:51:42.890841+0000","last_peered":"2023-07-09T21:51:42.890841+0000","last_clean":"2023-07-09T21:51:42.890841+0000","last_became_active":"2023-07-09T21:51:40.873044+0000","last_became_peered":"2023-07-09T21:51:40.873044+0000","last_unstale":"2023-07-09T21:51:42.890841+0000","last_undegraded":"2023-07-09T21:51:42.890841+0000","last_fullsized":"2023-07-09T21:51:42.890841+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:03:47.673733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447890+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:51:43.447890+0000","last_peered":"2023-07-09T21:51:43.447890+0000","last_clean":"2023-07-09T21:51:43.447890+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:51:43.447890+0000","last_undegraded":"2023-07-09T21:51:43.447890+0000","last_fullsized":"2023-07-09T21:51:43.447890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:26:21.519999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.890120+0000","last_change":"2023-07-09T21:51:41.884378+0000","last_active":"2023-07-09T21:51:41.890120+0000","last_peered":"2023-07-09T21:51:41.890120+0000","last_clean":"2023-07-09T21:51:41.890120+0000","last_became_active":"2023-07-09T21:51:41.883514+0000","last_became_peered":"2023-07-09T21:51:41.883514+0000","last_unstale":"2023-07-09T21:51:41.890120+0000","last_undegraded":"2023-07-09T21:51:41.890120+0000","last_fullsized":"2023-07-09T21:51:41.890120+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:35:30.427888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.870889+0000","last_change":"2023-07-09T21:51:40.869692+0000","last_active":"2023-07-09T21:51:42.870889+0000","last_peered":"2023-07-09T21:51:42.870889+0000","last_clean":"2023-07-09T21:51:42.870889+0000","last_became_active":"2023-07-09T21:51:40.869421+0000","last_became_peered":"2023-07-09T21:51:40.869421+0000","last_unstale":"2023-07-09T21:51:42.870889+0000","last_undegraded":"2023-07-09T21:51:42.870889+0000","last_fullsized":"2023-07-09T21:51:42.870889+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:35.323686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.857770+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:51:41.857770+0000","last_peered":"2023-07-09T21:51:41.857770+0000","last_clean":"2023-07-09T21:51:41.857770+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:51:41.857770+0000","last_undegraded":"2023-07-09T21:51:41.857770+0000","last_fullsized":"2023-07-09T21:51:41.857770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:27:12.376523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":434176,"data_stored":177722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71399999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":4.2229999999999999,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.629}]},{"osd":2,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":4.3049999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.754}]},{"osd":3,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.85199999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.56100000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.72799999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":417792,"data_stored":170555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.8540000000000001,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.39700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.434},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.41799999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.623}]},{"osd":5,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.52400000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.57499999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.66500000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":170535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":16.946000000000002,"5min":16.946000000000002,"15min":16.946000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":9.5449999999999999,"5min":9.5449999999999999,"15min":9.5449999999999999},"last":0.48699999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":9.6950000000000003,"5min":9.6950000000000003,"15min":9.6950000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":9.3659999999999997,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.36799999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":9.2840000000000007,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":17.004000000000001,"5min":17.004000000000001,"15min":17.004000000000001},"last":0.41899999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":6.2510000000000003,"5min":6.2510000000000003,"15min":6.2510000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":9.6630000000000003,"5min":9.6630000000000003,"15min":9.6630000000000003},"last":0.84099999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":6.1710000000000003,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":9.5879999999999992,"5min":9.5879999999999992,"15min":9.5879999999999992},"last":0.67400000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":9.6289999999999996,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":9.2319999999999993,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":0.81299999999999994}]},{"osd":7,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":9.3190000000000008,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":6.2169999999999996,"5min":6.2169999999999996,"15min":6.2169999999999996},"last":0.82499999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":1011712,"data_stored":760867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":11.949999999999999,"5min":11.949999999999999,"15min":11.949999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39800000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":23.010999999999999,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":10.952,"5min":10.952,"15min":10.952},"last":0.505}]},{"osd":4,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":22.974,"5min":22.974,"15min":22.974},"last":0.52500000000000002},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":11.904999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.55900000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.925,"5min":1.925,"15min":1.925},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":22.933,"5min":22.933,"15min":22.933},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.919,"5min":1.919,"15min":1.919},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":22.867999999999999,"5min":22.867999999999999,"15min":22.867999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":10.907999999999999,"5min":10.907999999999999,"15min":10.907999999999999},"last":0.627},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.61499999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":1024000,"data_stored":762467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.70299999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67500000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.78100000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.621}]},{"osd":5,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.748},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.80400000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.85099999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":430080,"data_stored":172063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":11.874000000000001,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.37}]},{"osd":1,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.41199999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.628},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.61199999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":421888,"data_stored":170577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.58099999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.63100000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.64200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.443},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.51900000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":171047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.628},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.52000000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.46400000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.48699999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.57799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:51:46.318 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:51:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.549+0000 7fd5df9ff700 1 Processor -- start 2023-07-09T21:51:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.550+0000 7fd5df9ff700 1 -- start start 2023-07-09T21:51:46.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.551+0000 7fd5df9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5d80d1220 0x7fd5d80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.551+0000 7fd5df9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd5d80b2350 0x7fd5d80afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.551+0000 7fd5df9ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d80d2ce0 con 0x7fd5d80b1e00 2023-07-09T21:51:46.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.551+0000 7fd5df9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d80b3350 con 0x7fd5d80b2350 2023-07-09T21:51:46.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.551+0000 7fd5df9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80b3630 con 0x7fd5d80d1220 2023-07-09T21:51:46.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.551+0000 7fd5dd79b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd5d80b1e00 0x7fd5d80d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58378/0 (socket says 172.21.15.53:58378) 2023-07-09T21:51:46.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.551+0000 7fd5dd79b700 1 -- 172.21.15.53:0/1231281122 learned_addr learned my addr 172.21.15.53:0/1231281122 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.551+0000 7fd5ddf9c700 1 --2- 172.21.15.53:0/1231281122 >> v2:172.21.15.184:3300/0 conn(0x7fd5d80b2350 0x7fd5d80afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.551+0000 7fd5dcf9a700 1 --2- 172.21.15.53:0/1231281122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5d80d1220 0x7fd5d80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.551+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483559549 0 0) 0x7fd5d80d2ce0 con 0x7fd5d80b1e00 2023-07-09T21:51:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.551+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c40035b0 con 0x7fd5d80b1e00 2023-07-09T21:51:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2450854758 0 0) 0x7fd5c40035b0 con 0x7fd5d80b1e00 2023-07-09T21:51:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5d80d1220 msgr2=0x7fd5d80b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 --2- 172.21.15.53:0/1231281122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5d80d1220 0x7fd5d80b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 >> v2:172.21.15.184:3300/0 conn(0x7fd5d80b2350 msgr2=0x7fd5d80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 --2- 172.21.15.53:0/1231281122 >> v2:172.21.15.184:3300/0 conn(0x7fd5d80b2350 0x7fd5d80afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d80b3910 con 0x7fd5d80b1e00 2023-07-09T21:51:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7fd5d40017f0 con 0x7fd5d80b1e00 2023-07-09T21:51:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 >> v1:172.21.15.53:6789/0 conn(0x7fd5d80b1e00 legacy=0x7fd5d80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 --2- 172.21.15.53:0/1231281122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5d80d1220 0x7fd5c4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 --2- 172.21.15.53:0/1231281122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5c4003fd0 0x7fd5c4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 --2- 172.21.15.53:0/1231281122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5c4004d90 0x7fd5c4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80b3350 con 0x7fd5c4004d90 2023-07-09T21:51:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80b3630 con 0x7fd5c4003fd0 2023-07-09T21:51:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c400ba90 con 0x7fd5d80d1220 2023-07-09T21:51:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5ddf9c700 1 --2- 172.21.15.53:0/1231281122 >> v2:172.21.15.184:3300/0 conn(0x7fd5d80b2350 0x7fd5d80afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.552+0000 7fd5ddf9c700 1 --2- 172.21.15.53:0/1231281122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5c4004d90 0x7fd5c4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.553+0000 7fd5dd79b700 1 --2- 172.21.15.53:0/1231281122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5d80d1220 0x7fd5c4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.553+0000 7fd5dcf9a700 1 --2- 172.21.15.53:0/1231281122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5c4003fd0 0x7fd5c4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.553+0000 7fd5ddf9c700 1 -- 172.21.15.53:0/1231281122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5d80d1220 msgr2=0x7fd5c4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.553+0000 7fd5ddf9c700 1 --2- 172.21.15.53:0/1231281122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5d80d1220 0x7fd5c4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.553+0000 7fd5ddf9c700 1 -- 172.21.15.53:0/1231281122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5c4003fd0 msgr2=0x7fd5c4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.553+0000 7fd5ddf9c700 1 --2- 172.21.15.53:0/1231281122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5c4003fd0 0x7fd5c4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.553+0000 7fd5ddf9c700 1 -- 172.21.15.53:0/1231281122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c40035b0 con 0x7fd5c4004d90 2023-07-09T21:51:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.553+0000 7fd5dcf9a700 1 --2- 172.21.15.53:0/1231281122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5c4003fd0 0x7fd5c4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.553+0000 7fd5ddf9c700 1 --2- 172.21.15.53:0/1231281122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5c4004d90 0x7fd5c4005200 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000e350 tx=0x7fd5c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3844095f9477511e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.553+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d000ee10 con 0x7fd5c4004d90 2023-07-09T21:51:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.553+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d000f040 con 0x7fd5c4004d90 2023-07-09T21:51:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.553+0000 7fd5cffff700 1 -- 172.21.15.53:0/1231281122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0003c40 con 0x7fd5c4004d90 2023-07-09T21:51:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.554+0000 7fd5df9ff700 1 -- 172.21.15.53:0/1231281122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5c4004d90 msgr2=0x7fd5c4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.554+0000 7fd5df9ff700 1 --2- 172.21.15.53:0/1231281122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5c4004d90 0x7fd5c4005200 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000e350 tx=0x7fd5c4005880 comp rx=0 tx=0).stop 2023-07-09T21:51:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.554+0000 7fd5ddf9c700 1 -- 172.21.15.53:0/1231281122 reap_dead start 2023-07-09T21:51:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.554+0000 7fd5df9ff700 1 -- 172.21.15.53:0/1231281122 shutdown_connections 2023-07-09T21:51:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.554+0000 7fd5df9ff700 1 -- 172.21.15.53:0/1231281122 >> 172.21.15.53:0/1231281122 conn(0x7fd5d809c1d0 msgr2=0x7fd5d80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.554+0000 7fd5df9ff700 1 -- 172.21.15.53:0/1231281122 shutdown_connections 2023-07-09T21:51:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.554+0000 7fd5df9ff700 1 -- 172.21.15.53:0/1231281122 wait complete. 2023-07-09T21:51:46.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.556+0000 7fd5df9ff700 1 Processor -- start 2023-07-09T21:51:46.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.556+0000 7fd5df9ff700 1 -- start start 2023-07-09T21:51:46.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.557+0000 7fd5df9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5c4004d90 0x7fd5d8155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.557+0000 7fd5df9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5d815eba0 0x7fd5d815f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.557+0000 7fd5df9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d815dbb0 0x7fd5d815e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.557+0000 7fd5df9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d8158ec0 con 0x7fd5d815dbb0 2023-07-09T21:51:46.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.557+0000 7fd5df9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d815f550 con 0x7fd5d815eba0 2023-07-09T21:51:46.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.557+0000 7fd5df9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80c6a70 con 0x7fd5c4004d90 2023-07-09T21:51:46.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.557+0000 7fd5ddf9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d815dbb0 0x7fd5d815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.557+0000 7fd5ddf9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d815dbb0 0x7fd5d815e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50154/0 (socket says 172.21.15.53:50154) 2023-07-09T21:51:46.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.557+0000 7fd5ddf9c700 1 -- 172.21.15.53:0/741781218 learned_addr learned my addr 172.21.15.53:0/741781218 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:46.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.557+0000 7fd5dcf9a700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5d815eba0 0x7fd5d815f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.557+0000 7fd5dd79b700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5c4004d90 0x7fd5d8155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.558+0000 7fd5ddf9c700 1 -- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5c4004d90 msgr2=0x7fd5d8155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:46.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.558+0000 7fd5ddf9c700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5c4004d90 0x7fd5d8155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.558+0000 7fd5ddf9c700 1 -- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5d815eba0 msgr2=0x7fd5d815f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:46.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.558+0000 7fd5ddf9c700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5d815eba0 0x7fd5d815f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.558+0000 7fd5ddf9c700 1 -- 172.21.15.53:0/741781218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d80c75f0 con 0x7fd5d815dbb0 2023-07-09T21:51:46.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.558+0000 7fd5dd79b700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5c4004d90 0x7fd5d8155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:51:46.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.558+0000 7fd5ddf9c700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d815dbb0 0x7fd5d815e050 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0004000 tx=0x7fd5d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:46.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.558+0000 7fd5cdffb700 1 -- 172.21.15.53:0/741781218 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0004440 con 0x7fd5d815dbb0 2023-07-09T21:51:46.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.558+0000 7fd5cdffb700 1 -- 172.21.15.53:0/741781218 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d0022070 con 0x7fd5d815dbb0 2023-07-09T21:51:46.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.558+0000 7fd5cdffb700 1 -- 172.21.15.53:0/741781218 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0004800 con 0x7fd5d815dbb0 2023-07-09T21:51:46.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.558+0000 7fd5df9ff700 1 -- 172.21.15.53:0/741781218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d80c6cc0 con 0x7fd5d815dbb0 2023-07-09T21:51:46.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.558+0000 7fd5df9ff700 1 -- 172.21.15.53:0/741781218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d80c7280 con 0x7fd5d815dbb0 2023-07-09T21:51:46.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.559+0000 7fd5df9ff700 1 -- 172.21.15.53:0/741781218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d80c7780 con 0x7fd5d815dbb0 2023-07-09T21:51:46.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.560+0000 7fd5cdffb700 1 -- 172.21.15.53:0/741781218 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd5d0014480 con 0x7fd5d815dbb0 2023-07-09T21:51:46.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.561+0000 7fd5cdffb700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd5bc06ace0 0x7fd5bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:46.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.561+0000 7fd5cdffb700 1 -- 172.21.15.53:0/741781218 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd5d008b4d0 con 0x7fd5d815dbb0 2023-07-09T21:51:46.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.562+0000 7fd5dd79b700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd5bc06ace0 0x7fd5bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:46.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.562+0000 7fd5dd79b700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd5bc06ace0 0x7fd5bc06d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40011d0 tx=0x7fd5d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:46.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.566+0000 7fd5cdffb700 1 -- 172.21.15.53:0/741781218 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd5d0056690 con 0x7fd5d815dbb0 2023-07-09T21:51:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.769+0000 7fd5df9ff700 1 -- 172.21.15.53:0/741781218 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5d8158ec0 con 0x7fd5bc06ace0 2023-07-09T21:51:46.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.779+0000 7fd5cdffb700 1 -- 172.21.15.53:0/741781218 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310797 (secure 0 0 0) 0x7fd5d8158ec0 con 0x7fd5bc06ace0 2023-07-09T21:51:46.783 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:46.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.783+0000 7fd5df9ff700 1 -- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd5bc06ace0 msgr2=0x7fd5bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:46.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.783+0000 7fd5df9ff700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd5bc06ace0 0x7fd5bc06d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40011d0 tx=0x7fd5d4009040 comp rx=0 tx=0).stop 2023-07-09T21:51:46.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.783+0000 7fd5df9ff700 1 -- 172.21.15.53:0/741781218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d815dbb0 msgr2=0x7fd5d815e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:46.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.783+0000 7fd5df9ff700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d815dbb0 0x7fd5d815e050 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0004000 tx=0x7fd5d0009750 comp rx=0 tx=0).stop 2023-07-09T21:51:46.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.783+0000 7fd5df9ff700 1 -- 172.21.15.53:0/741781218 shutdown_connections 2023-07-09T21:51:46.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.783+0000 7fd5df9ff700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd5bc06ace0 0x7fd5bc06d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.783+0000 7fd5df9ff700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d815dbb0 0x7fd5d815e050 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.783+0000 7fd5df9ff700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5c4004d90 0x7fd5d8155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.783+0000 7fd5df9ff700 1 --2- 172.21.15.53:0/741781218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5d815eba0 0x7fd5d815f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:46.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.783+0000 7fd5df9ff700 1 -- 172.21.15.53:0/741781218 >> 172.21.15.53:0/741781218 conn(0x7fd5d809c1d0 msgr2=0x7fd5d80d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:46.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.783+0000 7fd5df9ff700 1 -- 172.21.15.53:0/741781218 shutdown_connections 2023-07-09T21:51:46.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:46.783+0000 7fd5df9ff700 1 -- 172.21.15.53:0/741781218 wait complete. 2023-07-09T21:51:46.788 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:51:46.803 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-07-09T21:51:44.871854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224180,"kb_used_data":4468,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750540,"statfs":{"total":773094113280,"available":772864552960,"internally_reserved":0,"allocated":4575232,"data_stored":2555833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.025417"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871538+0000","last_change":"2023-07-09T21:51:41.871416+0000","last_active":"2023-07-09T21:51:42.871538+0000","last_peered":"2023-07-09T21:51:42.871538+0000","last_clean":"2023-07-09T21:51:42.871538+0000","last_became_active":"2023-07-09T21:51:41.871120+0000","last_became_peered":"2023-07-09T21:51:41.871120+0000","last_unstale":"2023-07-09T21:51:42.871538+0000","last_undegraded":"2023-07-09T21:51:42.871538+0000","last_fullsized":"2023-07-09T21:51:42.871538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:15:56.790768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871012+0000","last_change":"2023-07-09T21:51:41.868145+0000","last_active":"2023-07-09T21:51:42.871012+0000","last_peered":"2023-07-09T21:51:42.871012+0000","last_clean":"2023-07-09T21:51:42.871012+0000","last_became_active":"2023-07-09T21:51:41.867845+0000","last_became_peered":"2023-07-09T21:51:41.867845+0000","last_unstale":"2023-07-09T21:51:42.871012+0000","last_undegraded":"2023-07-09T21:51:42.871012+0000","last_fullsized":"2023-07-09T21:51:42.871012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:40:00.303451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872676+0000","last_change":"2023-07-09T21:51:41.889943+0000","last_active":"2023-07-09T21:51:42.872676+0000","last_peered":"2023-07-09T21:51:42.872676+0000","last_clean":"2023-07-09T21:51:42.872676+0000","last_became_active":"2023-07-09T21:51:41.889671+0000","last_became_peered":"2023-07-09T21:51:41.889671+0000","last_unstale":"2023-07-09T21:51:42.872676+0000","last_undegraded":"2023-07-09T21:51:42.872676+0000","last_fullsized":"2023-07-09T21:51:42.872676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:40:00.303451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.890117+0000","last_change":"2023-07-09T21:51:41.879253+0000","last_active":"2023-07-09T21:51:41.890117+0000","last_peered":"2023-07-09T21:51:41.890117+0000","last_clean":"2023-07-09T21:51:41.890117+0000","last_became_active":"2023-07-09T21:51:41.878589+0000","last_became_peered":"2023-07-09T21:51:41.878589+0000","last_unstale":"2023-07-09T21:51:41.890117+0000","last_undegraded":"2023-07-09T21:51:41.890117+0000","last_fullsized":"2023-07-09T21:51:41.890117+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:16.689711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.890053+0000","last_change":"2023-07-09T21:51:41.878916+0000","last_active":"2023-07-09T21:51:41.890053+0000","last_peered":"2023-07-09T21:51:41.890053+0000","last_clean":"2023-07-09T21:51:41.890053+0000","last_became_active":"2023-07-09T21:51:41.878162+0000","last_became_peered":"2023-07-09T21:51:41.878162+0000","last_unstale":"2023-07-09T21:51:41.890053+0000","last_undegraded":"2023-07-09T21:51:41.890053+0000","last_fullsized":"2023-07-09T21:51:41.890053+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:05:49.494350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447940+0000","last_change":"2023-07-09T21:51:41.861306+0000","last_active":"2023-07-09T21:51:43.447940+0000","last_peered":"2023-07-09T21:51:43.447940+0000","last_clean":"2023-07-09T21:51:43.447940+0000","last_became_active":"2023-07-09T21:51:41.860361+0000","last_became_peered":"2023-07-09T21:51:41.860361+0000","last_unstale":"2023-07-09T21:51:43.447940+0000","last_undegraded":"2023-07-09T21:51:43.447940+0000","last_fullsized":"2023-07-09T21:51:43.447940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:58:44.201194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872554+0000","last_change":"2023-07-09T21:51:41.877625+0000","last_active":"2023-07-09T21:51:42.872554+0000","last_peered":"2023-07-09T21:51:42.872554+0000","last_clean":"2023-07-09T21:51:42.872554+0000","last_became_active":"2023-07-09T21:51:41.877324+0000","last_became_peered":"2023-07-09T21:51:41.877324+0000","last_unstale":"2023-07-09T21:51:42.872554+0000","last_undegraded":"2023-07-09T21:51:42.872554+0000","last_fullsized":"2023-07-09T21:51:42.872554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:30:30.221265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.870799+0000","last_change":"2023-07-09T21:51:41.891629+0000","last_active":"2023-07-09T21:51:42.870799+0000","last_peered":"2023-07-09T21:51:42.870799+0000","last_clean":"2023-07-09T21:51:42.870799+0000","last_became_active":"2023-07-09T21:51:41.891310+0000","last_became_peered":"2023-07-09T21:51:41.891310+0000","last_unstale":"2023-07-09T21:51:42.870799+0000","last_undegraded":"2023-07-09T21:51:42.870799+0000","last_fullsized":"2023-07-09T21:51:42.870799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:03:07.824109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872592+0000","last_change":"2023-07-09T21:51:41.890003+0000","last_active":"2023-07-09T21:51:42.872592+0000","last_peered":"2023-07-09T21:51:42.872592+0000","last_clean":"2023-07-09T21:51:42.872592+0000","last_became_active":"2023-07-09T21:51:41.889647+0000","last_became_peered":"2023-07-09T21:51:41.889647+0000","last_unstale":"2023-07-09T21:51:42.872592+0000","last_undegraded":"2023-07-09T21:51:42.872592+0000","last_fullsized":"2023-07-09T21:51:42.872592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:36.325955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872934+0000","last_change":"2023-07-09T21:51:41.892551+0000","last_active":"2023-07-09T21:51:42.872934+0000","last_peered":"2023-07-09T21:51:42.872934+0000","last_clean":"2023-07-09T21:51:42.872934+0000","last_became_active":"2023-07-09T21:51:41.891625+0000","last_became_peered":"2023-07-09T21:51:41.891625+0000","last_unstale":"2023-07-09T21:51:42.872934+0000","last_undegraded":"2023-07-09T21:51:42.872934+0000","last_fullsized":"2023-07-09T21:51:42.872934+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:03:48.676001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873414+0000","last_change":"2023-07-09T21:51:41.889304+0000","last_active":"2023-07-09T21:51:42.873414+0000","last_peered":"2023-07-09T21:51:42.873414+0000","last_clean":"2023-07-09T21:51:42.873414+0000","last_became_active":"2023-07-09T21:51:41.888860+0000","last_became_peered":"2023-07-09T21:51:41.888860+0000","last_unstale":"2023-07-09T21:51:42.873414+0000","last_undegraded":"2023-07-09T21:51:42.873414+0000","last_fullsized":"2023-07-09T21:51:42.873414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:36:10.313479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872505+0000","last_change":"2023-07-09T21:51:41.872482+0000","last_active":"2023-07-09T21:51:42.872505+0000","last_peered":"2023-07-09T21:51:42.872505+0000","last_clean":"2023-07-09T21:51:42.872505+0000","last_became_active":"2023-07-09T21:51:41.872184+0000","last_became_peered":"2023-07-09T21:51:41.872184+0000","last_unstale":"2023-07-09T21:51:42.872505+0000","last_undegraded":"2023-07-09T21:51:42.872505+0000","last_fullsized":"2023-07-09T21:51:42.872505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:03:07.824109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872666+0000","last_change":"2023-07-09T21:51:41.891763+0000","last_active":"2023-07-09T21:51:42.872666+0000","last_peered":"2023-07-09T21:51:42.872666+0000","last_clean":"2023-07-09T21:51:42.872666+0000","last_became_active":"2023-07-09T21:51:41.891374+0000","last_became_peered":"2023-07-09T21:51:41.891374+0000","last_unstale":"2023-07-09T21:51:42.872666+0000","last_undegraded":"2023-07-09T21:51:42.872666+0000","last_fullsized":"2023-07-09T21:51:42.872666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:23:42.260911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.891122+0000","last_change":"2023-07-09T21:51:41.882777+0000","last_active":"2023-07-09T21:51:42.891122+0000","last_peered":"2023-07-09T21:51:42.891122+0000","last_clean":"2023-07-09T21:51:42.891122+0000","last_became_active":"2023-07-09T21:51:41.882587+0000","last_became_peered":"2023-07-09T21:51:41.882587+0000","last_unstale":"2023-07-09T21:51:42.891122+0000","last_undegraded":"2023-07-09T21:51:42.891122+0000","last_fullsized":"2023-07-09T21:51:42.891122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:36:10.313479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872522+0000","last_change":"2023-07-09T21:51:41.891786+0000","last_active":"2023-07-09T21:51:42.872522+0000","last_peered":"2023-07-09T21:51:42.872522+0000","last_clean":"2023-07-09T21:51:42.872522+0000","last_became_active":"2023-07-09T21:51:41.891518+0000","last_became_peered":"2023-07-09T21:51:41.891518+0000","last_unstale":"2023-07-09T21:51:42.872522+0000","last_undegraded":"2023-07-09T21:51:42.872522+0000","last_fullsized":"2023-07-09T21:51:42.872522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:16.684694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.895575+0000","last_change":"2023-07-09T21:51:41.892723+0000","last_active":"2023-07-09T21:51:41.895575+0000","last_peered":"2023-07-09T21:51:41.895575+0000","last_clean":"2023-07-09T21:51:41.895575+0000","last_became_active":"2023-07-09T21:51:41.892092+0000","last_became_peered":"2023-07-09T21:51:41.892092+0000","last_unstale":"2023-07-09T21:51:41.895575+0000","last_undegraded":"2023-07-09T21:51:41.895575+0000","last_fullsized":"2023-07-09T21:51:41.895575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:21:13.131738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.898941+0000","last_change":"2023-07-09T21:51:41.895123+0000","last_active":"2023-07-09T21:51:41.898941+0000","last_peered":"2023-07-09T21:51:41.898941+0000","last_clean":"2023-07-09T21:51:41.898941+0000","last_became_active":"2023-07-09T21:51:41.894824+0000","last_became_peered":"2023-07-09T21:51:41.894824+0000","last_unstale":"2023-07-09T21:51:41.898941+0000","last_undegraded":"2023-07-09T21:51:41.898941+0000","last_fullsized":"2023-07-09T21:51:41.898941+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:22.999496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.886827+0000","last_change":"2023-07-09T21:51:41.882679+0000","last_active":"2023-07-09T21:51:41.886827+0000","last_peered":"2023-07-09T21:51:41.886827+0000","last_clean":"2023-07-09T21:51:41.886827+0000","last_became_active":"2023-07-09T21:51:41.882418+0000","last_became_peered":"2023-07-09T21:51:41.882418+0000","last_unstale":"2023-07-09T21:51:41.886827+0000","last_undegraded":"2023-07-09T21:51:41.886827+0000","last_fullsized":"2023-07-09T21:51:41.886827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:16.689711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.888074+0000","last_change":"2023-07-09T21:51:41.869470+0000","last_active":"2023-07-09T21:51:41.888074+0000","last_peered":"2023-07-09T21:51:41.888074+0000","last_clean":"2023-07-09T21:51:41.888074+0000","last_became_active":"2023-07-09T21:51:41.869054+0000","last_became_peered":"2023-07-09T21:51:41.869054+0000","last_unstale":"2023-07-09T21:51:41.888074+0000","last_undegraded":"2023-07-09T21:51:41.888074+0000","last_fullsized":"2023-07-09T21:51:41.888074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:41:03.556315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.883116+0000","last_change":"2023-07-09T21:51:41.879587+0000","last_active":"2023-07-09T21:51:41.883116+0000","last_peered":"2023-07-09T21:51:41.883116+0000","last_clean":"2023-07-09T21:51:41.883116+0000","last_became_active":"2023-07-09T21:51:41.879324+0000","last_became_peered":"2023-07-09T21:51:41.879324+0000","last_unstale":"2023-07-09T21:51:41.883116+0000","last_undegraded":"2023-07-09T21:51:41.883116+0000","last_fullsized":"2023-07-09T21:51:41.883116+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:22:40.033857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872738+0000","last_change":"2023-07-09T21:51:41.878411+0000","last_active":"2023-07-09T21:51:42.872738+0000","last_peered":"2023-07-09T21:51:42.872738+0000","last_clean":"2023-07-09T21:51:42.872738+0000","last_became_active":"2023-07-09T21:51:41.878109+0000","last_became_peered":"2023-07-09T21:51:41.878109+0000","last_unstale":"2023-07-09T21:51:42.872738+0000","last_undegraded":"2023-07-09T21:51:42.872738+0000","last_fullsized":"2023-07-09T21:51:42.872738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:55:21.685470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.890730+0000","last_change":"2023-07-09T21:51:41.890191+0000","last_active":"2023-07-09T21:51:42.890730+0000","last_peered":"2023-07-09T21:51:42.890730+0000","last_clean":"2023-07-09T21:51:42.890730+0000","last_became_active":"2023-07-09T21:51:41.889932+0000","last_became_peered":"2023-07-09T21:51:41.889932+0000","last_unstale":"2023-07-09T21:51:42.890730+0000","last_undegraded":"2023-07-09T21:51:42.890730+0000","last_fullsized":"2023-07-09T21:51:42.890730+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:59.522483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.881513+0000","last_change":"2023-07-09T21:51:41.876357+0000","last_active":"2023-07-09T21:51:41.881513+0000","last_peered":"2023-07-09T21:51:41.881513+0000","last_clean":"2023-07-09T21:51:41.881513+0000","last_became_active":"2023-07-09T21:51:41.876101+0000","last_became_peered":"2023-07-09T21:51:41.876101+0000","last_unstale":"2023-07-09T21:51:41.881513+0000","last_undegraded":"2023-07-09T21:51:41.881513+0000","last_fullsized":"2023-07-09T21:51:41.881513+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:12:07.546919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.889616+0000","last_change":"2023-07-09T21:51:41.875798+0000","last_active":"2023-07-09T21:51:41.889616+0000","last_peered":"2023-07-09T21:51:41.889616+0000","last_clean":"2023-07-09T21:51:41.889616+0000","last_became_active":"2023-07-09T21:51:41.875248+0000","last_became_peered":"2023-07-09T21:51:41.875248+0000","last_unstale":"2023-07-09T21:51:41.889616+0000","last_undegraded":"2023-07-09T21:51:41.889616+0000","last_fullsized":"2023-07-09T21:51:41.889616+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:01:50.492018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.886971+0000","last_change":"2023-07-09T21:51:41.878610+0000","last_active":"2023-07-09T21:51:41.886971+0000","last_peered":"2023-07-09T21:51:41.886971+0000","last_clean":"2023-07-09T21:51:41.886971+0000","last_became_active":"2023-07-09T21:51:41.878185+0000","last_became_peered":"2023-07-09T21:51:41.878185+0000","last_unstale":"2023-07-09T21:51:41.886971+0000","last_undegraded":"2023-07-09T21:51:41.886971+0000","last_fullsized":"2023-07-09T21:51:41.886971+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:15:17.123642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447883+0000","last_change":"2023-07-09T21:51:41.894543+0000","last_active":"2023-07-09T21:51:43.447883+0000","last_peered":"2023-07-09T21:51:43.447883+0000","last_clean":"2023-07-09T21:51:43.447883+0000","last_became_active":"2023-07-09T21:51:41.894181+0000","last_became_peered":"2023-07-09T21:51:41.894181+0000","last_unstale":"2023-07-09T21:51:43.447883+0000","last_undegraded":"2023-07-09T21:51:43.447883+0000","last_fullsized":"2023-07-09T21:51:43.447883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:09:55.730170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.881155+0000","last_change":"2023-07-09T21:51:41.868619+0000","last_active":"2023-07-09T21:51:41.881155+0000","last_peered":"2023-07-09T21:51:41.881155+0000","last_clean":"2023-07-09T21:51:41.881155+0000","last_became_active":"2023-07-09T21:51:41.868286+0000","last_became_peered":"2023-07-09T21:51:41.868286+0000","last_unstale":"2023-07-09T21:51:41.881155+0000","last_undegraded":"2023-07-09T21:51:41.881155+0000","last_fullsized":"2023-07-09T21:51:41.881155+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:01:50.492018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873030+0000","last_change":"2023-07-09T21:51:41.889323+0000","last_active":"2023-07-09T21:51:42.873030+0000","last_peered":"2023-07-09T21:51:42.873030+0000","last_clean":"2023-07-09T21:51:42.873030+0000","last_became_active":"2023-07-09T21:51:41.889023+0000","last_became_peered":"2023-07-09T21:51:41.889023+0000","last_unstale":"2023-07-09T21:51:42.873030+0000","last_undegraded":"2023-07-09T21:51:42.873030+0000","last_fullsized":"2023-07-09T21:51:42.873030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:44:46.265782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.878892+0000","last_change":"2023-07-09T21:51:41.864921+0000","last_active":"2023-07-09T21:51:41.878892+0000","last_peered":"2023-07-09T21:51:41.878892+0000","last_clean":"2023-07-09T21:51:41.878892+0000","last_became_active":"2023-07-09T21:51:41.864565+0000","last_became_peered":"2023-07-09T21:51:41.864565+0000","last_unstale":"2023-07-09T21:51:41.878892+0000","last_undegraded":"2023-07-09T21:51:41.878892+0000","last_fullsized":"2023-07-09T21:51:41.878892+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:05:49.494350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.877850+0000","last_change":"2023-07-09T21:51:41.864858+0000","last_active":"2023-07-09T21:51:41.877850+0000","last_peered":"2023-07-09T21:51:41.877850+0000","last_clean":"2023-07-09T21:51:41.877850+0000","last_became_active":"2023-07-09T21:51:41.864547+0000","last_became_peered":"2023-07-09T21:51:41.864547+0000","last_unstale":"2023-07-09T21:51:41.877850+0000","last_undegraded":"2023-07-09T21:51:41.877850+0000","last_fullsized":"2023-07-09T21:51:41.877850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:58:18.133083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.878947+0000","last_change":"2023-07-09T21:51:41.874914+0000","last_active":"2023-07-09T21:51:41.878947+0000","last_peered":"2023-07-09T21:51:41.878947+0000","last_clean":"2023-07-09T21:51:41.878947+0000","last_became_active":"2023-07-09T21:51:41.874586+0000","last_became_peered":"2023-07-09T21:51:41.874586+0000","last_unstale":"2023-07-09T21:51:41.878947+0000","last_undegraded":"2023-07-09T21:51:41.878947+0000","last_fullsized":"2023-07-09T21:51:41.878947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:50:14.894597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447576+0000","last_change":"2023-07-09T21:51:41.863742+0000","last_active":"2023-07-09T21:51:43.447576+0000","last_peered":"2023-07-09T21:51:43.447576+0000","last_clean":"2023-07-09T21:51:43.447576+0000","last_became_active":"2023-07-09T21:51:41.863432+0000","last_became_peered":"2023-07-09T21:51:41.863432+0000","last_unstale":"2023-07-09T21:51:43.447576+0000","last_undegraded":"2023-07-09T21:51:43.447576+0000","last_fullsized":"2023-07-09T21:51:43.447576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:06:55.495606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.893640+0000","last_change":"2023-07-09T21:51:41.890567+0000","last_active":"2023-07-09T21:51:41.893640+0000","last_peered":"2023-07-09T21:51:41.893640+0000","last_clean":"2023-07-09T21:51:41.893640+0000","last_became_active":"2023-07-09T21:51:41.890207+0000","last_became_peered":"2023-07-09T21:51:41.890207+0000","last_unstale":"2023-07-09T21:51:41.893640+0000","last_undegraded":"2023-07-09T21:51:41.893640+0000","last_fullsized":"2023-07-09T21:51:41.893640+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:38:36.332179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.883103+0000","last_change":"2023-07-09T21:51:40.873240+0000","last_active":"2023-07-09T21:51:41.883103+0000","last_peered":"2023-07-09T21:51:41.883103+0000","last_clean":"2023-07-09T21:51:41.883103+0000","last_became_active":"2023-07-09T21:51:40.872972+0000","last_became_peered":"2023-07-09T21:51:40.872972+0000","last_unstale":"2023-07-09T21:51:41.883103+0000","last_undegraded":"2023-07-09T21:51:41.883103+0000","last_fullsized":"2023-07-09T21:51:41.883103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:41:02.554046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.448050+0000","last_change":"2023-07-09T21:51:41.889554+0000","last_active":"2023-07-09T21:51:43.448050+0000","last_peered":"2023-07-09T21:51:43.448050+0000","last_clean":"2023-07-09T21:51:43.448050+0000","last_became_active":"2023-07-09T21:51:41.889033+0000","last_became_peered":"2023-07-09T21:51:41.889033+0000","last_unstale":"2023-07-09T21:51:43.448050+0000","last_undegraded":"2023-07-09T21:51:43.448050+0000","last_fullsized":"2023-07-09T21:51:43.448050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:31.765587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872495+0000","last_change":"2023-07-09T21:51:40.873411+0000","last_active":"2023-07-09T21:51:42.872495+0000","last_peered":"2023-07-09T21:51:42.872495+0000","last_clean":"2023-07-09T21:51:42.872495+0000","last_became_active":"2023-07-09T21:51:40.873125+0000","last_became_peered":"2023-07-09T21:51:40.873125+0000","last_unstale":"2023-07-09T21:51:42.872495+0000","last_undegraded":"2023-07-09T21:51:42.872495+0000","last_fullsized":"2023-07-09T21:51:42.872495+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:50:13.892329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.891072+0000","last_change":"2023-07-09T21:51:41.882565+0000","last_active":"2023-07-09T21:51:42.891072+0000","last_peered":"2023-07-09T21:51:42.891072+0000","last_clean":"2023-07-09T21:51:42.891072+0000","last_became_active":"2023-07-09T21:51:41.882229+0000","last_became_peered":"2023-07-09T21:51:41.882229+0000","last_unstale":"2023-07-09T21:51:42.891072+0000","last_undegraded":"2023-07-09T21:51:42.891072+0000","last_fullsized":"2023-07-09T21:51:42.891072+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:57:23.754598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.448047+0000","last_change":"2023-07-09T21:51:40.873157+0000","last_active":"2023-07-09T21:51:43.448047+0000","last_peered":"2023-07-09T21:51:43.448047+0000","last_clean":"2023-07-09T21:51:43.448047+0000","last_became_active":"2023-07-09T21:51:40.872799+0000","last_became_peered":"2023-07-09T21:51:40.872799+0000","last_unstale":"2023-07-09T21:51:43.448047+0000","last_undegraded":"2023-07-09T21:51:43.448047+0000","last_fullsized":"2023-07-09T21:51:43.448047+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:37:42.625329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871561+0000","last_change":"2023-07-09T21:51:41.861899+0000","last_active":"2023-07-09T21:51:42.871561+0000","last_peered":"2023-07-09T21:51:42.871561+0000","last_clean":"2023-07-09T21:51:42.871561+0000","last_became_active":"2023-07-09T21:51:41.861035+0000","last_became_peered":"2023-07-09T21:51:41.861035+0000","last_unstale":"2023-07-09T21:51:42.871561+0000","last_undegraded":"2023-07-09T21:51:42.871561+0000","last_fullsized":"2023-07-09T21:51:42.871561+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:35:30.427888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.890945+0000","last_change":"2023-07-09T21:51:40.872388+0000","last_active":"2023-07-09T21:51:42.890945+0000","last_peered":"2023-07-09T21:51:42.890945+0000","last_clean":"2023-07-09T21:51:42.890945+0000","last_became_active":"2023-07-09T21:51:40.872090+0000","last_became_peered":"2023-07-09T21:51:40.872090+0000","last_unstale":"2023-07-09T21:51:42.890945+0000","last_undegraded":"2023-07-09T21:51:42.890945+0000","last_fullsized":"2023-07-09T21:51:42.890945+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:44:45.263514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872023+0000","last_change":"2023-07-09T21:51:41.878056+0000","last_active":"2023-07-09T21:51:42.872023+0000","last_peered":"2023-07-09T21:51:42.872023+0000","last_clean":"2023-07-09T21:51:42.872023+0000","last_became_active":"2023-07-09T21:51:41.877761+0000","last_became_peered":"2023-07-09T21:51:41.877761+0000","last_unstale":"2023-07-09T21:51:42.872023+0000","last_undegraded":"2023-07-09T21:51:42.872023+0000","last_fullsized":"2023-07-09T21:51:42.872023+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:38:21.900858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872938+0000","last_change":"2023-07-09T21:51:40.872533+0000","last_active":"2023-07-09T21:51:42.872938+0000","last_peered":"2023-07-09T21:51:42.872938+0000","last_clean":"2023-07-09T21:51:42.872938+0000","last_became_active":"2023-07-09T21:51:40.872194+0000","last_became_peered":"2023-07-09T21:51:40.872194+0000","last_unstale":"2023-07-09T21:51:42.872938+0000","last_undegraded":"2023-07-09T21:51:42.872938+0000","last_fullsized":"2023-07-09T21:51:42.872938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:12.935793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872799+0000","last_change":"2023-07-09T21:51:41.880142+0000","last_active":"2023-07-09T21:51:42.872799+0000","last_peered":"2023-07-09T21:51:42.872799+0000","last_clean":"2023-07-09T21:51:42.872799+0000","last_became_active":"2023-07-09T21:51:41.879730+0000","last_became_peered":"2023-07-09T21:51:41.879730+0000","last_unstale":"2023-07-09T21:51:42.872799+0000","last_undegraded":"2023-07-09T21:51:42.872799+0000","last_fullsized":"2023-07-09T21:51:42.872799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:46:30.014505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.884294+0000","last_change":"2023-07-09T21:51:40.881132+0000","last_active":"2023-07-09T21:51:41.884294+0000","last_peered":"2023-07-09T21:51:41.884294+0000","last_clean":"2023-07-09T21:51:41.884294+0000","last_became_active":"2023-07-09T21:51:40.880823+0000","last_became_peered":"2023-07-09T21:51:40.880823+0000","last_unstale":"2023-07-09T21:51:41.884294+0000","last_undegraded":"2023-07-09T21:51:41.884294+0000","last_fullsized":"2023-07-09T21:51:41.884294+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:18.684235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.890837+0000","last_change":"2023-07-09T21:51:41.891998+0000","last_active":"2023-07-09T21:51:42.890837+0000","last_peered":"2023-07-09T21:51:42.890837+0000","last_clean":"2023-07-09T21:51:42.890837+0000","last_became_active":"2023-07-09T21:51:41.891686+0000","last_became_peered":"2023-07-09T21:51:41.891686+0000","last_unstale":"2023-07-09T21:51:42.890837+0000","last_undegraded":"2023-07-09T21:51:42.890837+0000","last_fullsized":"2023-07-09T21:51:42.890837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:13.938062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447671+0000","last_change":"2023-07-09T21:51:40.877834+0000","last_active":"2023-07-09T21:51:43.447671+0000","last_peered":"2023-07-09T21:51:43.447671+0000","last_clean":"2023-07-09T21:51:43.447671+0000","last_became_active":"2023-07-09T21:51:40.877499+0000","last_became_peered":"2023-07-09T21:51:40.877499+0000","last_unstale":"2023-07-09T21:51:43.447671+0000","last_undegraded":"2023-07-09T21:51:43.447671+0000","last_fullsized":"2023-07-09T21:51:43.447671+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:19:28.696471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871392+0000","last_change":"2023-07-09T21:51:41.870683+0000","last_active":"2023-07-09T21:51:42.871392+0000","last_peered":"2023-07-09T21:51:42.871392+0000","last_clean":"2023-07-09T21:51:42.871392+0000","last_became_active":"2023-07-09T21:51:41.870099+0000","last_became_peered":"2023-07-09T21:51:41.870099+0000","last_unstale":"2023-07-09T21:51:42.871392+0000","last_undegraded":"2023-07-09T21:51:42.871392+0000","last_fullsized":"2023-07-09T21:51:42.871392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:59:05.718629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.890696+0000","last_change":"2023-07-09T21:51:40.875164+0000","last_active":"2023-07-09T21:51:42.890696+0000","last_peered":"2023-07-09T21:51:42.890696+0000","last_clean":"2023-07-09T21:51:42.890696+0000","last_became_active":"2023-07-09T21:51:40.874892+0000","last_became_peered":"2023-07-09T21:51:40.874892+0000","last_unstale":"2023-07-09T21:51:42.890696+0000","last_undegraded":"2023-07-09T21:51:42.890696+0000","last_fullsized":"2023-07-09T21:51:42.890696+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:17:06.618826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.890138+0000","last_change":"2023-07-09T21:51:41.879449+0000","last_active":"2023-07-09T21:51:41.890138+0000","last_peered":"2023-07-09T21:51:41.890138+0000","last_clean":"2023-07-09T21:51:41.890138+0000","last_became_active":"2023-07-09T21:51:41.879076+0000","last_became_peered":"2023-07-09T21:51:41.879076+0000","last_unstale":"2023-07-09T21:51:41.890138+0000","last_undegraded":"2023-07-09T21:51:41.890138+0000","last_fullsized":"2023-07-09T21:51:41.890138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:49:25.349292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871679+0000","last_change":"2023-07-09T21:51:40.870300+0000","last_active":"2023-07-09T21:51:42.871679+0000","last_peered":"2023-07-09T21:51:42.871679+0000","last_clean":"2023-07-09T21:51:42.871679+0000","last_became_active":"2023-07-09T21:51:40.869967+0000","last_became_peered":"2023-07-09T21:51:40.869967+0000","last_unstale":"2023-07-09T21:51:42.871679+0000","last_undegraded":"2023-07-09T21:51:42.871679+0000","last_fullsized":"2023-07-09T21:51:42.871679+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:12:06.544651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.886622+0000","last_change":"2023-07-09T21:51:41.881011+0000","last_active":"2023-07-09T21:51:41.886622+0000","last_peered":"2023-07-09T21:51:41.886622+0000","last_clean":"2023-07-09T21:51:41.886622+0000","last_became_active":"2023-07-09T21:51:41.880719+0000","last_became_peered":"2023-07-09T21:51:41.880719+0000","last_unstale":"2023-07-09T21:51:41.886622+0000","last_undegraded":"2023-07-09T21:51:41.886622+0000","last_fullsized":"2023-07-09T21:51:41.886622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:53:40.197296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873189+0000","last_change":"2023-07-09T21:51:40.871543+0000","last_active":"2023-07-09T21:51:42.873189+0000","last_peered":"2023-07-09T21:51:42.873189+0000","last_clean":"2023-07-09T21:51:42.873189+0000","last_became_active":"2023-07-09T21:51:40.871212+0000","last_became_peered":"2023-07-09T21:51:40.871212+0000","last_unstale":"2023-07-09T21:51:42.873189+0000","last_undegraded":"2023-07-09T21:51:42.873189+0000","last_fullsized":"2023-07-09T21:51:42.873189+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:13.824964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872337+0000","last_change":"2023-07-09T21:51:41.880537+0000","last_active":"2023-07-09T21:51:42.872337+0000","last_peered":"2023-07-09T21:51:42.872337+0000","last_clean":"2023-07-09T21:51:42.872337+0000","last_became_active":"2023-07-09T21:51:41.880078+0000","last_became_peered":"2023-07-09T21:51:41.880078+0000","last_unstale":"2023-07-09T21:51:42.872337+0000","last_undegraded":"2023-07-09T21:51:42.872337+0000","last_fullsized":"2023-07-09T21:51:42.872337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:21:13.131738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873481+0000","last_change":"2023-07-09T21:51:40.878283+0000","last_active":"2023-07-09T21:51:42.873481+0000","last_peered":"2023-07-09T21:51:42.873481+0000","last_clean":"2023-07-09T21:51:42.873481+0000","last_became_active":"2023-07-09T21:51:40.878009+0000","last_became_peered":"2023-07-09T21:51:40.878009+0000","last_unstale":"2023-07-09T21:51:42.873481+0000","last_undegraded":"2023-07-09T21:51:42.873481+0000","last_fullsized":"2023-07-09T21:51:42.873481+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:55:56.800975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.891215+0000","last_change":"2023-07-09T21:51:41.890308+0000","last_active":"2023-07-09T21:51:42.891215+0000","last_peered":"2023-07-09T21:51:42.891215+0000","last_clean":"2023-07-09T21:51:42.891215+0000","last_became_active":"2023-07-09T21:51:41.890046+0000","last_became_peered":"2023-07-09T21:51:41.890046+0000","last_unstale":"2023-07-09T21:51:42.891215+0000","last_undegraded":"2023-07-09T21:51:42.891215+0000","last_fullsized":"2023-07-09T21:51:42.891215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:55:57.803243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871236+0000","last_change":"2023-07-09T21:51:40.874084+0000","last_active":"2023-07-09T21:51:42.871236+0000","last_peered":"2023-07-09T21:51:42.871236+0000","last_clean":"2023-07-09T21:51:42.871236+0000","last_became_active":"2023-07-09T21:51:40.873733+0000","last_became_peered":"2023-07-09T21:51:40.873733+0000","last_unstale":"2023-07-09T21:51:42.871236+0000","last_undegraded":"2023-07-09T21:51:42.871236+0000","last_fullsized":"2023-07-09T21:51:42.871236+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:53:39.195027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872194+0000","last_change":"2023-07-09T21:51:41.892022+0000","last_active":"2023-07-09T21:51:42.872194+0000","last_peered":"2023-07-09T21:51:42.872194+0000","last_clean":"2023-07-09T21:51:42.872194+0000","last_became_active":"2023-07-09T21:51:41.891558+0000","last_became_peered":"2023-07-09T21:51:41.891558+0000","last_unstale":"2023-07-09T21:51:42.872194+0000","last_undegraded":"2023-07-09T21:51:42.872194+0000","last_fullsized":"2023-07-09T21:51:42.872194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:45:15.924528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871503+0000","last_change":"2023-07-09T21:51:40.863260+0000","last_active":"2023-07-09T21:51:42.871503+0000","last_peered":"2023-07-09T21:51:42.871503+0000","last_clean":"2023-07-09T21:51:42.871503+0000","last_became_active":"2023-07-09T21:51:40.862906+0000","last_became_peered":"2023-07-09T21:51:40.862906+0000","last_unstale":"2023-07-09T21:51:42.871503+0000","last_undegraded":"2023-07-09T21:51:42.871503+0000","last_fullsized":"2023-07-09T21:51:42.871503+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:45.901695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871102+0000","last_change":"2023-07-09T21:51:41.873355+0000","last_active":"2023-07-09T21:51:42.871102+0000","last_peered":"2023-07-09T21:51:42.871102+0000","last_clean":"2023-07-09T21:51:42.871102+0000","last_became_active":"2023-07-09T21:51:41.873083+0000","last_became_peered":"2023-07-09T21:51:41.873083+0000","last_unstale":"2023-07-09T21:51:42.871102+0000","last_undegraded":"2023-07-09T21:51:42.871102+0000","last_fullsized":"2023-07-09T21:51:42.871102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:06.967696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447651+0000","last_change":"2023-07-09T21:51:40.871910+0000","last_active":"2023-07-09T21:51:43.447651+0000","last_peered":"2023-07-09T21:51:43.447651+0000","last_clean":"2023-07-09T21:51:43.447651+0000","last_became_active":"2023-07-09T21:51:40.871510+0000","last_became_peered":"2023-07-09T21:51:40.871510+0000","last_unstale":"2023-07-09T21:51:43.447651+0000","last_undegraded":"2023-07-09T21:51:43.447651+0000","last_fullsized":"2023-07-09T21:51:43.447651+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:21:30.343831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.878696+0000","last_change":"2023-07-09T21:51:41.874861+0000","last_active":"2023-07-09T21:51:41.878696+0000","last_peered":"2023-07-09T21:51:41.878696+0000","last_clean":"2023-07-09T21:51:41.878696+0000","last_became_active":"2023-07-09T21:51:41.874524+0000","last_became_peered":"2023-07-09T21:51:41.874524+0000","last_unstale":"2023-07-09T21:51:41.878696+0000","last_undegraded":"2023-07-09T21:51:41.878696+0000","last_fullsized":"2023-07-09T21:51:41.878696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:03:07.824109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.856524+0000","last_change":"2023-07-09T21:51:40.877594+0000","last_active":"2023-07-09T21:51:41.856524+0000","last_peered":"2023-07-09T21:51:41.856524+0000","last_clean":"2023-07-09T21:51:41.856524+0000","last_became_active":"2023-07-09T21:51:40.877309+0000","last_became_peered":"2023-07-09T21:51:40.877309+0000","last_unstale":"2023-07-09T21:51:41.856524+0000","last_undegraded":"2023-07-09T21:51:41.856524+0000","last_fullsized":"2023-07-09T21:51:41.856524+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:49:24.347023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871260+0000","last_change":"2023-07-09T21:51:41.873934+0000","last_active":"2023-07-09T21:51:42.871260+0000","last_peered":"2023-07-09T21:51:42.871260+0000","last_clean":"2023-07-09T21:51:42.871260+0000","last_became_active":"2023-07-09T21:51:41.873662+0000","last_became_peered":"2023-07-09T21:51:41.873662+0000","last_unstale":"2023-07-09T21:51:42.871260+0000","last_undegraded":"2023-07-09T21:51:42.871260+0000","last_fullsized":"2023-07-09T21:51:42.871260+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:04:22.112776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.883702+0000","last_change":"2023-07-09T21:51:40.881061+0000","last_active":"2023-07-09T21:51:41.883702+0000","last_peered":"2023-07-09T21:51:41.883702+0000","last_clean":"2023-07-09T21:51:41.883702+0000","last_became_active":"2023-07-09T21:51:40.880725+0000","last_became_peered":"2023-07-09T21:51:40.880725+0000","last_unstale":"2023-07-09T21:51:41.883702+0000","last_undegraded":"2023-07-09T21:51:41.883702+0000","last_fullsized":"2023-07-09T21:51:41.883702+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:04:21.110508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871084+0000","last_change":"2023-07-09T21:51:41.861242+0000","last_active":"2023-07-09T21:51:42.871084+0000","last_peered":"2023-07-09T21:51:42.871084+0000","last_clean":"2023-07-09T21:51:42.871084+0000","last_became_active":"2023-07-09T21:51:41.860930+0000","last_became_peered":"2023-07-09T21:51:41.860930+0000","last_unstale":"2023-07-09T21:51:42.871084+0000","last_undegraded":"2023-07-09T21:51:42.871084+0000","last_fullsized":"2023-07-09T21:51:42.871084+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:19.686504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873369+0000","last_change":"2023-07-09T21:51:40.877586+0000","last_active":"2023-07-09T21:51:42.873369+0000","last_peered":"2023-07-09T21:51:42.873369+0000","last_clean":"2023-07-09T21:51:42.873369+0000","last_became_active":"2023-07-09T21:51:40.877296+0000","last_became_peered":"2023-07-09T21:51:40.877296+0000","last_unstale":"2023-07-09T21:51:42.873369+0000","last_undegraded":"2023-07-09T21:51:42.873369+0000","last_fullsized":"2023-07-09T21:51:42.873369+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:17.549300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873255+0000","last_change":"2023-07-09T21:51:41.889077+0000","last_active":"2023-07-09T21:51:42.873255+0000","last_peered":"2023-07-09T21:51:42.873255+0000","last_clean":"2023-07-09T21:51:42.873255+0000","last_became_active":"2023-07-09T21:51:41.888799+0000","last_became_peered":"2023-07-09T21:51:41.888799+0000","last_unstale":"2023-07-09T21:51:42.873255+0000","last_undegraded":"2023-07-09T21:51:42.873255+0000","last_fullsized":"2023-07-09T21:51:42.873255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:57:23.754598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.891230+0000","last_change":"2023-07-09T21:51:40.876658+0000","last_active":"2023-07-09T21:51:42.891230+0000","last_peered":"2023-07-09T21:51:42.891230+0000","last_clean":"2023-07-09T21:51:42.891230+0000","last_became_active":"2023-07-09T21:51:40.876233+0000","last_became_peered":"2023-07-09T21:51:40.876233+0000","last_unstale":"2023-07-09T21:51:42.891230+0000","last_undegraded":"2023-07-09T21:51:42.891230+0000","last_fullsized":"2023-07-09T21:51:42.891230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:44.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.891099+0000","last_change":"2023-07-09T21:51:41.882270+0000","last_active":"2023-07-09T21:51:42.891099+0000","last_peered":"2023-07-09T21:51:42.891099+0000","last_clean":"2023-07-09T21:51:42.891099+0000","last_became_active":"2023-07-09T21:51:41.882002+0000","last_became_peered":"2023-07-09T21:51:41.882002+0000","last_unstale":"2023-07-09T21:51:42.891099+0000","last_undegraded":"2023-07-09T21:51:42.891099+0000","last_fullsized":"2023-07-09T21:51:42.891099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:18.551568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.889497+0000","last_change":"2023-07-09T21:51:40.874960+0000","last_active":"2023-07-09T21:51:41.889497+0000","last_peered":"2023-07-09T21:51:41.889497+0000","last_clean":"2023-07-09T21:51:41.889497+0000","last_became_active":"2023-07-09T21:51:40.874700+0000","last_became_peered":"2023-07-09T21:51:40.874700+0000","last_unstale":"2023-07-09T21:51:41.889497+0000","last_undegraded":"2023-07-09T21:51:41.889497+0000","last_fullsized":"2023-07-09T21:51:41.889497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:17:41.875052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.871338+0000","last_change":"2023-07-09T21:51:41.867307+0000","last_active":"2023-07-09T21:51:41.871338+0000","last_peered":"2023-07-09T21:51:41.871338+0000","last_clean":"2023-07-09T21:51:41.871338+0000","last_became_active":"2023-07-09T21:51:41.866997+0000","last_became_peered":"2023-07-09T21:51:41.866997+0000","last_unstale":"2023-07-09T21:51:41.871338+0000","last_undegraded":"2023-07-09T21:51:41.871338+0000","last_fullsized":"2023-07-09T21:51:41.871338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:37:24.984323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447876+0000","last_change":"2023-07-09T21:51:40.873109+0000","last_active":"2023-07-09T21:51:43.447876+0000","last_peered":"2023-07-09T21:51:43.447876+0000","last_clean":"2023-07-09T21:51:43.447876+0000","last_became_active":"2023-07-09T21:51:40.872829+0000","last_became_peered":"2023-07-09T21:51:40.872829+0000","last_unstale":"2023-07-09T21:51:43.447876+0000","last_undegraded":"2023-07-09T21:51:43.447876+0000","last_fullsized":"2023-07-09T21:51:43.447876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:41:43.063908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.886893+0000","last_change":"2023-07-09T21:51:41.878983+0000","last_active":"2023-07-09T21:51:41.886893+0000","last_peered":"2023-07-09T21:51:41.886893+0000","last_clean":"2023-07-09T21:51:41.886893+0000","last_became_active":"2023-07-09T21:51:41.878177+0000","last_became_peered":"2023-07-09T21:51:41.878177+0000","last_unstale":"2023-07-09T21:51:41.886893+0000","last_undegraded":"2023-07-09T21:51:41.886893+0000","last_fullsized":"2023-07-09T21:51:41.886893+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:06.967696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.889941+0000","last_change":"2023-07-09T21:51:40.874345+0000","last_active":"2023-07-09T21:51:41.889941+0000","last_peered":"2023-07-09T21:51:41.889941+0000","last_clean":"2023-07-09T21:51:41.889941+0000","last_became_active":"2023-07-09T21:51:40.874036+0000","last_became_peered":"2023-07-09T21:51:40.874036+0000","last_unstale":"2023-07-09T21:51:41.889941+0000","last_undegraded":"2023-07-09T21:51:41.889941+0000","last_fullsized":"2023-07-09T21:51:41.889941+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:24:44.854204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872090+0000","last_change":"2023-07-09T21:51:41.882884+0000","last_active":"2023-07-09T21:51:42.872090+0000","last_peered":"2023-07-09T21:51:42.872090+0000","last_clean":"2023-07-09T21:51:42.872090+0000","last_became_active":"2023-07-09T21:51:41.882565+0000","last_became_peered":"2023-07-09T21:51:41.882565+0000","last_unstale":"2023-07-09T21:51:42.872090+0000","last_undegraded":"2023-07-09T21:51:42.872090+0000","last_fullsized":"2023-07-09T21:51:42.872090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:18:27.589211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.858750+0000","last_change":"2023-07-09T21:51:40.877516+0000","last_active":"2023-07-09T21:51:41.858750+0000","last_peered":"2023-07-09T21:51:41.858750+0000","last_clean":"2023-07-09T21:51:41.858750+0000","last_became_active":"2023-07-09T21:51:40.877202+0000","last_became_peered":"2023-07-09T21:51:40.877202+0000","last_unstale":"2023-07-09T21:51:41.858750+0000","last_undegraded":"2023-07-09T21:51:41.858750+0000","last_fullsized":"2023-07-09T21:51:41.858750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:15:16.121374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872673+0000","last_change":"2023-07-09T21:51:41.889406+0000","last_active":"2023-07-09T21:51:42.872673+0000","last_peered":"2023-07-09T21:51:42.872673+0000","last_clean":"2023-07-09T21:51:42.872673+0000","last_became_active":"2023-07-09T21:51:41.889074+0000","last_became_peered":"2023-07-09T21:51:41.889074+0000","last_unstale":"2023-07-09T21:51:42.872673+0000","last_undegraded":"2023-07-09T21:51:42.872673+0000","last_fullsized":"2023-07-09T21:51:42.872673+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:35.984955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.863217+0000","last_change":"2023-07-09T21:51:40.880135+0000","last_active":"2023-07-09T21:51:41.863217+0000","last_peered":"2023-07-09T21:51:41.863217+0000","last_clean":"2023-07-09T21:51:41.863217+0000","last_became_active":"2023-07-09T21:51:40.879836+0000","last_became_peered":"2023-07-09T21:51:40.879836+0000","last_unstale":"2023-07-09T21:51:41.863217+0000","last_undegraded":"2023-07-09T21:51:41.863217+0000","last_fullsized":"2023-07-09T21:51:41.863217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:39:59.301182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871290+0000","last_change":"2023-07-09T21:51:41.870849+0000","last_active":"2023-07-09T21:51:42.871290+0000","last_peered":"2023-07-09T21:51:42.871290+0000","last_clean":"2023-07-09T21:51:42.871290+0000","last_became_active":"2023-07-09T21:51:41.870446+0000","last_became_peered":"2023-07-09T21:51:41.870446+0000","last_unstale":"2023-07-09T21:51:42.871290+0000","last_undegraded":"2023-07-09T21:51:42.871290+0000","last_fullsized":"2023-07-09T21:51:42.871290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:21.973253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.859287+0000","last_change":"2023-07-09T21:51:40.877584+0000","last_active":"2023-07-09T21:51:41.859287+0000","last_peered":"2023-07-09T21:51:41.859287+0000","last_clean":"2023-07-09T21:51:41.859287+0000","last_became_active":"2023-07-09T21:51:40.877309+0000","last_became_peered":"2023-07-09T21:51:40.877309+0000","last_unstale":"2023-07-09T21:51:41.859287+0000","last_undegraded":"2023-07-09T21:51:41.859287+0000","last_fullsized":"2023-07-09T21:51:41.859287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:28:35.695432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872102+0000","last_change":"2023-07-09T21:51:41.870707+0000","last_active":"2023-07-09T21:51:42.872102+0000","last_peered":"2023-07-09T21:51:42.872102+0000","last_clean":"2023-07-09T21:51:42.872102+0000","last_became_active":"2023-07-09T21:51:41.870372+0000","last_became_peered":"2023-07-09T21:51:41.870372+0000","last_unstale":"2023-07-09T21:51:42.872102+0000","last_undegraded":"2023-07-09T21:51:42.872102+0000","last_fullsized":"2023-07-09T21:51:42.872102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:02:41.735102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872378+0000","last_change":"2023-07-09T21:51:40.868856+0000","last_active":"2023-07-09T21:51:42.872378+0000","last_peered":"2023-07-09T21:51:42.872378+0000","last_clean":"2023-07-09T21:51:42.872378+0000","last_became_active":"2023-07-09T21:51:40.867987+0000","last_became_peered":"2023-07-09T21:51:40.867987+0000","last_unstale":"2023-07-09T21:51:42.872378+0000","last_undegraded":"2023-07-09T21:51:42.872378+0000","last_fullsized":"2023-07-09T21:51:42.872378+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:38:35.329910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447997+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:51:43.447997+0000","last_peered":"2023-07-09T21:51:43.447997+0000","last_clean":"2023-07-09T21:51:43.447997+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:51:43.447997+0000","last_undegraded":"2023-07-09T21:51:43.447997+0000","last_fullsized":"2023-07-09T21:51:43.447997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:01:59.129256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.871160+0000","last_change":"2023-07-09T21:51:41.877326+0000","last_active":"2023-07-09T21:51:42.871160+0000","last_peered":"2023-07-09T21:51:42.871160+0000","last_clean":"2023-07-09T21:51:42.871160+0000","last_became_active":"2023-07-09T21:51:41.876867+0000","last_became_peered":"2023-07-09T21:51:41.876867+0000","last_unstale":"2023-07-09T21:51:42.871160+0000","last_undegraded":"2023-07-09T21:51:42.871160+0000","last_fullsized":"2023-07-09T21:51:42.871160+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:22.999496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872807+0000","last_change":"2023-07-09T21:51:40.867515+0000","last_active":"2023-07-09T21:51:42.872807+0000","last_peered":"2023-07-09T21:51:42.872807+0000","last_clean":"2023-07-09T21:51:42.872807+0000","last_became_active":"2023-07-09T21:51:40.867162+0000","last_became_peered":"2023-07-09T21:51:40.867162+0000","last_unstale":"2023-07-09T21:51:42.872807+0000","last_undegraded":"2023-07-09T21:51:42.872807+0000","last_fullsized":"2023-07-09T21:51:42.872807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:18.684235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872806+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:51:42.872806+0000","last_peered":"2023-07-09T21:51:42.872806+0000","last_clean":"2023-07-09T21:51:42.872806+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:51:42.872806+0000","last_undegraded":"2023-07-09T21:51:42.872806+0000","last_fullsized":"2023-07-09T21:51:42.872806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:15:43.299917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.889987+0000","last_change":"2023-07-09T21:51:41.881995+0000","last_active":"2023-07-09T21:51:41.889987+0000","last_peered":"2023-07-09T21:51:41.889987+0000","last_clean":"2023-07-09T21:51:41.889987+0000","last_became_active":"2023-07-09T21:51:41.881733+0000","last_became_peered":"2023-07-09T21:51:41.881733+0000","last_unstale":"2023-07-09T21:51:41.889987+0000","last_undegraded":"2023-07-09T21:51:41.889987+0000","last_fullsized":"2023-07-09T21:51:41.889987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:46.903963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.859715+0000","last_change":"2023-07-09T21:51:40.876279+0000","last_active":"2023-07-09T21:51:41.859715+0000","last_peered":"2023-07-09T21:51:41.859715+0000","last_clean":"2023-07-09T21:51:41.859715+0000","last_became_active":"2023-07-09T21:51:40.875909+0000","last_became_peered":"2023-07-09T21:51:40.875909+0000","last_unstale":"2023-07-09T21:51:41.859715+0000","last_undegraded":"2023-07-09T21:51:41.859715+0000","last_fullsized":"2023-07-09T21:51:41.859715+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:27:01.391231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.859094+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:51:41.859094+0000","last_peered":"2023-07-09T21:51:41.859094+0000","last_clean":"2023-07-09T21:51:41.859094+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:51:41.859094+0000","last_undegraded":"2023-07-09T21:51:41.859094+0000","last_fullsized":"2023-07-09T21:51:41.859094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:21:15.712679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873527+0000","last_change":"2023-07-09T21:51:41.886042+0000","last_active":"2023-07-09T21:51:42.873527+0000","last_peered":"2023-07-09T21:51:42.873527+0000","last_clean":"2023-07-09T21:51:42.873527+0000","last_became_active":"2023-07-09T21:51:41.885559+0000","last_became_peered":"2023-07-09T21:51:41.885559+0000","last_unstale":"2023-07-09T21:51:42.873527+0000","last_undegraded":"2023-07-09T21:51:42.873527+0000","last_fullsized":"2023-07-09T21:51:42.873527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:45.529766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.863153+0000","last_change":"2023-07-09T21:51:40.878610+0000","last_active":"2023-07-09T21:51:41.863153+0000","last_peered":"2023-07-09T21:51:41.863153+0000","last_clean":"2023-07-09T21:51:41.863153+0000","last_became_active":"2023-07-09T21:51:40.878339+0000","last_became_peered":"2023-07-09T21:51:40.878339+0000","last_unstale":"2023-07-09T21:51:41.863153+0000","last_undegraded":"2023-07-09T21:51:41.863153+0000","last_fullsized":"2023-07-09T21:51:41.863153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:35.323686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.872835+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:51:42.872835+0000","last_peered":"2023-07-09T21:51:42.872835+0000","last_clean":"2023-07-09T21:51:42.872835+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:51:42.872835+0000","last_undegraded":"2023-07-09T21:51:42.872835+0000","last_fullsized":"2023-07-09T21:51:42.872835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:16:35.201305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.863908+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:51:41.863908+0000","last_peered":"2023-07-09T21:51:41.863908+0000","last_clean":"2023-07-09T21:51:41.863908+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:51:41.863908+0000","last_undegraded":"2023-07-09T21:51:41.863908+0000","last_fullsized":"2023-07-09T21:51:41.863908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:50.256852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447907+0000","last_change":"2023-07-09T21:51:41.889931+0000","last_active":"2023-07-09T21:51:43.447907+0000","last_peered":"2023-07-09T21:51:43.447907+0000","last_clean":"2023-07-09T21:51:43.447907+0000","last_became_active":"2023-07-09T21:51:41.889621+0000","last_became_peered":"2023-07-09T21:51:41.889621+0000","last_unstale":"2023-07-09T21:51:43.447907+0000","last_undegraded":"2023-07-09T21:51:43.447907+0000","last_fullsized":"2023-07-09T21:51:43.447907+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:46:15.758055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.873563+0000","last_change":"2023-07-09T21:51:40.878258+0000","last_active":"2023-07-09T21:51:42.873563+0000","last_peered":"2023-07-09T21:51:42.873563+0000","last_clean":"2023-07-09T21:51:42.873563+0000","last_became_active":"2023-07-09T21:51:40.877804+0000","last_became_peered":"2023-07-09T21:51:40.877804+0000","last_unstale":"2023-07-09T21:51:42.873563+0000","last_undegraded":"2023-07-09T21:51:42.873563+0000","last_fullsized":"2023-07-09T21:51:42.873563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:04.791214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.863930+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:51:41.863930+0000","last_peered":"2023-07-09T21:51:41.863930+0000","last_clean":"2023-07-09T21:51:41.863930+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:51:41.863930+0000","last_undegraded":"2023-07-09T21:51:41.863930+0000","last_fullsized":"2023-07-09T21:51:41.863930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:57:41.397452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447853+0000","last_change":"2023-07-09T21:51:41.865234+0000","last_active":"2023-07-09T21:51:43.447853+0000","last_peered":"2023-07-09T21:51:43.447853+0000","last_clean":"2023-07-09T21:51:43.447853+0000","last_became_active":"2023-07-09T21:51:41.864978+0000","last_became_peered":"2023-07-09T21:51:41.864978+0000","last_unstale":"2023-07-09T21:51:43.447853+0000","last_undegraded":"2023-07-09T21:51:43.447853+0000","last_fullsized":"2023-07-09T21:51:43.447853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:55:06.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.856727+0000","last_change":"2023-07-09T21:51:40.866903+0000","last_active":"2023-07-09T21:51:41.856727+0000","last_peered":"2023-07-09T21:51:41.856727+0000","last_clean":"2023-07-09T21:51:41.856727+0000","last_became_active":"2023-07-09T21:51:40.866362+0000","last_became_peered":"2023-07-09T21:51:40.866362+0000","last_unstale":"2023-07-09T21:51:41.856727+0000","last_undegraded":"2023-07-09T21:51:41.856727+0000","last_fullsized":"2023-07-09T21:51:41.856727+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:24:44.854204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.864259+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:51:41.864259+0000","last_peered":"2023-07-09T21:51:41.864259+0000","last_clean":"2023-07-09T21:51:41.864259+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:51:41.864259+0000","last_undegraded":"2023-07-09T21:51:41.864259+0000","last_fullsized":"2023-07-09T21:51:41.864259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:14:32.469590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.891060+0000","last_change":"2023-07-09T21:51:41.877533+0000","last_active":"2023-07-09T21:51:42.891060+0000","last_peered":"2023-07-09T21:51:42.891060+0000","last_clean":"2023-07-09T21:51:42.891060+0000","last_became_active":"2023-07-09T21:51:41.877266+0000","last_became_peered":"2023-07-09T21:51:41.877266+0000","last_unstale":"2023-07-09T21:51:42.891060+0000","last_undegraded":"2023-07-09T21:51:42.891060+0000","last_fullsized":"2023-07-09T21:51:42.891060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:14.827232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.890841+0000","last_change":"2023-07-09T21:51:40.873357+0000","last_active":"2023-07-09T21:51:42.890841+0000","last_peered":"2023-07-09T21:51:42.890841+0000","last_clean":"2023-07-09T21:51:42.890841+0000","last_became_active":"2023-07-09T21:51:40.873044+0000","last_became_peered":"2023-07-09T21:51:40.873044+0000","last_unstale":"2023-07-09T21:51:42.890841+0000","last_undegraded":"2023-07-09T21:51:42.890841+0000","last_fullsized":"2023-07-09T21:51:42.890841+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:03:47.673733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:43.447890+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:51:43.447890+0000","last_peered":"2023-07-09T21:51:43.447890+0000","last_clean":"2023-07-09T21:51:43.447890+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:51:43.447890+0000","last_undegraded":"2023-07-09T21:51:43.447890+0000","last_fullsized":"2023-07-09T21:51:43.447890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:26:21.519999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.890120+0000","last_change":"2023-07-09T21:51:41.884378+0000","last_active":"2023-07-09T21:51:41.890120+0000","last_peered":"2023-07-09T21:51:41.890120+0000","last_clean":"2023-07-09T21:51:41.890120+0000","last_became_active":"2023-07-09T21:51:41.883514+0000","last_became_peered":"2023-07-09T21:51:41.883514+0000","last_unstale":"2023-07-09T21:51:41.890120+0000","last_undegraded":"2023-07-09T21:51:41.890120+0000","last_fullsized":"2023-07-09T21:51:41.890120+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:40.845932+0000","last_clean_scrub_stamp":"2023-07-09T21:51:40.845932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:35:30.427888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-09T21:51:42.870889+0000","last_change":"2023-07-09T21:51:40.869692+0000","last_active":"2023-07-09T21:51:42.870889+0000","last_peered":"2023-07-09T21:51:42.870889+0000","last_clean":"2023-07-09T21:51:42.870889+0000","last_became_active":"2023-07-09T21:51:40.869421+0000","last_became_peered":"2023-07-09T21:51:40.869421+0000","last_unstale":"2023-07-09T21:51:42.870889+0000","last_undegraded":"2023-07-09T21:51:42.870889+0000","last_fullsized":"2023-07-09T21:51:42.870889+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:51:39.843663+0000","last_clean_scrub_stamp":"2023-07-09T21:51:39.843663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:35.323686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:51:41.857770+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:51:41.857770+0000","last_peered":"2023-07-09T21:51:41.857770+0000","last_clean":"2023-07-09T21:51:41.857770+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:51:41.857770+0000","last_undegraded":"2023-07-09T21:51:41.857770+0000","last_fullsized":"2023-07-09T21:51:41.857770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:27:12.376523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":434176,"data_stored":177722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71399999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":4.2229999999999999,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.629}]},{"osd":2,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":4.3049999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.754}]},{"osd":3,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.85199999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.56100000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.72799999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":417792,"data_stored":170555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.8540000000000001,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.39700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.434},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.41799999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.623}]},{"osd":5,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.52400000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.57499999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.66500000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":170535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":16.946000000000002,"5min":16.946000000000002,"15min":16.946000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":9.5449999999999999,"5min":9.5449999999999999,"15min":9.5449999999999999},"last":0.48699999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":9.6950000000000003,"5min":9.6950000000000003,"15min":9.6950000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":9.3659999999999997,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.36799999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":9.2840000000000007,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":17.004000000000001,"5min":17.004000000000001,"15min":17.004000000000001},"last":0.41899999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":6.2510000000000003,"5min":6.2510000000000003,"15min":6.2510000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":9.6630000000000003,"5min":9.6630000000000003,"15min":9.6630000000000003},"last":0.84099999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":6.1710000000000003,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":9.5879999999999992,"5min":9.5879999999999992,"15min":9.5879999999999992},"last":0.67400000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":9.6289999999999996,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":9.2319999999999993,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":0.81299999999999994}]},{"osd":7,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":9.3190000000000008,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":6.2169999999999996,"5min":6.2169999999999996,"15min":6.2169999999999996},"last":0.82499999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":1011712,"data_stored":760867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":11.949999999999999,"5min":11.949999999999999,"15min":11.949999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39800000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":23.010999999999999,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":10.952,"5min":10.952,"15min":10.952},"last":0.505}]},{"osd":4,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":22.974,"5min":22.974,"15min":22.974},"last":0.52500000000000002},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":11.904999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.55900000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.925,"5min":1.925,"15min":1.925},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":22.933,"5min":22.933,"15min":22.933},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.919,"5min":1.919,"15min":1.919},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":22.867999999999999,"5min":22.867999999999999,"15min":22.867999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":10.907999999999999,"5min":10.907999999999999,"15min":10.907999999999999},"last":0.627},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.61499999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":1024000,"data_stored":762467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.70299999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67500000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.78100000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.621}]},{"osd":5,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.748},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.80400000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.85099999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":430080,"data_stored":172063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":11.874000000000001,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.37}]},{"osd":1,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.41199999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.628},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.61199999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":421888,"data_stored":170577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.58099999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.63100000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.64200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.443},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.51900000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":171047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.628},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.52000000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.46400000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.48699999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.57799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:51:46.809 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T21:51:46.810 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T21:51:47.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.050+0000 7faef3dff700 1 Processor -- start 2023-07-09T21:51:47.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.050+0000 7faef3dff700 1 -- start start 2023-07-09T21:51:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.051+0000 7faef3dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeec0b4f70 0x7faeec0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.051+0000 7faef3dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faeec0d12c0 0x7faeec0d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.051+0000 7faef3dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeec0d02a0 con 0x7faeec0cd430 2023-07-09T21:51:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.051+0000 7faef3dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeec0cfce0 con 0x7faeec0d12c0 2023-07-09T21:51:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.051+0000 7faef3dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0cffc0 con 0x7faeec0b4f70 2023-07-09T21:51:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.052+0000 7faef239c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faeec0d12c0 0x7faeec0d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.052+0000 7faef239c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faeec0d12c0 0x7faeec0d1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50166/0 (socket says 172.21.15.53:50166) 2023-07-09T21:51:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.052+0000 7faef239c700 1 -- 172.21.15.53:0/1732765447 learned_addr learned my addr 172.21.15.53:0/1732765447 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:47.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.052+0000 7faef139a700 1 --2- 172.21.15.53:0/1732765447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeec0b4f70 0x7faeec0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:47.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.052+0000 7faef239c700 1 -- 172.21.15.53:0/1732765447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeec0b4f70 msgr2=0x7faeec0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:47.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.052+0000 7faef239c700 1 --2- 172.21.15.53:0/1732765447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeec0b4f70 0x7faeec0cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.052+0000 7faef239c700 1 -- 172.21.15.53:0/1732765447 >> v1:172.21.15.184:6789/0 conn(0x7faeec0cd430 legacy=0x7faeec0b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:47.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.052+0000 7faef239c700 1 -- 172.21.15.53:0/1732765447 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec0d0ac0 con 0x7faeec0d12c0 2023-07-09T21:51:47.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.052+0000 7faef0b99700 1 -- 172.21.15.53:0/1732765447 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476711652 0 0) 0x7faeec0d02a0 con 0x7faeec0cd430 2023-07-09T21:51:47.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.052+0000 7faef239c700 1 --2- 172.21.15.53:0/1732765447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeec0d12c0 0x7faeec0d1700 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faee4009e50 tx=0x7faee400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82bd25d4953c3b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.053+0000 7faef0b99700 1 -- 172.21.15.53:0/1732765447 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400e070 con 0x7faeec0d12c0 2023-07-09T21:51:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.053+0000 7faef0b99700 1 -- 172.21.15.53:0/1732765447 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee400b910 con 0x7faeec0d12c0 2023-07-09T21:51:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.053+0000 7faef0b99700 1 -- 172.21.15.53:0/1732765447 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400bcc0 con 0x7faeec0d12c0 2023-07-09T21:51:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.053+0000 7faef3dff700 1 -- 172.21.15.53:0/1732765447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeec0d12c0 msgr2=0x7faeec0d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.053+0000 7faef3dff700 1 --2- 172.21.15.53:0/1732765447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeec0d12c0 0x7faeec0d1700 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faee4009e50 tx=0x7faee400b330 comp rx=0 tx=0).stop 2023-07-09T21:51:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.053+0000 7faef3dff700 1 -- 172.21.15.53:0/1732765447 shutdown_connections 2023-07-09T21:51:47.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.053+0000 7faef3dff700 1 --2- 172.21.15.53:0/1732765447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeec0d12c0 0x7faeec0d1700 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.053+0000 7faef3dff700 1 --2- 172.21.15.53:0/1732765447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeec0b4f70 0x7faeec0cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.053+0000 7faef3dff700 1 -- 172.21.15.53:0/1732765447 >> 172.21.15.53:0/1732765447 conn(0x7faeec066860 msgr2=0x7faeec06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:47.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.053+0000 7faef3dff700 1 -- 172.21.15.53:0/1732765447 shutdown_connections 2023-07-09T21:51:47.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.054+0000 7faef3dff700 1 -- 172.21.15.53:0/1732765447 wait complete. 2023-07-09T21:51:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.055+0000 7faef3dff700 1 Processor -- start 2023-07-09T21:51:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.055+0000 7faef3dff700 1 -- start start 2023-07-09T21:51:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.056+0000 7faef3dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeec0b4f70 0x7faeec153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.056+0000 7faef3dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeec0cd430 0x7faeec0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.056+0000 7faef3dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeec0d12c0 0x7faeec0c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.056+0000 7faef3dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0cb6a0 con 0x7faeec0cd430 2023-07-09T21:51:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.056+0000 7faef3dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec1548f0 con 0x7faeec0b4f70 2023-07-09T21:51:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.056+0000 7faef3dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0caa90 con 0x7faeec0d12c0 2023-07-09T21:51:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.057+0000 7faef139a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeec0cd430 0x7faeec0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.057+0000 7faef139a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeec0cd430 0x7faeec0c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50174/0 (socket says 172.21.15.53:50174) 2023-07-09T21:51:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.057+0000 7faef139a700 1 -- 172.21.15.53:0/2771072658 learned_addr learned my addr 172.21.15.53:0/2771072658 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.057+0000 7faef139a700 1 -- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeec0d12c0 msgr2=0x7faeec0c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.057+0000 7faef239c700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeec0d12c0 0x7faeec0c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.057+0000 7faef1b9b700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeec0b4f70 0x7faeec153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.057+0000 7faef139a700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeec0d12c0 0x7faeec0c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.057+0000 7faef139a700 1 -- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeec0b4f70 msgr2=0x7faeec153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.057+0000 7faef139a700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeec0b4f70 0x7faeec153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.057+0000 7faef139a700 1 -- 172.21.15.53:0/2771072658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee4009b30 con 0x7faeec0cd430 2023-07-09T21:51:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.057+0000 7faef239c700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeec0d12c0 0x7faeec0c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.057+0000 7faef1b9b700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeec0b4f70 0x7faeec153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.057+0000 7faef139a700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeec0cd430 0x7faeec0c8180 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7faedc00e980 tx=0x7faedc00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.058+0000 7faee27fc700 1 -- 172.21.15.53:0/2771072658 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc009710 con 0x7faeec0cd430 2023-07-09T21:51:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.058+0000 7faee27fc700 1 -- 172.21.15.53:0/2771072658 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc00c850 con 0x7faeec0cd430 2023-07-09T21:51:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.058+0000 7faef3dff700 1 -- 172.21.15.53:0/2771072658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec0cad70 con 0x7faeec0cd430 2023-07-09T21:51:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.058+0000 7faee27fc700 1 -- 172.21.15.53:0/2771072658 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00cc00 con 0x7faeec0cd430 2023-07-09T21:51:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.058+0000 7faef3dff700 1 -- 172.21.15.53:0/2771072658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec0cb330 con 0x7faeec0cd430 2023-07-09T21:51:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.059+0000 7faef3dff700 1 -- 172.21.15.53:0/2771072658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeec074350 con 0x7faeec0cd430 2023-07-09T21:51:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.060+0000 7faee27fc700 1 -- 172.21.15.53:0/2771072658 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faedc013470 con 0x7faeec0cd430 2023-07-09T21:51:47.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.061+0000 7faee27fc700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7faed006ace0 0x7faed006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:47.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.061+0000 7faee27fc700 1 -- 172.21.15.53:0/2771072658 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faedc089610 con 0x7faeec0cd430 2023-07-09T21:51:47.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.061+0000 7faef1b9b700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7faed006ace0 0x7faed006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:47.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.062+0000 7faef1b9b700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7faed006ace0 0x7faed006d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faee8000f60 tx=0x7faee8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:47.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.065+0000 7faee27fc700 1 -- 172.21.15.53:0/2771072658 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faedc058200 con 0x7faeec0cd430 2023-07-09T21:51:47.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.359+0000 7faef3dff700 1 -- 172.21.15.53:0/2771072658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7faeec0cb7e0 con 0x7faeec0cd430 2023-07-09T21:51:47.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.363+0000 7faee27fc700 1 -- 172.21.15.53:0/2771072658 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7faedc057d90 con 0x7faeec0cd430 2023-07-09T21:51:47.365 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2023-07-09T21:51:47.365 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBbK6tkVu19ABAApbFrRRJdrT0qBJ/fG9bEVA== 2023-07-09T21:51:47.365 INFO:teuthology.orchestra.run.smithi053.stdout: caps mds = "allow" 2023-07-09T21:51:47.366 INFO:teuthology.orchestra.run.smithi053.stdout: caps mon = "allow r" 2023-07-09T21:51:47.366 INFO:teuthology.orchestra.run.smithi053.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T21:51:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.366+0000 7faef3dff700 1 -- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7faed006ace0 msgr2=0x7faed006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.366+0000 7faef3dff700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7faed006ace0 0x7faed006d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faee8000f60 tx=0x7faee8009040 comp rx=0 tx=0).stop 2023-07-09T21:51:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.366+0000 7faef3dff700 1 -- 172.21.15.53:0/2771072658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeec0cd430 msgr2=0x7faeec0c8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.366+0000 7faef3dff700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeec0cd430 0x7faeec0c8180 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7faedc00e980 tx=0x7faedc00ed40 comp rx=0 tx=0).stop 2023-07-09T21:51:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.366+0000 7faef3dff700 1 -- 172.21.15.53:0/2771072658 shutdown_connections 2023-07-09T21:51:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.366+0000 7faef3dff700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7faed006ace0 0x7faed006d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.366+0000 7faef3dff700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeec0d12c0 0x7faeec0c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.366+0000 7faef3dff700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeec0b4f70 0x7faeec153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.366+0000 7faef3dff700 1 --2- 172.21.15.53:0/2771072658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeec0cd430 0x7faeec0c8180 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.366+0000 7faef3dff700 1 -- 172.21.15.53:0/2771072658 >> 172.21.15.53:0/2771072658 conn(0x7faeec066860 msgr2=0x7faeec0b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.366+0000 7faef3dff700 1 -- 172.21.15.53:0/2771072658 shutdown_connections 2023-07-09T21:51:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.366+0000 7faef3dff700 1 -- 172.21.15.53:0/2771072658 wait complete. 2023-07-09T21:51:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2023-07-09T21:51:47.385 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:51:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.583+0000 7fce133ff700 1 Processor -- start 2023-07-09T21:51:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.584+0000 7fce133ff700 1 -- start start 2023-07-09T21:51:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.585+0000 7fce133ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fce0c0d1220 0x7fce0c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.585+0000 7fce133ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce0c0b2350 0x7fce0c0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.585+0000 7fce133ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0c0d2ce0 con 0x7fce0c0b1e00 2023-07-09T21:51:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.585+0000 7fce133ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0c0b3350 con 0x7fce0c0d1220 2023-07-09T21:51:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.585+0000 7fce133ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0b3630 con 0x7fce0c0b2350 2023-07-09T21:51:47.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.585+0000 7fce1119b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fce0c0b1e00 0x7fce0c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58382/0 (socket says 172.21.15.53:58382) 2023-07-09T21:51:47.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.585+0000 7fce1119b700 1 -- 172.21.15.53:0/2883946636 learned_addr learned my addr 172.21.15.53:0/2883946636 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:47.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.585+0000 7fce1199c700 1 --2- 172.21.15.53:0/2883946636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce0c0b2350 0x7fce0c0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:47.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.585+0000 7fce1099a700 1 --2- 172.21.15.53:0/2883946636 >> v2:172.21.15.184:3300/0 conn(0x7fce0c0d1220 0x7fce0c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:47.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.586+0000 7fce03fff700 1 -- 172.21.15.53:0/2883946636 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583535249 0 0) 0x7fce0c0d2ce0 con 0x7fce0c0b1e00 2023-07-09T21:51:47.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.586+0000 7fce03fff700 1 -- 172.21.15.53:0/2883946636 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf80035b0 con 0x7fce0c0b1e00 2023-07-09T21:51:47.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.586+0000 7fce1199c700 1 -- 172.21.15.53:0/2883946636 >> v2:172.21.15.184:3300/0 conn(0x7fce0c0d1220 msgr2=0x7fce0c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:47.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.586+0000 7fce1199c700 1 --2- 172.21.15.53:0/2883946636 >> v2:172.21.15.184:3300/0 conn(0x7fce0c0d1220 0x7fce0c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.586+0000 7fce1199c700 1 -- 172.21.15.53:0/2883946636 >> v1:172.21.15.53:6789/0 conn(0x7fce0c0b1e00 legacy=0x7fce0c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:47.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.586+0000 7fce1199c700 1 -- 172.21.15.53:0/2883946636 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c0b3910 con 0x7fce0c0b2350 2023-07-09T21:51:47.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.586+0000 7fce1199c700 1 --2- 172.21.15.53:0/2883946636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce0c0b2350 0x7fce0c0afac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce04009d90 tx=0x7fce0400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a4a50f980eeb65 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:47.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.586+0000 7fce03fff700 1 -- 172.21.15.53:0/2883946636 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0400e070 con 0x7fce0c0b2350 2023-07-09T21:51:47.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.586+0000 7fce03fff700 1 -- 172.21.15.53:0/2883946636 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0400bb20 con 0x7fce0c0b2350 2023-07-09T21:51:47.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.586+0000 7fce03fff700 1 -- 172.21.15.53:0/2883946636 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04012430 con 0x7fce0c0b2350 2023-07-09T21:51:47.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.587+0000 7fce133ff700 1 -- 172.21.15.53:0/2883946636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce0c0b2350 msgr2=0x7fce0c0afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:47.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.587+0000 7fce133ff700 1 --2- 172.21.15.53:0/2883946636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce0c0b2350 0x7fce0c0afac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce04009d90 tx=0x7fce0400b330 comp rx=0 tx=0).stop 2023-07-09T21:51:47.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.587+0000 7fce133ff700 1 -- 172.21.15.53:0/2883946636 shutdown_connections 2023-07-09T21:51:47.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.587+0000 7fce133ff700 1 --2- 172.21.15.53:0/2883946636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce0c0b2350 0x7fce0c0afac0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.587+0000 7fce133ff700 1 --2- 172.21.15.53:0/2883946636 >> v2:172.21.15.184:3300/0 conn(0x7fce0c0d1220 0x7fce0c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.587+0000 7fce133ff700 1 -- 172.21.15.53:0/2883946636 >> 172.21.15.53:0/2883946636 conn(0x7fce0c09c1d0 msgr2=0x7fce0c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:47.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.587+0000 7fce133ff700 1 -- 172.21.15.53:0/2883946636 shutdown_connections 2023-07-09T21:51:47.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.587+0000 7fce133ff700 1 -- 172.21.15.53:0/2883946636 wait complete. 2023-07-09T21:51:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.589+0000 7fce133ff700 1 Processor -- start 2023-07-09T21:51:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.589+0000 7fce133ff700 1 -- start start 2023-07-09T21:51:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.590+0000 7fce133ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce0c0b1e00 0x7fce0c1492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.590+0000 7fce133ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c0b2350 0x7fce0c0b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.590+0000 7fce133ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0c0d1220 0x7fce0c0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.590+0000 7fce133ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0c71a0 con 0x7fce0c0b2350 2023-07-09T21:51:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.590+0000 7fce133ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0b8660 con 0x7fce0c0d1220 2023-07-09T21:51:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.590+0000 7fce133ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0b8940 con 0x7fce0c0b1e00 2023-07-09T21:51:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.590+0000 7fce1099a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c0b2350 0x7fce0c0b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.590+0000 7fce1099a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c0b2350 0x7fce0c0b5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50180/0 (socket says 172.21.15.53:50180) 2023-07-09T21:51:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.590+0000 7fce1099a700 1 -- 172.21.15.53:0/3386262957 learned_addr learned my addr 172.21.15.53:0/3386262957 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.591+0000 7fce1119b700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce0c0b1e00 0x7fce0c1492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.591+0000 7fce1099a700 1 -- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce0c0b1e00 msgr2=0x7fce0c1492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.591+0000 7fce1099a700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce0c0b1e00 0x7fce0c1492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.591+0000 7fce1099a700 1 -- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0c0d1220 msgr2=0x7fce0c0b7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.591+0000 7fce1099a700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0c0d1220 0x7fce0c0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.591+0000 7fce1099a700 1 -- 172.21.15.53:0/3386262957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce04009a70 con 0x7fce0c0b2350 2023-07-09T21:51:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.591+0000 7fce1119b700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce0c0b1e00 0x7fce0c1492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.591+0000 7fce1099a700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c0b2350 0x7fce0c0b5d70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00e840 tx=0x7fcdfc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.591+0000 7fce01ffb700 1 -- 172.21.15.53:0/3386262957 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc009590 con 0x7fce0c0b2350 2023-07-09T21:51:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.591+0000 7fce01ffb700 1 -- 172.21.15.53:0/3386262957 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc013680 con 0x7fce0c0b2350 2023-07-09T21:51:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.591+0000 7fce133ff700 1 -- 172.21.15.53:0/3386262957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c0c6dc0 con 0x7fce0c0b2350 2023-07-09T21:51:47.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.591+0000 7fce01ffb700 1 -- 172.21.15.53:0/3386262957 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc013a30 con 0x7fce0c0b2350 2023-07-09T21:51:47.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.591+0000 7fce133ff700 1 -- 172.21.15.53:0/3386262957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c0b8c20 con 0x7fce0c0b2350 2023-07-09T21:51:47.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.592+0000 7fce133ff700 1 -- 172.21.15.53:0/3386262957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c0b3eb0 con 0x7fce0c0b2350 2023-07-09T21:51:47.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.593+0000 7fce01ffb700 1 -- 172.21.15.53:0/3386262957 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcdfc013b90 con 0x7fce0c0b2350 2023-07-09T21:51:47.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.595+0000 7fce01ffb700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcdf006ace0 0x7fcdf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:47.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.595+0000 7fce01ffb700 1 -- 172.21.15.53:0/3386262957 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcdfc0894a0 con 0x7fce0c0b2350 2023-07-09T21:51:47.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.596+0000 7fce1119b700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcdf006ace0 0x7fcdf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:47.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.596+0000 7fce1119b700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcdf006ace0 0x7fcdf006d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fce080010e0 tx=0x7fce08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:47.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.599+0000 7fce01ffb700 1 -- 172.21.15.53:0/3386262957 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fce0c0b3eb0 con 0x7fce0c0b2350 2023-07-09T21:51:47.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.853+0000 7fce133ff700 1 -- 172.21.15.53:0/3386262957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce0c0c72e0 con 0x7fce0c0b2350 2023-07-09T21:51:47.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.854+0000 7fce01ffb700 1 -- 172.21.15.53:0/3386262957 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fce0c0c72e0 con 0x7fce0c0b2350 2023-07-09T21:51:47.855 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:47.855 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2100879728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2100879728},{"type":"v1","addr":"172.21.15.184:6837","nonce":2100879728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3650266673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3650266673},{"type":"v1","addr":"172.21.15.53:6834","nonce":3650266673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1905516924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1905516924},{"type":"v1","addr":"172.21.15.53:6835","nonce":1905516924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:51:41.406886+0000","modified":"2023-07-09T21:51:44.882338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5107},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5107":{"gid":5107,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6836/3388102458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3388102458},{"type":"v1","addr":"172.21.15.184:6836","nonce":3388102458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T21:51:47.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.856+0000 7fce133ff700 1 -- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcdf006ace0 msgr2=0x7fcdf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:47.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.856+0000 7fce133ff700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcdf006ace0 0x7fcdf006d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fce080010e0 tx=0x7fce08009040 comp rx=0 tx=0).stop 2023-07-09T21:51:47.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.856+0000 7fce133ff700 1 -- 172.21.15.53:0/3386262957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c0b2350 msgr2=0x7fce0c0b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:47.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.856+0000 7fce133ff700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c0b2350 0x7fce0c0b5d70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00e840 tx=0x7fcdfc00ec00 comp rx=0 tx=0).stop 2023-07-09T21:51:47.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.856+0000 7fce133ff700 1 -- 172.21.15.53:0/3386262957 shutdown_connections 2023-07-09T21:51:47.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.856+0000 7fce133ff700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcdf006ace0 0x7fcdf006d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.856+0000 7fce133ff700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0c0d1220 0x7fce0c0b7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.856+0000 7fce133ff700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce0c0b1e00 0x7fce0c1492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.856+0000 7fce133ff700 1 --2- 172.21.15.53:0/3386262957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c0b2350 0x7fce0c0b5d70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:47.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.856+0000 7fce133ff700 1 -- 172.21.15.53:0/3386262957 >> 172.21.15.53:0/3386262957 conn(0x7fce0c09c1d0 msgr2=0x7fce0c0b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:47.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.856+0000 7fce133ff700 1 -- 172.21.15.53:0/3386262957 shutdown_connections 2023-07-09T21:51:47.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:47.856+0000 7fce133ff700 1 -- 172.21.15.53:0/3386262957 wait complete. 2023-07-09T21:51:47.859 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 17 2023-07-09T21:51:48.278 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T21:51:41.406886+0000', 'modified': '2023-07-09T21:51:44.882338+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5107}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5107': {'gid': 5107, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.184:6836/3388102458', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 3388102458}, {'type': 'v1', 'addr': '172.21.15.184:6836', 'nonce': 3388102458}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T21:51:48.279 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T21:51:48.279 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-09T21:51:48.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.482+0000 7f7e4a3ff700 1 Processor -- start 2023-07-09T21:51:48.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.482+0000 7f7e4a3ff700 1 -- start start 2023-07-09T21:51:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.483+0000 7f7e4a3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e440b3ff0 0x7f7e440b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.483+0000 7f7e4a3ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7e440d0f60 0x7f7e440b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.483+0000 7f7e4a3ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e440b8e80 con 0x7f7e440d0b10 2023-07-09T21:51:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.483+0000 7f7e4a3ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e440b1e30 con 0x7f7e440d0f60 2023-07-09T21:51:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.483+0000 7f7e4a3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440afaa0 con 0x7f7e440b3ff0 2023-07-09T21:51:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.484+0000 7f7e437fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7e440d0b10 0x7f7e440b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58386/0 (socket says 172.21.15.53:58386) 2023-07-09T21:51:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.484+0000 7f7e437fe700 1 -- 172.21.15.53:0/1681688262 learned_addr learned my addr 172.21.15.53:0/1681688262 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:48.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.484+0000 7f7e4899c700 1 --2- 172.21.15.53:0/1681688262 >> v2:172.21.15.184:3300/0 conn(0x7f7e440d0f60 0x7f7e440b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.484+0000 7f7e43fff700 1 --2- 172.21.15.53:0/1681688262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e440b3ff0 0x7f7e440b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.484+0000 7f7e42ffd700 1 -- 172.21.15.53:0/1681688262 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285060124 0 0) 0x7f7e38001110 con 0x7f7e440d0b10 2023-07-09T21:51:48.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.484+0000 7f7e42ffd700 1 -- 172.21.15.53:0/1681688262 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e2c0035b0 con 0x7f7e440d0b10 2023-07-09T21:51:48.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.484+0000 7f7e43fff700 1 -- 172.21.15.53:0/1681688262 >> v2:172.21.15.184:3300/0 conn(0x7f7e440d0f60 msgr2=0x7f7e440b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.484+0000 7f7e43fff700 1 --2- 172.21.15.53:0/1681688262 >> v2:172.21.15.184:3300/0 conn(0x7f7e440d0f60 0x7f7e440b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.484+0000 7f7e43fff700 1 -- 172.21.15.53:0/1681688262 >> v1:172.21.15.53:6789/0 conn(0x7f7e440d0b10 legacy=0x7f7e440b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.485+0000 7f7e43fff700 1 -- 172.21.15.53:0/1681688262 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440afd80 con 0x7f7e440b3ff0 2023-07-09T21:51:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.485+0000 7f7e4899c700 1 --2- 172.21.15.53:0/1681688262 >> v2:172.21.15.184:3300/0 conn(0x7f7e440d0f60 0x7f7e440b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.485+0000 7f7e43fff700 1 --2- 172.21.15.53:0/1681688262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e440b3ff0 0x7f7e440b43c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009840 tx=0x7f7e34009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a1db8d2c256127 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.485+0000 7f7e42ffd700 1 -- 172.21.15.53:0/1681688262 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34011830 con 0x7f7e440b3ff0 2023-07-09T21:51:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.485+0000 7f7e42ffd700 1 -- 172.21.15.53:0/1681688262 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e34011990 con 0x7f7e440b3ff0 2023-07-09T21:51:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.485+0000 7f7e42ffd700 1 -- 172.21.15.53:0/1681688262 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34011d00 con 0x7f7e440b3ff0 2023-07-09T21:51:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.486+0000 7f7e4a3ff700 1 -- 172.21.15.53:0/1681688262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e440b3ff0 msgr2=0x7f7e440b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.486+0000 7f7e4a3ff700 1 --2- 172.21.15.53:0/1681688262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e440b3ff0 0x7f7e440b43c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009840 tx=0x7f7e34009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.486+0000 7f7e4a3ff700 1 -- 172.21.15.53:0/1681688262 shutdown_connections 2023-07-09T21:51:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.486+0000 7f7e4a3ff700 1 --2- 172.21.15.53:0/1681688262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e440b3ff0 0x7f7e440b43c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.486+0000 7f7e4a3ff700 1 --2- 172.21.15.53:0/1681688262 >> v2:172.21.15.184:3300/0 conn(0x7f7e440d0f60 0x7f7e440b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.486+0000 7f7e4a3ff700 1 -- 172.21.15.53:0/1681688262 >> 172.21.15.53:0/1681688262 conn(0x7f7e4409c1b0 msgr2=0x7f7e440d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.486+0000 7f7e4a3ff700 1 -- 172.21.15.53:0/1681688262 shutdown_connections 2023-07-09T21:51:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.486+0000 7f7e4a3ff700 1 -- 172.21.15.53:0/1681688262 wait complete. 2023-07-09T21:51:48.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.488+0000 7f7e4a3ff700 1 Processor -- start 2023-07-09T21:51:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.488+0000 7f7e4a3ff700 1 -- start start 2023-07-09T21:51:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e4a3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e440b3ff0 0x7f7e44157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e4a3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e440d0b10 0x7f7e44157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e4a3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e440d0f60 0x7f7e4415e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e4a3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440d08d0 con 0x7f7e440d0b10 2023-07-09T21:51:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e4a3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4415eed0 con 0x7f7e440b3ff0 2023-07-09T21:51:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e4a3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e441581a0 con 0x7f7e440d0f60 2023-07-09T21:51:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e440d0b10 0x7f7e44157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e440d0b10 0x7f7e44157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50188/0 (socket says 172.21.15.53:50188) 2023-07-09T21:51:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e437fe700 1 -- 172.21.15.53:0/1516199955 learned_addr learned my addr 172.21.15.53:0/1516199955 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e43fff700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e440b3ff0 0x7f7e44157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e4899c700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e440d0f60 0x7f7e4415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e437fe700 1 -- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e440d0f60 msgr2=0x7f7e4415e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e437fe700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e440d0f60 0x7f7e4415e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e437fe700 1 -- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e440b3ff0 msgr2=0x7f7e44157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e437fe700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e440b3ff0 0x7f7e44157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e437fe700 1 -- 172.21.15.53:0/1516199955 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c009a70 con 0x7f7e440d0b10 2023-07-09T21:51:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e43fff700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e440b3ff0 0x7f7e44157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.489+0000 7f7e4899c700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e440d0f60 0x7f7e4415e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.490+0000 7f7e437fe700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e440d0b10 0x7f7e44157370 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800c4d0 tx=0x7f7e3800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.490+0000 7f7e40ff9700 1 -- 172.21.15.53:0/1516199955 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38005d70 con 0x7f7e440d0b10 2023-07-09T21:51:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.490+0000 7f7e40ff9700 1 -- 172.21.15.53:0/1516199955 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e380070d0 con 0x7f7e440d0b10 2023-07-09T21:51:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.490+0000 7f7e40ff9700 1 -- 172.21.15.53:0/1516199955 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38007480 con 0x7f7e440d0b10 2023-07-09T21:51:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.490+0000 7f7e4a3ff700 1 -- 172.21.15.53:0/1516199955 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e340094a0 con 0x7f7e440d0b10 2023-07-09T21:51:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.490+0000 7f7e4a3ff700 1 -- 172.21.15.53:0/1516199955 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e440d05f0 con 0x7f7e440d0b10 2023-07-09T21:51:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.492+0000 7f7e40ff9700 1 -- 172.21.15.53:0/1516199955 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e380075e0 con 0x7f7e440d0b10 2023-07-09T21:51:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.493+0000 7f7e40ff9700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7e3006ace0 0x7f7e3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.493+0000 7f7e40ff9700 1 -- 172.21.15.53:0/1516199955 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e38088890 con 0x7f7e440d0b10 2023-07-09T21:51:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.494+0000 7f7e43fff700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7e3006ace0 0x7f7e3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.495+0000 7f7e43fff700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7e3006ace0 0x7f7e3006d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7e340090b0 tx=0x7f7e34008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.495+0000 7f7e5dcb3b80 1 Processor -- start 2023-07-09T21:51:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.495+0000 7f7e5dcb3b80 1 -- start start 2023-07-09T21:51:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.496+0000 7f7e5dcb3b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873ed060 0x557d873ed430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.496+0000 7f7e5dcb3b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 0x557d873f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.496+0000 7f7e5dcb3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 0x557d873c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.496+0000 7f7e5dcb3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d872cac60 con 0x557d873f0e20 2023-07-09T21:51:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.496+0000 7f7e5dcb3b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8731d9f0 con 0x557d873f0390 2023-07-09T21:51:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.496+0000 7f7e5dcb3b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d87316e80 con 0x557d873ed060 2023-07-09T21:51:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.496+0000 7f7e4899c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 0x557d873c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.496+0000 7f7e4899c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 0x557d873c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50190/0 (socket says 172.21.15.53:50190) 2023-07-09T21:51:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.496+0000 7f7e4899c700 1 -- 172.21.15.53:0/3213609688 learned_addr learned my addr 172.21.15.53:0/3213609688 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.496+0000 7f7e43fff700 1 --2- 172.21.15.53:0/3213609688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873ed060 0x557d873ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.496+0000 7f7e437fe700 1 --2- 172.21.15.53:0/3213609688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 0x557d873f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.497+0000 7f7e4899c700 1 -- 172.21.15.53:0/3213609688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873ed060 msgr2=0x557d873ed430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.497+0000 7f7e4899c700 1 --2- 172.21.15.53:0/3213609688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873ed060 0x557d873ed430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.497+0000 7f7e4899c700 1 -- 172.21.15.53:0/3213609688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 msgr2=0x557d873f08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.497+0000 7f7e4899c700 1 --2- 172.21.15.53:0/3213609688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 0x557d873f08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.497+0000 7f7e4899c700 1 -- 172.21.15.53:0/3213609688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d87144d90 con 0x557d873f0e20 2023-07-09T21:51:48.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.497+0000 7f7e4899c700 1 --2- 172.21.15.53:0/3213609688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 0x557d873c4560 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0076b0 tx=0x7f7e3c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fd731145264033 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:48.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.497+0000 7f7e29ffb700 1 -- 172.21.15.53:0/3213609688 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0147e0 con 0x557d873f0e20 2023-07-09T21:51:48.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.497+0000 7f7e29ffb700 1 -- 172.21.15.53:0/3213609688 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c00f050 con 0x557d873f0e20 2023-07-09T21:51:48.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.497+0000 7f7e29ffb700 1 -- 172.21.15.53:0/3213609688 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c014b60 con 0x557d873f0e20 2023-07-09T21:51:48.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.498+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/3213609688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 msgr2=0x557d873c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.498+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/3213609688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 0x557d873c4560 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0076b0 tx=0x7f7e3c009750 comp rx=0 tx=0).stop 2023-07-09T21:51:48.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.498+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/3213609688 shutdown_connections 2023-07-09T21:51:48.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.498+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/3213609688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 0x557d873c4560 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.498+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/3213609688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873ed060 0x557d873ed430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.498+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/3213609688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 0x557d873f08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.498+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/3213609688 >> 172.21.15.53:0/3213609688 conn(0x557d873baa90 msgr2=0x557d873c0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:48.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.498+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/3213609688 shutdown_connections 2023-07-09T21:51:48.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.498+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/3213609688 wait complete. 2023-07-09T21:51:48.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.499+0000 7f7e5dcb3b80 1 -- start start 2023-07-09T21:51:48.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.499+0000 7f7e5dcb3b80 1 Processor -- start 2023-07-09T21:51:48.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.500+0000 7f7e5dcb3b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873ed060 0x557d8740c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.500+0000 7f7e5dcb3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0390 0x557d87407540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.500+0000 7f7e5dcb3b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873f0e20 0x557d8740ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.500+0000 7f7e5dcb3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d872b6a70 con 0x557d873f0390 2023-07-09T21:51:48.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.500+0000 7f7e5dcb3b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d872b6770 con 0x557d873ed060 2023-07-09T21:51:48.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.500+0000 7f7e5dcb3b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d8719a8d0 con 0x557d873f0e20 2023-07-09T21:51:48.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.500+0000 7f7e5dcb3b80 10 client.0 _ll_register_callbacks cb 0x557d872b4710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:51:48.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.500+0000 7f7e437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0390 0x557d87407540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.500+0000 7f7e437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0390 0x557d87407540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50196/0 (socket says 172.21.15.53:50196) 2023-07-09T21:51:48.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.500+0000 7f7e437fe700 1 -- 172.21.15.53:0/3624735334 learned_addr learned my addr 172.21.15.53:0/3624735334 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:48.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.500+0000 7f7e4899c700 1 --2- 172.21.15.53:0/3624735334 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873f0e20 0x557d8740ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.500+0000 7f7e43fff700 1 --2- 172.21.15.53:0/3624735334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873ed060 0x557d8740c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e437fe700 1 -- 172.21.15.53:0/3624735334 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873f0e20 msgr2=0x557d8740ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:48.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e437fe700 1 --2- 172.21.15.53:0/3624735334 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873f0e20 0x557d8740ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e437fe700 1 -- 172.21.15.53:0/3624735334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873ed060 msgr2=0x557d8740c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:48.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e437fe700 1 --2- 172.21.15.53:0/3624735334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873ed060 0x557d8740c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e437fe700 1 -- 172.21.15.53:0/3624735334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c007330 con 0x557d873f0390 2023-07-09T21:51:48.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e437fe700 1 --2- 172.21.15.53:0/3624735334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0390 0x557d87407540 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7e380572a0 tx=0x7f7e38056dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e89f372cb9ed8d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:48.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e22ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-07-09T21:51:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e22ffd700 1 -- 172.21.15.53:0/3624735334 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3805d310 con 0x557d873f0390 2023-07-09T21:51:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e22ffd700 1 -- 172.21.15.53:0/3624735334 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e380533e0 con 0x557d873f0390 2023-07-09T21:51:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/3624735334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d873b80a0 con 0x557d873f0390 2023-07-09T21:51:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e22ffd700 1 -- 172.21.15.53:0/3624735334 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e3805b3e0 con 0x557d873f0390 2023-07-09T21:51:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e5dcb3b80 10 client.5289 fetch_fsmap learned FSMap version 17 2023-07-09T21:51:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/3624735334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557d8712dc10 con 0x557d873f0390 2023-07-09T21:51:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e22ffd700 1 -- 172.21.15.53:0/3624735334 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38072070 con 0x557d873f0390 2023-07-09T21:51:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e22ffd700 1 -- 172.21.15.53:0/3624735334 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7e380535a0 con 0x557d873f0390 2023-07-09T21:51:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e5dcb3b80 10 client.5289 fetch_fsmap finished waiting for FSMap version 17 2023-07-09T21:51:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.501+0000 7f7e5dcb3b80 10 client.5289 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-09T21:51:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.502+0000 7f7e5dcb3b80 20 client.5289 populate_metadata read hostname 'smithi053' 2023-07-09T21:51:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.502+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/3624735334 >> [v2:172.21.15.184:6834/3388102458,v1:172.21.15.184:6836/3388102458] conn(0x557d873c2390 0x557d873c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.502+0000 7f7e5dcb3b80 4 client.5289 mds_command: new command op to 5107 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T21:51:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.502+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/3624735334 --> [v2:172.21.15.184:6834/3388102458,v1:172.21.15.184:6836/3388102458] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557d8730fe60 con 0x557d873c2390 2023-07-09T21:51:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.502+0000 7f7e43fff700 1 --2- 172.21.15.53:0/3624735334 >> [v2:172.21.15.184:6834/3388102458,v1:172.21.15.184:6836/3388102458] conn(0x557d873c2390 0x557d873c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.503+0000 7f7e43fff700 1 --2- 172.21.15.53:0/3624735334 >> [v2:172.21.15.184:6834/3388102458,v1:172.21.15.184:6836/3388102458] conn(0x557d873c2390 0x557d873c2760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43b7ee8132384059 server_cookie=10e07af63fd001b8 in_seq=0 out_seq=0 2023-07-09T21:51:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.503+0000 7f7e22ffd700 10 client.5289 ms_handle_connect on v2:172.21.15.184:6834/3388102458 2023-07-09T21:51:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.503+0000 7f7e22ffd700 1 -- 172.21.15.53:0/3624735334 <== mds.0 v2:172.21.15.184:6834/3388102458 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557d8730fe60 con 0x557d873c2390 2023-07-09T21:51:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.503+0000 7f7e22ffd700 10 client.5289 handle_command_reply: tid=0 2023-07-09T21:51:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.503+0000 7f7e5dcb3b80 1 client.5289 shutdown 2023-07-09T21:51:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.504+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/3624735334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0390 msgr2=0x557d87407540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.504+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/3624735334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0390 0x557d87407540 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7e380572a0 tx=0x7f7e38056dc0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.504+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/3624735334 shutdown_connections 2023-07-09T21:51:48.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.504+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/3624735334 >> [v2:172.21.15.184:6834/3388102458,v1:172.21.15.184:6836/3388102458] conn(0x557d873c2390 0x557d873c2760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.504+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/3624735334 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873f0e20 0x557d8740ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.504+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/3624735334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873ed060 0x557d8740c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.504+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/3624735334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0390 0x557d87407540 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.504+0000 7f7e22ffd700 0 client.5289 ms_handle_reset on v2:172.21.15.184:6834/3388102458 2023-07-09T21:51:48.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.504+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/3624735334 >> 172.21.15.53:0/3624735334 conn(0x557d873baa90 msgr2=0x557d873c04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:48.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.504+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/3624735334 shutdown_connections 2023-07-09T21:51:48.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.504+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/3624735334 wait complete. 2023-07-09T21:51:48.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.504+0000 7f7e5dcb3b80 20 client.5289 trim_cache size 0 max 16384 2023-07-09T21:51:48.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.523+0000 7f7e5dcb3b80 1 Processor -- start 2023-07-09T21:51:48.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.523+0000 7f7e5dcb3b80 1 -- start start 2023-07-09T21:51:48.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.523+0000 7f7e5dcb3b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873ed060 0x557d873c5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.523+0000 7f7e5dcb3b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 0x557d873c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.523+0000 7f7e5dcb3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 0x557d873f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.523+0000 7f7e5dcb3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d873c2760 con 0x557d873f0e20 2023-07-09T21:51:48.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.523+0000 7f7e5dcb3b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d873e9790 con 0x557d873f0390 2023-07-09T21:51:48.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.523+0000 7f7e5dcb3b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d87408aa0 con 0x557d873ed060 2023-07-09T21:51:48.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.524+0000 7f7e4899c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 0x557d873f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.524+0000 7f7e4899c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 0x557d873f37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50202/0 (socket says 172.21.15.53:50202) 2023-07-09T21:51:48.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.524+0000 7f7e4899c700 1 -- 172.21.15.53:0/1255658491 learned_addr learned my addr 172.21.15.53:0/1255658491 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:48.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.524+0000 7f7e4899c700 1 -- 172.21.15.53:0/1255658491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873ed060 msgr2=0x557d873c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:48.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.524+0000 7f7e4899c700 1 --2- 172.21.15.53:0/1255658491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873ed060 0x557d873c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.524+0000 7f7e4899c700 1 -- 172.21.15.53:0/1255658491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 msgr2=0x557d873c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.524+0000 7f7e4899c700 1 --2- 172.21.15.53:0/1255658491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 0x557d873c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.524+0000 7f7e4899c700 1 -- 172.21.15.53:0/1255658491 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d8716b200 con 0x557d873f0e20 2023-07-09T21:51:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.524+0000 7f7e4899c700 1 --2- 172.21.15.53:0/1255658491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 0x557d873f37e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c016000 tx=0x7f7e3c00d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159a65464074b1b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.525+0000 7f7e2a7fc700 1 -- 172.21.15.53:0/1255658491 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c009db0 con 0x557d873f0e20 2023-07-09T21:51:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.525+0000 7f7e2a7fc700 1 -- 172.21.15.53:0/1255658491 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c0145e0 con 0x557d873f0e20 2023-07-09T21:51:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.525+0000 7f7e2a7fc700 1 -- 172.21.15.53:0/1255658491 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0149b0 con 0x557d873f0e20 2023-07-09T21:51:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.525+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/1255658491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 msgr2=0x557d873f37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.525+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/1255658491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 0x557d873f37e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c016000 tx=0x7f7e3c00d000 comp rx=0 tx=0).stop 2023-07-09T21:51:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.525+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/1255658491 shutdown_connections 2023-07-09T21:51:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.525+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/1255658491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873f0e20 0x557d873f37e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.525+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/1255658491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873ed060 0x557d873c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.525+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/1255658491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 0x557d873c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.525+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/1255658491 >> 172.21.15.53:0/1255658491 conn(0x557d873baa90 msgr2=0x557d873c70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:48.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.525+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/1255658491 shutdown_connections 2023-07-09T21:51:48.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.525+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/1255658491 wait complete. 2023-07-09T21:51:48.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.526+0000 7f7e5dcb3b80 1 -- start start 2023-07-09T21:51:48.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.526+0000 7f7e5dcb3b80 1 Processor -- start 2023-07-09T21:51:48.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.527+0000 7f7e5dcb3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873ed060 0x557d87475260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.527+0000 7f7e5dcb3b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 0x557d873ea490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.527+0000 7f7e5dcb3b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873f0e20 0x557d8740e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.527+0000 7f7e5dcb3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8742a460 con 0x557d873ed060 2023-07-09T21:51:48.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.527+0000 7f7e5dcb3b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d873c0150 con 0x557d873f0390 2023-07-09T21:51:48.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.527+0000 7f7e5dcb3b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d873ec420 con 0x557d873f0e20 2023-07-09T21:51:48.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.527+0000 7f7e5dcb3b80 10 client.0 _ll_register_callbacks cb 0x557d872b4710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:51:48.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.527+0000 7f7e43fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873ed060 0x557d87475260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.527+0000 7f7e43fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873ed060 0x557d87475260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50210/0 (socket says 172.21.15.53:50210) 2023-07-09T21:51:48.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.527+0000 7f7e43fff700 1 -- 172.21.15.53:0/119251439 learned_addr learned my addr 172.21.15.53:0/119251439 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:48.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.528+0000 7f7e4899c700 1 --2- 172.21.15.53:0/119251439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873f0e20 0x557d8740e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.528+0000 7f7e437fe700 1 --2- 172.21.15.53:0/119251439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 0x557d873ea490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.528+0000 7f7e43fff700 1 -- 172.21.15.53:0/119251439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873f0e20 msgr2=0x557d8740e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:48.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.528+0000 7f7e43fff700 1 --2- 172.21.15.53:0/119251439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873f0e20 0x557d8740e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.528+0000 7f7e43fff700 1 -- 172.21.15.53:0/119251439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 msgr2=0x557d873ea490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:48.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.528+0000 7f7e43fff700 1 --2- 172.21.15.53:0/119251439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 0x557d873ea490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.528+0000 7f7e43fff700 1 -- 172.21.15.53:0/119251439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d87144d90 con 0x557d873ed060 2023-07-09T21:51:48.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.528+0000 7f7e43fff700 1 --2- 172.21.15.53:0/119251439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873ed060 0x557d87475260 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009ea0 tx=0x7f7e34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f309018cdc696530 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:48.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.528+0000 7f7e22ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-07-09T21:51:48.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.528+0000 7f7e22ffd700 1 -- 172.21.15.53:0/119251439 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34034270 con 0x557d873ed060 2023-07-09T21:51:48.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.528+0000 7f7e22ffd700 1 -- 172.21.15.53:0/119251439 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e340343d0 con 0x557d873ed060 2023-07-09T21:51:48.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.528+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/119251439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e3c00f050 con 0x557d873ed060 2023-07-09T21:51:48.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.529+0000 7f7e22ffd700 1 -- 172.21.15.53:0/119251439 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e34034590 con 0x557d873ed060 2023-07-09T21:51:48.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.529+0000 7f7e5dcb3b80 10 client.5295 fetch_fsmap learned FSMap version 17 2023-07-09T21:51:48.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.529+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/119251439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557d87143260 con 0x557d873ed060 2023-07-09T21:51:48.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.529+0000 7f7e22ffd700 1 -- 172.21.15.53:0/119251439 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c00f050 con 0x557d873ed060 2023-07-09T21:51:48.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.529+0000 7f7e22ffd700 1 -- 172.21.15.53:0/119251439 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7e34004020 con 0x557d873ed060 2023-07-09T21:51:48.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.529+0000 7f7e5dcb3b80 10 client.5295 fetch_fsmap finished waiting for FSMap version 17 2023-07-09T21:51:48.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.529+0000 7f7e5dcb3b80 10 client.5295 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-09T21:51:48.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.529+0000 7f7e5dcb3b80 20 client.5295 populate_metadata read hostname 'smithi053' 2023-07-09T21:51:48.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.529+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/119251439 >> [v2:172.21.15.184:6834/3388102458,v1:172.21.15.184:6836/3388102458] conn(0x557d8740e610 0x557d8740e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.529+0000 7f7e5dcb3b80 4 client.5295 mds_command: new command op to 5107 tid=0[{"prefix": "status"}] 2023-07-09T21:51:48.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.529+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/119251439 --> [v2:172.21.15.184:6834/3388102458,v1:172.21.15.184:6836/3388102458] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557d872d2000 con 0x557d8740e610 2023-07-09T21:51:48.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.529+0000 7f7e437fe700 1 --2- 172.21.15.53:0/119251439 >> [v2:172.21.15.184:6834/3388102458,v1:172.21.15.184:6836/3388102458] conn(0x557d8740e610 0x557d8740e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.530+0000 7f7e437fe700 1 --2- 172.21.15.53:0/119251439 >> [v2:172.21.15.184:6834/3388102458,v1:172.21.15.184:6836/3388102458] conn(0x557d8740e610 0x557d8740e9e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3730030185952b9 server_cookie=333b03c481fd5c26 in_seq=0 out_seq=0 2023-07-09T21:51:48.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.530+0000 7f7e22ffd700 10 client.5295 ms_handle_connect on v2:172.21.15.184:6834/3388102458 2023-07-09T21:51:48.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.530+0000 7f7e22ffd700 1 -- 172.21.15.53:0/119251439 <== mds.0 v2:172.21.15.184:6834/3388102458 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x557d872d2000 con 0x557d8740e610 2023-07-09T21:51:48.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.530+0000 7f7e22ffd700 10 client.5295 handle_command_reply: tid=0 2023-07-09T21:51:48.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.530+0000 7f7e5dcb3b80 1 client.5295 shutdown 2023-07-09T21:51:48.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.530+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/119251439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873ed060 msgr2=0x557d87475260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.530+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/119251439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873ed060 0x557d87475260 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009ea0 tx=0x7f7e34004750 comp rx=0 tx=0).stop 2023-07-09T21:51:48.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/119251439 shutdown_connections 2023-07-09T21:51:48.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/119251439 >> [v2:172.21.15.184:6834/3388102458,v1:172.21.15.184:6836/3388102458] conn(0x557d8740e610 0x557d8740e9e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/119251439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557d873f0e20 0x557d8740e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/119251439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d873ed060 0x557d87475260 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e5dcb3b80 1 --2- 172.21.15.53:0/119251439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557d873f0390 0x557d873ea490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e22ffd700 0 client.5295 ms_handle_reset on v2:172.21.15.184:6834/3388102458 2023-07-09T21:51:48.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/119251439 >> 172.21.15.53:0/119251439 conn(0x557d873baa90 msgr2=0x557d873f3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:48.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/119251439 shutdown_connections 2023-07-09T21:51:48.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e5dcb3b80 1 -- 172.21.15.53:0/119251439 wait complete. 2023-07-09T21:51:48.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e5dcb3b80 20 client.5295 trim_cache size 0 max 16384 2023-07-09T21:51:48.544 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-07-09T21:51:48.544 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "25d21351-dc09-4310-b56b-79a331e4aa31", 2023-07-09T21:51:48.544 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-07-09T21:51:48.544 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 5107, 2023-07-09T21:51:48.545 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-07-09T21:51:48.545 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-07-09T21:51:48.545 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-07-09T21:51:48.545 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 6.6790307120000003, 2023-07-09T21:51:48.545 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 17, 2023-07-09T21:51:48.545 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 38, 2023-07-09T21:51:48.545 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 38, 2023-07-09T21:51:48.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 15.516502551 2023-07-09T21:51:48.546 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-07-09T21:51:48.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e4a3ff700 1 -- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7e3006ace0 msgr2=0x7f7e3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e4a3ff700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7e3006ace0 0x7f7e3006d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7e340090b0 tx=0x7f7e34008030 comp rx=0 tx=0).stop 2023-07-09T21:51:48.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e4a3ff700 1 -- 172.21.15.53:0/1516199955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e440d0b10 msgr2=0x7f7e44157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e4a3ff700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e440d0b10 0x7f7e44157370 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800c4d0 tx=0x7f7e3800c890 comp rx=0 tx=0).stop 2023-07-09T21:51:48.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e4a3ff700 1 -- 172.21.15.53:0/1516199955 shutdown_connections 2023-07-09T21:51:48.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e4a3ff700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7e3006ace0 0x7f7e3006d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e4a3ff700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e440d0f60 0x7f7e4415e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e4a3ff700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e440b3ff0 0x7f7e44157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.531+0000 7f7e4a3ff700 1 --2- 172.21.15.53:0/1516199955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e440d0b10 0x7f7e44157370 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.532+0000 7f7e4a3ff700 1 -- 172.21.15.53:0/1516199955 >> 172.21.15.53:0/1516199955 conn(0x7f7e4409c1b0 msgr2=0x7f7e440d1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:48.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.532+0000 7f7e4a3ff700 1 -- 172.21.15.53:0/1516199955 shutdown_connections 2023-07-09T21:51:48.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.532+0000 7f7e4a3ff700 1 -- 172.21.15.53:0/1516199955 wait complete. 2023-07-09T21:51:48.550 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:51:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.750+0000 7f39657ff700 1 Processor -- start 2023-07-09T21:51:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.750+0000 7f39657ff700 1 -- start start 2023-07-09T21:51:48.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.751+0000 7f39657ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f39600b3e90 0x7f396015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.751+0000 7f39657ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39600ce110 con 0x7f396015e890 2023-07-09T21:51:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.751+0000 7f39657ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396015b660 con 0x7f396015ae00 2023-07-09T21:51:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.751+0000 7f39657ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39600ce360 con 0x7f39600b3e90 2023-07-09T21:51:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.751+0000 7f395e7fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f39600b3e90 0x7f396015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.751+0000 7f395e7fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f39600b3e90 0x7f396015a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50220/0 (socket says 172.21.15.53:50220) 2023-07-09T21:51:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.751+0000 7f395e7fc700 1 -- 172.21.15.53:0/1471992395 learned_addr learned my addr 172.21.15.53:0/1471992395 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.751+0000 7f395effd700 1 --1- 172.21.15.53:0/1471992395 >> v1:172.21.15.53:6789/0 conn(0x7f396015e890 0x7f39600b3780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58396/0 (socket says 172.21.15.53:58396) 2023-07-09T21:51:48.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.752+0000 7f395e7fc700 1 -- 172.21.15.53:0/1471992395 >> v1:172.21.15.184:6789/0 conn(0x7f396015ae00 legacy=0x7f3960150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.752+0000 7f395e7fc700 1 -- 172.21.15.53:0/1471992395 >> v1:172.21.15.53:6789/0 conn(0x7f396015e890 legacy=0x7f39600b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.752+0000 7f395e7fc700 1 -- 172.21.15.53:0/1471992395 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600ce640 con 0x7f39600b3e90 2023-07-09T21:51:48.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.752+0000 7f395dffb700 1 -- 172.21.15.53:0/1471992395 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853176137 0 0) 0x7f39600ce110 con 0x7f396015e890 2023-07-09T21:51:48.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.752+0000 7f395e7fc700 1 --2- 172.21.15.53:0/1471992395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39600b3e90 0x7f396015a8c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f39540098f0 tx=0x7f3954009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a16564df8a49ba server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:48.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.752+0000 7f395dffb700 1 -- 172.21.15.53:0/1471992395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395400b8a0 con 0x7f39600b3e90 2023-07-09T21:51:48.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.752+0000 7f395dffb700 1 -- 172.21.15.53:0/1471992395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395400ba00 con 0x7f39600b3e90 2023-07-09T21:51:48.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.752+0000 7f395dffb700 1 -- 172.21.15.53:0/1471992395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395400bd90 con 0x7f39600b3e90 2023-07-09T21:51:48.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.753+0000 7f39657ff700 1 -- 172.21.15.53:0/1471992395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39600b3e90 msgr2=0x7f396015a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.753+0000 7f39657ff700 1 --2- 172.21.15.53:0/1471992395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39600b3e90 0x7f396015a8c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f39540098f0 tx=0x7f3954009c00 comp rx=0 tx=0).stop 2023-07-09T21:51:48.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.753+0000 7f39657ff700 1 -- 172.21.15.53:0/1471992395 shutdown_connections 2023-07-09T21:51:48.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.753+0000 7f39657ff700 1 --2- 172.21.15.53:0/1471992395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39600b3e90 0x7f396015a8c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.753+0000 7f39657ff700 1 -- 172.21.15.53:0/1471992395 >> 172.21.15.53:0/1471992395 conn(0x7f3960069f30 msgr2=0x7f396006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:48.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.753+0000 7f39657ff700 1 -- 172.21.15.53:0/1471992395 shutdown_connections 2023-07-09T21:51:48.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.753+0000 7f39657ff700 1 -- 172.21.15.53:0/1471992395 wait complete. 2023-07-09T21:51:48.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.755+0000 7f39657ff700 1 Processor -- start 2023-07-09T21:51:48.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.755+0000 7f39657ff700 1 -- start start 2023-07-09T21:51:48.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.756+0000 7f39657ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39600b3e90 0x7f3960159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.756+0000 7f39657ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396015ae00 0x7f396013afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.756+0000 7f39657ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396015e890 0x7f396013b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.756+0000 7f39657ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600701a0 con 0x7f396015e890 2023-07-09T21:51:48.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.756+0000 7f39657ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960149c10 con 0x7f396015ae00 2023-07-09T21:51:48.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.756+0000 7f39657ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39600b1520 con 0x7f39600b3e90 2023-07-09T21:51:48.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.756+0000 7f395f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396015e890 0x7f396013b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.756+0000 7f395effd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39600b3e90 0x7f3960159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.756+0000 7f395f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396015e890 0x7f396013b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50222/0 (socket says 172.21.15.53:50222) 2023-07-09T21:51:48.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.756+0000 7f395f7fe700 1 -- 172.21.15.53:0/3395075177 learned_addr learned my addr 172.21.15.53:0/3395075177 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:48.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.756+0000 7f395e7fc700 1 --2- 172.21.15.53:0/3395075177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396015ae00 0x7f396013afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.757+0000 7f395f7fe700 1 -- 172.21.15.53:0/3395075177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39600b3e90 msgr2=0x7f3960159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.757+0000 7f395f7fe700 1 --2- 172.21.15.53:0/3395075177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39600b3e90 0x7f3960159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.757+0000 7f395f7fe700 1 -- 172.21.15.53:0/3395075177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396015ae00 msgr2=0x7f396013afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:48.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.757+0000 7f395f7fe700 1 --2- 172.21.15.53:0/3395075177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396015ae00 0x7f396013afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:48.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.757+0000 7f395f7fe700 1 -- 172.21.15.53:0/3395075177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3954009550 con 0x7f396015e890 2023-07-09T21:51:48.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.757+0000 7f395f7fe700 1 --2- 172.21.15.53:0/3395075177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396015e890 0x7f396013b500 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f395800cc50 tx=0x7f395800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:48.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.757+0000 7f39477fe700 1 -- 172.21.15.53:0/3395075177 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958003c00 con 0x7f396015e890 2023-07-09T21:51:48.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.757+0000 7f39477fe700 1 -- 172.21.15.53:0/3395075177 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3958003d60 con 0x7f396015e890 2023-07-09T21:51:48.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.757+0000 7f39477fe700 1 -- 172.21.15.53:0/3395075177 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395800aab0 con 0x7f396015e890 2023-07-09T21:51:48.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.757+0000 7f39657ff700 1 -- 172.21.15.53:0/3395075177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396006f870 con 0x7f396015e890 2023-07-09T21:51:48.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.757+0000 7f39657ff700 1 -- 172.21.15.53:0/3395075177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396006fe30 con 0x7f396015e890 2023-07-09T21:51:48.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.758+0000 7f39657ff700 1 -- 172.21.15.53:0/3395075177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396004e280 con 0x7f396015e890 2023-07-09T21:51:48.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.759+0000 7f39477fe700 1 -- 172.21.15.53:0/3395075177 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f395800ac10 con 0x7f396015e890 2023-07-09T21:51:48.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.760+0000 7f39477fe700 1 --2- 172.21.15.53:0/3395075177 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f394c06ace0 0x7f394c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:48.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.760+0000 7f39477fe700 1 -- 172.21.15.53:0/3395075177 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3958089420 con 0x7f396015e890 2023-07-09T21:51:48.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.761+0000 7f395effd700 1 --2- 172.21.15.53:0/3395075177 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f394c06ace0 0x7f394c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:48.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.761+0000 7f395effd700 1 --2- 172.21.15.53:0/3395075177 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f394c06ace0 0x7f394c06d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3950000f60 tx=0x7f3950004a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:48.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:48.764+0000 7f39477fe700 1 -- 172.21.15.53:0/3395075177 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f39580544c0 con 0x7f396015e890 2023-07-09T21:51:49.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.022+0000 7f39657ff700 1 -- 172.21.15.53:0/3395075177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3960159f40 con 0x7f396015e890 2023-07-09T21:51:49.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.023+0000 7f39477fe700 1 -- 172.21.15.53:0/3395075177 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3958057ae0 con 0x7f396015e890 2023-07-09T21:51:49.024 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:51:49.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.025+0000 7f39657ff700 1 -- 172.21.15.53:0/3395075177 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f394c06ace0 msgr2=0x7f394c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:49.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.025+0000 7f39657ff700 1 --2- 172.21.15.53:0/3395075177 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f394c06ace0 0x7f394c06d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3950000f60 tx=0x7f3950004a50 comp rx=0 tx=0).stop 2023-07-09T21:51:49.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.025+0000 7f39657ff700 1 -- 172.21.15.53:0/3395075177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396015e890 msgr2=0x7f396013b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:49.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.025+0000 7f39657ff700 1 --2- 172.21.15.53:0/3395075177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396015e890 0x7f396013b500 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f395800cc50 tx=0x7f395800cf60 comp rx=0 tx=0).stop 2023-07-09T21:51:49.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.025+0000 7f39657ff700 1 -- 172.21.15.53:0/3395075177 shutdown_connections 2023-07-09T21:51:49.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.025+0000 7f39657ff700 1 --2- 172.21.15.53:0/3395075177 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f394c06ace0 0x7f394c06d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:49.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.025+0000 7f39657ff700 1 --2- 172.21.15.53:0/3395075177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396015e890 0x7f396013b500 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:49.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.025+0000 7f39657ff700 1 --2- 172.21.15.53:0/3395075177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39600b3e90 0x7f3960159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:49.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.025+0000 7f39657ff700 1 --2- 172.21.15.53:0/3395075177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396015ae00 0x7f396013afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:49.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.025+0000 7f39657ff700 1 -- 172.21.15.53:0/3395075177 >> 172.21.15.53:0/3395075177 conn(0x7f3960069f30 msgr2=0x7f396015cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:49.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.025+0000 7f39657ff700 1 -- 172.21.15.53:0/3395075177 shutdown_connections 2023-07-09T21:51:49.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:49.025+0000 7f39657ff700 1 -- 172.21.15.53:0/3395075177 wait complete. 2023-07-09T21:51:49.044 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T21:51:49.045 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:51:49.045 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-07-09T21:51:49.046 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T21:51:49.046 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:51:49.046 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T21:51:49.046 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T21:51:49.047 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:51:49.047 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:51:49.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:49.048 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-07-09T21:51:49.091 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:51:49.091 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:51:49.091 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:51:49.091 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:49.092 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-07-09T21:51:49.092 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:49.092 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:51:49.092 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-07-09T21:51:49.092 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-07-09T21:51:49.092 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:51:49.093 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-07-09T21:51:49.093 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-07-09T21:51:49.093 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:51:49.093 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:51:49.093 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-07-09T21:51:49.093 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-09T21:51:49.093 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42043sec preferred_lft 42043sec 2023-07-09T21:51:49.094 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-07-09T21:51:49.094 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:49.094 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:51:49.094 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:51:49.094 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-07-09T21:51:49.094 INFO:teuthology.orchestra.run.smithi053.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:51:49.094 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 4e:2d:4a:aa:2a:16 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:51:49.095 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:51:49.095 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:49.095 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::7d:bbff:fed2:eee3/64 scope link 2023-07-09T21:51:49.095 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:49.095 INFO:teuthology.orchestra.run.smithi053.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:51:49.095 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 4e:2d:4a:aa:2a:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:51:49.095 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::4c2d:4aff:feaa:2a16/64 scope link 2023-07-09T21:51:49.096 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:49.096 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:51:49.096 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 7e:34:96:47:0b:ee brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:51:49.096 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::7c34:96ff:fe47:bee/64 scope link 2023-07-09T21:51:49.096 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:49.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:49.098 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:51:49.202 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-07-09T21:51:49.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:49.207 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-07-09T21:51:49.252 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-07-09T21:51:49.252 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:51:49.252 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-09T21:51:49.253 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-09T21:51:49.253 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:51:49.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:49.254 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-07-09T21:51:49.255 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-07-09T21:51:49.255 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:51:49.255 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:51:49.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:51:49.256 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-07-09T21:51:49.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:49.464 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-07-09T21:51:49.508 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T21:51:49.508 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:51:49.508 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:51:49.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:49.509 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-07-09T21:51:49.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:51:49.617 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T21:51:49.660 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:51:49.660 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:51:49.661 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:51:49.741 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-09T21:51:49.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:49.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-09T21:51:49.889 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-09T21:51:49.889 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-09T21:51:49.889 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2023-07-09T21:51:49.910 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-09T21:51:49.910 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-09T21:51:49.910 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2023-07-09T21:51:49.910 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:51:49.910 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:51:49.932 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-09T21:51:49.932 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-09T21:51:49.933 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2023-07-09T21:51:49.933 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:51:49.933 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:51:49.933 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-07-09T21:51:49.933 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-07-09T21:51:49.933 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=25d21351-dc09-4310-b56b-79a331e4aa31" will pass to kernel 2023-07-09T21:51:49.938 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T21:51:49.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:49.939 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:51:50.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:50.009 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:51:50.115 INFO:teuthology.orchestra.run.smithi053.stdout:client5307 2023-07-09T21:51:50.115 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:51:50.116 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:50.158 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:51:50.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.396+0000 7fa6b13ff700 1 Processor -- start 2023-07-09T21:51:50.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.397+0000 7fa6b13ff700 1 -- start start 2023-07-09T21:51:50.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.398+0000 7fa6b13ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6ac15afd0 0x7fa6ac150c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:50.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.398+0000 7fa6b13ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ac15b430 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.398+0000 7fa6b13ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ac0ce110 con 0x7fa6ac15e890 2023-07-09T21:51:50.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.398+0000 7fa6b13ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6ac15b660 con 0x7fa6ac15afd0 2023-07-09T21:51:50.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.398+0000 7fa6ab7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6ac15afd0 0x7fa6ac150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:50.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.398+0000 7fa6ab7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6ac15afd0 0x7fa6ac150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50232/0 (socket says 172.21.15.53:50232) 2023-07-09T21:51:50.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.398+0000 7fa6ab7fe700 1 -- 172.21.15.53:0/906867334 learned_addr learned my addr 172.21.15.53:0/906867334 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:50.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.399+0000 7fa6ab7fe700 1 -- 172.21.15.53:0/906867334 >> v1:172.21.15.184:6789/0 conn(0x7fa6ac15e890 legacy=0x7fa6ac0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:50.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.399+0000 7fa6ab7fe700 1 -- 172.21.15.53:0/906867334 >> v1:172.21.15.53:6789/0 conn(0x7fa6ac0b3e90 legacy=0x7fa6ac15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:50.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.399+0000 7fa6ab7fe700 1 -- 172.21.15.53:0/906867334 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac0ce360 con 0x7fa6ac15afd0 2023-07-09T21:51:50.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.399+0000 7fa6aa7fc700 1 -- 172.21.15.53:0/906867334 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664738496 0 0) 0x7fa6ac15b430 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.399+0000 7fa6ab7fe700 1 --2- 172.21.15.53:0/906867334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ac15afd0 0x7fa6ac150c40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009e50 tx=0x7fa6a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28225ebb30a4376 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:50.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.399+0000 7fa6aa7fc700 1 -- 172.21.15.53:0/906867334 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a400e070 con 0x7fa6ac15afd0 2023-07-09T21:51:50.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.399+0000 7fa6aa7fc700 1 -- 172.21.15.53:0/906867334 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a400b9c0 con 0x7fa6ac15afd0 2023-07-09T21:51:50.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.399+0000 7fa6aa7fc700 1 -- 172.21.15.53:0/906867334 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a400bd70 con 0x7fa6ac15afd0 2023-07-09T21:51:50.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.400+0000 7fa6b13ff700 1 -- 172.21.15.53:0/906867334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ac15afd0 msgr2=0x7fa6ac150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:50.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.400+0000 7fa6b13ff700 1 --2- 172.21.15.53:0/906867334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ac15afd0 0x7fa6ac150c40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009e50 tx=0x7fa6a400b330 comp rx=0 tx=0).stop 2023-07-09T21:51:50.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.400+0000 7fa6b13ff700 1 -- 172.21.15.53:0/906867334 shutdown_connections 2023-07-09T21:51:50.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.400+0000 7fa6b13ff700 1 --2- 172.21.15.53:0/906867334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ac15afd0 0x7fa6ac150c40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:50.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.400+0000 7fa6b13ff700 1 -- 172.21.15.53:0/906867334 >> 172.21.15.53:0/906867334 conn(0x7fa6ac069f30 msgr2=0x7fa6ac06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:50.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.400+0000 7fa6b13ff700 1 -- 172.21.15.53:0/906867334 shutdown_connections 2023-07-09T21:51:50.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.400+0000 7fa6b13ff700 1 -- 172.21.15.53:0/906867334 wait complete. 2023-07-09T21:51:50.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.402+0000 7fa6b13ff700 1 Processor -- start 2023-07-09T21:51:50.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.402+0000 7fa6b13ff700 1 -- start start 2023-07-09T21:51:50.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.403+0000 7fa6b13ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ac0b3e90 0x7fa6ac148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:50.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.403+0000 7fa6b13ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6ac15afd0 0x7fa6ac148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:50.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.403+0000 7fa6b13ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6ac15e890 0x7fa6ac1513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:50.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.403+0000 7fa6b13ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac148890 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.403+0000 7fa6b13ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac0b16a0 con 0x7fa6ac15e890 2023-07-09T21:51:50.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.403+0000 7fa6b13ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac0afb80 con 0x7fa6ac15afd0 2023-07-09T21:51:50.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.403+0000 7fa6aaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ac0b3e90 0x7fa6ac148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:50.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.403+0000 7fa6aaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ac0b3e90 0x7fa6ac148a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50234/0 (socket says 172.21.15.53:50234) 2023-07-09T21:51:50.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.403+0000 7fa6aaffd700 1 -- 172.21.15.53:0/2950812934 learned_addr learned my addr 172.21.15.53:0/2950812934 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:50.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.403+0000 7fa6a3fff700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6ac15afd0 0x7fa6ac148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:50.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.403+0000 7fa6ab7fe700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6ac15e890 0x7fa6ac1513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:50.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.404+0000 7fa6aaffd700 1 -- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6ac15afd0 msgr2=0x7fa6ac148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:50.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.404+0000 7fa6aaffd700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6ac15afd0 0x7fa6ac148350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:50.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.404+0000 7fa6aaffd700 1 -- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6ac15e890 msgr2=0x7fa6ac1513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:50.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.404+0000 7fa6aaffd700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6ac15e890 0x7fa6ac1513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:50.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.404+0000 7fa6aaffd700 1 -- 172.21.15.53:0/2950812934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a4009b30 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.404+0000 7fa6aaffd700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ac0b3e90 0x7fa6ac148a10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa69c00c450 tx=0x7fa69c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:50.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.404+0000 7fa6a37fe700 1 -- 172.21.15.53:0/2950812934 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c0052d0 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.404+0000 7fa6a37fe700 1 -- 172.21.15.53:0/2950812934 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69c005430 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.404+0000 7fa6a37fe700 1 -- 172.21.15.53:0/2950812934 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c0038c0 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.404+0000 7fa6b13ff700 1 -- 172.21.15.53:0/2950812934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ac0b10e0 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.404+0000 7fa6b13ff700 1 -- 172.21.15.53:0/2950812934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ac150ea0 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.405+0000 7fa6b13ff700 1 -- 172.21.15.53:0/2950812934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ac04e280 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.406+0000 7fa6a37fe700 1 -- 172.21.15.53:0/2950812934 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa69c003a20 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.407+0000 7fa6a37fe700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa68c06ace0 0x7fa68c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:50.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.407+0000 7fa6a37fe700 1 -- 172.21.15.53:0/2950812934 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa69c0887b0 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.408+0000 7fa6a3fff700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa68c06ace0 0x7fa68c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:50.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.408+0000 7fa6a3fff700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa68c06ace0 0x7fa68c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac1f5210 tx=0x7fa694009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:50.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.411+0000 7fa6a37fe700 1 -- 172.21.15.53:0/2950812934 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa69c053850 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.664+0000 7fa6b13ff700 1 -- 172.21.15.53:0/2950812934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa6ac06d240 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.665+0000 7fa6a37fe700 1 -- 172.21.15.53:0/2950812934 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa69c00ce60 con 0x7fa6ac0b3e90 2023-07-09T21:51:50.666 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:51:50.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.667+0000 7fa6b13ff700 1 -- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa68c06ace0 msgr2=0x7fa68c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:50.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.667+0000 7fa6b13ff700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa68c06ace0 0x7fa68c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac1f5210 tx=0x7fa694009040 comp rx=0 tx=0).stop 2023-07-09T21:51:50.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.667+0000 7fa6b13ff700 1 -- 172.21.15.53:0/2950812934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ac0b3e90 msgr2=0x7fa6ac148a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:50.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.667+0000 7fa6b13ff700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ac0b3e90 0x7fa6ac148a10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa69c00c450 tx=0x7fa69c00c760 comp rx=0 tx=0).stop 2023-07-09T21:51:50.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.667+0000 7fa6b13ff700 1 -- 172.21.15.53:0/2950812934 shutdown_connections 2023-07-09T21:51:50.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.667+0000 7fa6b13ff700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa68c06ace0 0x7fa68c06d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:50.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.667+0000 7fa6b13ff700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6ac15e890 0x7fa6ac1513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:50.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.667+0000 7fa6b13ff700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ac0b3e90 0x7fa6ac148a10 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:50.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.667+0000 7fa6b13ff700 1 --2- 172.21.15.53:0/2950812934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6ac15afd0 0x7fa6ac148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:50.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.667+0000 7fa6b13ff700 1 -- 172.21.15.53:0/2950812934 >> 172.21.15.53:0/2950812934 conn(0x7fa6ac069f30 msgr2=0x7fa6ac0b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:50.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.667+0000 7fa6b13ff700 1 -- 172.21.15.53:0/2950812934 shutdown_connections 2023-07-09T21:51:50.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:50.667+0000 7fa6b13ff700 1 -- 172.21.15.53:0/2950812934 wait complete. 2023-07-09T21:51:50.686 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T21:51:50.687 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:51:50.687 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-07-09T21:51:50.687 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T21:51:50.688 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T21:51:50.688 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T21:51:50.688 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T21:51:50.688 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:51:50.689 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T21:51:50.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:50.689 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-07-09T21:51:50.736 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:51:50.737 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:51:50.737 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:51:50.737 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:50.737 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-07-09T21:51:50.737 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:50.737 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:51:50.737 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:51:50.738 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-07-09T21:51:50.738 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:51:50.738 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:51:50.739 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-07-09T21:51:50.740 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:51:50.740 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-07-09T21:51:50.740 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:51:50.740 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-07-09T21:51:50.740 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-09T21:51:50.740 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42040sec preferred_lft 42040sec 2023-07-09T21:51:50.741 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c7b:9bae:bb6f:ebac/64 scope link noprefixroute 2023-07-09T21:51:50.741 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:50.741 INFO:teuthology.orchestra.run.smithi184.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:51:50.741 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether a6:56:97:e0:ed:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:51:50.741 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:51:50.741 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:50.741 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::e4ec:4fff:feff:3b5b/64 scope link 2023-07-09T21:51:50.742 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:50.742 INFO:teuthology.orchestra.run.smithi184.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:51:50.742 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether a6:56:97:e0:ed:a7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T21:51:50.742 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::a456:97ff:fee0:eda7/64 scope link 2023-07-09T21:51:50.742 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:50.742 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:51:50.742 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether d6:7b:16:b8:b8:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T21:51:50.742 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::d47b:16ff:feb8:b80a/64 scope link 2023-07-09T21:51:50.743 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:51:50.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:50.744 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:51:50.811 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-07-09T21:51:50.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:50.815 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-07-09T21:51:50.859 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-07-09T21:51:50.860 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:51:50.860 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T21:51:50.860 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T21:51:50.860 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:51:50.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:50.862 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-09T21:51:50.862 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-09T21:51:50.862 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T21:51:50.862 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T21:51:50.863 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T21:51:50.863 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-09T21:51:51.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:51.030 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-07-09T21:51:51.073 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T21:51:51.073 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T21:51:51.073 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T21:51:51.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:51.074 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-07-09T21:51:51.180 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:51:51.181 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T21:51:51.222 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T21:51:51.223 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:51:51.223 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T21:51:51.304 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-09T21:51:51.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:51.305 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-09T21:51:51.445 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-09T21:51:51.445 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-09T21:51:51.446 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-09T21:51:51.464 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-09T21:51:51.464 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-09T21:51:51.464 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-09T21:51:51.464 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:51:51.464 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:51:51.486 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-09T21:51:51.486 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-09T21:51:51.486 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-09T21:51:51.486 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:51:51.487 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:51:51.487 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-07-09T21:51:51.487 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-07-09T21:51:51.487 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=25d21351-dc09-4310-b56b-79a331e4aa31" will pass to kernel 2023-07-09T21:51:51.492 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T21:51:51.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:51.492 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T21:51:51.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:51.561 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:51:51.644 INFO:teuthology.orchestra.run.smithi184.stdout:client4907 2023-07-09T21:51:51.645 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:51:51.645 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:51.689 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-09T21:51:51.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.904+0000 7f628afff700 1 Processor -- start 2023-07-09T21:51:51.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.904+0000 7f628afff700 1 -- start start 2023-07-09T21:51:51.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.905+0000 7f628afff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62840d1140 0x7f628415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:51.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.905+0000 7f628afff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62840d2c70 con 0x7f62840d28a0 2023-07-09T21:51:51.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.905+0000 7f628afff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62840d0190 con 0x7f62840ce030 2023-07-09T21:51:51.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.905+0000 7f628afff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62840d3de0 con 0x7f62840d1140 2023-07-09T21:51:51.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.905+0000 7f6288d9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f62840d28a0 0x7f62840d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58410/0 (socket says 172.21.15.53:58410) 2023-07-09T21:51:51.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.905+0000 7f6288d9b700 1 -- 172.21.15.53:0/700304477 learned_addr learned my addr 172.21.15.53:0/700304477 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:51.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.905+0000 7f6283fff700 1 --2- 172.21.15.53:0/700304477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62840d1140 0x7f628415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:51.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.906+0000 7f62837fe700 1 -- 172.21.15.53:0/700304477 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718844837 0 0) 0x7f62840d2c70 con 0x7f62840d28a0 2023-07-09T21:51:51.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.906+0000 7f62837fe700 1 -- 172.21.15.53:0/700304477 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62740035b0 con 0x7f62840d28a0 2023-07-09T21:51:51.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.906+0000 7f62837fe700 1 -- 172.21.15.53:0/700304477 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160231710 0 0) 0x7f62840d0190 con 0x7f62840ce030 2023-07-09T21:51:51.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.906+0000 7f62837fe700 1 -- 172.21.15.53:0/700304477 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62840d2c70 con 0x7f62840ce030 2023-07-09T21:51:51.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.906+0000 7f6283fff700 1 -- 172.21.15.53:0/700304477 >> v1:172.21.15.184:6789/0 conn(0x7f62840ce030 legacy=0x7f62840ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:51.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.906+0000 7f6283fff700 1 -- 172.21.15.53:0/700304477 >> v1:172.21.15.53:6789/0 conn(0x7f62840d28a0 legacy=0x7f62840d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:51.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.906+0000 7f6283fff700 1 -- 172.21.15.53:0/700304477 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62840d0470 con 0x7f62840d1140 2023-07-09T21:51:51.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.906+0000 7f6283fff700 1 --2- 172.21.15.53:0/700304477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62840d1140 0x7f628415c7b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6270009870 tx=0x7f6270009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9db2e0e81ece6a03 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:51.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.906+0000 7f62837fe700 1 -- 172.21.15.53:0/700304477 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270011830 con 0x7f62840d1140 2023-07-09T21:51:51.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.907+0000 7f62837fe700 1 -- 172.21.15.53:0/700304477 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6270011990 con 0x7f62840d1140 2023-07-09T21:51:51.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.907+0000 7f62837fe700 1 -- 172.21.15.53:0/700304477 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270011d20 con 0x7f62840d1140 2023-07-09T21:51:51.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.907+0000 7f628afff700 1 -- 172.21.15.53:0/700304477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62840d1140 msgr2=0x7f628415c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:51.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.907+0000 7f628afff700 1 --2- 172.21.15.53:0/700304477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62840d1140 0x7f628415c7b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6270009870 tx=0x7f6270009b80 comp rx=0 tx=0).stop 2023-07-09T21:51:51.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.907+0000 7f628afff700 1 -- 172.21.15.53:0/700304477 shutdown_connections 2023-07-09T21:51:51.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.907+0000 7f628afff700 1 --2- 172.21.15.53:0/700304477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62840d1140 0x7f628415c7b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:51.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.907+0000 7f628afff700 1 -- 172.21.15.53:0/700304477 >> 172.21.15.53:0/700304477 conn(0x7f628409c1b0 msgr2=0x7f62840d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:51.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.907+0000 7f628afff700 1 -- 172.21.15.53:0/700304477 shutdown_connections 2023-07-09T21:51:51.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.907+0000 7f628afff700 1 -- 172.21.15.53:0/700304477 wait complete. 2023-07-09T21:51:51.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.909+0000 7f628afff700 1 Processor -- start 2023-07-09T21:51:51.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.909+0000 7f628afff700 1 -- start start 2023-07-09T21:51:51.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.910+0000 7f628afff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62840ce030 0x7f6284155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:51.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.910+0000 7f628afff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62840d1140 0x7f62840b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:51.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.910+0000 7f628afff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62840d28a0 0x7f628415a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:51.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.910+0000 7f628afff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840b71b0 con 0x7f62840ce030 2023-07-09T21:51:51.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.910+0000 7f628afff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840b7490 con 0x7f62840d28a0 2023-07-09T21:51:51.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.910+0000 7f628afff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62840b7770 con 0x7f62840d1140 2023-07-09T21:51:51.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.910+0000 7f6288d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62840ce030 0x7f6284155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:51.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.910+0000 7f6288d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62840ce030 0x7f6284155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50236/0 (socket says 172.21.15.53:50236) 2023-07-09T21:51:51.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.910+0000 7f6288d9b700 1 -- 172.21.15.53:0/954722494 learned_addr learned my addr 172.21.15.53:0/954722494 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:51.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.910+0000 7f6283fff700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62840d1140 0x7f62840b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:51.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.910+0000 7f628959c700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62840d28a0 0x7f628415a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:51.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.911+0000 7f6288d9b700 1 -- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62840d1140 msgr2=0x7f62840b6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:51.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.911+0000 7f6288d9b700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62840d1140 0x7f62840b6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:51.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.911+0000 7f6288d9b700 1 -- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62840d28a0 msgr2=0x7f628415a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:51.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.911+0000 7f6288d9b700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62840d28a0 0x7f628415a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:51.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.911+0000 7f6288d9b700 1 -- 172.21.15.53:0/954722494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700094a0 con 0x7f62840ce030 2023-07-09T21:51:51.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.911+0000 7f6288d9b700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62840ce030 0x7f6284155320 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6278001eb0 tx=0x7f627800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:51.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.911+0000 7f62817fa700 1 -- 172.21.15.53:0/954722494 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278005d70 con 0x7f62840ce030 2023-07-09T21:51:51.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.911+0000 7f62817fa700 1 -- 172.21.15.53:0/954722494 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62780070d0 con 0x7f62840ce030 2023-07-09T21:51:51.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.911+0000 7f62817fa700 1 -- 172.21.15.53:0/954722494 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278007460 con 0x7f62840ce030 2023-07-09T21:51:51.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.911+0000 7f628afff700 1 -- 172.21.15.53:0/954722494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62840b7a50 con 0x7f62840ce030 2023-07-09T21:51:51.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.911+0000 7f628afff700 1 -- 172.21.15.53:0/954722494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628415ae80 con 0x7f62840ce030 2023-07-09T21:51:51.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.912+0000 7f628afff700 1 -- 172.21.15.53:0/954722494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62840b7f70 con 0x7f62840ce030 2023-07-09T21:51:51.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.914+0000 7f62817fa700 1 -- 172.21.15.53:0/954722494 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f62780075c0 con 0x7f62840ce030 2023-07-09T21:51:51.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.915+0000 7f62817fa700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f626806ad10 0x7f626806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:51.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.915+0000 7f62817fa700 1 -- 172.21.15.53:0/954722494 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62780888c0 con 0x7f62840ce030 2023-07-09T21:51:51.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.915+0000 7f6283fff700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f626806ad10 0x7f626806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:51.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.916+0000 7f6283fff700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f626806ad10 0x7f626806d1c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f62840d1530 tx=0x7f627001c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:51.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:51.919+0000 7f62817fa700 1 -- 172.21.15.53:0/954722494 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f62780538d0 con 0x7f62840ce030 2023-07-09T21:51:52.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.174+0000 7f628afff700 1 -- 172.21.15.53:0/954722494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6284074350 con 0x7f62840ce030 2023-07-09T21:51:52.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.554+0000 7f62817fa700 1 -- 172.21.15.53:0/954722494 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f6278056ef0 con 0x7f62840ce030 2023-07-09T21:51:52.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.557+0000 7f628afff700 1 -- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f626806ad10 msgr2=0x7f626806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:52.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.557+0000 7f628afff700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f626806ad10 0x7f626806d1c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f62840d1530 tx=0x7f627001c040 comp rx=0 tx=0).stop 2023-07-09T21:51:52.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.557+0000 7f628afff700 1 -- 172.21.15.53:0/954722494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62840ce030 msgr2=0x7f6284155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:52.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.557+0000 7f628afff700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62840ce030 0x7f6284155320 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6278001eb0 tx=0x7f627800c7b0 comp rx=0 tx=0).stop 2023-07-09T21:51:52.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.557+0000 7f628afff700 1 -- 172.21.15.53:0/954722494 shutdown_connections 2023-07-09T21:51:52.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.557+0000 7f628afff700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f626806ad10 0x7f626806d1c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:52.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.557+0000 7f628afff700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62840d28a0 0x7f628415a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:52.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.557+0000 7f628afff700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62840ce030 0x7f6284155320 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:52.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.557+0000 7f628afff700 1 --2- 172.21.15.53:0/954722494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62840d1140 0x7f62840b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:52.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.557+0000 7f628afff700 1 -- 172.21.15.53:0/954722494 >> 172.21.15.53:0/954722494 conn(0x7f628409c1b0 msgr2=0x7f628406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:52.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.557+0000 7f628afff700 1 -- 172.21.15.53:0/954722494 shutdown_connections 2023-07-09T21:51:52.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.557+0000 7f628afff700 1 -- 172.21.15.53:0/954722494 wait complete. 2023-07-09T21:51:52.578 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-09T21:51:52.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.779+0000 7fc26f5ff700 1 Processor -- start 2023-07-09T21:51:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.779+0000 7fc26f5ff700 1 -- start start 2023-07-09T21:51:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.780+0000 7fc26f5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680b3ff0 0x7fc2680b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.780+0000 7fc26f5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc2680d0f60 0x7fc2680b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:52.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.780+0000 7fc26f5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2680b8e80 con 0x7fc2680d0b10 2023-07-09T21:51:52.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.780+0000 7fc26f5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2680b1e30 con 0x7fc2680d0f60 2023-07-09T21:51:52.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.780+0000 7fc26f5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680afaa0 con 0x7fc2680b3ff0 2023-07-09T21:51:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.781+0000 7fc26d39b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680b3ff0 0x7fc2680b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.781+0000 7fc26db9c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc2680d0f60 0x7fc2680b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.781+0000 7fc26d39b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680b3ff0 0x7fc2680b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:58398/0 (socket says 172.21.15.53:58398) 2023-07-09T21:51:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.781+0000 7fc26d39b700 1 -- 172.21.15.53:0/121303745 learned_addr learned my addr 172.21.15.53:0/121303745 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.781+0000 7fc26db9c700 1 -- 172.21.15.53:0/121303745 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680b3ff0 msgr2=0x7fc2680b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.781+0000 7fc26db9c700 1 --2- 172.21.15.53:0/121303745 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680b3ff0 0x7fc2680b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.781+0000 7fc26db9c700 1 -- 172.21.15.53:0/121303745 >> v1:172.21.15.184:6789/0 conn(0x7fc2680d0b10 legacy=0x7fc2680b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.781+0000 7fc26db9c700 1 -- 172.21.15.53:0/121303745 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2680afd80 con 0x7fc2680d0f60 2023-07-09T21:51:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.781+0000 7fc25ffff700 1 -- 172.21.15.53:0/121303745 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217069316 0 0) 0x7fc258001110 con 0x7fc2680d0b10 2023-07-09T21:51:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.782+0000 7fc26db9c700 1 --2- 172.21.15.53:0/121303745 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2680d0f60 0x7fc2680b2ce0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc260009d90 tx=0x7fc26000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba778bd31355114 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.782+0000 7fc25ffff700 1 -- 172.21.15.53:0/121303745 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000e070 con 0x7fc2680d0f60 2023-07-09T21:51:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.782+0000 7fc25ffff700 1 -- 172.21.15.53:0/121303745 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26000bb20 con 0x7fc2680d0f60 2023-07-09T21:51:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.782+0000 7fc25ffff700 1 -- 172.21.15.53:0/121303745 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260012430 con 0x7fc2680d0f60 2023-07-09T21:51:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.783+0000 7fc26f5ff700 1 -- 172.21.15.53:0/121303745 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2680d0f60 msgr2=0x7fc2680b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.783+0000 7fc26f5ff700 1 --2- 172.21.15.53:0/121303745 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2680d0f60 0x7fc2680b2ce0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc260009d90 tx=0x7fc26000b330 comp rx=0 tx=0).stop 2023-07-09T21:51:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.783+0000 7fc26f5ff700 1 -- 172.21.15.53:0/121303745 shutdown_connections 2023-07-09T21:51:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.783+0000 7fc26f5ff700 1 --2- 172.21.15.53:0/121303745 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2680d0f60 0x7fc2680b2ce0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.783+0000 7fc26f5ff700 1 --2- 172.21.15.53:0/121303745 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680b3ff0 0x7fc2680b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.783+0000 7fc26f5ff700 1 -- 172.21.15.53:0/121303745 >> 172.21.15.53:0/121303745 conn(0x7fc26809c1b0 msgr2=0x7fc2680d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.783+0000 7fc26f5ff700 1 -- 172.21.15.53:0/121303745 shutdown_connections 2023-07-09T21:51:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.783+0000 7fc26f5ff700 1 -- 172.21.15.53:0/121303745 wait complete. 2023-07-09T21:51:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.785+0000 7fc26f5ff700 1 Processor -- start 2023-07-09T21:51:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.785+0000 7fc26f5ff700 1 -- start start 2023-07-09T21:51:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26f5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680b3ff0 0x7fc2680cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26f5ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2680d0b10 0x7fc2680cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26f5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2680d0f60 0x7fc2680cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26f5ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680ce310 con 0x7fc2680d0b10 2023-07-09T21:51:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26f5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680ce5f0 con 0x7fc2680d0f60 2023-07-09T21:51:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26f5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680ce8d0 con 0x7fc2680b3ff0 2023-07-09T21:51:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26cb9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2680d0b10 0x7fc2680cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26cb9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2680d0b10 0x7fc2680cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50238/0 (socket says 172.21.15.53:50238) 2023-07-09T21:51:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26cb9a700 1 -- 172.21.15.53:0/3368508136 learned_addr learned my addr 172.21.15.53:0/3368508136 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26d39b700 1 --2- 172.21.15.53:0/3368508136 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680b3ff0 0x7fc2680cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26cb9a700 1 -- 172.21.15.53:0/3368508136 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680b3ff0 msgr2=0x7fc2680cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:52.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26cb9a700 1 --2- 172.21.15.53:0/3368508136 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680b3ff0 0x7fc2680cf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:52.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26cb9a700 1 -- 172.21.15.53:0/3368508136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2680d0f60 msgr2=0x7fc2680cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:52.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26cb9a700 1 --2- 172.21.15.53:0/3368508136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2680d0f60 0x7fc2680cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:52.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.786+0000 7fc26cb9a700 1 -- 172.21.15.53:0/3368508136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc260009a70 con 0x7fc2680d0b10 2023-07-09T21:51:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.787+0000 7fc26cb9a700 1 --2- 172.21.15.53:0/3368508136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2680d0b10 0x7fc2680cf700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc25800c750 tx=0x7fc25800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.787+0000 7fc25dffb700 1 -- 172.21.15.53:0/3368508136 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2580054e0 con 0x7fc2680d0b10 2023-07-09T21:51:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.787+0000 7fc25dffb700 1 -- 172.21.15.53:0/3368508136 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc258003680 con 0x7fc2680d0b10 2023-07-09T21:51:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.787+0000 7fc25dffb700 1 -- 172.21.15.53:0/3368508136 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc258003a30 con 0x7fc2680d0b10 2023-07-09T21:51:52.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.787+0000 7fc26f5ff700 1 -- 172.21.15.53:0/3368508136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2680cebb0 con 0x7fc2680d0b10 2023-07-09T21:51:52.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.787+0000 7fc26f5ff700 1 -- 172.21.15.53:0/3368508136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26815fb70 con 0x7fc2680d0b10 2023-07-09T21:51:52.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.788+0000 7fc26f5ff700 1 -- 172.21.15.53:0/3368508136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26815d090 con 0x7fc2680d0b10 2023-07-09T21:51:52.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.789+0000 7fc25dffb700 1 -- 172.21.15.53:0/3368508136 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc258003b90 con 0x7fc2680d0b10 2023-07-09T21:51:52.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.790+0000 7fc25dffb700 1 --2- 172.21.15.53:0/3368508136 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc24c06ace0 0x7fc24c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:52.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.791+0000 7fc25dffb700 1 -- 172.21.15.53:0/3368508136 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc258088840 con 0x7fc2680d0b10 2023-07-09T21:51:52.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.791+0000 7fc26d39b700 1 --2- 172.21.15.53:0/3368508136 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc24c06ace0 0x7fc24c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:52.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.792+0000 7fc26d39b700 1 --2- 172.21.15.53:0/3368508136 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc24c06ace0 0x7fc24c06d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc264009aa0 tx=0x7fc264008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:52.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:52.795+0000 7fc25dffb700 1 -- 172.21.15.53:0/3368508136 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc26815d090 con 0x7fc2680d0b10 2023-07-09T21:51:53.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.028+0000 7fc26f5ff700 1 -- 172.21.15.53:0/3368508136 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2680ce760 con 0x7fc24c06ace0 2023-07-09T21:51:53.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.031+0000 7fc25dffb700 1 -- 172.21.15.53:0/3368508136 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc2680ce760 con 0x7fc24c06ace0 2023-07-09T21:51:53.032 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-07-09T21:51:53.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:51:53.032 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephfs" 2023-07-09T21:51:53.032 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:51:53.032 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-07-09T21:51:53.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.032+0000 7fc26f5ff700 1 -- 172.21.15.53:0/3368508136 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc24c06ace0 msgr2=0x7fc24c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.032+0000 7fc26f5ff700 1 --2- 172.21.15.53:0/3368508136 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc24c06ace0 0x7fc24c06d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc264009aa0 tx=0x7fc264008040 comp rx=0 tx=0).stop 2023-07-09T21:51:53.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.032+0000 7fc26f5ff700 1 -- 172.21.15.53:0/3368508136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2680d0b10 msgr2=0x7fc2680cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.032+0000 7fc26f5ff700 1 --2- 172.21.15.53:0/3368508136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2680d0b10 0x7fc2680cf700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc25800c750 tx=0x7fc25800cb10 comp rx=0 tx=0).stop 2023-07-09T21:51:53.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.032+0000 7fc26f5ff700 1 -- 172.21.15.53:0/3368508136 shutdown_connections 2023-07-09T21:51:53.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.032+0000 7fc26f5ff700 1 --2- 172.21.15.53:0/3368508136 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc24c06ace0 0x7fc24c06d190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.033+0000 7fc26f5ff700 1 --2- 172.21.15.53:0/3368508136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2680d0f60 0x7fc2680cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.033+0000 7fc26f5ff700 1 --2- 172.21.15.53:0/3368508136 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680b3ff0 0x7fc2680cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.033+0000 7fc26f5ff700 1 --2- 172.21.15.53:0/3368508136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2680d0b10 0x7fc2680cf700 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.033+0000 7fc26f5ff700 1 -- 172.21.15.53:0/3368508136 >> 172.21.15.53:0/3368508136 conn(0x7fc26809c1b0 msgr2=0x7fc26806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.033+0000 7fc26f5ff700 1 -- 172.21.15.53:0/3368508136 shutdown_connections 2023-07-09T21:51:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.033+0000 7fc26f5ff700 1 -- 172.21.15.53:0/3368508136 wait complete. 2023-07-09T21:51:53.052 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T21:51:53.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.255+0000 7fe5093ff700 1 Processor -- start 2023-07-09T21:51:53.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.255+0000 7fe5093ff700 1 -- start start 2023-07-09T21:51:53.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.256+0000 7fe5093ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe5040b3ff0 0x7fe5040b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:53.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.256+0000 7fe5093ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5040d0b10 0x7fe5040d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:53.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.256+0000 7fe5093ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5040b8e80 con 0x7fe5040b25d0 2023-07-09T21:51:53.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.256+0000 7fe5093ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5040d14a0 con 0x7fe5040b3ff0 2023-07-09T21:51:53.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.256+0000 7fe5093ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5040b1e30 con 0x7fe5040d0b10 2023-07-09T21:51:53.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.256+0000 7fe5037fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe5040b25d0 0x7fe5040b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54996/0 (socket says 172.21.15.53:54996) 2023-07-09T21:51:53.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.256+0000 7fe5037fe700 1 -- 172.21.15.53:0/534491426 learned_addr learned my addr 172.21.15.53:0/534491426 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:53.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.256+0000 7fe502ffd700 1 --2- 172.21.15.53:0/534491426 >> v2:172.21.15.184:3300/0 conn(0x7fe5040b3ff0 0x7fe5040b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:53.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.257+0000 7fe5027fc700 1 --2- 172.21.15.53:0/534491426 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5040d0b10 0x7fe5040d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:53.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.257+0000 7fe501ffb700 1 -- 172.21.15.53:0/534491426 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933235227 0 0) 0x7fe4fc001490 con 0x7fe5040b25d0 2023-07-09T21:51:53.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.257+0000 7fe501ffb700 1 -- 172.21.15.53:0/534491426 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4ec0035b0 con 0x7fe5040b25d0 2023-07-09T21:51:53.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.257+0000 7fe502ffd700 1 -- 172.21.15.53:0/534491426 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5040d0b10 msgr2=0x7fe5040d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:53.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.257+0000 7fe502ffd700 1 --2- 172.21.15.53:0/534491426 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5040d0b10 0x7fe5040d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.257+0000 7fe502ffd700 1 -- 172.21.15.53:0/534491426 >> v1:172.21.15.53:6789/0 conn(0x7fe5040b25d0 legacy=0x7fe5040b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.257+0000 7fe502ffd700 1 -- 172.21.15.53:0/534491426 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5040afaa0 con 0x7fe5040b3ff0 2023-07-09T21:51:53.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.258+0000 7fe502ffd700 1 --2- 172.21.15.53:0/534491426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5040b3ff0 0x7fe5040b43c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009840 tx=0x7fe4f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eca0c080a8fd2b80 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:53.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.258+0000 7fe501ffb700 1 -- 172.21.15.53:0/534491426 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4011830 con 0x7fe5040b3ff0 2023-07-09T21:51:53.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.258+0000 7fe501ffb700 1 -- 172.21.15.53:0/534491426 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f4011990 con 0x7fe5040b3ff0 2023-07-09T21:51:53.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.258+0000 7fe501ffb700 1 -- 172.21.15.53:0/534491426 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4011d20 con 0x7fe5040b3ff0 2023-07-09T21:51:53.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.258+0000 7fe5093ff700 1 -- 172.21.15.53:0/534491426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5040b3ff0 msgr2=0x7fe5040b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.258+0000 7fe5093ff700 1 --2- 172.21.15.53:0/534491426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5040b3ff0 0x7fe5040b43c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009840 tx=0x7fe4f4009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:53.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.258+0000 7fe5093ff700 1 -- 172.21.15.53:0/534491426 shutdown_connections 2023-07-09T21:51:53.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.258+0000 7fe5093ff700 1 --2- 172.21.15.53:0/534491426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5040b3ff0 0x7fe5040b43c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.258+0000 7fe5093ff700 1 --2- 172.21.15.53:0/534491426 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5040d0b10 0x7fe5040d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.258+0000 7fe5093ff700 1 -- 172.21.15.53:0/534491426 >> 172.21.15.53:0/534491426 conn(0x7fe50409c1b0 msgr2=0x7fe5040d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:53.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.258+0000 7fe5093ff700 1 -- 172.21.15.53:0/534491426 shutdown_connections 2023-07-09T21:51:53.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.258+0000 7fe5093ff700 1 -- 172.21.15.53:0/534491426 wait complete. 2023-07-09T21:51:53.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.260+0000 7fe5093ff700 1 Processor -- start 2023-07-09T21:51:53.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.260+0000 7fe5093ff700 1 -- start start 2023-07-09T21:51:53.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.261+0000 7fe5093ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5040b25d0 0x7fe504152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:53.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.261+0000 7fe5093ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5040b3ff0 0x7fe5040b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:53.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.261+0000 7fe5093ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5040d0b10 0x7fe5040b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:53.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.261+0000 7fe5093ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5040caa50 con 0x7fe5040d0b10 2023-07-09T21:51:53.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.261+0000 7fe5093ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50409cd30 con 0x7fe5040b3ff0 2023-07-09T21:51:53.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.261+0000 7fe5093ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5040d0690 con 0x7fe5040b25d0 2023-07-09T21:51:53.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.261+0000 7fe5037fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5040d0b10 0x7fe5040b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:53.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.262+0000 7fe5037fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5040d0b10 0x7fe5040b6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52458/0 (socket says 172.21.15.53:52458) 2023-07-09T21:51:53.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.262+0000 7fe5037fe700 1 -- 172.21.15.53:0/3001339121 learned_addr learned my addr 172.21.15.53:0/3001339121 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:53.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.262+0000 7fe5027fc700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5040b3ff0 0x7fe5040b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:53.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.262+0000 7fe502ffd700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5040b25d0 0x7fe504152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:53.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.262+0000 7fe5037fe700 1 -- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5040b25d0 msgr2=0x7fe504152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.262+0000 7fe5037fe700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5040b25d0 0x7fe504152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.262+0000 7fe5037fe700 1 -- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5040b3ff0 msgr2=0x7fe5040b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.262+0000 7fe5037fe700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5040b3ff0 0x7fe5040b6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.262+0000 7fe5037fe700 1 -- 172.21.15.53:0/3001339121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f40094a0 con 0x7fe5040d0b10 2023-07-09T21:51:53.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.262+0000 7fe5037fe700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5040d0b10 0x7fe5040b6fe0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00cb40 tx=0x7fe4fc00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:53.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.262+0000 7fe4eb7fe700 1 -- 172.21.15.53:0/3001339121 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc00a9e0 con 0x7fe5040d0b10 2023-07-09T21:51:53.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.263+0000 7fe4eb7fe700 1 -- 172.21.15.53:0/3001339121 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc00ab40 con 0x7fe5040d0b10 2023-07-09T21:51:53.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.263+0000 7fe5093ff700 1 -- 172.21.15.53:0/3001339121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5040ca0b0 con 0x7fe5040d0b10 2023-07-09T21:51:53.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.263+0000 7fe4eb7fe700 1 -- 172.21.15.53:0/3001339121 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc012400 con 0x7fe5040d0b10 2023-07-09T21:51:53.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.263+0000 7fe5093ff700 1 -- 172.21.15.53:0/3001339121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5040ca670 con 0x7fe5040d0b10 2023-07-09T21:51:53.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.264+0000 7fe5093ff700 1 -- 172.21.15.53:0/3001339121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5040cab90 con 0x7fe5040d0b10 2023-07-09T21:51:53.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.265+0000 7fe4eb7fe700 1 -- 172.21.15.53:0/3001339121 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4fc01b3b0 con 0x7fe5040d0b10 2023-07-09T21:51:53.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.265+0000 7fe4eb7fe700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe4f006ace0 0x7fe4f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:53.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.266+0000 7fe4eb7fe700 1 -- 172.21.15.53:0/3001339121 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4fc088eb0 con 0x7fe5040d0b10 2023-07-09T21:51:53.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.266+0000 7fe502ffd700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe4f006ace0 0x7fe4f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:53.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.267+0000 7fe502ffd700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe4f006ace0 0x7fe4f006d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4000c00 tx=0x7fe4f4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:53.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.270+0000 7fe4eb7fe700 1 -- 172.21.15.53:0/3001339121 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe5040cab90 con 0x7fe5040d0b10 2023-07-09T21:51:53.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.478+0000 7fe5093ff700 1 -- 172.21.15.53:0/3001339121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe5040b8e80 con 0x7fe5040d0b10 2023-07-09T21:51:53.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.478+0000 7fe4eb7fe700 1 -- 172.21.15.53:0/3001339121 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe5040b8e80 con 0x7fe5040d0b10 2023-07-09T21:51:53.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.481+0000 7fe5093ff700 1 -- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe4f006ace0 msgr2=0x7fe4f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.481+0000 7fe5093ff700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe4f006ace0 0x7fe4f006d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4000c00 tx=0x7fe4f4008030 comp rx=0 tx=0).stop 2023-07-09T21:51:53.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.481+0000 7fe5093ff700 1 -- 172.21.15.53:0/3001339121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5040d0b10 msgr2=0x7fe5040b6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.481+0000 7fe5093ff700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5040d0b10 0x7fe5040b6fe0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00cb40 tx=0x7fe4fc00ce50 comp rx=0 tx=0).stop 2023-07-09T21:51:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.481+0000 7fe5093ff700 1 -- 172.21.15.53:0/3001339121 shutdown_connections 2023-07-09T21:51:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.481+0000 7fe5093ff700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe4f006ace0 0x7fe4f006d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.481+0000 7fe5093ff700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5040d0b10 0x7fe5040b6fe0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.481+0000 7fe5093ff700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5040b25d0 0x7fe504152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.481+0000 7fe5093ff700 1 --2- 172.21.15.53:0/3001339121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5040b3ff0 0x7fe5040b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.481+0000 7fe5093ff700 1 -- 172.21.15.53:0/3001339121 >> 172.21.15.53:0/3001339121 conn(0x7fe50409c1b0 msgr2=0x7fe5040d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.481+0000 7fe5093ff700 1 -- 172.21.15.53:0/3001339121 shutdown_connections 2023-07-09T21:51:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.481+0000 7fe5093ff700 1 -- 172.21.15.53:0/3001339121 wait complete. 2023-07-09T21:51:53.500 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000818796 2023-07-09T21:51:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.702+0000 7f3465bff700 1 Processor -- start 2023-07-09T21:51:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.702+0000 7f3465bff700 1 -- start start 2023-07-09T21:51:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.703+0000 7f3465bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3460069f30 0x7f346006a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.703+0000 7f3465bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34601601d0 0x7f3460160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.703+0000 7f3465bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34600cdba0 con 0x7f3460071650 2023-07-09T21:51:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.703+0000 7f3465bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346006a910 con 0x7f3460069f30 2023-07-09T21:51:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.703+0000 7f3465bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34600cf370 con 0x7f34601601d0 2023-07-09T21:51:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.704+0000 7f345effd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3460069f30 0x7f346006a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.704+0000 7f345effd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3460069f30 0x7f346006a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52468/0 (socket says 172.21.15.53:52468) 2023-07-09T21:51:53.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.704+0000 7f345effd700 1 -- 172.21.15.53:0/1093334780 learned_addr learned my addr 172.21.15.53:0/1093334780 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:53.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.704+0000 7f345ffff700 1 --2- 172.21.15.53:0/1093334780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34601601d0 0x7f3460160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:53.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.704+0000 7f345effd700 1 -- 172.21.15.53:0/1093334780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34601601d0 msgr2=0x7f3460160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:53.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.704+0000 7f345effd700 1 --2- 172.21.15.53:0/1093334780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34601601d0 0x7f3460160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.704+0000 7f345effd700 1 -- 172.21.15.53:0/1093334780 >> v1:172.21.15.184:6789/0 conn(0x7f3460071650 legacy=0x7f34600ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.704+0000 7f345effd700 1 -- 172.21.15.53:0/1093334780 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34600cf650 con 0x7f3460069f30 2023-07-09T21:51:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.704+0000 7f345effd700 1 --2- 172.21.15.53:0/1093334780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3460069f30 0x7f346006a3d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f34540098f0 tx=0x7f3454009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d779b9df94684e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.705+0000 7f345e7fc700 1 -- 172.21.15.53:0/1093334780 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345400b8a0 con 0x7f3460069f30 2023-07-09T21:51:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.705+0000 7f345e7fc700 1 -- 172.21.15.53:0/1093334780 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345400ba00 con 0x7f3460069f30 2023-07-09T21:51:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.705+0000 7f345e7fc700 1 -- 172.21.15.53:0/1093334780 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345400bd90 con 0x7f3460069f30 2023-07-09T21:51:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.705+0000 7f3465bff700 1 -- 172.21.15.53:0/1093334780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3460069f30 msgr2=0x7f346006a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.705+0000 7f3465bff700 1 --2- 172.21.15.53:0/1093334780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3460069f30 0x7f346006a3d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f34540098f0 tx=0x7f3454009c00 comp rx=0 tx=0).stop 2023-07-09T21:51:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.705+0000 7f3465bff700 1 -- 172.21.15.53:0/1093334780 shutdown_connections 2023-07-09T21:51:53.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.705+0000 7f3465bff700 1 --2- 172.21.15.53:0/1093334780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34601601d0 0x7f3460160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.705+0000 7f3465bff700 1 --2- 172.21.15.53:0/1093334780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3460069f30 0x7f346006a3d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.705+0000 7f3465bff700 1 -- 172.21.15.53:0/1093334780 >> 172.21.15.53:0/1093334780 conn(0x7f34600cc640 msgr2=0x7f34600cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:53.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.705+0000 7f3465bff700 1 -- 172.21.15.53:0/1093334780 shutdown_connections 2023-07-09T21:51:53.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.706+0000 7f3465bff700 1 -- 172.21.15.53:0/1093334780 wait complete. 2023-07-09T21:51:53.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.707+0000 7f3465bff700 1 Processor -- start 2023-07-09T21:51:53.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.707+0000 7f3465bff700 1 -- start start 2023-07-09T21:51:53.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.708+0000 7f3465bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3460069f30 0x7f34600af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:53.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.708+0000 7f3465bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3460071650 0x7f34600c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:53.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.708+0000 7f3465bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34601601d0 0x7f34601572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:53.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.708+0000 7f3465bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3460153c00 con 0x7f3460071650 2023-07-09T21:51:53.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.708+0000 7f3465bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34600b05f0 con 0x7f34601601d0 2023-07-09T21:51:53.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.708+0000 7f3465bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34601f6680 con 0x7f3460069f30 2023-07-09T21:51:53.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.708+0000 7f345effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3460071650 0x7f34600c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:53.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.709+0000 7f345effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3460071650 0x7f34600c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52474/0 (socket says 172.21.15.53:52474) 2023-07-09T21:51:53.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.709+0000 7f345effd700 1 -- 172.21.15.53:0/804996999 learned_addr learned my addr 172.21.15.53:0/804996999 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:53.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.709+0000 7f345f7fe700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3460069f30 0x7f34600af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:53.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.709+0000 7f345ffff700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34601601d0 0x7f34601572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:53.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.709+0000 7f345effd700 1 -- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3460069f30 msgr2=0x7f34600af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.709+0000 7f345effd700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3460069f30 0x7f34600af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.709+0000 7f345effd700 1 -- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34601601d0 msgr2=0x7f34601572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.709+0000 7f345effd700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34601601d0 0x7f34601572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.709+0000 7f345effd700 1 -- 172.21.15.53:0/804996999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3454009550 con 0x7f3460071650 2023-07-09T21:51:53.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.709+0000 7f345ffff700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34601601d0 0x7f34601572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:53.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.709+0000 7f345effd700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3460071650 0x7f34600c86b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3454000c00 tx=0x7f3454004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:53.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.709+0000 7f3447fff700 1 -- 172.21.15.53:0/804996999 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454004480 con 0x7f3460071650 2023-07-09T21:51:53.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.710+0000 7f3447fff700 1 -- 172.21.15.53:0/804996999 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345401f070 con 0x7f3460071650 2023-07-09T21:51:53.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.710+0000 7f3465bff700 1 -- 172.21.15.53:0/804996999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34600af9e0 con 0x7f3460071650 2023-07-09T21:51:53.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.710+0000 7f3447fff700 1 -- 172.21.15.53:0/804996999 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34540038c0 con 0x7f3460071650 2023-07-09T21:51:53.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.710+0000 7f3465bff700 1 -- 172.21.15.53:0/804996999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34600affa0 con 0x7f3460071650 2023-07-09T21:51:53.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.711+0000 7f3465bff700 1 -- 172.21.15.53:0/804996999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34600b0780 con 0x7f3460071650 2023-07-09T21:51:53.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.712+0000 7f3447fff700 1 -- 172.21.15.53:0/804996999 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3454021030 con 0x7f3460071650 2023-07-09T21:51:53.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.713+0000 7f3447fff700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f344c06ace0 0x7f344c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:53.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.713+0000 7f3447fff700 1 -- 172.21.15.53:0/804996999 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f345408a9a0 con 0x7f3460071650 2023-07-09T21:51:53.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.713+0000 7f345f7fe700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f344c06ace0 0x7f344c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:53.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.714+0000 7f345f7fe700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f344c06ace0 0x7f344c06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3450000f60 tx=0x7f3450009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:53.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.717+0000 7f3447fff700 1 -- 172.21.15.53:0/804996999 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3454055c00 con 0x7f3460071650 2023-07-09T21:51:53.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.956+0000 7f3465bff700 1 -- 172.21.15.53:0/804996999 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000818796", "target": ["mon-mgr", ""]}) v1 -- 0x7f34600cd830 con 0x7f344c06ace0 2023-07-09T21:51:53.964 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:51:53.963+0000 7fa52c43e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:51:53.964 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:51:53.963+0000 7fa52c43e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:51:53.964 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:51:53.963+0000 7fa52c43e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:51:53.965 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:51:53.963+0000 7fa52c43e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:51:53.965 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:51:53.963+0000 7fa52c43e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:51:53.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.985+0000 7f3447fff700 1 -- 172.21.15.53:0/804996999 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f34500050d0 con 0x7f344c06ace0 2023-07-09T21:51:53.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.987+0000 7f3465bff700 1 -- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f344c06ace0 msgr2=0x7f344c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.987+0000 7f3465bff700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f344c06ace0 0x7f344c06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3450000f60 tx=0x7f3450009040 comp rx=0 tx=0).stop 2023-07-09T21:51:53.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.987+0000 7f3465bff700 1 -- 172.21.15.53:0/804996999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3460071650 msgr2=0x7f34600c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:53.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.987+0000 7f3465bff700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3460071650 0x7f34600c86b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3454000c00 tx=0x7f3454004750 comp rx=0 tx=0).stop 2023-07-09T21:51:53.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.987+0000 7f3465bff700 1 -- 172.21.15.53:0/804996999 shutdown_connections 2023-07-09T21:51:53.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.987+0000 7f3465bff700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f344c06ace0 0x7f344c06d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.987+0000 7f3465bff700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34601601d0 0x7f34601572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.987+0000 7f3465bff700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3460069f30 0x7f34600af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.987+0000 7f3465bff700 1 --2- 172.21.15.53:0/804996999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3460071650 0x7f34600c86b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:53.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.987+0000 7f3465bff700 1 -- 172.21.15.53:0/804996999 >> 172.21.15.53:0/804996999 conn(0x7f34600cc640 msgr2=0x7f34600cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:53.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.988+0000 7f3465bff700 1 -- 172.21.15.53:0/804996999 shutdown_connections 2023-07-09T21:51:53.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:53.988+0000 7f3465bff700 1 -- 172.21.15.53:0/804996999 wait complete. 2023-07-09T21:51:54.007 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot create cephfs group_0000000000818796 snapshot_0000000000342682 2023-07-09T21:51:54.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.211+0000 7f01217ff700 1 Processor -- start 2023-07-09T21:51:54.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.211+0000 7f01217ff700 1 -- start start 2023-07-09T21:51:54.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.212+0000 7f01217ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f011c0d28a0 0x7f011c15c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:54.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.212+0000 7f01217ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f011c0d0a30 0x7f011c0d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:54.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.212+0000 7f01217ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f011c160350 0x7f011c1607d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:54.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.212+0000 7f01217ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f011c0d1410 con 0x7f011c0d0a30 2023-07-09T21:51:54.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.212+0000 7f01217ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f011c0d3de0 con 0x7f011c0d28a0 2023-07-09T21:51:54.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.212+0000 7f01217ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011c15ccf0 con 0x7f011c160350 2023-07-09T21:51:54.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.212+0000 7f011a7fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f011c0d0a30 0x7f011c0d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:54.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.212+0000 7f011a7fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f011c0d0a30 0x7f011c0d0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52476/0 (socket says 172.21.15.53:52476) 2023-07-09T21:51:54.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.212+0000 7f011a7fc700 1 -- 172.21.15.53:0/976389025 learned_addr learned my addr 172.21.15.53:0/976389025 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:54.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.213+0000 7f011b7fe700 1 --2- 172.21.15.53:0/976389025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f011c160350 0x7f011c1607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:54.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.213+0000 7f011affd700 1 --2- 172.21.15.53:0/976389025 >> v2:172.21.15.184:3300/0 conn(0x7f011c0d28a0 0x7f011c15c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:54.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.213+0000 7f011a7fc700 1 -- 172.21.15.53:0/976389025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f011c160350 msgr2=0x7f011c1607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:54.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.213+0000 7f011a7fc700 1 --2- 172.21.15.53:0/976389025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f011c160350 0x7f011c1607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.213+0000 7f011a7fc700 1 -- 172.21.15.53:0/976389025 >> v2:172.21.15.184:3300/0 conn(0x7f011c0d28a0 msgr2=0x7f011c15c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:54.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.213+0000 7f011a7fc700 1 --2- 172.21.15.53:0/976389025 >> v2:172.21.15.184:3300/0 conn(0x7f011c0d28a0 0x7f011c15c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.213+0000 7f011a7fc700 1 -- 172.21.15.53:0/976389025 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c0d2c70 con 0x7f011c0d0a30 2023-07-09T21:51:54.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.213+0000 7f011affd700 1 --2- 172.21.15.53:0/976389025 >> v2:172.21.15.184:3300/0 conn(0x7f011c0d28a0 0x7f011c15c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:54.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.213+0000 7f011a7fc700 1 --2- 172.21.15.53:0/976389025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f011c0d0a30 0x7f011c0d0ed0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f011c072060 tx=0x7f0110009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea095c667123cb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:54.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.213+0000 7f0119ffb700 1 -- 172.21.15.53:0/976389025 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000b870 con 0x7f011c0d0a30 2023-07-09T21:51:54.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.213+0000 7f0119ffb700 1 -- 172.21.15.53:0/976389025 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011000b9d0 con 0x7f011c0d0a30 2023-07-09T21:51:54.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.214+0000 7f0119ffb700 1 -- 172.21.15.53:0/976389025 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000bd60 con 0x7f011c0d0a30 2023-07-09T21:51:54.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.214+0000 7f01217ff700 1 -- 172.21.15.53:0/976389025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f011c0d0a30 msgr2=0x7f011c0d0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:54.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.214+0000 7f01217ff700 1 --2- 172.21.15.53:0/976389025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f011c0d0a30 0x7f011c0d0ed0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f011c072060 tx=0x7f0110009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.214+0000 7f01217ff700 1 -- 172.21.15.53:0/976389025 shutdown_connections 2023-07-09T21:51:54.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.214+0000 7f01217ff700 1 --2- 172.21.15.53:0/976389025 >> v2:172.21.15.184:3300/0 conn(0x7f011c0d28a0 0x7f011c15c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.214+0000 7f01217ff700 1 --2- 172.21.15.53:0/976389025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f011c160350 0x7f011c1607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.214+0000 7f01217ff700 1 --2- 172.21.15.53:0/976389025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f011c0d0a30 0x7f011c0d0ed0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.214+0000 7f01217ff700 1 -- 172.21.15.53:0/976389025 >> 172.21.15.53:0/976389025 conn(0x7f011c09c1b0 msgr2=0x7f011c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:54.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.214+0000 7f01217ff700 1 -- 172.21.15.53:0/976389025 shutdown_connections 2023-07-09T21:51:54.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.214+0000 7f01217ff700 1 -- 172.21.15.53:0/976389025 wait complete. 2023-07-09T21:51:54.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.216+0000 7f01217ff700 1 Processor -- start 2023-07-09T21:51:54.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.216+0000 7f01217ff700 1 -- start start 2023-07-09T21:51:54.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.217+0000 7f01217ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f011c0d0a30 0x7f011c0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:54.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.217+0000 7f01217ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f011c0d28a0 0x7f011c1f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:54.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.217+0000 7f01217ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f011c160350 0x7f011c0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:54.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.217+0000 7f01217ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c14ed90 con 0x7f011c0d0a30 2023-07-09T21:51:54.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.217+0000 7f01217ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c0ca780 con 0x7f011c160350 2023-07-09T21:51:54.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.217+0000 7f01217ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011c0caa60 con 0x7f011c0d28a0 2023-07-09T21:51:54.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.217+0000 7f011affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f011c0d0a30 0x7f011c0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:54.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.217+0000 7f011affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f011c0d0a30 0x7f011c0cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52492/0 (socket says 172.21.15.53:52492) 2023-07-09T21:51:54.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.217+0000 7f011affd700 1 -- 172.21.15.53:0/2768508912 learned_addr learned my addr 172.21.15.53:0/2768508912 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:54.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.217+0000 7f011b7fe700 1 --2- 172.21.15.53:0/2768508912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f011c160350 0x7f011c0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:54.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.217+0000 7f011a7fc700 1 --2- 172.21.15.53:0/2768508912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f011c0d28a0 0x7f011c1f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:54.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.218+0000 7f011affd700 1 -- 172.21.15.53:0/2768508912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f011c0d28a0 msgr2=0x7f011c1f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:54.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.218+0000 7f011affd700 1 --2- 172.21.15.53:0/2768508912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f011c0d28a0 0x7f011c1f2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.218+0000 7f011affd700 1 -- 172.21.15.53:0/2768508912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f011c160350 msgr2=0x7f011c0c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:54.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.218+0000 7f011affd700 1 --2- 172.21.15.53:0/2768508912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f011c160350 0x7f011c0c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.218+0000 7f011affd700 1 -- 172.21.15.53:0/2768508912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0110009550 con 0x7f011c0d0a30 2023-07-09T21:51:54.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.218+0000 7f011affd700 1 --2- 172.21.15.53:0/2768508912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f011c0d0a30 0x7f011c0cb820 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c750 tx=0x7f010c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:54.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.218+0000 7f01037fe700 1 -- 172.21.15.53:0/2768508912 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c011800 con 0x7f011c0d0a30 2023-07-09T21:51:54.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.218+0000 7f01037fe700 1 -- 172.21.15.53:0/2768508912 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c011960 con 0x7f011c0d0a30 2023-07-09T21:51:54.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.218+0000 7f01037fe700 1 -- 172.21.15.53:0/2768508912 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c011cd0 con 0x7f011c0d0a30 2023-07-09T21:51:54.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.218+0000 7f01217ff700 1 -- 172.21.15.53:0/2768508912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011c0cad40 con 0x7f011c0d0a30 2023-07-09T21:51:54.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.218+0000 7f01217ff700 1 -- 172.21.15.53:0/2768508912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011c0cb300 con 0x7f011c0d0a30 2023-07-09T21:51:54.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.219+0000 7f01217ff700 1 -- 172.21.15.53:0/2768508912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011c074350 con 0x7f011c0d0a30 2023-07-09T21:51:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.220+0000 7f01037fe700 1 -- 172.21.15.53:0/2768508912 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f010c021350 con 0x7f011c0d0a30 2023-07-09T21:51:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.221+0000 7f01037fe700 1 --2- 172.21.15.53:0/2768508912 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f010806ace0 0x7f010806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.221+0000 7f01037fe700 1 -- 172.21.15.53:0/2768508912 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f010c089590 con 0x7f011c0d0a30 2023-07-09T21:51:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.222+0000 7f011a7fc700 1 --2- 172.21.15.53:0/2768508912 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f010806ace0 0x7f010806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.222+0000 7f011a7fc700 1 --2- 172.21.15.53:0/2768508912 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f010806ace0 0x7f010806d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0110000c00 tx=0x7f0110008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.225+0000 7f01037fe700 1 -- 172.21.15.53:0/2768508912 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f010c057fa0 con 0x7f011c0d0a30 2023-07-09T21:51:54.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.465+0000 7f01217ff700 1 -- 172.21.15.53:0/2768508912 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot create", "vol_name": "cephfs", "group_name": "group_0000000000818796", "snap_name": "snapshot_0000000000342682", "target": ["mon-mgr", ""]}) v1 -- 0x7f011c0d0470 con 0x7f010806ace0 2023-07-09T21:51:54.468 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:51:54.467+0000 7fa52c43e700 -1 mgr.server reply reply (38) Function not implemented subvolume group snapshots are not supported 2023-07-09T21:51:54.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.468+0000 7f01037fe700 1 -- 172.21.15.53:0/2768508912 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: -38 subvolume group snapshots are not supported) v1 ==== 51+0+0 (secure 0 0 0) 0x7f011000bbc0 con 0x7f010806ace0 2023-07-09T21:51:54.470 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOSYS: subvolume group snapshots are not supported 2023-07-09T21:51:54.478 DEBUG:teuthology.orchestra.run:got remote process result: 38 2023-07-09T21:51:54.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs group_0000000000818796 2023-07-09T21:51:54.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.680+0000 7f90503ff700 1 Processor -- start 2023-07-09T21:51:54.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.681+0000 7f90503ff700 1 -- start start 2023-07-09T21:51:54.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.682+0000 7f90503ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f904806c9f0 0x7f904806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:54.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.682+0000 7f90503ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904815ddf0 con 0x7f9048071880 2023-07-09T21:51:54.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.682+0000 7f90503ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904806c4e0 con 0x7f90480b1910 2023-07-09T21:51:54.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.682+0000 7f90503ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904806bf20 con 0x7f904806c9f0 2023-07-09T21:51:54.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.682+0000 7f904e99c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9048071880 0x7f90480cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55006/0 (socket says 172.21.15.53:55006) 2023-07-09T21:51:54.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.682+0000 7f904e99c700 1 -- 172.21.15.53:0/90957345 learned_addr learned my addr 172.21.15.53:0/90957345 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.682+0000 7f904e19b700 1 --2- 172.21.15.53:0/90957345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f904806c9f0 0x7f904806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.682+0000 7f904d199700 1 -- 172.21.15.53:0/90957345 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557957949 0 0) 0x7f904815ddf0 con 0x7f9048071880 2023-07-09T21:51:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.683+0000 7f904d199700 1 -- 172.21.15.53:0/90957345 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90340035b0 con 0x7f9048071880 2023-07-09T21:51:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.683+0000 7f904d199700 1 -- 172.21.15.53:0/90957345 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836795208 0 0) 0x7f904806c4e0 con 0x7f90480b1910 2023-07-09T21:51:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.683+0000 7f904d199700 1 -- 172.21.15.53:0/90957345 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f904815ddf0 con 0x7f90480b1910 2023-07-09T21:51:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.683+0000 7f904e19b700 1 -- 172.21.15.53:0/90957345 >> v1:172.21.15.184:6789/0 conn(0x7f90480b1910 legacy=0x7f9048071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.683+0000 7f904e19b700 1 -- 172.21.15.53:0/90957345 >> v1:172.21.15.53:6789/0 conn(0x7f9048071880 legacy=0x7f90480cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:54.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.683+0000 7f904e19b700 1 -- 172.21.15.53:0/90957345 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904806c200 con 0x7f904806c9f0 2023-07-09T21:51:54.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.683+0000 7f904e19b700 1 --2- 172.21.15.53:0/90957345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f904806c9f0 0x7f904806b5b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9044009870 tx=0x7f9044009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59cbd3354200d0ac server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:54.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.683+0000 7f904d199700 1 -- 172.21.15.53:0/90957345 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9044011830 con 0x7f904806c9f0 2023-07-09T21:51:54.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.683+0000 7f904d199700 1 -- 172.21.15.53:0/90957345 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9044011990 con 0x7f904806c9f0 2023-07-09T21:51:54.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.683+0000 7f904d199700 1 -- 172.21.15.53:0/90957345 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9044011d20 con 0x7f904806c9f0 2023-07-09T21:51:54.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.684+0000 7f90503ff700 1 -- 172.21.15.53:0/90957345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f904806c9f0 msgr2=0x7f904806b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:54.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.684+0000 7f90503ff700 1 --2- 172.21.15.53:0/90957345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f904806c9f0 0x7f904806b5b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9044009870 tx=0x7f9044009b80 comp rx=0 tx=0).stop 2023-07-09T21:51:54.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.684+0000 7f90503ff700 1 -- 172.21.15.53:0/90957345 shutdown_connections 2023-07-09T21:51:54.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.684+0000 7f90503ff700 1 --2- 172.21.15.53:0/90957345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f904806c9f0 0x7f904806b5b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.684+0000 7f90503ff700 1 -- 172.21.15.53:0/90957345 >> 172.21.15.53:0/90957345 conn(0x7f90480b05d0 msgr2=0x7f90480b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:54.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.684+0000 7f90503ff700 1 -- 172.21.15.53:0/90957345 shutdown_connections 2023-07-09T21:51:54.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.684+0000 7f90503ff700 1 -- 172.21.15.53:0/90957345 wait complete. 2023-07-09T21:51:54.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.686+0000 7f90503ff700 1 Processor -- start 2023-07-09T21:51:54.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.686+0000 7f90503ff700 1 -- start start 2023-07-09T21:51:54.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.687+0000 7f90503ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f904806c9f0 0x7f9048158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:54.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.687+0000 7f90503ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9048071880 0x7f90480c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:54.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.687+0000 7f90503ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90480b1910 0x7f90480a8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:54.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.687+0000 7f90503ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90480c3930 con 0x7f9048071880 2023-07-09T21:51:54.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.687+0000 7f90503ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90480c3c10 con 0x7f904806c9f0 2023-07-09T21:51:54.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.687+0000 7f90503ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90480c3ef0 con 0x7f90480b1910 2023-07-09T21:51:54.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.687+0000 7f904d99a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9048071880 0x7f90480c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:54.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.687+0000 7f904d99a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9048071880 0x7f90480c3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52504/0 (socket says 172.21.15.53:52504) 2023-07-09T21:51:54.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.687+0000 7f904d99a700 1 -- 172.21.15.53:0/470566230 learned_addr learned my addr 172.21.15.53:0/470566230 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:54.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.687+0000 7f904e19b700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f904806c9f0 0x7f9048158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:54.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.687+0000 7f904e99c700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90480b1910 0x7f90480a8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:54.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.688+0000 7f904d99a700 1 -- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90480b1910 msgr2=0x7f90480a8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:54.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.688+0000 7f904d99a700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90480b1910 0x7f90480a8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.688+0000 7f904d99a700 1 -- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f904806c9f0 msgr2=0x7f9048158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:54.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.688+0000 7f904d99a700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f904806c9f0 0x7f9048158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.688+0000 7f904d99a700 1 -- 172.21.15.53:0/470566230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90440094a0 con 0x7f9048071880 2023-07-09T21:51:54.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.688+0000 7f904d99a700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9048071880 0x7f90480c3050 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f903800c500 tx=0x7f903800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:54.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.688+0000 7f903effd700 1 -- 172.21.15.53:0/470566230 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90380052d0 con 0x7f9048071880 2023-07-09T21:51:54.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.688+0000 7f903effd700 1 -- 172.21.15.53:0/470566230 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9038005450 con 0x7f9048071880 2023-07-09T21:51:54.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.688+0000 7f90503ff700 1 -- 172.21.15.53:0/470566230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90480c41d0 con 0x7f9048071880 2023-07-09T21:51:54.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.688+0000 7f903effd700 1 -- 172.21.15.53:0/470566230 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90380038c0 con 0x7f9048071880 2023-07-09T21:51:54.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.688+0000 7f90503ff700 1 -- 172.21.15.53:0/470566230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9048159060 con 0x7f9048071880 2023-07-09T21:51:54.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.689+0000 7f90503ff700 1 -- 172.21.15.53:0/470566230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90480c46f0 con 0x7f9048071880 2023-07-09T21:51:54.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.691+0000 7f903effd700 1 -- 172.21.15.53:0/470566230 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9038003a20 con 0x7f9048071880 2023-07-09T21:51:54.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.692+0000 7f903effd700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f902c06ace0 0x7f902c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:54.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.692+0000 7f903effd700 1 -- 172.21.15.53:0/470566230 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90380888c0 con 0x7f9048071880 2023-07-09T21:51:54.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.693+0000 7f904e19b700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f902c06ace0 0x7f902c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:54.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.693+0000 7f904e19b700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f902c06ace0 0x7f902c06d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f90440097c0 tx=0x7f904401c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:54.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.697+0000 7f903effd700 1 -- 172.21.15.53:0/470566230 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f90480c46f0 con 0x7f9048071880 2023-07-09T21:51:54.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.938+0000 7f90503ff700 1 -- 172.21.15.53:0/470566230 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "group_0000000000818796", "target": ["mon-mgr", ""]}) v1 -- 0x7f9048070c50 con 0x7f902c06ace0 2023-07-09T21:51:54.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.943+0000 7f903effd700 1 -- 172.21.15.53:0/470566230 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9044011b00 con 0x7f902c06ace0 2023-07-09T21:51:54.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.946+0000 7f90503ff700 1 -- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f902c06ace0 msgr2=0x7f902c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:54.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.946+0000 7f90503ff700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f902c06ace0 0x7f902c06d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f90440097c0 tx=0x7f904401c040 comp rx=0 tx=0).stop 2023-07-09T21:51:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.946+0000 7f90503ff700 1 -- 172.21.15.53:0/470566230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9048071880 msgr2=0x7f90480c3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.946+0000 7f90503ff700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9048071880 0x7f90480c3050 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f903800c500 tx=0x7f903800c810 comp rx=0 tx=0).stop 2023-07-09T21:51:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.946+0000 7f90503ff700 1 -- 172.21.15.53:0/470566230 shutdown_connections 2023-07-09T21:51:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.946+0000 7f90503ff700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f902c06ace0 0x7f902c06d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.946+0000 7f90503ff700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90480b1910 0x7f90480a8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.946+0000 7f90503ff700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f904806c9f0 0x7f9048158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.946+0000 7f90503ff700 1 --2- 172.21.15.53:0/470566230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9048071880 0x7f90480c3050 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:54.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.946+0000 7f90503ff700 1 -- 172.21.15.53:0/470566230 >> 172.21.15.53:0/470566230 conn(0x7f90480b05d0 msgr2=0x7f90480ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:54.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.946+0000 7f90503ff700 1 -- 172.21.15.53:0/470566230 shutdown_connections 2023-07-09T21:51:54.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:54.946+0000 7f90503ff700 1 -- 172.21.15.53:0/470566230 wait complete. 2023-07-09T21:51:54.965 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:51:54.965 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:51:55.059 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:51:55.177 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:51:55.178 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:51:55.178 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:55.221 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:51:55.222 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:55.304 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:55.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.542+0000 7f98917ff700 1 Processor -- start 2023-07-09T21:51:55.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.543+0000 7f98917ff700 1 -- start start 2023-07-09T21:51:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.544+0000 7f98917ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f988c15e890 0x7f988c0b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.544+0000 7f98917ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988c15b430 con 0x7f988c15afd0 2023-07-09T21:51:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.544+0000 7f98917ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988c0ce110 con 0x7f988c0b3cc0 2023-07-09T21:51:55.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.544+0000 7f98917ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988c0b4130 con 0x7f988c15e890 2023-07-09T21:51:55.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.544+0000 7f988b7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f988c15afd0 0x7f988c150c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55008/0 (socket says 172.21.15.53:55008) 2023-07-09T21:51:55.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.544+0000 7f988b7fe700 1 -- 172.21.15.53:0/539882011 learned_addr learned my addr 172.21.15.53:0/539882011 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:55.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.545+0000 7f988affd700 1 --2- 172.21.15.53:0/539882011 >> v2:172.21.15.184:3300/0 conn(0x7f988c15e890 0x7f988c0b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:55.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.545+0000 7f988a7fc700 1 -- 172.21.15.53:0/539882011 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653415975 0 0) 0x7f988c15b430 con 0x7f988c15afd0 2023-07-09T21:51:55.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.545+0000 7f988a7fc700 1 -- 172.21.15.53:0/539882011 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98780035b0 con 0x7f988c15afd0 2023-07-09T21:51:55.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.545+0000 7f988a7fc700 1 -- 172.21.15.53:0/539882011 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967055366 0 0) 0x7f988c0ce110 con 0x7f988c0b3cc0 2023-07-09T21:51:55.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.545+0000 7f988a7fc700 1 -- 172.21.15.53:0/539882011 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f988c15b430 con 0x7f988c0b3cc0 2023-07-09T21:51:55.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.545+0000 7f988affd700 1 -- 172.21.15.53:0/539882011 >> v1:172.21.15.184:6789/0 conn(0x7f988c0b3cc0 legacy=0x7f988c15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:55.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.545+0000 7f988affd700 1 -- 172.21.15.53:0/539882011 >> v1:172.21.15.53:6789/0 conn(0x7f988c15afd0 legacy=0x7f988c150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:55.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.545+0000 7f988affd700 1 -- 172.21.15.53:0/539882011 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c15b660 con 0x7f988c15e890 2023-07-09T21:51:55.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.545+0000 7f988affd700 1 --2- 172.21.15.53:0/539882011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c15e890 0x7f988c0b3780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f987c009840 tx=0x7f987c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=350c9d6eca3608cd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:55.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.546+0000 7f988a7fc700 1 -- 172.21.15.53:0/539882011 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c011830 con 0x7f988c15e890 2023-07-09T21:51:55.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.546+0000 7f988a7fc700 1 -- 172.21.15.53:0/539882011 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c011990 con 0x7f988c15e890 2023-07-09T21:51:55.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.546+0000 7f988a7fc700 1 -- 172.21.15.53:0/539882011 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c011d20 con 0x7f988c15e890 2023-07-09T21:51:55.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.546+0000 7f98917ff700 1 -- 172.21.15.53:0/539882011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c15e890 msgr2=0x7f988c0b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:55.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.546+0000 7f98917ff700 1 --2- 172.21.15.53:0/539882011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c15e890 0x7f988c0b3780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f987c009840 tx=0x7f987c009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:55.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.546+0000 7f98917ff700 1 -- 172.21.15.53:0/539882011 shutdown_connections 2023-07-09T21:51:55.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.546+0000 7f98917ff700 1 --2- 172.21.15.53:0/539882011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c15e890 0x7f988c0b3780 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:55.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.546+0000 7f98917ff700 1 -- 172.21.15.53:0/539882011 >> 172.21.15.53:0/539882011 conn(0x7f988c069f30 msgr2=0x7f988c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:55.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.546+0000 7f98917ff700 1 -- 172.21.15.53:0/539882011 shutdown_connections 2023-07-09T21:51:55.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.546+0000 7f98917ff700 1 -- 172.21.15.53:0/539882011 wait complete. 2023-07-09T21:51:55.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.548+0000 7f98917ff700 1 Processor -- start 2023-07-09T21:51:55.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.548+0000 7f98917ff700 1 -- start start 2023-07-09T21:51:55.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.549+0000 7f98917ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f988c0b3cc0 0x7f988c1e4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:55.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.549+0000 7f98917ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f988c15afd0 0x7f988c15c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:55.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.549+0000 7f98917ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c15e890 0x7f988c15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:55.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.549+0000 7f98917ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c1e7600 con 0x7f988c15afd0 2023-07-09T21:51:55.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.549+0000 7f98917ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c13dca0 con 0x7f988c15e890 2023-07-09T21:51:55.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.549+0000 7f98917ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c1e69f0 con 0x7f988c0b3cc0 2023-07-09T21:51:55.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.550+0000 7f9883fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f988c15afd0 0x7f988c15c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:55.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.550+0000 7f9883fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f988c15afd0 0x7f988c15c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52514/0 (socket says 172.21.15.53:52514) 2023-07-09T21:51:55.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.550+0000 7f9883fff700 1 -- 172.21.15.53:0/768255473 learned_addr learned my addr 172.21.15.53:0/768255473 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:55.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.550+0000 7f988affd700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f988c0b3cc0 0x7f988c1e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:55.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.550+0000 7f988b7fe700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c15e890 0x7f988c15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:55.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.550+0000 7f9883fff700 1 -- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f988c0b3cc0 msgr2=0x7f988c1e4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:55.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.550+0000 7f9883fff700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f988c0b3cc0 0x7f988c1e4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:55.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.550+0000 7f9883fff700 1 -- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c15e890 msgr2=0x7f988c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:55.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.550+0000 7f9883fff700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c15e890 0x7f988c15ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:55.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.550+0000 7f9883fff700 1 -- 172.21.15.53:0/768255473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c0094a0 con 0x7f988c15afd0 2023-07-09T21:51:55.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.550+0000 7f9883fff700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f988c15afd0 0x7f988c15c930 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f987400c500 tx=0x7f987400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:55.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.551+0000 7f98837fe700 1 -- 172.21.15.53:0/768255473 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740052d0 con 0x7f988c15afd0 2023-07-09T21:51:55.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.551+0000 7f98837fe700 1 -- 172.21.15.53:0/768255473 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9874005450 con 0x7f988c15afd0 2023-07-09T21:51:55.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.551+0000 7f98917ff700 1 -- 172.21.15.53:0/768255473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988c1e6cd0 con 0x7f988c15afd0 2023-07-09T21:51:55.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.551+0000 7f98837fe700 1 -- 172.21.15.53:0/768255473 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740038c0 con 0x7f988c15afd0 2023-07-09T21:51:55.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.551+0000 7f98917ff700 1 -- 172.21.15.53:0/768255473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988c1e7290 con 0x7f988c15afd0 2023-07-09T21:51:55.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.552+0000 7f98917ff700 1 -- 172.21.15.53:0/768255473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988c0ccde0 con 0x7f988c15afd0 2023-07-09T21:51:55.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.553+0000 7f98837fe700 1 -- 172.21.15.53:0/768255473 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9874003a20 con 0x7f988c15afd0 2023-07-09T21:51:55.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.554+0000 7f98837fe700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f986c06ace0 0x7f986c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:55.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.554+0000 7f98837fe700 1 -- 172.21.15.53:0/768255473 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98740888b0 con 0x7f988c15afd0 2023-07-09T21:51:55.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.554+0000 7f988affd700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f986c06ace0 0x7f986c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:55.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.555+0000 7f988affd700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f986c06ace0 0x7f986c06d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f987c009fd0 tx=0x7f987c01c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:55.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.559+0000 7f98837fe700 1 -- 172.21.15.53:0/768255473 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f98740538c0 con 0x7f988c15afd0 2023-07-09T21:51:55.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.574+0000 7f98837fe700 1 -- 172.21.15.53:0/768255473 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f9874053c90 con 0x7f988c15afd0 2023-07-09T21:51:55.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.773+0000 7f98917ff700 1 -- 172.21.15.53:0/768255473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f988c04e280 con 0x7f988c15afd0 2023-07-09T21:51:55.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.774+0000 7f98837fe700 1 -- 172.21.15.53:0/768255473 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f9874075d90 con 0x7f988c15afd0 2023-07-09T21:51:55.776 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:55.776 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:42.861246+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:51:39.793448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:51:40.342794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:55.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.777+0000 7f98917ff700 1 -- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f986c06ace0 msgr2=0x7f986c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:55.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.777+0000 7f98917ff700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f986c06ace0 0x7f986c06d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f987c009fd0 tx=0x7f987c01c040 comp rx=0 tx=0).stop 2023-07-09T21:51:55.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.777+0000 7f98917ff700 1 -- 172.21.15.53:0/768255473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f988c15afd0 msgr2=0x7f988c15c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:55.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.777+0000 7f98917ff700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f988c15afd0 0x7f988c15c930 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f987400c500 tx=0x7f987400c810 comp rx=0 tx=0).stop 2023-07-09T21:51:55.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.777+0000 7f98917ff700 1 -- 172.21.15.53:0/768255473 shutdown_connections 2023-07-09T21:51:55.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.777+0000 7f98917ff700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f986c06ace0 0x7f986c06d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.777+0000 7f98917ff700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c15e890 0x7f988c15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.777+0000 7f98917ff700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f988c0b3cc0 0x7f988c1e4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.777+0000 7f98917ff700 1 --2- 172.21.15.53:0/768255473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f988c15afd0 0x7f988c15c930 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.777+0000 7f98917ff700 1 -- 172.21.15.53:0/768255473 >> 172.21.15.53:0/768255473 conn(0x7f988c069f30 msgr2=0x7f988c154030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.777+0000 7f98917ff700 1 -- 172.21.15.53:0/768255473 shutdown_connections 2023-07-09T21:51:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:55.777+0000 7f98917ff700 1 -- 172.21.15.53:0/768255473 wait complete. 2023-07-09T21:51:55.797 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:51:39.793448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:51:40.342794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:51:55.798 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:51:56.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.001+0000 7fcf6efff700 1 Processor -- start 2023-07-09T21:51:56.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.001+0000 7fcf6efff700 1 -- start start 2023-07-09T21:51:56.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.002+0000 7fcf6efff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf680b3ff0 0x7fcf680b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.002+0000 7fcf6efff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf680b8e80 con 0x7fcf680d0f60 2023-07-09T21:51:56.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.002+0000 7fcf6efff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf680b33f0 con 0x7fcf680d0b10 2023-07-09T21:51:56.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.002+0000 7fcf6efff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680b1e30 con 0x7fcf680b3ff0 2023-07-09T21:51:56.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.003+0000 7fcf6d59c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcf680d0f60 0x7fcf680b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55024/0 (socket says 172.21.15.53:55024) 2023-07-09T21:51:56.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.003+0000 7fcf6d59c700 1 -- 172.21.15.53:0/1889550232 learned_addr learned my addr 172.21.15.53:0/1889550232 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:56.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.003+0000 7fcf6cd9b700 1 --2- 172.21.15.53:0/1889550232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf680b3ff0 0x7fcf680b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.003+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969924371 0 0) 0x7fcf60001490 con 0x7fcf680d0f60 2023-07-09T21:51:56.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.003+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf580035b0 con 0x7fcf680d0f60 2023-07-09T21:51:56.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.003+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657677739 0 0) 0x7fcf680b33f0 con 0x7fcf680d0b10 2023-07-09T21:51:56.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.003+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf60001490 con 0x7fcf680d0b10 2023-07-09T21:51:56.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.003+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1738277767 0 0) 0x7fcf580035b0 con 0x7fcf680d0f60 2023-07-09T21:51:56.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.003+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf680b3ff0 msgr2=0x7fcf680b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:56.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.003+0000 7fcf677fe700 1 --2- 172.21.15.53:0/1889550232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf680b3ff0 0x7fcf680b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.003+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 >> v1:172.21.15.184:6789/0 conn(0x7fcf680d0b10 legacy=0x7fcf680b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.003+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf680afaa0 con 0x7fcf680d0f60 2023-07-09T21:51:56.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.003+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7fcf60001b80 con 0x7fcf680d0f60 2023-07-09T21:51:56.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf6cd9b700 1 --2- 172.21.15.53:0/1889550232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf680b3ff0 0x7fcf680b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:51:56.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 >> v1:172.21.15.53:6789/0 conn(0x7fcf680d0f60 legacy=0x7fcf680b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf677fe700 1 --2- 172.21.15.53:0/1889550232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf58003bc0 0x7fcf58003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf677fe700 1 --2- 172.21.15.53:0/1889550232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf58004850 0x7fcf58004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf677fe700 1 --2- 172.21.15.53:0/1889550232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf680b3ff0 0x7fcf58005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680b1e30 con 0x7fcf58004850 2023-07-09T21:51:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5800ba40 con 0x7fcf58003bc0 2023-07-09T21:51:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5800bc00 con 0x7fcf680b3ff0 2023-07-09T21:51:56.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf67fff700 1 --2- 172.21.15.53:0/1889550232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf58004850 0x7fcf58004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf6cd9b700 1 --2- 172.21.15.53:0/1889550232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf58003bc0 0x7fcf58003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf6d59c700 1 --2- 172.21.15.53:0/1889550232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf680b3ff0 0x7fcf58005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf67fff700 1 -- 172.21.15.53:0/1889550232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf680b3ff0 msgr2=0x7fcf58005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf67fff700 1 --2- 172.21.15.53:0/1889550232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf680b3ff0 0x7fcf58005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf67fff700 1 -- 172.21.15.53:0/1889550232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf58003bc0 msgr2=0x7fcf58003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf67fff700 1 --2- 172.21.15.53:0/1889550232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf58003bc0 0x7fcf58003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.004+0000 7fcf67fff700 1 -- 172.21.15.53:0/1889550232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0094a0 con 0x7fcf58004850 2023-07-09T21:51:56.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.005+0000 7fcf67fff700 1 --2- 172.21.15.53:0/1889550232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf58004850 0x7fcf58004cc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcf54001940 tx=0x7fcf58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96141eba2d8cb6e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:56.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.005+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54001430 con 0x7fcf58004850 2023-07-09T21:51:56.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.005+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf540050d0 con 0x7fcf58004850 2023-07-09T21:51:56.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.005+0000 7fcf677fe700 1 -- 172.21.15.53:0/1889550232 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54005480 con 0x7fcf58004850 2023-07-09T21:51:56.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.005+0000 7fcf6efff700 1 -- 172.21.15.53:0/1889550232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf58004850 msgr2=0x7fcf58004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.005+0000 7fcf6efff700 1 --2- 172.21.15.53:0/1889550232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf58004850 0x7fcf58004cc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcf54001940 tx=0x7fcf58005880 comp rx=0 tx=0).stop 2023-07-09T21:51:56.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.005+0000 7fcf6d59c700 1 -- 172.21.15.53:0/1889550232 reap_dead start 2023-07-09T21:51:56.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.005+0000 7fcf6efff700 1 -- 172.21.15.53:0/1889550232 shutdown_connections 2023-07-09T21:51:56.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.005+0000 7fcf6efff700 1 -- 172.21.15.53:0/1889550232 >> 172.21.15.53:0/1889550232 conn(0x7fcf6809c1b0 msgr2=0x7fcf680d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:56.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.006+0000 7fcf6efff700 1 -- 172.21.15.53:0/1889550232 shutdown_connections 2023-07-09T21:51:56.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.006+0000 7fcf6efff700 1 -- 172.21.15.53:0/1889550232 wait complete. 2023-07-09T21:51:56.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.007+0000 7fcf6efff700 1 Processor -- start 2023-07-09T21:51:56.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.008+0000 7fcf6efff700 1 -- start start 2023-07-09T21:51:56.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6efff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf58004850 0x7fcf68152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6efff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf6815b3b0 0x7fcf680cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6efff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf680cb960 0x7fcf680cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6efff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680cb000 con 0x7fcf58004850 2023-07-09T21:51:56.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6efff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680ca380 con 0x7fcf680cb960 2023-07-09T21:51:56.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6efff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680ca660 con 0x7fcf6815b3b0 2023-07-09T21:51:56.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6cd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf58004850 0x7fcf68152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6cd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf58004850 0x7fcf68152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52526/0 (socket says 172.21.15.53:52526) 2023-07-09T21:51:56.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6cd9b700 1 -- 172.21.15.53:0/2262614297 learned_addr learned my addr 172.21.15.53:0/2262614297 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:56.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6cd9b700 1 -- 172.21.15.53:0/2262614297 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf6815b3b0 msgr2=0x7fcf680cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6cd9b700 1 --2- 172.21.15.53:0/2262614297 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf6815b3b0 0x7fcf680cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6cd9b700 1 -- 172.21.15.53:0/2262614297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf680cb960 msgr2=0x7fcf680cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6cd9b700 1 --2- 172.21.15.53:0/2262614297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf680cb960 0x7fcf680cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6cd9b700 1 -- 172.21.15.53:0/2262614297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf680ca940 con 0x7fcf58004850 2023-07-09T21:51:56.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.009+0000 7fcf6cd9b700 1 --2- 172.21.15.53:0/2262614297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf58004850 0x7fcf68152560 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c011cd0 tx=0x7fcf5c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:56.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.010+0000 7fcf657fa700 1 -- 172.21.15.53:0/2262614297 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c011e70 con 0x7fcf58004850 2023-07-09T21:51:56.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.010+0000 7fcf657fa700 1 -- 172.21.15.53:0/2262614297 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c00fd40 con 0x7fcf58004850 2023-07-09T21:51:56.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.010+0000 7fcf657fa700 1 -- 172.21.15.53:0/2262614297 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c004240 con 0x7fcf58004850 2023-07-09T21:51:56.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.010+0000 7fcf6efff700 1 -- 172.21.15.53:0/2262614297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf680cac20 con 0x7fcf58004850 2023-07-09T21:51:56.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.010+0000 7fcf6efff700 1 -- 172.21.15.53:0/2262614297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6815adf0 con 0x7fcf58004850 2023-07-09T21:51:56.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.011+0000 7fcf6efff700 1 -- 172.21.15.53:0/2262614297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf680cb270 con 0x7fcf58004850 2023-07-09T21:51:56.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.012+0000 7fcf657fa700 1 -- 172.21.15.53:0/2262614297 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fcf5c0043a0 con 0x7fcf58004850 2023-07-09T21:51:56.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.013+0000 7fcf657fa700 1 --2- 172.21.15.53:0/2262614297 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcf4c06ad70 0x7fcf4c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.013+0000 7fcf657fa700 1 -- 172.21.15.53:0/2262614297 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf5c089a30 con 0x7fcf58004850 2023-07-09T21:51:56.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.014+0000 7fcf67fff700 1 --2- 172.21.15.53:0/2262614297 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcf4c06ad70 0x7fcf4c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.014+0000 7fcf67fff700 1 --2- 172.21.15.53:0/2262614297 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcf4c06ad70 0x7fcf4c06d220 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcf680cd230 tx=0x7fcf54009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:56.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.017+0000 7fcf657fa700 1 -- 172.21.15.53:0/2262614297 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcf5c054b80 con 0x7fcf58004850 2023-07-09T21:51:56.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.225+0000 7fcf6efff700 1 -- 172.21.15.53:0/2262614297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf68074350 con 0x7fcf58004850 2023-07-09T21:51:56.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.226+0000 7fcf657fa700 1 -- 172.21.15.53:0/2262614297 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf5c0220a0 con 0x7fcf58004850 2023-07-09T21:51:56.227 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:51:56.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.228+0000 7fcf6efff700 1 -- 172.21.15.53:0/2262614297 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcf4c06ad70 msgr2=0x7fcf4c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.228+0000 7fcf6efff700 1 --2- 172.21.15.53:0/2262614297 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcf4c06ad70 0x7fcf4c06d220 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcf680cd230 tx=0x7fcf54009030 comp rx=0 tx=0).stop 2023-07-09T21:51:56.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.228+0000 7fcf6efff700 1 -- 172.21.15.53:0/2262614297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf58004850 msgr2=0x7fcf68152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.228+0000 7fcf6efff700 1 --2- 172.21.15.53:0/2262614297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf58004850 0x7fcf68152560 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c011cd0 tx=0x7fcf5c00f520 comp rx=0 tx=0).stop 2023-07-09T21:51:56.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.229+0000 7fcf6efff700 1 -- 172.21.15.53:0/2262614297 shutdown_connections 2023-07-09T21:51:56.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.229+0000 7fcf6efff700 1 --2- 172.21.15.53:0/2262614297 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcf4c06ad70 0x7fcf4c06d220 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.229+0000 7fcf6efff700 1 --2- 172.21.15.53:0/2262614297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf680cb960 0x7fcf680cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.229+0000 7fcf6efff700 1 --2- 172.21.15.53:0/2262614297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf58004850 0x7fcf68152560 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.229+0000 7fcf6efff700 1 --2- 172.21.15.53:0/2262614297 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf6815b3b0 0x7fcf680cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.229+0000 7fcf6efff700 1 -- 172.21.15.53:0/2262614297 >> 172.21.15.53:0/2262614297 conn(0x7fcf6809c1b0 msgr2=0x7fcf680d13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:56.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.229+0000 7fcf6efff700 1 -- 172.21.15.53:0/2262614297 shutdown_connections 2023-07-09T21:51:56.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.229+0000 7fcf6efff700 1 -- 172.21.15.53:0/2262614297 wait complete. 2023-07-09T21:51:56.247 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:51:56.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.448+0000 7f6e2fbff700 1 Processor -- start 2023-07-09T21:51:56.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.448+0000 7f6e2fbff700 1 -- start start 2023-07-09T21:51:56.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.449+0000 7f6e2fbff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6e280b3ff0 0x7f6e280b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2fbff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6e280d0b10 0x7f6e280d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2fbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e280b25d0 0x7f6e280b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2fbff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e280d14d0 con 0x7f6e280d0b10 2023-07-09T21:51:56.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2fbff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e280b8e80 con 0x7f6e280b3ff0 2023-07-09T21:51:56.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2fbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280afaa0 con 0x7f6e280b25d0 2023-07-09T21:51:56.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2d19a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6e280d0b10 0x7f6e280d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2d19a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6e280d0b10 0x7f6e280d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52534/0 (socket says 172.21.15.53:52534) 2023-07-09T21:51:56.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2d19a700 1 -- 172.21.15.53:0/2437619606 learned_addr learned my addr 172.21.15.53:0/2437619606 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:56.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2e19c700 1 --2- 172.21.15.53:0/2437619606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e280b25d0 0x7f6e280b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2d99b700 1 --2- 172.21.15.53:0/2437619606 >> v2:172.21.15.184:3300/0 conn(0x7f6e280b3ff0 0x7f6e280b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2d19a700 1 -- 172.21.15.53:0/2437619606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e280b25d0 msgr2=0x7f6e280b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:56.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2d19a700 1 --2- 172.21.15.53:0/2437619606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e280b25d0 0x7f6e280b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2d19a700 1 -- 172.21.15.53:0/2437619606 >> v2:172.21.15.184:3300/0 conn(0x7f6e280b3ff0 msgr2=0x7f6e280b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:56.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2d19a700 1 --2- 172.21.15.53:0/2437619606 >> v2:172.21.15.184:3300/0 conn(0x7f6e280b3ff0 0x7f6e280b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.450+0000 7f6e2d19a700 1 -- 172.21.15.53:0/2437619606 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e280afd80 con 0x7f6e280d0b10 2023-07-09T21:51:56.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.451+0000 7f6e2d19a700 1 --2- 172.21.15.53:0/2437619606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280d0b10 0x7f6e280d0f90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6e280b5b00 tx=0x7f6e18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a711c355e219efc6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:56.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.451+0000 7f6e2c999700 1 -- 172.21.15.53:0/2437619606 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1800b870 con 0x7f6e280d0b10 2023-07-09T21:51:56.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.451+0000 7f6e2c999700 1 -- 172.21.15.53:0/2437619606 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1800b9d0 con 0x7f6e280d0b10 2023-07-09T21:51:56.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.451+0000 7f6e2c999700 1 -- 172.21.15.53:0/2437619606 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1800bd60 con 0x7f6e280d0b10 2023-07-09T21:51:56.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.451+0000 7f6e2fbff700 1 -- 172.21.15.53:0/2437619606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280d0b10 msgr2=0x7f6e280d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.451+0000 7f6e2fbff700 1 --2- 172.21.15.53:0/2437619606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280d0b10 0x7f6e280d0f90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6e280b5b00 tx=0x7f6e18009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.452+0000 7f6e2fbff700 1 -- 172.21.15.53:0/2437619606 shutdown_connections 2023-07-09T21:51:56.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.452+0000 7f6e2fbff700 1 --2- 172.21.15.53:0/2437619606 >> v2:172.21.15.184:3300/0 conn(0x7f6e280b3ff0 0x7f6e280b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.452+0000 7f6e2fbff700 1 --2- 172.21.15.53:0/2437619606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e280b25d0 0x7f6e280b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.452+0000 7f6e2fbff700 1 --2- 172.21.15.53:0/2437619606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280d0b10 0x7f6e280d0f90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.452+0000 7f6e2fbff700 1 -- 172.21.15.53:0/2437619606 >> 172.21.15.53:0/2437619606 conn(0x7f6e2809c1b0 msgr2=0x7f6e280d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:56.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.452+0000 7f6e2fbff700 1 -- 172.21.15.53:0/2437619606 shutdown_connections 2023-07-09T21:51:56.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.452+0000 7f6e2fbff700 1 -- 172.21.15.53:0/2437619606 wait complete. 2023-07-09T21:51:56.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.453+0000 7f6e2fbff700 1 Processor -- start 2023-07-09T21:51:56.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.454+0000 7f6e2fbff700 1 -- start start 2023-07-09T21:51:56.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2fbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e280b25d0 0x7f6e280b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2fbff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280b3ff0 0x7f6e280cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2fbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e280d0b10 0x7f6e2814cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2fbff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280cf2e0 con 0x7f6e280b3ff0 2023-07-09T21:51:56.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2fbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280b6de0 con 0x7f6e280d0b10 2023-07-09T21:51:56.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2fbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280b70c0 con 0x7f6e280b25d0 2023-07-09T21:51:56.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2d19a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280b3ff0 0x7f6e280cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2d19a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280b3ff0 0x7f6e280cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52546/0 (socket says 172.21.15.53:52546) 2023-07-09T21:51:56.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2d19a700 1 -- 172.21.15.53:0/3154441756 learned_addr learned my addr 172.21.15.53:0/3154441756 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:56.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2d99b700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e280b25d0 0x7f6e280b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2e19c700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e280d0b10 0x7f6e2814cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2d19a700 1 -- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e280b25d0 msgr2=0x7f6e280b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2d19a700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e280b25d0 0x7f6e280b6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2d19a700 1 -- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e280d0b10 msgr2=0x7f6e2814cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2d19a700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e280d0b10 0x7f6e2814cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2d19a700 1 -- 172.21.15.53:0/3154441756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e18009550 con 0x7f6e280b3ff0 2023-07-09T21:51:56.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.455+0000 7f6e2e19c700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e280d0b10 0x7f6e2814cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:56.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.456+0000 7f6e2d19a700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280b3ff0 0x7f6e280cd7e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6e18000c00 tx=0x7f6e18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:56.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.456+0000 7f6e1e7fc700 1 -- 172.21.15.53:0/3154441756 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e18004540 con 0x7f6e280b3ff0 2023-07-09T21:51:56.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.456+0000 7f6e1e7fc700 1 -- 172.21.15.53:0/3154441756 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e180036a0 con 0x7f6e280b3ff0 2023-07-09T21:51:56.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.456+0000 7f6e1e7fc700 1 -- 172.21.15.53:0/3154441756 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e18003a50 con 0x7f6e280b3ff0 2023-07-09T21:51:56.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.456+0000 7f6e2fbff700 1 -- 172.21.15.53:0/3154441756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e280b73a0 con 0x7f6e280b3ff0 2023-07-09T21:51:56.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.456+0000 7f6e2fbff700 1 -- 172.21.15.53:0/3154441756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e280b7960 con 0x7f6e280b3ff0 2023-07-09T21:51:56.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.457+0000 7f6e2fbff700 1 -- 172.21.15.53:0/3154441756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e28074350 con 0x7f6e280b3ff0 2023-07-09T21:51:56.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.458+0000 7f6e1e7fc700 1 -- 172.21.15.53:0/3154441756 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f6e18021070 con 0x7f6e280b3ff0 2023-07-09T21:51:56.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.459+0000 7f6e1e7fc700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6e0c06ad70 0x7f6e0c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.459+0000 7f6e1e7fc700 1 -- 172.21.15.53:0/3154441756 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6e1808ac90 con 0x7f6e280b3ff0 2023-07-09T21:51:56.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.460+0000 7f6e2d99b700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6e0c06ad70 0x7f6e0c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.460+0000 7f6e2d99b700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6e0c06ad70 0x7f6e0c06d220 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6e240098b0 tx=0x7f6e24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:56.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.463+0000 7f6e1e7fc700 1 -- 172.21.15.53:0/3154441756 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6e18055c50 con 0x7f6e280b3ff0 2023-07-09T21:51:56.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.670+0000 7f6e2fbff700 1 -- 172.21.15.53:0/3154441756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6e280b3cb0 con 0x7f6e280b3ff0 2023-07-09T21:51:56.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.671+0000 7f6e1e7fc700 1 -- 172.21.15.53:0/3154441756 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6e180150a0 con 0x7f6e280b3ff0 2023-07-09T21:51:56.672 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:51:56.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.673+0000 7f6e2fbff700 1 -- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6e0c06ad70 msgr2=0x7f6e0c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.673+0000 7f6e2fbff700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6e0c06ad70 0x7f6e0c06d220 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6e240098b0 tx=0x7f6e24008040 comp rx=0 tx=0).stop 2023-07-09T21:51:56.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.673+0000 7f6e2fbff700 1 -- 172.21.15.53:0/3154441756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280b3ff0 msgr2=0x7f6e280cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.673+0000 7f6e2fbff700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280b3ff0 0x7f6e280cd7e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6e18000c00 tx=0x7f6e18004750 comp rx=0 tx=0).stop 2023-07-09T21:51:56.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.673+0000 7f6e2fbff700 1 -- 172.21.15.53:0/3154441756 shutdown_connections 2023-07-09T21:51:56.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.673+0000 7f6e2fbff700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6e0c06ad70 0x7f6e0c06d220 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.673+0000 7f6e2fbff700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e280d0b10 0x7f6e2814cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.673+0000 7f6e2fbff700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e280b25d0 0x7f6e280b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.673+0000 7f6e2fbff700 1 --2- 172.21.15.53:0/3154441756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280b3ff0 0x7f6e280cd7e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.673+0000 7f6e2fbff700 1 -- 172.21.15.53:0/3154441756 >> 172.21.15.53:0/3154441756 conn(0x7f6e2809c1b0 msgr2=0x7f6e280b5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:56.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.673+0000 7f6e2fbff700 1 -- 172.21.15.53:0/3154441756 shutdown_connections 2023-07-09T21:51:56.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.673+0000 7f6e2fbff700 1 -- 172.21.15.53:0/3154441756 wait complete. 2023-07-09T21:51:56.692 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:51:56.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.896+0000 7f0be19ff700 1 Processor -- start 2023-07-09T21:51:56.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.896+0000 7f0be19ff700 1 -- start start 2023-07-09T21:51:56.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.897+0000 7f0be19ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0bdc0d1220 0x7f0bdc0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.897+0000 7f0be19ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0bdc0b0e20 0x7f0bdc0b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.897+0000 7f0be19ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc0b8e80 con 0x7f0bdc0b3ff0 2023-07-09T21:51:56.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.897+0000 7f0be19ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc0afaa0 con 0x7f0bdc0b0e20 2023-07-09T21:51:56.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.897+0000 7f0be19ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0afd80 con 0x7f0bdc0d1220 2023-07-09T21:51:56.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.898+0000 7f0bdb7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0bdc0b0e20 0x7f0bdc0b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.898+0000 7f0bdb7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0bdc0b0e20 0x7f0bdc0b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52550/0 (socket says 172.21.15.53:52550) 2023-07-09T21:51:56.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.898+0000 7f0bdb7fe700 1 -- 172.21.15.53:0/3510479688 learned_addr learned my addr 172.21.15.53:0/3510479688 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:56.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.898+0000 7f0bdb7fe700 1 -- 172.21.15.53:0/3510479688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0bdc0d1220 msgr2=0x7f0bdc0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:56.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.898+0000 7f0bdb7fe700 1 --2- 172.21.15.53:0/3510479688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0bdc0d1220 0x7f0bdc0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.898+0000 7f0bdb7fe700 1 -- 172.21.15.53:0/3510479688 >> v1:172.21.15.184:6789/0 conn(0x7f0bdc0b3ff0 legacy=0x7f0bdc0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:56.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.898+0000 7f0bdb7fe700 1 -- 172.21.15.53:0/3510479688 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0b0060 con 0x7f0bdc0b0e20 2023-07-09T21:51:56.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.898+0000 7f0bdb7fe700 1 --2- 172.21.15.53:0/3510479688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bdc0b0e20 0x7f0bdc0b1280 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009e50 tx=0x7f0bd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c28edf1959a09ae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:56.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.898+0000 7f0bd9ffb700 1 -- 172.21.15.53:0/3510479688 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400e070 con 0x7f0bdc0b0e20 2023-07-09T21:51:56.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.899+0000 7f0bd9ffb700 1 -- 172.21.15.53:0/3510479688 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd4003a20 con 0x7f0bdc0b0e20 2023-07-09T21:51:56.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.899+0000 7f0bd9ffb700 1 -- 172.21.15.53:0/3510479688 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4003dd0 con 0x7f0bdc0b0e20 2023-07-09T21:51:56.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.899+0000 7f0be19ff700 1 -- 172.21.15.53:0/3510479688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bdc0b0e20 msgr2=0x7f0bdc0b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.899+0000 7f0be19ff700 1 --2- 172.21.15.53:0/3510479688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bdc0b0e20 0x7f0bdc0b1280 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009e50 tx=0x7f0bd400b330 comp rx=0 tx=0).stop 2023-07-09T21:51:56.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.899+0000 7f0be19ff700 1 -- 172.21.15.53:0/3510479688 shutdown_connections 2023-07-09T21:51:56.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.899+0000 7f0be19ff700 1 --2- 172.21.15.53:0/3510479688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bdc0b0e20 0x7f0bdc0b1280 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.899+0000 7f0be19ff700 1 --2- 172.21.15.53:0/3510479688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0bdc0d1220 0x7f0bdc0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.899+0000 7f0be19ff700 1 -- 172.21.15.53:0/3510479688 >> 172.21.15.53:0/3510479688 conn(0x7f0bdc09c1b0 msgr2=0x7f0bdc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:56.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.899+0000 7f0be19ff700 1 -- 172.21.15.53:0/3510479688 shutdown_connections 2023-07-09T21:51:56.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.899+0000 7f0be19ff700 1 -- 172.21.15.53:0/3510479688 wait complete. 2023-07-09T21:51:56.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.901+0000 7f0be19ff700 1 Processor -- start 2023-07-09T21:51:56.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.901+0000 7f0be19ff700 1 -- start start 2023-07-09T21:51:56.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.902+0000 7f0be19ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bdc0b0e20 0x7f0bdc157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.902+0000 7f0be19ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bdc0b3ff0 0x7f0bdc153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.902+0000 7f0be19ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0bdc0d1220 0x7f0bdc0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.902+0000 7f0be19ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc15cdb0 con 0x7f0bdc0b3ff0 2023-07-09T21:51:56.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.902+0000 7f0be19ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc15d000 con 0x7f0bdc0b0e20 2023-07-09T21:51:56.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.902+0000 7f0be19ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc15d2e0 con 0x7f0bdc0d1220 2023-07-09T21:51:56.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.902+0000 7f0bda7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bdc0b3ff0 0x7f0bdc153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.902+0000 7f0bda7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bdc0b3ff0 0x7f0bdc153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52566/0 (socket says 172.21.15.53:52566) 2023-07-09T21:51:56.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.902+0000 7f0bda7fc700 1 -- 172.21.15.53:0/379520034 learned_addr learned my addr 172.21.15.53:0/379520034 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:56.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.902+0000 7f0bdaffd700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bdc0b0e20 0x7f0bdc157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.903+0000 7f0bdb7fe700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0bdc0d1220 0x7f0bdc0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.903+0000 7f0bda7fc700 1 -- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0bdc0d1220 msgr2=0x7f0bdc0ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.903+0000 7f0bda7fc700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0bdc0d1220 0x7f0bdc0ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.903+0000 7f0bda7fc700 1 -- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bdc0b0e20 msgr2=0x7f0bdc157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:56.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.903+0000 7f0bda7fc700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bdc0b0e20 0x7f0bdc157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:56.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.903+0000 7f0bda7fc700 1 -- 172.21.15.53:0/379520034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd4009b30 con 0x7f0bdc0b3ff0 2023-07-09T21:51:56.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.903+0000 7f0bda7fc700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bdc0b3ff0 0x7f0bdc153f10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000b450 tx=0x7f0bd000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:56.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.903+0000 7f0bc3fff700 1 -- 172.21.15.53:0/379520034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0011830 con 0x7f0bdc0b3ff0 2023-07-09T21:51:56.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.903+0000 7f0bc3fff700 1 -- 172.21.15.53:0/379520034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd0011990 con 0x7f0bdc0b3ff0 2023-07-09T21:51:56.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.903+0000 7f0bc3fff700 1 -- 172.21.15.53:0/379520034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0011d40 con 0x7f0bdc0b3ff0 2023-07-09T21:51:56.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.903+0000 7f0be19ff700 1 -- 172.21.15.53:0/379520034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc15d5c0 con 0x7f0bdc0b3ff0 2023-07-09T21:51:56.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.904+0000 7f0be19ff700 1 -- 172.21.15.53:0/379520034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc154450 con 0x7f0bdc0b3ff0 2023-07-09T21:51:56.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.905+0000 7f0be19ff700 1 -- 172.21.15.53:0/379520034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc0d0960 con 0x7f0bdc0b3ff0 2023-07-09T21:51:56.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.906+0000 7f0bc3fff700 1 -- 172.21.15.53:0/379520034 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f0bd001a400 con 0x7f0bdc0b3ff0 2023-07-09T21:51:56.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.906+0000 7f0bc3fff700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0bc806ad70 0x7f0bc806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:56.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.907+0000 7f0bc3fff700 1 -- 172.21.15.53:0/379520034 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0bd0089480 con 0x7f0bdc0b3ff0 2023-07-09T21:51:56.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.907+0000 7f0bdaffd700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0bc806ad70 0x7f0bc806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:56.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.908+0000 7f0bdaffd700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0bc806ad70 0x7f0bc806d220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0b3950 tx=0x7f0bcc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:56.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:56.911+0000 7f0bc3fff700 1 -- 172.21.15.53:0/379520034 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0bd00544d0 con 0x7f0bdc0b3ff0 2023-07-09T21:51:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.117+0000 7f0be19ff700 1 -- 172.21.15.53:0/379520034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0bdc15dae0 con 0x7f0bdc0b3ff0 2023-07-09T21:51:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.117+0000 7f0bc3fff700 1 -- 172.21.15.53:0/379520034 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0bdc15dae0 con 0x7f0bdc0b3ff0 2023-07-09T21:51:57.119 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:51:57.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.120+0000 7f0be19ff700 1 -- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0bc806ad70 msgr2=0x7f0bc806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:57.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.120+0000 7f0be19ff700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0bc806ad70 0x7f0bc806d220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0b3950 tx=0x7f0bcc009040 comp rx=0 tx=0).stop 2023-07-09T21:51:57.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.120+0000 7f0be19ff700 1 -- 172.21.15.53:0/379520034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bdc0b3ff0 msgr2=0x7f0bdc153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:57.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.120+0000 7f0be19ff700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bdc0b3ff0 0x7f0bdc153f10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000b450 tx=0x7f0bd000b760 comp rx=0 tx=0).stop 2023-07-09T21:51:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.120+0000 7f0be19ff700 1 -- 172.21.15.53:0/379520034 shutdown_connections 2023-07-09T21:51:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.120+0000 7f0be19ff700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0bc806ad70 0x7f0bc806d220 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.120+0000 7f0be19ff700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0bdc0d1220 0x7f0bdc0ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.120+0000 7f0be19ff700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bdc0b0e20 0x7f0bdc157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.120+0000 7f0be19ff700 1 --2- 172.21.15.53:0/379520034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bdc0b3ff0 0x7f0bdc153f10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.120+0000 7f0be19ff700 1 -- 172.21.15.53:0/379520034 >> 172.21.15.53:0/379520034 conn(0x7f0bdc09c1b0 msgr2=0x7f0bdc0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.120+0000 7f0be19ff700 1 -- 172.21.15.53:0/379520034 shutdown_connections 2023-07-09T21:51:57.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.120+0000 7f0be19ff700 1 -- 172.21.15.53:0/379520034 wait complete. 2023-07-09T21:51:57.139 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:51:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.341+0000 7eff05fff700 1 Processor -- start 2023-07-09T21:51:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.342+0000 7eff05fff700 1 -- start start 2023-07-09T21:51:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.343+0000 7eff05fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7eff000b3ff0 0x7eff000b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.343+0000 7eff05fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff000b8e80 con 0x7eff000d0f90 2023-07-09T21:51:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.343+0000 7eff05fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff000b33f0 con 0x7eff000d0b10 2023-07-09T21:51:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.343+0000 7eff05fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff000b1e30 con 0x7eff000b3ff0 2023-07-09T21:51:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.343+0000 7efeff7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7eff000b3ff0 0x7eff000b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.343+0000 7efefffff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7eff000d0f90 0x7eff000b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55030/0 (socket says 172.21.15.53:55030) 2023-07-09T21:51:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.343+0000 7efefffff700 1 -- 172.21.15.53:0/1634218499 learned_addr learned my addr 172.21.15.53:0/1634218499 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.344+0000 7efeff7fe700 1 -- 172.21.15.53:0/1634218499 >> v1:172.21.15.184:6789/0 conn(0x7eff000d0b10 legacy=0x7eff000b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.344+0000 7efeff7fe700 1 -- 172.21.15.53:0/1634218499 >> v1:172.21.15.53:6789/0 conn(0x7eff000d0f90 legacy=0x7eff000b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.344+0000 7efeff7fe700 1 -- 172.21.15.53:0/1634218499 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff000afaa0 con 0x7eff000b3ff0 2023-07-09T21:51:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.344+0000 7efefe7fc700 1 -- 172.21.15.53:0/1634218499 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425554490 0 0) 0x7efef8001490 con 0x7eff000d0f90 2023-07-09T21:51:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.344+0000 7efeff7fe700 1 --2- 172.21.15.53:0/1634218499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff000b3ff0 0x7eff000b43c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efef0009840 tx=0x7efef0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde63e51d6755d65 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.344+0000 7efefe7fc700 1 -- 172.21.15.53:0/1634218499 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef0011830 con 0x7eff000b3ff0 2023-07-09T21:51:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.344+0000 7efefe7fc700 1 -- 172.21.15.53:0/1634218499 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef0011990 con 0x7eff000b3ff0 2023-07-09T21:51:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.344+0000 7efefe7fc700 1 -- 172.21.15.53:0/1634218499 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef0011d20 con 0x7eff000b3ff0 2023-07-09T21:51:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.345+0000 7eff05fff700 1 -- 172.21.15.53:0/1634218499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff000b3ff0 msgr2=0x7eff000b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.345+0000 7eff05fff700 1 --2- 172.21.15.53:0/1634218499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff000b3ff0 0x7eff000b43c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efef0009840 tx=0x7efef0009b50 comp rx=0 tx=0).stop 2023-07-09T21:51:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.345+0000 7eff05fff700 1 -- 172.21.15.53:0/1634218499 shutdown_connections 2023-07-09T21:51:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.345+0000 7eff05fff700 1 --2- 172.21.15.53:0/1634218499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff000b3ff0 0x7eff000b43c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.345+0000 7eff05fff700 1 -- 172.21.15.53:0/1634218499 >> 172.21.15.53:0/1634218499 conn(0x7eff0009c1b0 msgr2=0x7eff000d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.345+0000 7eff05fff700 1 -- 172.21.15.53:0/1634218499 shutdown_connections 2023-07-09T21:51:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.345+0000 7eff05fff700 1 -- 172.21.15.53:0/1634218499 wait complete. 2023-07-09T21:51:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.347+0000 7eff05fff700 1 Processor -- start 2023-07-09T21:51:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.347+0000 7eff05fff700 1 -- start start 2023-07-09T21:51:57.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.348+0000 7eff05fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff000b3ff0 0x7eff000ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:57.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.348+0000 7eff05fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff000d0b10 0x7eff000ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:57.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.348+0000 7eff05fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff000d0f90 0x7eff000cf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:57.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.348+0000 7eff05fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff000cdac0 con 0x7eff000d0f90 2023-07-09T21:51:57.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.348+0000 7eff05fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff000cdda0 con 0x7eff000b3ff0 2023-07-09T21:51:57.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.348+0000 7eff05fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff000ce080 con 0x7eff000d0b10 2023-07-09T21:51:57.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.348+0000 7efefffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff000d0f90 0x7eff000cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.348+0000 7efefffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff000d0f90 0x7eff000cf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52586/0 (socket says 172.21.15.53:52586) 2023-07-09T21:51:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.348+0000 7efefffff700 1 -- 172.21.15.53:0/348579642 learned_addr learned my addr 172.21.15.53:0/348579642 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.348+0000 7efefeffd700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff000d0b10 0x7eff000ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.348+0000 7efeff7fe700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff000b3ff0 0x7eff000ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.348+0000 7efefffff700 1 -- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff000d0b10 msgr2=0x7eff000ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.349+0000 7efefffff700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff000d0b10 0x7eff000ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.349+0000 7efefffff700 1 -- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff000b3ff0 msgr2=0x7eff000ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.349+0000 7efefffff700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff000b3ff0 0x7eff000ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.349+0000 7efefffff700 1 -- 172.21.15.53:0/348579642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef00094a0 con 0x7eff000d0f90 2023-07-09T21:51:57.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.349+0000 7efefffff700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff000d0f90 0x7eff000cf850 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efef800cba0 tx=0x7efef800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:57.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.349+0000 7efee7fff700 1 -- 172.21.15.53:0/348579642 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef800aaa0 con 0x7eff000d0f90 2023-07-09T21:51:57.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.349+0000 7efee7fff700 1 -- 172.21.15.53:0/348579642 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef800ac20 con 0x7eff000d0f90 2023-07-09T21:51:57.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.349+0000 7efee7fff700 1 -- 172.21.15.53:0/348579642 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef80070d0 con 0x7eff000d0f90 2023-07-09T21:51:57.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.349+0000 7eff05fff700 1 -- 172.21.15.53:0/348579642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff000ce360 con 0x7eff000d0f90 2023-07-09T21:51:57.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.349+0000 7eff05fff700 1 -- 172.21.15.53:0/348579642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff000cf0a0 con 0x7eff000d0f90 2023-07-09T21:51:57.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.350+0000 7eff05fff700 1 -- 172.21.15.53:0/348579642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff00074350 con 0x7eff000d0f90 2023-07-09T21:51:57.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.351+0000 7efee7fff700 1 -- 172.21.15.53:0/348579642 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7efef8007230 con 0x7eff000d0f90 2023-07-09T21:51:57.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.352+0000 7efee7fff700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7efeec06ad70 0x7efeec06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.352+0000 7efee7fff700 1 -- 172.21.15.53:0/348579642 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efef8088e90 con 0x7eff000d0f90 2023-07-09T21:51:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.353+0000 7efeff7fe700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7efeec06ad70 0x7efeec06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.353+0000 7efeff7fe700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7efeec06ad70 0x7efeec06d220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efef00090b0 tx=0x7efef001c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.356+0000 7efee7fff700 1 -- 172.21.15.53:0/348579642 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efef8053e50 con 0x7eff000d0f90 2023-07-09T21:51:57.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.567+0000 7eff05fff700 1 -- 172.21.15.53:0/348579642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff000b8e80 con 0x7eff000d0f90 2023-07-09T21:51:57.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.567+0000 7efee7fff700 1 -- 172.21.15.53:0/348579642 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7efef808a020 con 0x7eff000d0f90 2023-07-09T21:51:57.569 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:51:57.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.569+0000 7eff05fff700 1 -- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7efeec06ad70 msgr2=0x7efeec06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:57.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.569+0000 7eff05fff700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7efeec06ad70 0x7efeec06d220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efef00090b0 tx=0x7efef001c040 comp rx=0 tx=0).stop 2023-07-09T21:51:57.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.569+0000 7eff05fff700 1 -- 172.21.15.53:0/348579642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff000d0f90 msgr2=0x7eff000cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:57.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.570+0000 7eff05fff700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff000d0f90 0x7eff000cf850 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efef800cba0 tx=0x7efef800ceb0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.570+0000 7eff05fff700 1 -- 172.21.15.53:0/348579642 shutdown_connections 2023-07-09T21:51:57.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.570+0000 7eff05fff700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7efeec06ad70 0x7efeec06d220 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.570+0000 7eff05fff700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff000d0f90 0x7eff000cf850 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.570+0000 7eff05fff700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff000b3ff0 0x7eff000ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.570+0000 7eff05fff700 1 --2- 172.21.15.53:0/348579642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff000d0b10 0x7eff000ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.570+0000 7eff05fff700 1 -- 172.21.15.53:0/348579642 >> 172.21.15.53:0/348579642 conn(0x7eff0009c1b0 msgr2=0x7eff000d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:57.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.570+0000 7eff05fff700 1 -- 172.21.15.53:0/348579642 shutdown_connections 2023-07-09T21:51:57.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.570+0000 7eff05fff700 1 -- 172.21.15.53:0/348579642 wait complete. 2023-07-09T21:51:57.589 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:51:57.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.789+0000 7ff3cd7ff700 1 Processor -- start 2023-07-09T21:51:57.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.789+0000 7ff3cd7ff700 1 -- start start 2023-07-09T21:51:57.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.790+0000 7ff3cd7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3c80b3ff0 0x7ff3c80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:57.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.790+0000 7ff3cd7ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3c80d0f60 0x7ff3c80b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:57.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.790+0000 7ff3cd7ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c80b8e80 con 0x7ff3c80d0b10 2023-07-09T21:51:57.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.790+0000 7ff3cd7ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c80b1e30 con 0x7ff3c80d0f60 2023-07-09T21:51:57.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.790+0000 7ff3cd7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80afaa0 con 0x7ff3c80b3ff0 2023-07-09T21:51:57.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.791+0000 7ff3c77fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3c80d0f60 0x7ff3c80b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:57.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.791+0000 7ff3c67fc700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff3c80d0b10 0x7ff3c80b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55042/0 (socket says 172.21.15.53:55042) 2023-07-09T21:51:57.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.791+0000 7ff3c67fc700 1 -- 172.21.15.53:0/3118266255 learned_addr learned my addr 172.21.15.53:0/3118266255 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:57.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.791+0000 7ff3c6ffd700 1 --2- 172.21.15.53:0/3118266255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3c80b3ff0 0x7ff3c80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:57.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.791+0000 7ff3c77fe700 1 -- 172.21.15.53:0/3118266255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3c80b3ff0 msgr2=0x7ff3c80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:57.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.791+0000 7ff3c77fe700 1 --2- 172.21.15.53:0/3118266255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3c80b3ff0 0x7ff3c80b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.791+0000 7ff3c77fe700 1 -- 172.21.15.53:0/3118266255 >> v1:172.21.15.53:6789/0 conn(0x7ff3c80d0b10 legacy=0x7ff3c80b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:57.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.791+0000 7ff3c5ffb700 1 -- 172.21.15.53:0/3118266255 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624394002 0 0) 0x7ff3bc001110 con 0x7ff3c80d0b10 2023-07-09T21:51:57.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.791+0000 7ff3c77fe700 1 -- 172.21.15.53:0/3118266255 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c80afd80 con 0x7ff3c80d0f60 2023-07-09T21:51:57.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.791+0000 7ff3c77fe700 1 --2- 172.21.15.53:0/3118266255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c80d0f60 0x7ff3c80b2ce0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009d90 tx=0x7ff3c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3903c89d6ac153cf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:57.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.792+0000 7ff3c5ffb700 1 -- 172.21.15.53:0/3118266255 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c000e070 con 0x7ff3c80d0f60 2023-07-09T21:51:57.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.792+0000 7ff3c5ffb700 1 -- 172.21.15.53:0/3118266255 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c000bbd0 con 0x7ff3c80d0f60 2023-07-09T21:51:57.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.792+0000 7ff3c5ffb700 1 -- 172.21.15.53:0/3118266255 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0012430 con 0x7ff3c80d0f60 2023-07-09T21:51:57.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.792+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/3118266255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c80d0f60 msgr2=0x7ff3c80b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:57.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.792+0000 7ff3cd7ff700 1 --2- 172.21.15.53:0/3118266255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c80d0f60 0x7ff3c80b2ce0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009d90 tx=0x7ff3c000b330 comp rx=0 tx=0).stop 2023-07-09T21:51:57.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.792+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/3118266255 shutdown_connections 2023-07-09T21:51:57.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.792+0000 7ff3cd7ff700 1 --2- 172.21.15.53:0/3118266255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c80d0f60 0x7ff3c80b2ce0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.792+0000 7ff3cd7ff700 1 --2- 172.21.15.53:0/3118266255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3c80b3ff0 0x7ff3c80b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.792+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/3118266255 >> 172.21.15.53:0/3118266255 conn(0x7ff3c809c1b0 msgr2=0x7ff3c80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:57.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.792+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/3118266255 shutdown_connections 2023-07-09T21:51:57.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.792+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/3118266255 wait complete. 2023-07-09T21:51:57.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.795+0000 7ff3cd7ff700 1 Processor -- start 2023-07-09T21:51:57.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.795+0000 7ff3cd7ff700 1 -- start start 2023-07-09T21:51:57.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.796+0000 7ff3cd7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3c80b3ff0 0x7ff3c81f1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:57.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.796+0000 7ff3cd7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c80d0b10 0x7ff3c80ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:57.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.796+0000 7ff3cd7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3c80d0f60 0x7ff3c80b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:57.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.796+0000 7ff3cd7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c81f6190 con 0x7ff3c80d0b10 2023-07-09T21:51:57.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.796+0000 7ff3cd7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c815f640 con 0x7ff3c80d0f60 2023-07-09T21:51:57.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.796+0000 7ff3cd7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c81f5580 con 0x7ff3c80b3ff0 2023-07-09T21:51:57.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.796+0000 7ff3c67fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c80d0b10 0x7ff3c80ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:57.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.796+0000 7ff3c67fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c80d0b10 0x7ff3c80ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52606/0 (socket says 172.21.15.53:52606) 2023-07-09T21:51:57.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.796+0000 7ff3c67fc700 1 -- 172.21.15.53:0/2577908619 learned_addr learned my addr 172.21.15.53:0/2577908619 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.797+0000 7ff3c67fc700 1 -- 172.21.15.53:0/2577908619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3c80b3ff0 msgr2=0x7ff3c81f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.797+0000 7ff3c67fc700 1 --2- 172.21.15.53:0/2577908619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3c80b3ff0 0x7ff3c81f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.797+0000 7ff3c67fc700 1 -- 172.21.15.53:0/2577908619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3c80d0f60 msgr2=0x7ff3c80b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.797+0000 7ff3c67fc700 1 --2- 172.21.15.53:0/2577908619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3c80d0f60 0x7ff3c80b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.797+0000 7ff3c67fc700 1 -- 172.21.15.53:0/2577908619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c0009a70 con 0x7ff3c80d0b10 2023-07-09T21:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.797+0000 7ff3c67fc700 1 --2- 172.21.15.53:0/2577908619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c80d0b10 0x7ff3c80ccc10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00c730 tx=0x7ff3bc00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:57.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.797+0000 7ff3af7fe700 1 -- 172.21.15.53:0/2577908619 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc004c80 con 0x7ff3c80d0b10 2023-07-09T21:51:57.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.797+0000 7ff3af7fe700 1 -- 172.21.15.53:0/2577908619 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc004e00 con 0x7ff3c80d0b10 2023-07-09T21:51:57.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.797+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/2577908619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c81f5860 con 0x7ff3c80d0b10 2023-07-09T21:51:57.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.797+0000 7ff3af7fe700 1 -- 172.21.15.53:0/2577908619 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc007310 con 0x7ff3c80d0b10 2023-07-09T21:51:57.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.797+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/2577908619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c81f5e20 con 0x7ff3c80d0b10 2023-07-09T21:51:57.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.798+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/2577908619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c80d0940 con 0x7ff3c80d0b10 2023-07-09T21:51:57.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.799+0000 7ff3af7fe700 1 -- 172.21.15.53:0/2577908619 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7ff3bc007470 con 0x7ff3c80d0b10 2023-07-09T21:51:57.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.801+0000 7ff3af7fe700 1 --2- 172.21.15.53:0/2577908619 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff3b406ad70 0x7ff3b406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:57.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.801+0000 7ff3af7fe700 1 -- 172.21.15.53:0/2577908619 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff3bc089120 con 0x7ff3c80d0b10 2023-07-09T21:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.801+0000 7ff3c6ffd700 1 --2- 172.21.15.53:0/2577908619 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff3b406ad70 0x7ff3b406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.802+0000 7ff3c6ffd700 1 --2- 172.21.15.53:0/2577908619 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff3b406ad70 0x7ff3b406d220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80097f0 tx=0x7ff3b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:57.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:57.805+0000 7ff3af7fe700 1 -- 172.21.15.53:0/2577908619 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff3bc054170 con 0x7ff3c80d0b10 2023-07-09T21:51:58.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.033+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/2577908619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff3c80b8e80 con 0x7ff3c80d0b10 2023-07-09T21:51:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.034+0000 7ff3af7fe700 1 -- 172.21.15.53:0/2577908619 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff3c80b8e80 con 0x7ff3c80d0b10 2023-07-09T21:51:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.036+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/2577908619 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff3b406ad70 msgr2=0x7ff3b406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.036+0000 7ff3cd7ff700 1 --2- 172.21.15.53:0/2577908619 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff3b406ad70 0x7ff3b406d220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80097f0 tx=0x7ff3b8008040 comp rx=0 tx=0).stop 2023-07-09T21:51:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.036+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/2577908619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c80d0b10 msgr2=0x7ff3c80ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.036+0000 7ff3cd7ff700 1 --2- 172.21.15.53:0/2577908619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c80d0b10 0x7ff3c80ccc10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00c730 tx=0x7ff3bc00caf0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.036+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/2577908619 shutdown_connections 2023-07-09T21:51:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.036+0000 7ff3cd7ff700 1 --2- 172.21.15.53:0/2577908619 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff3b406ad70 0x7ff3b406d220 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.036+0000 7ff3cd7ff700 1 --2- 172.21.15.53:0/2577908619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3c80d0f60 0x7ff3c80b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.036+0000 7ff3cd7ff700 1 --2- 172.21.15.53:0/2577908619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3c80b3ff0 0x7ff3c81f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.036+0000 7ff3cd7ff700 1 --2- 172.21.15.53:0/2577908619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c80d0b10 0x7ff3c80ccc10 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.036+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/2577908619 >> 172.21.15.53:0/2577908619 conn(0x7ff3c809c1b0 msgr2=0x7ff3c80b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.036+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/2577908619 shutdown_connections 2023-07-09T21:51:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.036+0000 7ff3cd7ff700 1 -- 172.21.15.53:0/2577908619 wait complete. 2023-07-09T21:51:58.040 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-07-09T21:51:58.055 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T21:51:58.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:58.056 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-09T21:51:58.146 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:51:58.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:51:58.147 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T21:51:58.191 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:51:58.191 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:58.236 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:51:58.237 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:51:58.320 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:51:58.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.519+0000 7f4efb9ff700 1 Processor -- start 2023-07-09T21:51:58.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.519+0000 7f4efb9ff700 1 -- start start 2023-07-09T21:51:58.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.520+0000 7f4efb9ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4ef40b6c80 0x7f4ef40d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:58.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.520+0000 7f4efb9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4ef40d1050 0x7f4ef40b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:58.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.520+0000 7f4efb9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef40b7f50 con 0x7f4ef40b4510 2023-07-09T21:51:58.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.520+0000 7f4efb9ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef40b48e0 con 0x7f4ef40b6c80 2023-07-09T21:51:58.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.520+0000 7f4efb9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef40d14d0 con 0x7f4ef40d1050 2023-07-09T21:51:58.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.520+0000 7f4ef8f9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4ef40b6c80 0x7f4ef40d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:58.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.520+0000 7f4ef8f9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4ef40b6c80 0x7f4ef40d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52610/0 (socket says 172.21.15.53:52610) 2023-07-09T21:51:58.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.520+0000 7f4ef8f9a700 1 -- 172.21.15.53:0/1170233009 learned_addr learned my addr 172.21.15.53:0/1170233009 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:58.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.520+0000 7f4ef9f9c700 1 --2- 172.21.15.53:0/1170233009 >> v2:172.21.15.184:3300/0 conn(0x7f4ef40d1050 0x7f4ef40b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:58.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.521+0000 7f4ef8f9a700 1 -- 172.21.15.53:0/1170233009 >> v2:172.21.15.184:3300/0 conn(0x7f4ef40d1050 msgr2=0x7f4ef40b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:58.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.521+0000 7f4ef8f9a700 1 --2- 172.21.15.53:0/1170233009 >> v2:172.21.15.184:3300/0 conn(0x7f4ef40d1050 0x7f4ef40b83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.521+0000 7f4ef8f9a700 1 -- 172.21.15.53:0/1170233009 >> v1:172.21.15.184:6789/0 conn(0x7f4ef40b4510 legacy=0x7f4ef40cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:58.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.521+0000 7f4ef8f9a700 1 -- 172.21.15.53:0/1170233009 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef40b70d0 con 0x7f4ef40b6c80 2023-07-09T21:51:58.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.521+0000 7f4ef8f9a700 1 --2- 172.21.15.53:0/1170233009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ef40b6c80 0x7f4ef40d0b10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4067390 tx=0x7f4ee4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175e4b9b01f2856d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:58.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.521+0000 7f4eebfff700 1 -- 172.21.15.53:0/1170233009 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4011830 con 0x7f4ef40b6c80 2023-07-09T21:51:58.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.521+0000 7f4eebfff700 1 -- 172.21.15.53:0/1170233009 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee4011990 con 0x7f4ef40b6c80 2023-07-09T21:51:58.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.521+0000 7f4eebfff700 1 -- 172.21.15.53:0/1170233009 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4011d20 con 0x7f4ef40b6c80 2023-07-09T21:51:58.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.522+0000 7f4efb9ff700 1 -- 172.21.15.53:0/1170233009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ef40b6c80 msgr2=0x7f4ef40d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:58.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.522+0000 7f4efb9ff700 1 --2- 172.21.15.53:0/1170233009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ef40b6c80 0x7f4ef40d0b10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4067390 tx=0x7f4ee4009bd0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.522+0000 7f4efb9ff700 1 -- 172.21.15.53:0/1170233009 shutdown_connections 2023-07-09T21:51:58.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.522+0000 7f4efb9ff700 1 --2- 172.21.15.53:0/1170233009 >> v2:172.21.15.184:3300/0 conn(0x7f4ef40d1050 0x7f4ef40b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.522+0000 7f4efb9ff700 1 --2- 172.21.15.53:0/1170233009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ef40b6c80 0x7f4ef40d0b10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.522+0000 7f4efb9ff700 1 -- 172.21.15.53:0/1170233009 >> 172.21.15.53:0/1170233009 conn(0x7f4ef409c1d0 msgr2=0x7f4ef40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:58.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.522+0000 7f4efb9ff700 1 -- 172.21.15.53:0/1170233009 shutdown_connections 2023-07-09T21:51:58.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.522+0000 7f4efb9ff700 1 -- 172.21.15.53:0/1170233009 wait complete. 2023-07-09T21:51:58.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.524+0000 7f4efb9ff700 1 Processor -- start 2023-07-09T21:51:58.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.525+0000 7f4efb9ff700 1 -- start start 2023-07-09T21:51:58.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.526+0000 7f4efb9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ef40b4510 0x7f4ef40c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:58.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.526+0000 7f4efb9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ef40b6c80 0x7f4ef40c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:58.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.526+0000 7f4efb9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ef40d1050 0x7f4ef4150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:58.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.526+0000 7f4efb9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40c8bc0 con 0x7f4ef40b6c80 2023-07-09T21:51:58.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.526+0000 7f4efb9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4155420 con 0x7f4ef40d1050 2023-07-09T21:51:58.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.526+0000 7f4efb9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40c8dd0 con 0x7f4ef40b4510 2023-07-09T21:51:58.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.526+0000 7f4ef8f9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ef40b6c80 0x7f4ef40c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:58.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.526+0000 7f4ef8f9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ef40b6c80 0x7f4ef40c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52620/0 (socket says 172.21.15.53:52620) 2023-07-09T21:51:58.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.526+0000 7f4ef8f9a700 1 -- 172.21.15.53:0/3166740345 learned_addr learned my addr 172.21.15.53:0/3166740345 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:58.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.526+0000 7f4ef9f9c700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ef40d1050 0x7f4ef4150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:58.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.526+0000 7f4ef979b700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ef40b4510 0x7f4ef40c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:58.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.527+0000 7f4ef8f9a700 1 -- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ef40b4510 msgr2=0x7f4ef40c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:58.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.527+0000 7f4ef8f9a700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ef40b4510 0x7f4ef40c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.527+0000 7f4ef8f9a700 1 -- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ef40d1050 msgr2=0x7f4ef4150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:58.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.527+0000 7f4ef8f9a700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ef40d1050 0x7f4ef4150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.527+0000 7f4ef8f9a700 1 -- 172.21.15.53:0/3166740345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee4009550 con 0x7f4ef40b6c80 2023-07-09T21:51:58.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.527+0000 7f4ef8f9a700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ef40b6c80 0x7f4ef40c8680 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4000c00 tx=0x7f4ee4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:58.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.527+0000 7f4ee9ffb700 1 -- 172.21.15.53:0/3166740345 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4004480 con 0x7f4ef40b6c80 2023-07-09T21:51:58.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.527+0000 7f4ee9ffb700 1 -- 172.21.15.53:0/3166740345 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee401f070 con 0x7f4ef40b6c80 2023-07-09T21:51:58.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.527+0000 7f4efb9ff700 1 -- 172.21.15.53:0/3166740345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef4155670 con 0x7f4ef40b6c80 2023-07-09T21:51:58.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.527+0000 7f4ee9ffb700 1 -- 172.21.15.53:0/3166740345 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee40038c0 con 0x7f4ef40b6c80 2023-07-09T21:51:58.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.527+0000 7f4efb9ff700 1 -- 172.21.15.53:0/3166740345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef4155c30 con 0x7f4ef40b6c80 2023-07-09T21:51:58.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.528+0000 7f4efb9ff700 1 -- 172.21.15.53:0/3166740345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef404e280 con 0x7f4ef40b6c80 2023-07-09T21:51:58.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.529+0000 7f4ee9ffb700 1 -- 172.21.15.53:0/3166740345 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f4ee4021030 con 0x7f4ef40b6c80 2023-07-09T21:51:58.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.530+0000 7f4ee9ffb700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ed806ad70 0x7f4ed806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:58.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.530+0000 7f4ee9ffb700 1 -- 172.21.15.53:0/3166740345 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ee408a9b0 con 0x7f4ef40b6c80 2023-07-09T21:51:58.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.531+0000 7f4ef979b700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ed806ad70 0x7f4ed806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:58.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.531+0000 7f4ef979b700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ed806ad70 0x7f4ed806d220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0000fb0 tx=0x7f4ef0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:58.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.535+0000 7f4ee9ffb700 1 -- 172.21.15.53:0/3166740345 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4ee4055b20 con 0x7f4ef40b6c80 2023-07-09T21:51:58.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.747+0000 7f4efb9ff700 1 -- 172.21.15.53:0/3166740345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ef4155df0 con 0x7f4ef40b6c80 2023-07-09T21:51:58.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.748+0000 7f4ee9ffb700 1 -- 172.21.15.53:0/3166740345 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f4ee4082e60 con 0x7f4ef40b6c80 2023-07-09T21:51:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:51:58.750 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:42.861246+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:51:39.793448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:51:40.342794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:51:58.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.751+0000 7f4efb9ff700 1 -- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ed806ad70 msgr2=0x7f4ed806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:58.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.751+0000 7f4efb9ff700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ed806ad70 0x7f4ed806d220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0000fb0 tx=0x7f4ef0009040 comp rx=0 tx=0).stop 2023-07-09T21:51:58.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.751+0000 7f4efb9ff700 1 -- 172.21.15.53:0/3166740345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ef40b6c80 msgr2=0x7f4ef40c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:58.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.751+0000 7f4efb9ff700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ef40b6c80 0x7f4ef40c8680 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4000c00 tx=0x7f4ee4004750 comp rx=0 tx=0).stop 2023-07-09T21:51:58.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.751+0000 7f4efb9ff700 1 -- 172.21.15.53:0/3166740345 shutdown_connections 2023-07-09T21:51:58.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.751+0000 7f4efb9ff700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f4ed806ad70 0x7f4ed806d220 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.751+0000 7f4efb9ff700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ef40d1050 0x7f4ef4150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.751+0000 7f4efb9ff700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ef40b4510 0x7f4ef40c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.751+0000 7f4efb9ff700 1 --2- 172.21.15.53:0/3166740345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ef40b6c80 0x7f4ef40c8680 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.751+0000 7f4efb9ff700 1 -- 172.21.15.53:0/3166740345 >> 172.21.15.53:0/3166740345 conn(0x7f4ef409c1d0 msgr2=0x7f4ef40ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:58.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.751+0000 7f4efb9ff700 1 -- 172.21.15.53:0/3166740345 shutdown_connections 2023-07-09T21:51:58.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.751+0000 7f4efb9ff700 1 -- 172.21.15.53:0/3166740345 wait complete. 2023-07-09T21:51:58.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:51:39.793448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:51:40.342794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:51:58.771 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:51:58.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.973+0000 7f79acfff700 1 Processor -- start 2023-07-09T21:51:58.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.973+0000 7f79acfff700 1 -- start start 2023-07-09T21:51:58.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.974+0000 7f79acfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f79a80b3ff0 0x7f79a80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:58.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.974+0000 7f79acfff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a80b8e80 con 0x7f79a80d0f90 2023-07-09T21:51:58.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.974+0000 7f79acfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a80b33f0 con 0x7f79a80d0b10 2023-07-09T21:51:58.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.974+0000 7f79acfff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a80b1e30 con 0x7f79a80b3ff0 2023-07-09T21:51:58.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.975+0000 7f79a659c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f79a80b3ff0 0x7f79a80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:58.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.975+0000 7f79a659c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f79a80b3ff0 0x7f79a80b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52622/0 (socket says 172.21.15.53:52622) 2023-07-09T21:51:58.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.975+0000 7f79a659c700 1 -- 172.21.15.53:0/3910115109 learned_addr learned my addr 172.21.15.53:0/3910115109 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:58.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.975+0000 7f79a6d9d700 1 --1- 172.21.15.53:0/3910115109 >> v1:172.21.15.53:6789/0 conn(0x7f79a80d0f90 0x7f79a80b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55052/0 (socket says 172.21.15.53:55052) 2023-07-09T21:51:58.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.975+0000 7f79a659c700 1 -- 172.21.15.53:0/3910115109 >> v1:172.21.15.184:6789/0 conn(0x7f79a80d0b10 legacy=0x7f79a80b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:58.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.975+0000 7f79a659c700 1 -- 172.21.15.53:0/3910115109 >> v1:172.21.15.53:6789/0 conn(0x7f79a80d0f90 legacy=0x7f79a80b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:58.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.975+0000 7f79a659c700 1 -- 172.21.15.53:0/3910115109 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80afaa0 con 0x7f79a80b3ff0 2023-07-09T21:51:58.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.975+0000 7f79a559a700 1 -- 172.21.15.53:0/3910115109 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311666035 0 0) 0x7f79a0001490 con 0x7f79a80d0f90 2023-07-09T21:51:58.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.975+0000 7f79a659c700 1 --2- 172.21.15.53:0/3910115109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79a80b3ff0 0x7f79a80b43c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f79980098f0 tx=0x7f7998009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e508bd27ad55a0fc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:58.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.976+0000 7f79a559a700 1 -- 172.21.15.53:0/3910115109 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800b8a0 con 0x7f79a80b3ff0 2023-07-09T21:51:58.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.976+0000 7f79a559a700 1 -- 172.21.15.53:0/3910115109 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799800ba00 con 0x7f79a80b3ff0 2023-07-09T21:51:58.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.976+0000 7f79a559a700 1 -- 172.21.15.53:0/3910115109 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800bd90 con 0x7f79a80b3ff0 2023-07-09T21:51:58.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.976+0000 7f79acfff700 1 -- 172.21.15.53:0/3910115109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79a80b3ff0 msgr2=0x7f79a80b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:58.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.976+0000 7f79acfff700 1 --2- 172.21.15.53:0/3910115109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79a80b3ff0 0x7f79a80b43c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f79980098f0 tx=0x7f7998009c00 comp rx=0 tx=0).stop 2023-07-09T21:51:58.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.976+0000 7f79acfff700 1 -- 172.21.15.53:0/3910115109 shutdown_connections 2023-07-09T21:51:58.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.976+0000 7f79acfff700 1 --2- 172.21.15.53:0/3910115109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79a80b3ff0 0x7f79a80b43c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.976+0000 7f79acfff700 1 -- 172.21.15.53:0/3910115109 >> 172.21.15.53:0/3910115109 conn(0x7f79a809c1b0 msgr2=0x7f79a80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:58.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.976+0000 7f79acfff700 1 -- 172.21.15.53:0/3910115109 shutdown_connections 2023-07-09T21:51:58.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.976+0000 7f79acfff700 1 -- 172.21.15.53:0/3910115109 wait complete. 2023-07-09T21:51:58.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.978+0000 7f79acfff700 1 Processor -- start 2023-07-09T21:51:58.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.978+0000 7f79acfff700 1 -- start start 2023-07-09T21:51:58.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.979+0000 7f79acfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a80b3ff0 0x7f79a809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:58.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.979+0000 7f79acfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a80d0b10 0x7f79a81f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:58.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.979+0000 7f79acfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79a80d0f90 0x7f79a81ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:58.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.979+0000 7f79acfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80cbc10 con 0x7f79a80d0f90 2023-07-09T21:51:58.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.979+0000 7f79acfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80cbef0 con 0x7f79a80b3ff0 2023-07-09T21:51:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.979+0000 7f79acfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80cc1d0 con 0x7f79a80d0b10 2023-07-09T21:51:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79a6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79a80d0f90 0x7f79a81ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79a6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79a80d0f90 0x7f79a81ef3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52634/0 (socket says 172.21.15.53:52634) 2023-07-09T21:51:58.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79a6d9d700 1 -- 172.21.15.53:0/1001533145 learned_addr learned my addr 172.21.15.53:0/1001533145 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:58.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79a659c700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a80b3ff0 0x7f79a809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:58.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79a6d9d700 1 -- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a80d0b10 msgr2=0x7f79a81f5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:58.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79a5d9b700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a80d0b10 0x7f79a81f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:58.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79a6d9d700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a80d0b10 0x7f79a81f5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79a6d9d700 1 -- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a80b3ff0 msgr2=0x7f79a809cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79a6d9d700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a80b3ff0 0x7f79a809cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79a6d9d700 1 -- 172.21.15.53:0/1001533145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7998009550 con 0x7f79a80d0f90 2023-07-09T21:51:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79a659c700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a80b3ff0 0x7f79a809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79a5d9b700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a80d0b10 0x7f79a81f5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79a6d9d700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79a80d0f90 0x7f79a81ef3e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f79a000cb60 tx=0x7f79a000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f7996ffd700 1 -- 172.21.15.53:0/1001533145 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a000ab50 con 0x7f79a80d0f90 2023-07-09T21:51:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f7996ffd700 1 -- 172.21.15.53:0/1001533145 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a000acb0 con 0x7f79a80d0f90 2023-07-09T21:51:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f7996ffd700 1 -- 172.21.15.53:0/1001533145 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0007310 con 0x7f79a80d0f90 2023-07-09T21:51:58.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.980+0000 7f79acfff700 1 -- 172.21.15.53:0/1001533145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a80cc4b0 con 0x7f79a80d0f90 2023-07-09T21:51:58.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.981+0000 7f79acfff700 1 -- 172.21.15.53:0/1001533145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a81f6630 con 0x7f79a80d0f90 2023-07-09T21:51:58.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.982+0000 7f79acfff700 1 -- 172.21.15.53:0/1001533145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a80cc9d0 con 0x7f79a80d0f90 2023-07-09T21:51:58.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.983+0000 7f7996ffd700 1 -- 172.21.15.53:0/1001533145 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f79a0007470 con 0x7f79a80d0f90 2023-07-09T21:51:58.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.983+0000 7f7996ffd700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f798806ad70 0x7f798806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:58.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.983+0000 7f7996ffd700 1 -- 172.21.15.53:0/1001533145 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79a0088f80 con 0x7f79a80d0f90 2023-07-09T21:51:58.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.984+0000 7f79a659c700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f798806ad70 0x7f798806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:58.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.985+0000 7f79a659c700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f798806ad70 0x7f798806d220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7998009c40 tx=0x7f7998008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:58.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:58.988+0000 7f7996ffd700 1 -- 172.21.15.53:0/1001533145 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f79a80cc9d0 con 0x7f79a80d0f90 2023-07-09T21:51:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.193+0000 7f79acfff700 1 -- 172.21.15.53:0/1001533145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79a80b8e80 con 0x7f79a80d0f90 2023-07-09T21:51:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.193+0000 7f7996ffd700 1 -- 172.21.15.53:0/1001533145 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79a80b8e80 con 0x7f79a80d0f90 2023-07-09T21:51:59.195 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:51:59.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.196+0000 7f79acfff700 1 -- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f798806ad70 msgr2=0x7f798806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:59.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.196+0000 7f79acfff700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f798806ad70 0x7f798806d220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7998009c40 tx=0x7f7998008030 comp rx=0 tx=0).stop 2023-07-09T21:51:59.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.196+0000 7f79acfff700 1 -- 172.21.15.53:0/1001533145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79a80d0f90 msgr2=0x7f79a81ef3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:59.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.196+0000 7f79acfff700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79a80d0f90 0x7f79a81ef3e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f79a000cb60 tx=0x7f79a000cf20 comp rx=0 tx=0).stop 2023-07-09T21:51:59.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.196+0000 7f79acfff700 1 -- 172.21.15.53:0/1001533145 shutdown_connections 2023-07-09T21:51:59.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.196+0000 7f79acfff700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f798806ad70 0x7f798806d220 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.196+0000 7f79acfff700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79a80d0f90 0x7f79a81ef3e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.196+0000 7f79acfff700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a80b3ff0 0x7f79a809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.196+0000 7f79acfff700 1 --2- 172.21.15.53:0/1001533145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a80d0b10 0x7f79a81f5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.196+0000 7f79acfff700 1 -- 172.21.15.53:0/1001533145 >> 172.21.15.53:0/1001533145 conn(0x7f79a809c1b0 msgr2=0x7f79a80b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:59.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.196+0000 7f79acfff700 1 -- 172.21.15.53:0/1001533145 shutdown_connections 2023-07-09T21:51:59.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.196+0000 7f79acfff700 1 -- 172.21.15.53:0/1001533145 wait complete. 2023-07-09T21:51:59.215 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:51:59.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.416+0000 7fa0cf3ff700 1 Processor -- start 2023-07-09T21:51:59.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.416+0000 7fa0cf3ff700 1 -- start start 2023-07-09T21:51:59.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.417+0000 7fa0cf3ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa0c80b3ff0 0x7fa0c80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:59.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.417+0000 7fa0cf3ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa0c80d0b10 0x7fa0c80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:59.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.417+0000 7fa0cf3ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c80b8e80 con 0x7fa0c80b25d0 2023-07-09T21:51:59.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.417+0000 7fa0cf3ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c80d14d0 con 0x7fa0c80b3ff0 2023-07-09T21:51:59.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.417+0000 7fa0cf3ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c80b1e30 con 0x7fa0c80d0b10 2023-07-09T21:51:59.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.417+0000 7fa0cd19b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa0c80b3ff0 0x7fa0c80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:59.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.417+0000 7fa0cd99c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa0c80b25d0 0x7fa0c80b2a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55058/0 (socket says 172.21.15.53:55058) 2023-07-09T21:51:59.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.417+0000 7fa0cd99c700 1 -- 172.21.15.53:0/1529908895 learned_addr learned my addr 172.21.15.53:0/1529908895 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:51:59.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.417+0000 7fa0cd19b700 1 --2- 172.21.15.53:0/1529908895 >> v2:172.21.15.53:3300/0 conn(0x7fa0c80b3ff0 0x7fa0c80b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52638/0 (socket says 172.21.15.53:52638) 2023-07-09T21:51:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.418+0000 7fa0cc99a700 1 --2- 172.21.15.53:0/1529908895 >> v2:172.21.15.184:3300/0 conn(0x7fa0c80d0b10 0x7fa0c80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.418+0000 7fa0cd19b700 1 -- 172.21.15.53:0/1529908895 >> v2:172.21.15.184:3300/0 conn(0x7fa0c80d0b10 msgr2=0x7fa0c80d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.418+0000 7fa0cd19b700 1 --2- 172.21.15.53:0/1529908895 >> v2:172.21.15.184:3300/0 conn(0x7fa0c80d0b10 0x7fa0c80d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.418+0000 7fa0cd19b700 1 -- 172.21.15.53:0/1529908895 >> v1:172.21.15.53:6789/0 conn(0x7fa0c80b25d0 legacy=0x7fa0c80b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.418+0000 7fa0cd19b700 1 -- 172.21.15.53:0/1529908895 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c80afaa0 con 0x7fa0c80b3ff0 2023-07-09T21:51:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.418+0000 7fa0cd19b700 1 --2- 172.21.15.53:0/1529908895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c80b3ff0 0x7fa0c80b43c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa0c809c8e0 tx=0x7fa0c4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94482b174aebdef0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.418+0000 7fa0bffff700 1 -- 172.21.15.53:0/1529908895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4011830 con 0x7fa0c80b3ff0 2023-07-09T21:51:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.418+0000 7fa0bffff700 1 -- 172.21.15.53:0/1529908895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c4011990 con 0x7fa0c80b3ff0 2023-07-09T21:51:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.418+0000 7fa0bffff700 1 -- 172.21.15.53:0/1529908895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4011d20 con 0x7fa0c80b3ff0 2023-07-09T21:51:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.419+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/1529908895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c80b3ff0 msgr2=0x7fa0c80b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.419+0000 7fa0cf3ff700 1 --2- 172.21.15.53:0/1529908895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c80b3ff0 0x7fa0c80b43c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa0c809c8e0 tx=0x7fa0c4009b20 comp rx=0 tx=0).stop 2023-07-09T21:51:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.419+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/1529908895 shutdown_connections 2023-07-09T21:51:59.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.419+0000 7fa0cf3ff700 1 --2- 172.21.15.53:0/1529908895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c80b3ff0 0x7fa0c80b43c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.419+0000 7fa0cf3ff700 1 --2- 172.21.15.53:0/1529908895 >> v2:172.21.15.184:3300/0 conn(0x7fa0c80d0b10 0x7fa0c80d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.419+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/1529908895 >> 172.21.15.53:0/1529908895 conn(0x7fa0c809c1b0 msgr2=0x7fa0c80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:59.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.419+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/1529908895 shutdown_connections 2023-07-09T21:51:59.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.419+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/1529908895 wait complete. 2023-07-09T21:51:59.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.421+0000 7fa0cf3ff700 1 Processor -- start 2023-07-09T21:51:59.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.421+0000 7fa0cf3ff700 1 -- start start 2023-07-09T21:51:59.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cf3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0c80b25d0 0x7fa0c80ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:59.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cf3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0c80b3ff0 0x7fa0c81f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:59.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cf3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c80d0b10 0x7fa0c814f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:59.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cf3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c80cf610 con 0x7fa0c80d0b10 2023-07-09T21:51:59.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cf3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c81f3110 con 0x7fa0c80b25d0 2023-07-09T21:51:59.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cf3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c80cda10 con 0x7fa0c80b3ff0 2023-07-09T21:51:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cd99c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c80d0b10 0x7fa0c814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cd99c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c80d0b10 0x7fa0c814f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52644/0 (socket says 172.21.15.53:52644) 2023-07-09T21:51:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cd99c700 1 -- 172.21.15.53:0/2199692456 learned_addr learned my addr 172.21.15.53:0/2199692456 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cc99a700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0c80b3ff0 0x7fa0c81f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cd19b700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0c80b25d0 0x7fa0c80ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cd99c700 1 -- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0c80b3ff0 msgr2=0x7fa0c81f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cd99c700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0c80b3ff0 0x7fa0c81f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cd99c700 1 -- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0c80b25d0 msgr2=0x7fa0c80ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cd99c700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0c80b25d0 0x7fa0c80ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.422+0000 7fa0cd99c700 1 -- 172.21.15.53:0/2199692456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c40094a0 con 0x7fa0c80d0b10 2023-07-09T21:51:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.423+0000 7fa0cd99c700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c80d0b10 0x7fa0c814f250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000cbc0 tx=0x7fa0c000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.423+0000 7fa0bdffb700 1 -- 172.21.15.53:0/2199692456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000a9e0 con 0x7fa0c80d0b10 2023-07-09T21:51:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.423+0000 7fa0bdffb700 1 -- 172.21.15.53:0/2199692456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c000ab40 con 0x7fa0c80d0b10 2023-07-09T21:51:59.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.423+0000 7fa0bdffb700 1 -- 172.21.15.53:0/2199692456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0012400 con 0x7fa0c80d0b10 2023-07-09T21:51:59.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.423+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/2199692456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c80cdcf0 con 0x7fa0c80d0b10 2023-07-09T21:51:59.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.423+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/2199692456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c80ce2b0 con 0x7fa0c80d0b10 2023-07-09T21:51:59.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.424+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/2199692456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c8074350 con 0x7fa0c80d0b10 2023-07-09T21:51:59.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.425+0000 7fa0bdffb700 1 -- 172.21.15.53:0/2199692456 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fa0c001b3b0 con 0x7fa0c80d0b10 2023-07-09T21:51:59.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.426+0000 7fa0bdffb700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa0ac06ad70 0x7fa0ac06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:59.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.426+0000 7fa0bdffb700 1 -- 172.21.15.53:0/2199692456 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0c0088ef0 con 0x7fa0c80d0b10 2023-07-09T21:51:59.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.426+0000 7fa0cd19b700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa0ac06ad70 0x7fa0ac06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:59.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.427+0000 7fa0cd19b700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa0ac06ad70 0x7fa0ac06d220 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40090b0 tx=0x7fa0c4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:59.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.430+0000 7fa0bdffb700 1 -- 172.21.15.53:0/2199692456 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa0c0053f60 con 0x7fa0c80d0b10 2023-07-09T21:51:59.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.637+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/2199692456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa0c80b8e80 con 0x7fa0c80d0b10 2023-07-09T21:51:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.637+0000 7fa0bdffb700 1 -- 172.21.15.53:0/2199692456 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0c0017020 con 0x7fa0c80d0b10 2023-07-09T21:51:59.639 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:51:59.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.640+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa0ac06ad70 msgr2=0x7fa0ac06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:59.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.640+0000 7fa0cf3ff700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa0ac06ad70 0x7fa0ac06d220 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40090b0 tx=0x7fa0c4008030 comp rx=0 tx=0).stop 2023-07-09T21:51:59.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.640+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/2199692456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c80d0b10 msgr2=0x7fa0c814f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:59.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.640+0000 7fa0cf3ff700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c80d0b10 0x7fa0c814f250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000cbc0 tx=0x7fa0c000ced0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.640+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/2199692456 shutdown_connections 2023-07-09T21:51:59.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.640+0000 7fa0cf3ff700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa0ac06ad70 0x7fa0ac06d220 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.640+0000 7fa0cf3ff700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c80d0b10 0x7fa0c814f250 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.640+0000 7fa0cf3ff700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0c80b25d0 0x7fa0c80ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.640+0000 7fa0cf3ff700 1 --2- 172.21.15.53:0/2199692456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0c80b3ff0 0x7fa0c81f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.640+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/2199692456 >> 172.21.15.53:0/2199692456 conn(0x7fa0c809c1b0 msgr2=0x7fa0c806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:59.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.640+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/2199692456 shutdown_connections 2023-07-09T21:51:59.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.640+0000 7fa0cf3ff700 1 -- 172.21.15.53:0/2199692456 wait complete. 2023-07-09T21:51:59.659 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:51:59.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.861+0000 7fbc9f5ff700 1 Processor -- start 2023-07-09T21:51:59.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.862+0000 7fbc9f5ff700 1 -- start start 2023-07-09T21:51:59.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.863+0000 7fbc9f5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc9806c9f0 0x7fbc9806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:59.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.863+0000 7fbc9f5ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc980b1910 0x7fbc98071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:59.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.863+0000 7fbc9f5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9815ddf0 con 0x7fbc980b1d80 2023-07-09T21:51:59.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.863+0000 7fbc9f5ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9806c4e0 con 0x7fbc980b1910 2023-07-09T21:51:59.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.863+0000 7fbc9f5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9806bf20 con 0x7fbc9806c9f0 2023-07-09T21:51:59.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.863+0000 7fbc9cb9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc980b1910 0x7fbc98071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.863+0000 7fbc9cb9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc980b1910 0x7fbc98071170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52646/0 (socket says 172.21.15.53:52646) 2023-07-09T21:51:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.863+0000 7fbc9cb9a700 1 -- 172.21.15.53:0/2373938761 learned_addr learned my addr 172.21.15.53:0/2373938761 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.863+0000 7fbc9d39b700 1 --2- 172.21.15.53:0/2373938761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc9806c9f0 0x7fbc9806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.863+0000 7fbc9cb9a700 1 -- 172.21.15.53:0/2373938761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc9806c9f0 msgr2=0x7fbc9806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:51:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.863+0000 7fbc9cb9a700 1 --2- 172.21.15.53:0/2373938761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc9806c9f0 0x7fbc9806b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.864+0000 7fbc9cb9a700 1 -- 172.21.15.53:0/2373938761 >> v1:172.21.15.184:6789/0 conn(0x7fbc980b1d80 legacy=0x7fbc980cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.864+0000 7fbc9cb9a700 1 -- 172.21.15.53:0/2373938761 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9806c200 con 0x7fbc980b1910 2023-07-09T21:51:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.864+0000 7fbc9cb9a700 1 --2- 172.21.15.53:0/2373938761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc980b1910 0x7fbc98071170 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbc880098f0 tx=0x7fbc88009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41446e4ae2394a94 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.864+0000 7fbc8ffff700 1 -- 172.21.15.53:0/2373938761 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800b8a0 con 0x7fbc980b1910 2023-07-09T21:51:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.864+0000 7fbc8ffff700 1 -- 172.21.15.53:0/2373938761 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8800ba00 con 0x7fbc980b1910 2023-07-09T21:51:59.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.864+0000 7fbc8ffff700 1 -- 172.21.15.53:0/2373938761 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800bd90 con 0x7fbc980b1910 2023-07-09T21:51:59.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.864+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/2373938761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc980b1910 msgr2=0x7fbc98071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:59.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.864+0000 7fbc9f5ff700 1 --2- 172.21.15.53:0/2373938761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc980b1910 0x7fbc98071170 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbc880098f0 tx=0x7fbc88009c00 comp rx=0 tx=0).stop 2023-07-09T21:51:59.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.865+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/2373938761 shutdown_connections 2023-07-09T21:51:59.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.865+0000 7fbc9f5ff700 1 --2- 172.21.15.53:0/2373938761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc9806c9f0 0x7fbc9806b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.865+0000 7fbc9f5ff700 1 --2- 172.21.15.53:0/2373938761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc980b1910 0x7fbc98071170 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.865+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/2373938761 >> 172.21.15.53:0/2373938761 conn(0x7fbc980b05d0 msgr2=0x7fbc980b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:51:59.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.865+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/2373938761 shutdown_connections 2023-07-09T21:51:59.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.865+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/2373938761 wait complete. 2023-07-09T21:51:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.866+0000 7fbc9f5ff700 1 Processor -- start 2023-07-09T21:51:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.867+0000 7fbc9f5ff700 1 -- start start 2023-07-09T21:51:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.867+0000 7fbc9f5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc9806c9f0 0x7fbc981f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.867+0000 7fbc9f5ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc980b1910 0x7fbc9815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.867+0000 7fbc9f5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc980b1d80 0x7fbc981570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9f5ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc980cccc0 con 0x7fbc980b1910 2023-07-09T21:51:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9f5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc981f2740 con 0x7fbc980b1d80 2023-07-09T21:51:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9f5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc980cc690 con 0x7fbc9806c9f0 2023-07-09T21:51:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9cb9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc980b1910 0x7fbc9815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9cb9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc980b1910 0x7fbc9815a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52650/0 (socket says 172.21.15.53:52650) 2023-07-09T21:51:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9cb9a700 1 -- 172.21.15.53:0/91489564 learned_addr learned my addr 172.21.15.53:0/91489564 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:51:59.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9cb9a700 1 -- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc9806c9f0 msgr2=0x7fbc981f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:59.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9cb9a700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc9806c9f0 0x7fbc981f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9cb9a700 1 -- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc980b1d80 msgr2=0x7fbc981570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:51:59.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9db9c700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc980b1d80 0x7fbc981570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:59.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9cb9a700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc980b1d80 0x7fbc981570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:51:59.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9cb9a700 1 -- 172.21.15.53:0/91489564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc88009550 con 0x7fbc980b1910 2023-07-09T21:51:59.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9db9c700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc980b1d80 0x7fbc981570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:51:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.868+0000 7fbc9cb9a700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc980b1910 0x7fbc9815a780 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbc88000c00 tx=0x7fbc88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.869+0000 7fbc8dffb700 1 -- 172.21.15.53:0/91489564 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc88004480 con 0x7fbc980b1910 2023-07-09T21:51:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.869+0000 7fbc8dffb700 1 -- 172.21.15.53:0/91489564 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8801f070 con 0x7fbc980b1910 2023-07-09T21:51:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.869+0000 7fbc8dffb700 1 -- 172.21.15.53:0/91489564 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc880038c0 con 0x7fbc980b1910 2023-07-09T21:51:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.869+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/91489564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9815acc0 con 0x7fbc980b1910 2023-07-09T21:51:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.869+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/91489564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc980cc8e0 con 0x7fbc980b1910 2023-07-09T21:51:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.870+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/91489564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc980cce00 con 0x7fbc980b1910 2023-07-09T21:51:59.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.871+0000 7fbc8dffb700 1 -- 172.21.15.53:0/91489564 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fbc88021030 con 0x7fbc980b1910 2023-07-09T21:51:59.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.872+0000 7fbc8dffb700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbc7c06ad70 0x7fbc7c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:51:59.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.872+0000 7fbc8dffb700 1 -- 172.21.15.53:0/91489564 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc8808aa80 con 0x7fbc980b1910 2023-07-09T21:51:59.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.872+0000 7fbc9d39b700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbc7c06ad70 0x7fbc7c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:51:59.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.873+0000 7fbc9d39b700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbc7c06ad70 0x7fbc7c06d220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc940097f0 tx=0x7fbc94008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:51:59.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:51:59.876+0000 7fbc8dffb700 1 -- 172.21.15.53:0/91489564 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbc980cce00 con 0x7fbc980b1910 2023-07-09T21:52:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.082+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/91489564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc980cce00 con 0x7fbc980b1910 2023-07-09T21:52:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.082+0000 7fbc8dffb700 1 -- 172.21.15.53:0/91489564 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc980cce00 con 0x7fbc980b1910 2023-07-09T21:52:00.084 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:52:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.084+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbc7c06ad70 msgr2=0x7fbc7c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.084+0000 7fbc9f5ff700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbc7c06ad70 0x7fbc7c06d220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc940097f0 tx=0x7fbc94008040 comp rx=0 tx=0).stop 2023-07-09T21:52:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.084+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/91489564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc980b1910 msgr2=0x7fbc9815a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.084+0000 7fbc9f5ff700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc980b1910 0x7fbc9815a780 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbc88000c00 tx=0x7fbc88004750 comp rx=0 tx=0).stop 2023-07-09T21:52:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.084+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/91489564 shutdown_connections 2023-07-09T21:52:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.084+0000 7fbc9f5ff700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbc7c06ad70 0x7fbc7c06d220 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.084+0000 7fbc9f5ff700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc980b1d80 0x7fbc981570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.085+0000 7fbc9f5ff700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc9806c9f0 0x7fbc981f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.085+0000 7fbc9f5ff700 1 --2- 172.21.15.53:0/91489564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc980b1910 0x7fbc9815a780 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.085+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/91489564 >> 172.21.15.53:0/91489564 conn(0x7fbc980b05d0 msgr2=0x7fbc98071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:00.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.085+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/91489564 shutdown_connections 2023-07-09T21:52:00.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.085+0000 7fbc9f5ff700 1 -- 172.21.15.53:0/91489564 wait complete. 2023-07-09T21:52:00.103 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:52:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.305+0000 7fc58c7ff700 1 Processor -- start 2023-07-09T21:52:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.305+0000 7fc58c7ff700 1 -- start start 2023-07-09T21:52:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.306+0000 7fc58c7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc584069f30 0x7fc58406a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.306+0000 7fc58c7ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc5841601d0 0x7fc584160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.306+0000 7fc58c7ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5840cdba0 con 0x7fc584071650 2023-07-09T21:52:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.306+0000 7fc58c7ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58406a8e0 con 0x7fc5841601d0 2023-07-09T21:52:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.306+0000 7fc58c7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840cf370 con 0x7fc584069f30 2023-07-09T21:52:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.307+0000 7fc58ad9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc5841601d0 0x7fc584160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.307+0000 7fc58a59b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc584071650 0x7fc5840ce030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55060/0 (socket says 172.21.15.53:55060) 2023-07-09T21:52:00.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.307+0000 7fc58ad9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc5841601d0 0x7fc584160650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52654/0 (socket says 172.21.15.53:52654) 2023-07-09T21:52:00.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.307+0000 7fc58a59b700 1 -- 172.21.15.53:0/3463418444 learned_addr learned my addr 172.21.15.53:0/3463418444 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:00.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.307+0000 7fc589d9a700 1 --2- 172.21.15.53:0/3463418444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc584069f30 0x7fc58406a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:00.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.307+0000 7fc58ad9c700 1 -- 172.21.15.53:0/3463418444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc584069f30 msgr2=0x7fc58406a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:00.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.307+0000 7fc58ad9c700 1 --2- 172.21.15.53:0/3463418444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc584069f30 0x7fc58406a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.307+0000 7fc58ad9c700 1 -- 172.21.15.53:0/3463418444 >> v1:172.21.15.53:6789/0 conn(0x7fc584071650 legacy=0x7fc5840ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.307+0000 7fc58ad9c700 1 -- 172.21.15.53:0/3463418444 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5840cf650 con 0x7fc5841601d0 2023-07-09T21:52:00.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.307+0000 7fc589599700 1 -- 172.21.15.53:0/3463418444 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373650027 0 0) 0x7fc5840cdba0 con 0x7fc584071650 2023-07-09T21:52:00.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.307+0000 7fc58ad9c700 1 --2- 172.21.15.53:0/3463418444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5841601d0 0x7fc584160650 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009d90 tx=0x7fc57c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff35d7e853103aa0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:00.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.308+0000 7fc589599700 1 -- 172.21.15.53:0/3463418444 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00e070 con 0x7fc5841601d0 2023-07-09T21:52:00.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.308+0000 7fc589599700 1 -- 172.21.15.53:0/3463418444 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c00bb20 con 0x7fc5841601d0 2023-07-09T21:52:00.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.308+0000 7fc589599700 1 -- 172.21.15.53:0/3463418444 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c012430 con 0x7fc5841601d0 2023-07-09T21:52:00.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.308+0000 7fc58c7ff700 1 -- 172.21.15.53:0/3463418444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5841601d0 msgr2=0x7fc584160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.308+0000 7fc58c7ff700 1 --2- 172.21.15.53:0/3463418444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5841601d0 0x7fc584160650 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009d90 tx=0x7fc57c00b330 comp rx=0 tx=0).stop 2023-07-09T21:52:00.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.308+0000 7fc58c7ff700 1 -- 172.21.15.53:0/3463418444 shutdown_connections 2023-07-09T21:52:00.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.308+0000 7fc58c7ff700 1 --2- 172.21.15.53:0/3463418444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5841601d0 0x7fc584160650 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.308+0000 7fc58c7ff700 1 --2- 172.21.15.53:0/3463418444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc584069f30 0x7fc58406a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.308+0000 7fc58c7ff700 1 -- 172.21.15.53:0/3463418444 >> 172.21.15.53:0/3463418444 conn(0x7fc5840cc640 msgr2=0x7fc5840cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:00.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.308+0000 7fc58c7ff700 1 -- 172.21.15.53:0/3463418444 shutdown_connections 2023-07-09T21:52:00.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.308+0000 7fc58c7ff700 1 -- 172.21.15.53:0/3463418444 wait complete. 2023-07-09T21:52:00.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.310+0000 7fc58c7ff700 1 Processor -- start 2023-07-09T21:52:00.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.310+0000 7fc58c7ff700 1 -- start start 2023-07-09T21:52:00.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.311+0000 7fc58c7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc584069f30 0x7fc58415e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:00.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.311+0000 7fc58c7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc584071650 0x7fc5841577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:00.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.311+0000 7fc58c7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5841601d0 0x7fc58406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:00.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.311+0000 7fc58c7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840c4aa0 con 0x7fc584069f30 2023-07-09T21:52:00.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.311+0000 7fc58c7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840c3a00 con 0x7fc5841601d0 2023-07-09T21:52:00.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.311+0000 7fc58c7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840c3ce0 con 0x7fc584071650 2023-07-09T21:52:00.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.311+0000 7fc58a59b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc584069f30 0x7fc58415e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:00.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.311+0000 7fc58a59b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc584069f30 0x7fc58415e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52660/0 (socket says 172.21.15.53:52660) 2023-07-09T21:52:00.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.311+0000 7fc58a59b700 1 -- 172.21.15.53:0/1906875105 learned_addr learned my addr 172.21.15.53:0/1906875105 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:00.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc589d9a700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc584071650 0x7fc5841577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:00.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc58ad9c700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5841601d0 0x7fc58406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:00.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc58a59b700 1 -- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc584071650 msgr2=0x7fc5841577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc58a59b700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc584071650 0x7fc5841577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc58a59b700 1 -- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5841601d0 msgr2=0x7fc58406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc58a59b700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5841601d0 0x7fc58406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc58a59b700 1 -- 172.21.15.53:0/1906875105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c009a70 con 0x7fc584069f30 2023-07-09T21:52:00.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc58ad9c700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5841601d0 0x7fc58406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:00.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc589d9a700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc584071650 0x7fc5841577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:00.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc58a59b700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc584069f30 0x7fc58415e510 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc5800011e0 tx=0x7fc58000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:00.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc57affd700 1 -- 172.21.15.53:0/1906875105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580004c80 con 0x7fc584069f30 2023-07-09T21:52:00.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc57affd700 1 -- 172.21.15.53:0/1906875105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc580004e00 con 0x7fc584069f30 2023-07-09T21:52:00.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc57affd700 1 -- 172.21.15.53:0/1906875105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580007310 con 0x7fc584069f30 2023-07-09T21:52:00.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.312+0000 7fc58c7ff700 1 -- 172.21.15.53:0/1906875105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5840c3fc0 con 0x7fc584069f30 2023-07-09T21:52:00.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.313+0000 7fc58c7ff700 1 -- 172.21.15.53:0/1906875105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5840c4580 con 0x7fc584069f30 2023-07-09T21:52:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.314+0000 7fc58c7ff700 1 -- 172.21.15.53:0/1906875105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5840c47a0 con 0x7fc584069f30 2023-07-09T21:52:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.314+0000 7fc57affd700 1 -- 172.21.15.53:0/1906875105 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fc580007470 con 0x7fc584069f30 2023-07-09T21:52:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.315+0000 7fc57affd700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc56806ad70 0x7fc56806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:00.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.315+0000 7fc57affd700 1 -- 172.21.15.53:0/1906875105 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5800892b0 con 0x7fc584069f30 2023-07-09T21:52:00.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.316+0000 7fc589d9a700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc56806ad70 0x7fc56806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:00.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.317+0000 7fc589d9a700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc56806ad70 0x7fc56806d220 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc5840d00d0 tx=0x7fc574008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:00.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.320+0000 7fc57affd700 1 -- 172.21.15.53:0/1906875105 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc5800542e0 con 0x7fc584069f30 2023-07-09T21:52:00.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.528+0000 7fc58c7ff700 1 -- 172.21.15.53:0/1906875105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc584074350 con 0x7fc584069f30 2023-07-09T21:52:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.529+0000 7fc57affd700 1 -- 172.21.15.53:0/1906875105 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc580057900 con 0x7fc584069f30 2023-07-09T21:52:00.530 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:52:00.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.531+0000 7fc58c7ff700 1 -- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc56806ad70 msgr2=0x7fc56806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.531+0000 7fc58c7ff700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc56806ad70 0x7fc56806d220 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc5840d00d0 tx=0x7fc574008040 comp rx=0 tx=0).stop 2023-07-09T21:52:00.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.531+0000 7fc58c7ff700 1 -- 172.21.15.53:0/1906875105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc584069f30 msgr2=0x7fc58415e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.531+0000 7fc58c7ff700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc584069f30 0x7fc58415e510 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc5800011e0 tx=0x7fc58000cae0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.531+0000 7fc58c7ff700 1 -- 172.21.15.53:0/1906875105 shutdown_connections 2023-07-09T21:52:00.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.531+0000 7fc58c7ff700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc56806ad70 0x7fc56806d220 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.531+0000 7fc58c7ff700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5841601d0 0x7fc58406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.531+0000 7fc58c7ff700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc584069f30 0x7fc58415e510 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.531+0000 7fc58c7ff700 1 --2- 172.21.15.53:0/1906875105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc584071650 0x7fc5841577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.531+0000 7fc58c7ff700 1 -- 172.21.15.53:0/1906875105 >> 172.21.15.53:0/1906875105 conn(0x7fc5840cc640 msgr2=0x7fc5840cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:00.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.531+0000 7fc58c7ff700 1 -- 172.21.15.53:0/1906875105 shutdown_connections 2023-07-09T21:52:00.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.531+0000 7fc58c7ff700 1 -- 172.21.15.53:0/1906875105 wait complete. 2023-07-09T21:52:00.551 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:52:00.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.751+0000 7f423bdff700 1 Processor -- start 2023-07-09T21:52:00.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.752+0000 7f423bdff700 1 -- start start 2023-07-09T21:52:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.753+0000 7f423bdff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f42340cd430 0x7f42340cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.753+0000 7f423bdff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f42340d22d0 0x7f42340b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.753+0000 7f423bdff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42340d02a0 con 0x7f42340b4860 2023-07-09T21:52:00.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.753+0000 7f423bdff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42340b5240 con 0x7f42340d22d0 2023-07-09T21:52:00.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.753+0000 7f423bdff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42340cfce0 con 0x7f42340cd430 2023-07-09T21:52:00.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.753+0000 7f423939a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f42340b4860 0x7f42341601f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55072/0 (socket says 172.21.15.53:55072) 2023-07-09T21:52:00.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.753+0000 7f423939a700 1 -- 172.21.15.53:0/3879912208 learned_addr learned my addr 172.21.15.53:0/3879912208 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:00.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.753+0000 7f423a39c700 1 --2- 172.21.15.53:0/3879912208 >> v2:172.21.15.53:3300/0 conn(0x7f42340d22d0 0x7f42340b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:00.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.753+0000 7f4239b9b700 1 --2- 172.21.15.53:0/3879912208 >> v2:172.21.15.184:3300/0 conn(0x7f42340cd430 0x7f42340cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:00.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.754+0000 7f423a39c700 1 -- 172.21.15.53:0/3879912208 >> v2:172.21.15.184:3300/0 conn(0x7f42340cd430 msgr2=0x7f42340cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:00.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.754+0000 7f423a39c700 1 --2- 172.21.15.53:0/3879912208 >> v2:172.21.15.184:3300/0 conn(0x7f42340cd430 0x7f42340cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.754+0000 7f423a39c700 1 -- 172.21.15.53:0/3879912208 >> v1:172.21.15.53:6789/0 conn(0x7f42340b4860 legacy=0x7f42341601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.754+0000 7f423a39c700 1 -- 172.21.15.53:0/3879912208 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42340cffc0 con 0x7f42340d22d0 2023-07-09T21:52:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.754+0000 7f4238b99700 1 -- 172.21.15.53:0/3879912208 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630080472 0 0) 0x7f42340d02a0 con 0x7f42340b4860 2023-07-09T21:52:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.754+0000 7f423a39c700 1 --2- 172.21.15.53:0/3879912208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42340d22d0 0x7f42340b4d00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f42340c9e60 tx=0x7f422c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993550c391bfcbb5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.754+0000 7f4238b99700 1 -- 172.21.15.53:0/3879912208 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c00e070 con 0x7f42340d22d0 2023-07-09T21:52:00.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.754+0000 7f4238b99700 1 -- 172.21.15.53:0/3879912208 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c00bb20 con 0x7f42340d22d0 2023-07-09T21:52:00.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.754+0000 7f4238b99700 1 -- 172.21.15.53:0/3879912208 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c012430 con 0x7f42340d22d0 2023-07-09T21:52:00.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.755+0000 7f423bdff700 1 -- 172.21.15.53:0/3879912208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42340d22d0 msgr2=0x7f42340b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.755+0000 7f423bdff700 1 --2- 172.21.15.53:0/3879912208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42340d22d0 0x7f42340b4d00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f42340c9e60 tx=0x7f422c00b330 comp rx=0 tx=0).stop 2023-07-09T21:52:00.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.755+0000 7f423bdff700 1 -- 172.21.15.53:0/3879912208 shutdown_connections 2023-07-09T21:52:00.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.755+0000 7f423bdff700 1 --2- 172.21.15.53:0/3879912208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42340d22d0 0x7f42340b4d00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.755+0000 7f423bdff700 1 --2- 172.21.15.53:0/3879912208 >> v2:172.21.15.184:3300/0 conn(0x7f42340cd430 0x7f42340cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.755+0000 7f423bdff700 1 -- 172.21.15.53:0/3879912208 >> 172.21.15.53:0/3879912208 conn(0x7f4234066860 msgr2=0x7f423406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:00.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.755+0000 7f423bdff700 1 -- 172.21.15.53:0/3879912208 shutdown_connections 2023-07-09T21:52:00.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.755+0000 7f423bdff700 1 -- 172.21.15.53:0/3879912208 wait complete. 2023-07-09T21:52:00.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.757+0000 7f423bdff700 1 Processor -- start 2023-07-09T21:52:00.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.757+0000 7f423bdff700 1 -- start start 2023-07-09T21:52:00.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.758+0000 7f423bdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42340b4860 0x7f423415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:00.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.758+0000 7f423bdff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42340cd430 0x7f42341511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:00.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.758+0000 7f423bdff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42340d22d0 0x7f42340cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:00.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.758+0000 7f423bdff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42341f2eb0 con 0x7f42340d22d0 2023-07-09T21:52:00.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.758+0000 7f423bdff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42341f2020 con 0x7f42340cd430 2023-07-09T21:52:00.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.758+0000 7f423bdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42341f22a0 con 0x7f42340b4860 2023-07-09T21:52:00.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.758+0000 7f423a39c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42340d22d0 0x7f42340cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:00.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.758+0000 7f423a39c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42340d22d0 0x7f42340cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52678/0 (socket says 172.21.15.53:52678) 2023-07-09T21:52:00.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.758+0000 7f423a39c700 1 -- 172.21.15.53:0/3752656406 learned_addr learned my addr 172.21.15.53:0/3752656406 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:00.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.758+0000 7f423939a700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42340cd430 0x7f42341511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:00.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.758+0000 7f4239b9b700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42340b4860 0x7f423415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:00.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.759+0000 7f423a39c700 1 -- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42340b4860 msgr2=0x7f423415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.759+0000 7f423a39c700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42340b4860 0x7f423415cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.759+0000 7f423a39c700 1 -- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42340cd430 msgr2=0x7f42341511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.759+0000 7f423a39c700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42340cd430 0x7f42341511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.759+0000 7f423a39c700 1 -- 172.21.15.53:0/3752656406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009a70 con 0x7f42340d22d0 2023-07-09T21:52:00.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.759+0000 7f4239b9b700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42340b4860 0x7f423415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:00.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.759+0000 7f423a39c700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42340d22d0 0x7f42340cc400 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f42340673b0 tx=0x7f422c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:00.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.759+0000 7f422a7fc700 1 -- 172.21.15.53:0/3752656406 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c012430 con 0x7f42340d22d0 2023-07-09T21:52:00.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.759+0000 7f422a7fc700 1 -- 172.21.15.53:0/3752656406 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c020070 con 0x7f42340d22d0 2023-07-09T21:52:00.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.759+0000 7f423bdff700 1 -- 172.21.15.53:0/3752656406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42341f2580 con 0x7f42340d22d0 2023-07-09T21:52:00.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.759+0000 7f422a7fc700 1 -- 172.21.15.53:0/3752656406 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c004280 con 0x7f42340d22d0 2023-07-09T21:52:00.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.759+0000 7f423bdff700 1 -- 172.21.15.53:0/3752656406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42341f2b40 con 0x7f42340d22d0 2023-07-09T21:52:00.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.760+0000 7f423bdff700 1 -- 172.21.15.53:0/3752656406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4234074350 con 0x7f42340d22d0 2023-07-09T21:52:00.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.761+0000 7f422a7fc700 1 -- 172.21.15.53:0/3752656406 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f422c0043e0 con 0x7f42340d22d0 2023-07-09T21:52:00.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.762+0000 7f422a7fc700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f421806ad70 0x7f421806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:00.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.762+0000 7f422a7fc700 1 -- 172.21.15.53:0/3752656406 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f422c022070 con 0x7f42340d22d0 2023-07-09T21:52:00.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.763+0000 7f4239b9b700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f421806ad70 0x7f421806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:00.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.763+0000 7f4239b9b700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f421806ad70 0x7f421806d220 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4230009c30 tx=0x7f4230008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:00.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.767+0000 7f422a7fc700 1 -- 172.21.15.53:0/3752656406 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f422c0566e0 con 0x7f42340d22d0 2023-07-09T21:52:00.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.993+0000 7f423bdff700 1 -- 172.21.15.53:0/3752656406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f42340b81d0 con 0x7f42340d22d0 2023-07-09T21:52:00.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.993+0000 7f422a7fc700 1 -- 172.21.15.53:0/3752656406 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f422c059d00 con 0x7f42340d22d0 2023-07-09T21:52:00.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.995+0000 7f423bdff700 1 -- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f421806ad70 msgr2=0x7f421806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.995+0000 7f423bdff700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f421806ad70 0x7f421806d220 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4230009c30 tx=0x7f4230008040 comp rx=0 tx=0).stop 2023-07-09T21:52:00.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.995+0000 7f423bdff700 1 -- 172.21.15.53:0/3752656406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42340d22d0 msgr2=0x7f42340cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:00.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.995+0000 7f423bdff700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42340d22d0 0x7f42340cc400 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f42340673b0 tx=0x7f422c004ad0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.995+0000 7f423bdff700 1 -- 172.21.15.53:0/3752656406 shutdown_connections 2023-07-09T21:52:00.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.995+0000 7f423bdff700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f421806ad70 0x7f421806d220 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.995+0000 7f423bdff700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42340d22d0 0x7f42340cc400 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.995+0000 7f423bdff700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42340b4860 0x7f423415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.995+0000 7f423bdff700 1 --2- 172.21.15.53:0/3752656406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42340cd430 0x7f42341511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:00.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.995+0000 7f423bdff700 1 -- 172.21.15.53:0/3752656406 >> 172.21.15.53:0/3752656406 conn(0x7f4234066860 msgr2=0x7f42340d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:00.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.995+0000 7f423bdff700 1 -- 172.21.15.53:0/3752656406 shutdown_connections 2023-07-09T21:52:00.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:00.996+0000 7f423bdff700 1 -- 172.21.15.53:0/3752656406 wait complete. 2023-07-09T21:52:00.999 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-07-09T21:52:01.014 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T21:52:01.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:01.015 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-09T21:52:01.109 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:52:01.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:01.111 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T21:52:01.156 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:52:01.157 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:01.201 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348820k,nr_inodes=4087205,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-09T21:52:01.202 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:52:01.203 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:01.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345736k,nr_inodes=4086434,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-09T21:52:01.247 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:52:01.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.445+0000 7fe1093ff700 1 Processor -- start 2023-07-09T21:52:01.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.446+0000 7fe1093ff700 1 -- start start 2023-07-09T21:52:01.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.447+0000 7fe1093ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1040b4510 0x7fe1040b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.447+0000 7fe1093ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1040b7f50 con 0x7fe1040d1220 2023-07-09T21:52:01.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.447+0000 7fe1093ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1040b7340 con 0x7fe1040cd590 2023-07-09T21:52:01.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.447+0000 7fe1093ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040b48e0 con 0x7fe1040b4510 2023-07-09T21:52:01.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.447+0000 7fe1037fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe1040d1220 0x7fe1040b83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55084/0 (socket says 172.21.15.53:55084) 2023-07-09T21:52:01.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.447+0000 7fe1037fe700 1 -- 172.21.15.53:0/3848027085 learned_addr learned my addr 172.21.15.53:0/3848027085 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:01.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.447+0000 7fe102ffd700 1 --2- 172.21.15.53:0/3848027085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1040b4510 0x7fe1040b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300381586 0 0) 0x7fe1040b7f50 con 0x7fe1040d1220 2023-07-09T21:52:01.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0ec0035b0 con 0x7fe1040d1220 2023-07-09T21:52:01.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864483980 0 0) 0x7fe1040b7340 con 0x7fe1040cd590 2023-07-09T21:52:01.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1040b7f50 con 0x7fe1040cd590 2023-07-09T21:52:01.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 610719980 0 0) 0x7fe0ec0035b0 con 0x7fe1040d1220 2023-07-09T21:52:01.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1040b4510 msgr2=0x7fe1040b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:01.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 --2- 172.21.15.53:0/3848027085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1040b4510 0x7fe1040b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 >> v1:172.21.15.184:6789/0 conn(0x7fe1040cd590 legacy=0x7fe1040d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:01.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1040b7620 con 0x7fe1040d1220 2023-07-09T21:52:01.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7fe0fc0019f0 con 0x7fe1040d1220 2023-07-09T21:52:01.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 >> v1:172.21.15.53:6789/0 conn(0x7fe1040d1220 legacy=0x7fe1040b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:01.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 --2- 172.21.15.53:0/3848027085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0ec003bc0 0x7fe0ec003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 --2- 172.21.15.53:0/3848027085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0ec004850 0x7fe0ec004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 --2- 172.21.15.53:0/3848027085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0ec005200 0x7fe0ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec00c0e0 con 0x7fe0ec003bc0 2023-07-09T21:52:01.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec00c220 con 0x7fe0ec005200 2023-07-09T21:52:01.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec00c3b0 con 0x7fe0ec004850 2023-07-09T21:52:01.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe102ffd700 1 --2- 172.21.15.53:0/3848027085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1040b4510 0x7fe1040b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:52:01.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe102ffd700 1 --2- 172.21.15.53:0/3848027085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0ec003bc0 0x7fe0ec003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe1037fe700 1 --2- 172.21.15.53:0/3848027085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0ec005200 0x7fe0ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.448+0000 7fe1027fc700 1 --2- 172.21.15.53:0/3848027085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0ec004850 0x7fe0ec004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.449+0000 7fe1027fc700 1 -- 172.21.15.53:0/3848027085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0ec005200 msgr2=0x7fe0ec00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.449+0000 7fe1027fc700 1 --2- 172.21.15.53:0/3848027085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0ec005200 0x7fe0ec00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.449+0000 7fe1027fc700 1 -- 172.21.15.53:0/3848027085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0ec003bc0 msgr2=0x7fe0ec003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.449+0000 7fe1027fc700 1 --2- 172.21.15.53:0/3848027085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0ec003bc0 0x7fe0ec003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.449+0000 7fe1027fc700 1 -- 172.21.15.53:0/3848027085 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0035b0 con 0x7fe0ec004850 2023-07-09T21:52:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.449+0000 7fe1027fc700 1 --2- 172.21.15.53:0/3848027085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0ec004850 0x7fe0ec004cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8001980 tx=0x7fe0ec005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0810a81cdb0f5f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.449+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8001470 con 0x7fe0ec004850 2023-07-09T21:52:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.449+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f80052d0 con 0x7fe0ec004850 2023-07-09T21:52:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.449+0000 7fe101ffb700 1 -- 172.21.15.53:0/3848027085 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8003680 con 0x7fe0ec004850 2023-07-09T21:52:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.450+0000 7fe1093ff700 1 -- 172.21.15.53:0/3848027085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0ec004850 msgr2=0x7fe0ec004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.450+0000 7fe1093ff700 1 --2- 172.21.15.53:0/3848027085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0ec004850 0x7fe0ec004cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8001980 tx=0x7fe0ec005880 comp rx=0 tx=0).stop 2023-07-09T21:52:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.450+0000 7fe1037fe700 1 -- 172.21.15.53:0/3848027085 reap_dead start 2023-07-09T21:52:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.450+0000 7fe1093ff700 1 -- 172.21.15.53:0/3848027085 shutdown_connections 2023-07-09T21:52:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.450+0000 7fe1093ff700 1 -- 172.21.15.53:0/3848027085 >> 172.21.15.53:0/3848027085 conn(0x7fe10409c1d0 msgr2=0x7fe1040d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.450+0000 7fe1093ff700 1 -- 172.21.15.53:0/3848027085 shutdown_connections 2023-07-09T21:52:01.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.450+0000 7fe1093ff700 1 -- 172.21.15.53:0/3848027085 wait complete. 2023-07-09T21:52:01.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.452+0000 7fe1093ff700 1 Processor -- start 2023-07-09T21:52:01.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.452+0000 7fe1093ff700 1 -- start start 2023-07-09T21:52:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.453+0000 7fe1093ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0ec004850 0x7fe1040c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.453+0000 7fe1093ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe104159340 0x7fe1040c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.453+0000 7fe1093ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1040c84d0 0x7fe1041f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.453+0000 7fe1093ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe104158f20 con 0x7fe104159340 2023-07-09T21:52:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.453+0000 7fe1093ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040c8940 con 0x7fe0ec004850 2023-07-09T21:52:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.453+0000 7fe1093ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe104158580 con 0x7fe1040c84d0 2023-07-09T21:52:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.453+0000 7fe1027fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe104159340 0x7fe1040c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.453+0000 7fe1027fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe104159340 0x7fe1040c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52692/0 (socket says 172.21.15.53:52692) 2023-07-09T21:52:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.453+0000 7fe1027fc700 1 -- 172.21.15.53:0/760677845 learned_addr learned my addr 172.21.15.53:0/760677845 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe1037fe700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1040c84d0 0x7fe1041f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe102ffd700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0ec004850 0x7fe1040c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe1027fc700 1 -- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1040c84d0 msgr2=0x7fe1041f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe1027fc700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1040c84d0 0x7fe1041f2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe1027fc700 1 -- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0ec004850 msgr2=0x7fe1040c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe1027fc700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0ec004850 0x7fe1040c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe1027fc700 1 -- 172.21.15.53:0/760677845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe104158860 con 0x7fe104159340 2023-07-09T21:52:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe1037fe700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1040c84d0 0x7fe1041f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe102ffd700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0ec004850 0x7fe1040c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe1027fc700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe104159340 0x7fe1040c7f90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8006a90 tx=0x7fe0f8001310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe0eb7fe700 1 -- 172.21.15.53:0/760677845 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8001410 con 0x7fe104159340 2023-07-09T21:52:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe0eb7fe700 1 -- 172.21.15.53:0/760677845 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f8007040 con 0x7fe104159340 2023-07-09T21:52:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe1093ff700 1 -- 172.21.15.53:0/760677845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe104158b40 con 0x7fe104159340 2023-07-09T21:52:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.454+0000 7fe0eb7fe700 1 -- 172.21.15.53:0/760677845 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80073b0 con 0x7fe104159340 2023-07-09T21:52:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.455+0000 7fe1093ff700 1 -- 172.21.15.53:0/760677845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1041f26a0 con 0x7fe104159340 2023-07-09T21:52:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.455+0000 7fe1093ff700 1 -- 172.21.15.53:0/760677845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe104159190 con 0x7fe104159340 2023-07-09T21:52:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.456+0000 7fe0eb7fe700 1 -- 172.21.15.53:0/760677845 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fe0f8007510 con 0x7fe104159340 2023-07-09T21:52:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.457+0000 7fe0eb7fe700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe0f006ad70 0x7fe0f006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.457+0000 7fe0eb7fe700 1 -- 172.21.15.53:0/760677845 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe0f808a640 con 0x7fe104159340 2023-07-09T21:52:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.458+0000 7fe102ffd700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe0f006ad70 0x7fe0f006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.458+0000 7fe102ffd700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe0f006ad70 0x7fe0f006d220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe1040ce9e0 tx=0x7fe0f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.461+0000 7fe0eb7fe700 1 -- 172.21.15.53:0/760677845 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe0f8055690 con 0x7fe104159340 2023-07-09T21:52:01.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.716+0000 7fe1093ff700 1 -- 172.21.15.53:0/760677845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1040b7bb0 con 0x7fe104159340 2023-07-09T21:52:01.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.717+0000 7fe0eb7fe700 1 -- 172.21.15.53:0/760677845 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fe0f8058cb0 con 0x7fe104159340 2023-07-09T21:52:01.718 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:01.718 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2100879728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2100879728},{"type":"v1","addr":"172.21.15.184:6837","nonce":2100879728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3650266673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3650266673},{"type":"v1","addr":"172.21.15.53:6834","nonce":3650266673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1905516924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1905516924},{"type":"v1","addr":"172.21.15.53:6835","nonce":1905516924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:51:41.406886+0000","modified":"2023-07-09T21:51:44.882338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5107},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5107":{"gid":5107,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6836/3388102458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3388102458},{"type":"v1","addr":"172.21.15.184:6836","nonce":3388102458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T21:52:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.719+0000 7fe1093ff700 1 -- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe0f006ad70 msgr2=0x7fe0f006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.719+0000 7fe1093ff700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe0f006ad70 0x7fe0f006d220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe1040ce9e0 tx=0x7fe0f4008040 comp rx=0 tx=0).stop 2023-07-09T21:52:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.719+0000 7fe1093ff700 1 -- 172.21.15.53:0/760677845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe104159340 msgr2=0x7fe1040c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.719+0000 7fe1093ff700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe104159340 0x7fe1040c7f90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8006a90 tx=0x7fe0f8001310 comp rx=0 tx=0).stop 2023-07-09T21:52:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.719+0000 7fe1093ff700 1 -- 172.21.15.53:0/760677845 shutdown_connections 2023-07-09T21:52:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.719+0000 7fe1093ff700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe0f006ad70 0x7fe0f006d220 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.719+0000 7fe1093ff700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1040c84d0 0x7fe1041f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.719+0000 7fe1093ff700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0ec004850 0x7fe1040c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.719+0000 7fe1093ff700 1 --2- 172.21.15.53:0/760677845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe104159340 0x7fe1040c7f90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.719+0000 7fe1093ff700 1 -- 172.21.15.53:0/760677845 >> 172.21.15.53:0/760677845 conn(0x7fe10409c1d0 msgr2=0x7fe1040b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.719+0000 7fe1093ff700 1 -- 172.21.15.53:0/760677845 shutdown_connections 2023-07-09T21:52:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.719+0000 7fe1093ff700 1 -- 172.21.15.53:0/760677845 wait complete. 2023-07-09T21:52:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 18 2023-07-09T21:52:01.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:52:01.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.937+0000 7f432fbff700 1 Processor -- start 2023-07-09T21:52:01.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.937+0000 7f432fbff700 1 -- start start 2023-07-09T21:52:01.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.938+0000 7f432fbff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f43280b1e00 0x7f43280b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.938+0000 7f432fbff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43280d1220 0x7f43280afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.938+0000 7f432fbff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43280d2ce0 con 0x7f43280b2350 2023-07-09T21:52:01.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.938+0000 7f432fbff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43280b3350 con 0x7f43280d1220 2023-07-09T21:52:01.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.938+0000 7f432fbff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43280b3630 con 0x7f43280b1e00 2023-07-09T21:52:01.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.939+0000 7f432e19c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43280d1220 0x7f43280afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.939+0000 7f432d19a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f43280b2350 0x7f43280d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55098/0 (socket says 172.21.15.53:55098) 2023-07-09T21:52:01.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.939+0000 7f432d19a700 1 -- 172.21.15.53:0/1450015804 learned_addr learned my addr 172.21.15.53:0/1450015804 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:01.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.939+0000 7f432d99b700 1 --2- 172.21.15.53:0/1450015804 >> v2:172.21.15.184:3300/0 conn(0x7f43280b1e00 0x7f43280b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.939+0000 7f432e19c700 1 -- 172.21.15.53:0/1450015804 >> v2:172.21.15.184:3300/0 conn(0x7f43280b1e00 msgr2=0x7f43280b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:01.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.939+0000 7f432e19c700 1 --2- 172.21.15.53:0/1450015804 >> v2:172.21.15.184:3300/0 conn(0x7f43280b1e00 0x7f43280b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.939+0000 7f432e19c700 1 -- 172.21.15.53:0/1450015804 >> v1:172.21.15.53:6789/0 conn(0x7f43280b2350 legacy=0x7f43280d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:01.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.939+0000 7f432e19c700 1 -- 172.21.15.53:0/1450015804 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43280b3910 con 0x7f43280d1220 2023-07-09T21:52:01.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.939+0000 7f432e19c700 1 --2- 172.21.15.53:0/1450015804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43280d1220 0x7f43280afac0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f432808d170 tx=0x7f432000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc17c7f80a3683d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:01.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.940+0000 7f432c999700 1 -- 172.21.15.53:0/1450015804 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000e070 con 0x7f43280d1220 2023-07-09T21:52:01.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.940+0000 7f432c999700 1 -- 172.21.15.53:0/1450015804 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432000bbd0 con 0x7f43280d1220 2023-07-09T21:52:01.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.940+0000 7f432c999700 1 -- 172.21.15.53:0/1450015804 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320012430 con 0x7f43280d1220 2023-07-09T21:52:01.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.940+0000 7f432fbff700 1 -- 172.21.15.53:0/1450015804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43280d1220 msgr2=0x7f43280afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:01.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.940+0000 7f432fbff700 1 --2- 172.21.15.53:0/1450015804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43280d1220 0x7f43280afac0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f432808d170 tx=0x7f432000b330 comp rx=0 tx=0).stop 2023-07-09T21:52:01.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.940+0000 7f432fbff700 1 -- 172.21.15.53:0/1450015804 shutdown_connections 2023-07-09T21:52:01.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.940+0000 7f432fbff700 1 --2- 172.21.15.53:0/1450015804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43280d1220 0x7f43280afac0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.940+0000 7f432fbff700 1 --2- 172.21.15.53:0/1450015804 >> v2:172.21.15.184:3300/0 conn(0x7f43280b1e00 0x7f43280b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.940+0000 7f432fbff700 1 -- 172.21.15.53:0/1450015804 >> 172.21.15.53:0/1450015804 conn(0x7f432809c1d0 msgr2=0x7f43280d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:01.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.940+0000 7f432fbff700 1 -- 172.21.15.53:0/1450015804 shutdown_connections 2023-07-09T21:52:01.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.940+0000 7f432fbff700 1 -- 172.21.15.53:0/1450015804 wait complete. 2023-07-09T21:52:01.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.942+0000 7f432fbff700 1 Processor -- start 2023-07-09T21:52:01.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.942+0000 7f432fbff700 1 -- start start 2023-07-09T21:52:01.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.943+0000 7f432fbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43280b1e00 0x7f43280c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.943+0000 7f432fbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43280b2350 0x7f43280c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.943+0000 7f432fbff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43280d1220 0x7f4328155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.943+0000 7f432fbff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43280c7160 con 0x7f43280d1220 2023-07-09T21:52:01.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.943+0000 7f432fbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43280c6ba0 con 0x7f43280b2350 2023-07-09T21:52:01.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.943+0000 7f432fbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43280c6e80 con 0x7f43280b1e00 2023-07-09T21:52:01.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.944+0000 7f432e19c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43280d1220 0x7f4328155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.944+0000 7f432e19c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43280d1220 0x7f4328155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52712/0 (socket says 172.21.15.53:52712) 2023-07-09T21:52:01.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.944+0000 7f432e19c700 1 -- 172.21.15.53:0/506115121 learned_addr learned my addr 172.21.15.53:0/506115121 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:01.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.944+0000 7f432d99b700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43280b1e00 0x7f43280c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.944+0000 7f432e19c700 1 -- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43280b1e00 msgr2=0x7f43280c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:01.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.944+0000 7f432e19c700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43280b1e00 0x7f43280c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.944+0000 7f432e19c700 1 -- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43280b2350 msgr2=0x7f43280c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:01.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.944+0000 7f432d19a700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43280b2350 0x7f43280c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.944+0000 7f432e19c700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43280b2350 0x7f43280c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:01.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.944+0000 7f432e19c700 1 -- 172.21.15.53:0/506115121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320009a70 con 0x7f43280d1220 2023-07-09T21:52:01.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.944+0000 7f432d19a700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43280b2350 0x7f43280c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:01.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.944+0000 7f432e19c700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43280d1220 0x7f4328155710 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4320014040 tx=0x7f4320004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:01.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.945+0000 7f431e7fc700 1 -- 172.21.15.53:0/506115121 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320012430 con 0x7f43280d1220 2023-07-09T21:52:01.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.945+0000 7f431e7fc700 1 -- 172.21.15.53:0/506115121 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4320020070 con 0x7f43280d1220 2023-07-09T21:52:01.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.945+0000 7f432fbff700 1 -- 172.21.15.53:0/506115121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43280cd6a0 con 0x7f43280d1220 2023-07-09T21:52:01.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.945+0000 7f431e7fc700 1 -- 172.21.15.53:0/506115121 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320004280 con 0x7f43280d1220 2023-07-09T21:52:01.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.945+0000 7f432fbff700 1 -- 172.21.15.53:0/506115121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43280c9970 con 0x7f43280d1220 2023-07-09T21:52:01.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.946+0000 7f432fbff700 1 -- 172.21.15.53:0/506115121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43280affe0 con 0x7f43280d1220 2023-07-09T21:52:01.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.947+0000 7f431e7fc700 1 -- 172.21.15.53:0/506115121 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f43200043e0 con 0x7f43280d1220 2023-07-09T21:52:01.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.948+0000 7f431e7fc700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f430c06ad70 0x7f430c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:01.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.948+0000 7f431e7fc700 1 -- 172.21.15.53:0/506115121 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4320022070 con 0x7f43280d1220 2023-07-09T21:52:01.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.949+0000 7f432d99b700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f430c06ad70 0x7f430c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:01.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.949+0000 7f432d99b700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f430c06ad70 0x7f430c06d220 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4324006fd0 tx=0x7f4324008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:01.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:01.952+0000 7f431e7fc700 1 -- 172.21.15.53:0/506115121 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43280affe0 con 0x7f43280d1220 2023-07-09T21:52:02.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.160+0000 7f432fbff700 1 -- 172.21.15.53:0/506115121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43280cdbc0 con 0x7f43280d1220 2023-07-09T21:52:02.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.161+0000 7f431e7fc700 1 -- 172.21.15.53:0/506115121 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f43280cdbc0 con 0x7f43280d1220 2023-07-09T21:52:02.163 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:02.163 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:51:42.861246+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:51:39.793448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:51:40.342794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:52:02.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.164+0000 7f432fbff700 1 -- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f430c06ad70 msgr2=0x7f430c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:02.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.164+0000 7f432fbff700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f430c06ad70 0x7f430c06d220 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4324006fd0 tx=0x7f4324008040 comp rx=0 tx=0).stop 2023-07-09T21:52:02.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.164+0000 7f432fbff700 1 -- 172.21.15.53:0/506115121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43280d1220 msgr2=0x7f4328155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.164+0000 7f432fbff700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43280d1220 0x7f4328155710 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4320014040 tx=0x7f4320004ad0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.164+0000 7f432fbff700 1 -- 172.21.15.53:0/506115121 shutdown_connections 2023-07-09T21:52:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.164+0000 7f432fbff700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f430c06ad70 0x7f430c06d220 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.164+0000 7f432fbff700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43280d1220 0x7f4328155710 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.164+0000 7f432fbff700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43280b1e00 0x7f43280c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.164+0000 7f432fbff700 1 --2- 172.21.15.53:0/506115121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43280b2350 0x7f43280c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.164+0000 7f432fbff700 1 -- 172.21.15.53:0/506115121 >> 172.21.15.53:0/506115121 conn(0x7f432809c1d0 msgr2=0x7f4328158190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.164+0000 7f432fbff700 1 -- 172.21.15.53:0/506115121 shutdown_connections 2023-07-09T21:52:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.164+0000 7f432fbff700 1 -- 172.21.15.53:0/506115121 wait complete. 2023-07-09T21:52:02.183 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:51:39.793448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:51:40.342794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:52:02.184 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:52:02.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.387+0000 7f3972bff700 1 Processor -- start 2023-07-09T21:52:02.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.387+0000 7f3972bff700 1 -- start start 2023-07-09T21:52:02.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.388+0000 7f3972bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f396c0b3ff0 0x7f396c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:02.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.388+0000 7f3972bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f396c0d0f90 0x7f396c0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:02.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.388+0000 7f3972bff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396c0b8e80 con 0x7f396c0d0b10 2023-07-09T21:52:02.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.388+0000 7f3972bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396c0b1e30 con 0x7f396c0b3ff0 2023-07-09T21:52:02.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.388+0000 7f3972bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396c0afaa0 con 0x7f396c0d0f90 2023-07-09T21:52:02.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.389+0000 7f397099b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f396c0b3ff0 0x7f396c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:02.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.389+0000 7f397099b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f396c0b3ff0 0x7f396c0b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52716/0 (socket says 172.21.15.53:52716) 2023-07-09T21:52:02.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.389+0000 7f396bfff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f396c0d0b10 0x7f396c0b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55104/0 (socket says 172.21.15.53:55104) 2023-07-09T21:52:02.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.389+0000 7f397099b700 1 -- 172.21.15.53:0/2095752323 learned_addr learned my addr 172.21.15.53:0/2095752323 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:02.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.389+0000 7f397119c700 1 --2- 172.21.15.53:0/2095752323 >> v2:172.21.15.184:3300/0 conn(0x7f396c0d0f90 0x7f396c0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:02.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.389+0000 7f397099b700 1 -- 172.21.15.53:0/2095752323 >> v2:172.21.15.184:3300/0 conn(0x7f396c0d0f90 msgr2=0x7f396c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:02.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.389+0000 7f397099b700 1 --2- 172.21.15.53:0/2095752323 >> v2:172.21.15.184:3300/0 conn(0x7f396c0d0f90 0x7f396c0b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.389+0000 7f397099b700 1 -- 172.21.15.53:0/2095752323 >> v1:172.21.15.53:6789/0 conn(0x7f396c0d0b10 legacy=0x7f396c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:02.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.389+0000 7f397099b700 1 -- 172.21.15.53:0/2095752323 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c0afd80 con 0x7f396c0b3ff0 2023-07-09T21:52:02.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.389+0000 7f396b7fe700 1 -- 172.21.15.53:0/2095752323 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52469051 0 0) 0x7f3958001110 con 0x7f396c0d0b10 2023-07-09T21:52:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.389+0000 7f397099b700 1 --2- 172.21.15.53:0/2095752323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c0b3ff0 0x7f396c0b43c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f396c0674e0 tx=0x7f3960009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d526209a1fea6d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.390+0000 7f396b7fe700 1 -- 172.21.15.53:0/2095752323 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396000b870 con 0x7f396c0b3ff0 2023-07-09T21:52:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.390+0000 7f396b7fe700 1 -- 172.21.15.53:0/2095752323 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396000b9d0 con 0x7f396c0b3ff0 2023-07-09T21:52:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.390+0000 7f396b7fe700 1 -- 172.21.15.53:0/2095752323 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396000bd60 con 0x7f396c0b3ff0 2023-07-09T21:52:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.390+0000 7f3972bff700 1 -- 172.21.15.53:0/2095752323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c0b3ff0 msgr2=0x7f396c0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.390+0000 7f3972bff700 1 --2- 172.21.15.53:0/2095752323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c0b3ff0 0x7f396c0b43c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f396c0674e0 tx=0x7f3960009bd0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.390+0000 7f3972bff700 1 -- 172.21.15.53:0/2095752323 shutdown_connections 2023-07-09T21:52:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.390+0000 7f3972bff700 1 --2- 172.21.15.53:0/2095752323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c0b3ff0 0x7f396c0b43c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.390+0000 7f3972bff700 1 --2- 172.21.15.53:0/2095752323 >> v2:172.21.15.184:3300/0 conn(0x7f396c0d0f90 0x7f396c0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.390+0000 7f3972bff700 1 -- 172.21.15.53:0/2095752323 >> 172.21.15.53:0/2095752323 conn(0x7f396c09c1b0 msgr2=0x7f396c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:02.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.390+0000 7f3972bff700 1 -- 172.21.15.53:0/2095752323 shutdown_connections 2023-07-09T21:52:02.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.390+0000 7f3972bff700 1 -- 172.21.15.53:0/2095752323 wait complete. 2023-07-09T21:52:02.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.393+0000 7f3972bff700 1 Processor -- start 2023-07-09T21:52:02.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.393+0000 7f3972bff700 1 -- start start 2023-07-09T21:52:02.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.394+0000 7f3972bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f396c0b3ff0 0x7f396c1f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:02.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.394+0000 7f3972bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c0d0b10 0x7f396c151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:02.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.394+0000 7f3972bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396c0d0f90 0x7f396c0cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:02.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.394+0000 7f3972bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0cd040 con 0x7f396c0d0b10 2023-07-09T21:52:02.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.394+0000 7f3972bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c151970 con 0x7f396c0d0f90 2023-07-09T21:52:02.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.394+0000 7f3972bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0cb720 con 0x7f396c0b3ff0 2023-07-09T21:52:02.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.394+0000 7f396bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c0d0b10 0x7f396c151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:02.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.395+0000 7f396bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c0d0b10 0x7f396c151430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52720/0 (socket says 172.21.15.53:52720) 2023-07-09T21:52:02.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.395+0000 7f396bfff700 1 -- 172.21.15.53:0/3710363003 learned_addr learned my addr 172.21.15.53:0/3710363003 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:02.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.395+0000 7f397099b700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f396c0b3ff0 0x7f396c1f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:02.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.395+0000 7f397119c700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396c0d0f90 0x7f396c0cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.395+0000 7f396bfff700 1 -- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f396c0b3ff0 msgr2=0x7f396c1f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.395+0000 7f396bfff700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f396c0b3ff0 0x7f396c1f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.395+0000 7f396bfff700 1 -- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396c0d0f90 msgr2=0x7f396c0cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.395+0000 7f396bfff700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396c0d0f90 0x7f396c0cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.395+0000 7f396bfff700 1 -- 172.21.15.53:0/3710363003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3960009550 con 0x7f396c0d0b10 2023-07-09T21:52:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.395+0000 7f396bfff700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c0d0b10 0x7f396c151430 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f395800c730 tx=0x7f395800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.396+0000 7f39697fa700 1 -- 172.21.15.53:0/3710363003 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958004c80 con 0x7f396c0d0b10 2023-07-09T21:52:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.396+0000 7f39697fa700 1 -- 172.21.15.53:0/3710363003 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3958004e00 con 0x7f396c0d0b10 2023-07-09T21:52:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.396+0000 7f3972bff700 1 -- 172.21.15.53:0/3710363003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c1f63a0 con 0x7f396c0d0b10 2023-07-09T21:52:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.396+0000 7f39697fa700 1 -- 172.21.15.53:0/3710363003 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958007310 con 0x7f396c0d0b10 2023-07-09T21:52:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.396+0000 7f3972bff700 1 -- 172.21.15.53:0/3710363003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c1f5de0 con 0x7f396c0d0b10 2023-07-09T21:52:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.397+0000 7f3972bff700 1 -- 172.21.15.53:0/3710363003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396c074350 con 0x7f396c0d0b10 2023-07-09T21:52:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.398+0000 7f39697fa700 1 -- 172.21.15.53:0/3710363003 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f3958007470 con 0x7f396c0d0b10 2023-07-09T21:52:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.399+0000 7f39697fa700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f395006ad70 0x7f395006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.399+0000 7f39697fa700 1 -- 172.21.15.53:0/3710363003 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3958088fc0 con 0x7f396c0d0b10 2023-07-09T21:52:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.399+0000 7f397099b700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f395006ad70 0x7f395006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:02.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.400+0000 7f397099b700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f395006ad70 0x7f395006d220 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3960009c10 tx=0x7f3960008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.403+0000 7f39697fa700 1 -- 172.21.15.53:0/3710363003 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3958053f80 con 0x7f396c0d0b10 2023-07-09T21:52:02.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.610+0000 7f3972bff700 1 -- 172.21.15.53:0/3710363003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f396c0b8e80 con 0x7f396c0d0b10 2023-07-09T21:52:02.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.611+0000 7f39697fa700 1 -- 172.21.15.53:0/3710363003 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f396c0b8e80 con 0x7f396c0d0b10 2023-07-09T21:52:02.613 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:52:02.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.613+0000 7f3972bff700 1 -- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f395006ad70 msgr2=0x7f395006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:02.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.613+0000 7f3972bff700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f395006ad70 0x7f395006d220 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3960009c10 tx=0x7f3960008030 comp rx=0 tx=0).stop 2023-07-09T21:52:02.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.613+0000 7f3972bff700 1 -- 172.21.15.53:0/3710363003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c0d0b10 msgr2=0x7f396c151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.613+0000 7f3972bff700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c0d0b10 0x7f396c151430 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f395800c730 tx=0x7f395800ca40 comp rx=0 tx=0).stop 2023-07-09T21:52:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.613+0000 7f3972bff700 1 -- 172.21.15.53:0/3710363003 shutdown_connections 2023-07-09T21:52:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.613+0000 7f3972bff700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f395006ad70 0x7f395006d220 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.613+0000 7f3972bff700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396c0d0f90 0x7f396c0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.613+0000 7f3972bff700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f396c0b3ff0 0x7f396c1f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.613+0000 7f3972bff700 1 --2- 172.21.15.53:0/3710363003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c0d0b10 0x7f396c151430 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.613+0000 7f3972bff700 1 -- 172.21.15.53:0/3710363003 >> 172.21.15.53:0/3710363003 conn(0x7f396c09c1b0 msgr2=0x7f396c06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:02.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.613+0000 7f3972bff700 1 -- 172.21.15.53:0/3710363003 shutdown_connections 2023-07-09T21:52:02.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.613+0000 7f3972bff700 1 -- 172.21.15.53:0/3710363003 wait complete. 2023-07-09T21:52:02.633 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:52:02.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.834+0000 7feb9e3ff700 1 Processor -- start 2023-07-09T21:52:02.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.834+0000 7feb9e3ff700 1 -- start start 2023-07-09T21:52:02.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.835+0000 7feb9e3ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feb980d1220 0x7feb980b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.835+0000 7feb9e3ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7feb980b0e20 0x7feb980b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.835+0000 7feb9e3ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb980b8e80 con 0x7feb980b3ff0 2023-07-09T21:52:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.835+0000 7feb9e3ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb980afaa0 con 0x7feb980d1220 2023-07-09T21:52:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.835+0000 7feb9e3ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb980afd80 con 0x7feb980b0e20 2023-07-09T21:52:02.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.836+0000 7feb977fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feb980d1220 0x7feb980b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:02.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.836+0000 7feb97fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7feb980b3ff0 0x7feb980d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56244/0 (socket says 172.21.15.53:56244) 2023-07-09T21:52:02.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.836+0000 7feb97fff700 1 -- 172.21.15.53:0/2557166746 learned_addr learned my addr 172.21.15.53:0/2557166746 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:02.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.836+0000 7feb9c99c700 1 --2- 172.21.15.53:0/2557166746 >> v2:172.21.15.184:3300/0 conn(0x7feb980b0e20 0x7feb980b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:02.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.836+0000 7feb977fe700 1 -- 172.21.15.53:0/2557166746 >> v2:172.21.15.184:3300/0 conn(0x7feb980b0e20 msgr2=0x7feb980b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:02.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.836+0000 7feb977fe700 1 --2- 172.21.15.53:0/2557166746 >> v2:172.21.15.184:3300/0 conn(0x7feb980b0e20 0x7feb980b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.836+0000 7feb977fe700 1 -- 172.21.15.53:0/2557166746 >> v1:172.21.15.53:6789/0 conn(0x7feb980b3ff0 legacy=0x7feb980d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.836+0000 7feb977fe700 1 -- 172.21.15.53:0/2557166746 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb980b0060 con 0x7feb980d1220 2023-07-09T21:52:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.836+0000 7feb9c99c700 1 --2- 172.21.15.53:0/2557166746 >> v2:172.21.15.184:3300/0 conn(0x7feb980b0e20 0x7feb980b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.836+0000 7feb96ffd700 1 -- 172.21.15.53:0/2557166746 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504782912 0 0) 0x7feb88001110 con 0x7feb980b3ff0 2023-07-09T21:52:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.836+0000 7feb977fe700 1 --2- 172.21.15.53:0/2557166746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb980d1220 0x7feb980b43c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feb980d3ce0 tx=0x7feb8c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb646f3aaff67787 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.837+0000 7feb96ffd700 1 -- 172.21.15.53:0/2557166746 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c011830 con 0x7feb980d1220 2023-07-09T21:52:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.837+0000 7feb96ffd700 1 -- 172.21.15.53:0/2557166746 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c011990 con 0x7feb980d1220 2023-07-09T21:52:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.837+0000 7feb96ffd700 1 -- 172.21.15.53:0/2557166746 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c011d20 con 0x7feb980d1220 2023-07-09T21:52:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.837+0000 7feb9e3ff700 1 -- 172.21.15.53:0/2557166746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb980d1220 msgr2=0x7feb980b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.837+0000 7feb9e3ff700 1 --2- 172.21.15.53:0/2557166746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb980d1220 0x7feb980b43c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feb980d3ce0 tx=0x7feb8c009b20 comp rx=0 tx=0).stop 2023-07-09T21:52:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.837+0000 7feb9e3ff700 1 -- 172.21.15.53:0/2557166746 shutdown_connections 2023-07-09T21:52:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.837+0000 7feb9e3ff700 1 --2- 172.21.15.53:0/2557166746 >> v2:172.21.15.184:3300/0 conn(0x7feb980b0e20 0x7feb980b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.837+0000 7feb9e3ff700 1 --2- 172.21.15.53:0/2557166746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb980d1220 0x7feb980b43c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.837+0000 7feb9e3ff700 1 -- 172.21.15.53:0/2557166746 >> 172.21.15.53:0/2557166746 conn(0x7feb9809c1b0 msgr2=0x7feb980d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:02.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.837+0000 7feb9e3ff700 1 -- 172.21.15.53:0/2557166746 shutdown_connections 2023-07-09T21:52:02.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.837+0000 7feb9e3ff700 1 -- 172.21.15.53:0/2557166746 wait complete. 2023-07-09T21:52:02.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.839+0000 7feb9e3ff700 1 Processor -- start 2023-07-09T21:52:02.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.839+0000 7feb9e3ff700 1 -- start start 2023-07-09T21:52:02.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.840+0000 7feb9e3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb980b0e20 0x7feb9814b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:02.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.840+0000 7feb9e3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb980b3ff0 0x7feb9814bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:02.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.840+0000 7feb9e3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb980d1220 0x7feb981e5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:02.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.840+0000 7feb9e3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb980c8810 con 0x7feb980d1220 2023-07-09T21:52:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.840+0000 7feb9e3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb980c7b90 con 0x7feb980b0e20 2023-07-09T21:52:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.840+0000 7feb9e3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb980c7e70 con 0x7feb980b3ff0 2023-07-09T21:52:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.841+0000 7feb9c99c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb980d1220 0x7feb981e5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.841+0000 7feb9c99c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb980d1220 0x7feb981e5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52380/0 (socket says 172.21.15.53:52380) 2023-07-09T21:52:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.841+0000 7feb9c99c700 1 -- 172.21.15.53:0/580646336 learned_addr learned my addr 172.21.15.53:0/580646336 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.841+0000 7feb977fe700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb980b3ff0 0x7feb9814bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.841+0000 7feb97fff700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb980b0e20 0x7feb9814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.841+0000 7feb9c99c700 1 -- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb980b3ff0 msgr2=0x7feb9814bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.841+0000 7feb9c99c700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb980b3ff0 0x7feb9814bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.841+0000 7feb9c99c700 1 -- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb980b0e20 msgr2=0x7feb9814b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.841+0000 7feb9c99c700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb980b0e20 0x7feb9814b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.841+0000 7feb9c99c700 1 -- 172.21.15.53:0/580646336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c0094a0 con 0x7feb980d1220 2023-07-09T21:52:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.841+0000 7feb97fff700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb980b0e20 0x7feb9814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.841+0000 7feb9c99c700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb980d1220 0x7feb981e5ab0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feb90007e70 tx=0x7feb9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:02.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.842+0000 7feb94ff9700 1 -- 172.21.15.53:0/580646336 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9000ddd0 con 0x7feb980d1220 2023-07-09T21:52:02.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.842+0000 7feb94ff9700 1 -- 172.21.15.53:0/580646336 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9000f040 con 0x7feb980d1220 2023-07-09T21:52:02.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.842+0000 7feb9e3ff700 1 -- 172.21.15.53:0/580646336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb980c8150 con 0x7feb980d1220 2023-07-09T21:52:02.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.842+0000 7feb94ff9700 1 -- 172.21.15.53:0/580646336 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90003c60 con 0x7feb980d1220 2023-07-09T21:52:02.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.842+0000 7feb9e3ff700 1 -- 172.21.15.53:0/580646336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9814c0c0 con 0x7feb980d1220 2023-07-09T21:52:02.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.843+0000 7feb9e3ff700 1 -- 172.21.15.53:0/580646336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb980c8950 con 0x7feb980d1220 2023-07-09T21:52:02.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.844+0000 7feb94ff9700 1 -- 172.21.15.53:0/580646336 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7feb90004030 con 0x7feb980d1220 2023-07-09T21:52:02.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.845+0000 7feb94ff9700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7feb8406ad70 0x7feb8406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.845+0000 7feb94ff9700 1 -- 172.21.15.53:0/580646336 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb90089780 con 0x7feb980d1220 2023-07-09T21:52:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.845+0000 7feb97fff700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7feb8406ad70 0x7feb8406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.846+0000 7feb97fff700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7feb8406ad70 0x7feb8406d220 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7feb88000f60 tx=0x7feb88007b00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:02.849+0000 7feb94ff9700 1 -- 172.21.15.53:0/580646336 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feb980c8950 con 0x7feb980d1220 2023-07-09T21:52:03.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.058+0000 7feb9e3ff700 1 -- 172.21.15.53:0/580646336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb980c8950 con 0x7feb980d1220 2023-07-09T21:52:03.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.058+0000 7feb94ff9700 1 -- 172.21.15.53:0/580646336 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7feb980c8950 con 0x7feb980d1220 2023-07-09T21:52:03.061 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:52:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.060+0000 7feb9e3ff700 1 -- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7feb8406ad70 msgr2=0x7feb8406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.060+0000 7feb9e3ff700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7feb8406ad70 0x7feb8406d220 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7feb88000f60 tx=0x7feb88007b00 comp rx=0 tx=0).stop 2023-07-09T21:52:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.060+0000 7feb9e3ff700 1 -- 172.21.15.53:0/580646336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb980d1220 msgr2=0x7feb981e5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.060+0000 7feb9e3ff700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb980d1220 0x7feb981e5ab0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feb90007e70 tx=0x7feb9000d3b0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.060+0000 7feb9e3ff700 1 -- 172.21.15.53:0/580646336 shutdown_connections 2023-07-09T21:52:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.060+0000 7feb9e3ff700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7feb8406ad70 0x7feb8406d220 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.060+0000 7feb9e3ff700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb980d1220 0x7feb981e5ab0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.060+0000 7feb9e3ff700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb980b0e20 0x7feb9814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.060+0000 7feb9e3ff700 1 --2- 172.21.15.53:0/580646336 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb980b3ff0 0x7feb9814bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.060+0000 7feb9e3ff700 1 -- 172.21.15.53:0/580646336 >> 172.21.15.53:0/580646336 conn(0x7feb9809c1b0 msgr2=0x7feb980d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.060+0000 7feb9e3ff700 1 -- 172.21.15.53:0/580646336 shutdown_connections 2023-07-09T21:52:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.061+0000 7feb9e3ff700 1 -- 172.21.15.53:0/580646336 wait complete. 2023-07-09T21:52:03.081 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:52:03.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.283+0000 7fdb621ff700 1 Processor -- start 2023-07-09T21:52:03.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.283+0000 7fdb621ff700 1 -- start start 2023-07-09T21:52:03.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.284+0000 7fdb621ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdb5c0d1220 0x7fdb5c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.284+0000 7fdb621ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdb5c0b0e20 0x7fdb5c0b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.284+0000 7fdb621ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5c0b8e80 con 0x7fdb5c0b3ff0 2023-07-09T21:52:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.284+0000 7fdb621ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5c0afaa0 con 0x7fdb5c0d1220 2023-07-09T21:52:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.284+0000 7fdb621ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5c0afd80 con 0x7fdb5c0b0e20 2023-07-09T21:52:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.284+0000 7fdb53fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdb5c0d1220 0x7fdb5c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.284+0000 7fdb53fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdb5c0d1220 0x7fdb5c0b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52388/0 (socket says 172.21.15.53:52388) 2023-07-09T21:52:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.284+0000 7fdb53fff700 1 -- 172.21.15.53:0/1128220220 learned_addr learned my addr 172.21.15.53:0/1128220220 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.285+0000 7fdb5bfff700 1 --2- 172.21.15.53:0/1128220220 >> v2:172.21.15.184:3300/0 conn(0x7fdb5c0b0e20 0x7fdb5c0b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.285+0000 7fdb53fff700 1 -- 172.21.15.53:0/1128220220 >> v2:172.21.15.184:3300/0 conn(0x7fdb5c0b0e20 msgr2=0x7fdb5c0b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.285+0000 7fdb53fff700 1 --2- 172.21.15.53:0/1128220220 >> v2:172.21.15.184:3300/0 conn(0x7fdb5c0b0e20 0x7fdb5c0b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.285+0000 7fdb53fff700 1 -- 172.21.15.53:0/1128220220 >> v1:172.21.15.184:6789/0 conn(0x7fdb5c0b3ff0 legacy=0x7fdb5c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.285+0000 7fdb53fff700 1 -- 172.21.15.53:0/1128220220 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c0b0060 con 0x7fdb5c0d1220 2023-07-09T21:52:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.285+0000 7fdb5bfff700 1 --2- 172.21.15.53:0/1128220220 >> v2:172.21.15.184:3300/0 conn(0x7fdb5c0b0e20 0x7fdb5c0b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.285+0000 7fdb53fff700 1 --2- 172.21.15.53:0/1128220220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb5c0d1220 0x7fdb5c0b43c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0d3ce0 tx=0x7fdb44009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511649d8d83cbd80 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.285+0000 7fdb5affd700 1 -- 172.21.15.53:0/1128220220 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44004230 con 0x7fdb5c0d1220 2023-07-09T21:52:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.285+0000 7fdb5affd700 1 -- 172.21.15.53:0/1128220220 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb44004390 con 0x7fdb5c0d1220 2023-07-09T21:52:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.285+0000 7fdb5affd700 1 -- 172.21.15.53:0/1128220220 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440036a0 con 0x7fdb5c0d1220 2023-07-09T21:52:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.286+0000 7fdb621ff700 1 -- 172.21.15.53:0/1128220220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb5c0d1220 msgr2=0x7fdb5c0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.286+0000 7fdb621ff700 1 --2- 172.21.15.53:0/1128220220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb5c0d1220 0x7fdb5c0b43c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0d3ce0 tx=0x7fdb44009bd0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.286+0000 7fdb621ff700 1 -- 172.21.15.53:0/1128220220 shutdown_connections 2023-07-09T21:52:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.286+0000 7fdb621ff700 1 --2- 172.21.15.53:0/1128220220 >> v2:172.21.15.184:3300/0 conn(0x7fdb5c0b0e20 0x7fdb5c0b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.286+0000 7fdb621ff700 1 --2- 172.21.15.53:0/1128220220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb5c0d1220 0x7fdb5c0b43c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.286+0000 7fdb621ff700 1 -- 172.21.15.53:0/1128220220 >> 172.21.15.53:0/1128220220 conn(0x7fdb5c09c1b0 msgr2=0x7fdb5c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:03.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.286+0000 7fdb621ff700 1 -- 172.21.15.53:0/1128220220 shutdown_connections 2023-07-09T21:52:03.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.286+0000 7fdb621ff700 1 -- 172.21.15.53:0/1128220220 wait complete. 2023-07-09T21:52:03.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.288+0000 7fdb621ff700 1 Processor -- start 2023-07-09T21:52:03.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.289+0000 7fdb621ff700 1 -- start start 2023-07-09T21:52:03.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.290+0000 7fdb621ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb5c0b0e20 0x7fdb5c15b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:03.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.290+0000 7fdb621ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb5c0b3ff0 0x7fdb5c157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:03.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.290+0000 7fdb621ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb5c0d1220 0x7fdb5c1575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:03.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.290+0000 7fdb621ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c159ac0 con 0x7fdb5c0d1220 2023-07-09T21:52:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.290+0000 7fdb621ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c1fa8c0 con 0x7fdb5c0b0e20 2023-07-09T21:52:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.290+0000 7fdb621ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c1f9cb0 con 0x7fdb5c0b3ff0 2023-07-09T21:52:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.290+0000 7fdb5bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb5c0d1220 0x7fdb5c1575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.290+0000 7fdb5bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb5c0d1220 0x7fdb5c1575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52398/0 (socket says 172.21.15.53:52398) 2023-07-09T21:52:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.290+0000 7fdb5bfff700 1 -- 172.21.15.53:0/561731816 learned_addr learned my addr 172.21.15.53:0/561731816 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb5b7fe700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb5c0b0e20 0x7fdb5c15b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb53fff700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb5c0b3ff0 0x7fdb5c157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb5bfff700 1 -- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb5c0b3ff0 msgr2=0x7fdb5c157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb5bfff700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb5c0b3ff0 0x7fdb5c157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb5bfff700 1 -- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb5c0b0e20 msgr2=0x7fdb5c15b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb5bfff700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb5c0b0e20 0x7fdb5c15b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb5bfff700 1 -- 172.21.15.53:0/561731816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44009550 con 0x7fdb5c0d1220 2023-07-09T21:52:03.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb53fff700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb5c0b3ff0 0x7fdb5c157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:03.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb5b7fe700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb5c0b0e20 0x7fdb5c15b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:03.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb5bfff700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb5c0d1220 0x7fdb5c1575a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400cd50 tx=0x7fdb5400a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:03.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb58ff9700 1 -- 172.21.15.53:0/561731816 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5400f480 con 0x7fdb5c0d1220 2023-07-09T21:52:03.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb58ff9700 1 -- 172.21.15.53:0/561731816 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5400f600 con 0x7fdb5c0d1220 2023-07-09T21:52:03.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb58ff9700 1 -- 172.21.15.53:0/561731816 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5400f9b0 con 0x7fdb5c0d1220 2023-07-09T21:52:03.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.291+0000 7fdb621ff700 1 -- 172.21.15.53:0/561731816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5c1f9f90 con 0x7fdb5c0d1220 2023-07-09T21:52:03.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.292+0000 7fdb621ff700 1 -- 172.21.15.53:0/561731816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5c1fa550 con 0x7fdb5c0d1220 2023-07-09T21:52:03.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.292+0000 7fdb621ff700 1 -- 172.21.15.53:0/561731816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5c1faa30 con 0x7fdb5c0d1220 2023-07-09T21:52:03.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.293+0000 7fdb58ff9700 1 -- 172.21.15.53:0/561731816 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fdb5400b040 con 0x7fdb5c0d1220 2023-07-09T21:52:03.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.294+0000 7fdb58ff9700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdb3c06ad70 0x7fdb3c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:03.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.294+0000 7fdb58ff9700 1 -- 172.21.15.53:0/561731816 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb54089f80 con 0x7fdb5c0d1220 2023-07-09T21:52:03.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.295+0000 7fdb5b7fe700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdb3c06ad70 0x7fdb3c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:03.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.295+0000 7fdb5b7fe700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdb3c06ad70 0x7fdb3c06d220 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c003f40 tx=0x7fdb4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:03.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.299+0000 7fdb58ff9700 1 -- 172.21.15.53:0/561731816 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdb54054e30 con 0x7fdb5c0d1220 2023-07-09T21:52:03.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.503+0000 7fdb621ff700 1 -- 172.21.15.53:0/561731816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb5c0b0310 con 0x7fdb5c0d1220 2023-07-09T21:52:03.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.504+0000 7fdb58ff9700 1 -- 172.21.15.53:0/561731816 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdb5401d020 con 0x7fdb5c0d1220 2023-07-09T21:52:03.506 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:52:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.506+0000 7fdb621ff700 1 -- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdb3c06ad70 msgr2=0x7fdb3c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.506+0000 7fdb621ff700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdb3c06ad70 0x7fdb3c06d220 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c003f40 tx=0x7fdb4c009040 comp rx=0 tx=0).stop 2023-07-09T21:52:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.506+0000 7fdb621ff700 1 -- 172.21.15.53:0/561731816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb5c0d1220 msgr2=0x7fdb5c1575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.506+0000 7fdb621ff700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb5c0d1220 0x7fdb5c1575a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400cd50 tx=0x7fdb5400a560 comp rx=0 tx=0).stop 2023-07-09T21:52:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.506+0000 7fdb621ff700 1 -- 172.21.15.53:0/561731816 shutdown_connections 2023-07-09T21:52:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.506+0000 7fdb621ff700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdb3c06ad70 0x7fdb3c06d220 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.506+0000 7fdb621ff700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb5c0d1220 0x7fdb5c1575a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.506+0000 7fdb621ff700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb5c0b0e20 0x7fdb5c15b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.506+0000 7fdb621ff700 1 --2- 172.21.15.53:0/561731816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb5c0b3ff0 0x7fdb5c157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.507+0000 7fdb621ff700 1 -- 172.21.15.53:0/561731816 >> 172.21.15.53:0/561731816 conn(0x7fdb5c09c1b0 msgr2=0x7fdb5c0b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.507+0000 7fdb621ff700 1 -- 172.21.15.53:0/561731816 shutdown_connections 2023-07-09T21:52:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.507+0000 7fdb621ff700 1 -- 172.21.15.53:0/561731816 wait complete. 2023-07-09T21:52:03.526 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:52:03.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.729+0000 7f9bf17ff700 1 Processor -- start 2023-07-09T21:52:03.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.729+0000 7f9bf17ff700 1 -- start start 2023-07-09T21:52:03.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.730+0000 7f9bf17ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9bec0b43c0 0x7f9bec0b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.730+0000 7f9bf17ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec0b8e80 con 0x7f9bec0d1220 2023-07-09T21:52:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.730+0000 7f9bf17ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec0afaa0 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.730+0000 7f9bf17ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec0afd80 con 0x7f9bec0b43c0 2023-07-09T21:52:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.730+0000 7f9beb7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9bec0b43c0 0x7f9bec0b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.731+0000 7f9beb7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9bec0b43c0 0x7f9bec0b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52400/0 (socket says 172.21.15.53:52400) 2023-07-09T21:52:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.731+0000 7f9bea7fc700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9bec0d1220 0x7f9bec0b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56260/0 (socket says 172.21.15.53:56260) 2023-07-09T21:52:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.731+0000 7f9beb7fe700 1 -- 172.21.15.53:0/1787472105 learned_addr learned my addr 172.21.15.53:0/1787472105 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:03.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.731+0000 7f9beb7fe700 1 -- 172.21.15.53:0/1787472105 >> v1:172.21.15.184:6789/0 conn(0x7f9bec0b3ff0 legacy=0x7f9bec0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.731+0000 7f9beb7fe700 1 -- 172.21.15.53:0/1787472105 >> v1:172.21.15.53:6789/0 conn(0x7f9bec0d1220 legacy=0x7f9bec0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.731+0000 7f9beb7fe700 1 -- 172.21.15.53:0/1787472105 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec0b0060 con 0x7f9bec0b43c0 2023-07-09T21:52:03.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.731+0000 7f9beb7fe700 1 --2- 172.21.15.53:0/1787472105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bec0b43c0 0x7f9bec0b1530 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009e50 tx=0x7f9be400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c2c131dd29de75 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:03.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.731+0000 7f9be9ffb700 1 -- 172.21.15.53:0/1787472105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400e070 con 0x7f9bec0b43c0 2023-07-09T21:52:03.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.732+0000 7f9be9ffb700 1 -- 172.21.15.53:0/1787472105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be400b9c0 con 0x7f9bec0b43c0 2023-07-09T21:52:03.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.732+0000 7f9be9ffb700 1 -- 172.21.15.53:0/1787472105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400bd70 con 0x7f9bec0b43c0 2023-07-09T21:52:03.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.732+0000 7f9bf17ff700 1 -- 172.21.15.53:0/1787472105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bec0b43c0 msgr2=0x7f9bec0b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.732+0000 7f9bf17ff700 1 --2- 172.21.15.53:0/1787472105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bec0b43c0 0x7f9bec0b1530 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009e50 tx=0x7f9be400b330 comp rx=0 tx=0).stop 2023-07-09T21:52:03.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.732+0000 7f9bf17ff700 1 -- 172.21.15.53:0/1787472105 shutdown_connections 2023-07-09T21:52:03.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.732+0000 7f9bf17ff700 1 --2- 172.21.15.53:0/1787472105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bec0b43c0 0x7f9bec0b1530 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.732+0000 7f9bf17ff700 1 -- 172.21.15.53:0/1787472105 >> 172.21.15.53:0/1787472105 conn(0x7f9bec09c1b0 msgr2=0x7f9bec0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:03.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.732+0000 7f9bf17ff700 1 -- 172.21.15.53:0/1787472105 shutdown_connections 2023-07-09T21:52:03.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.732+0000 7f9bf17ff700 1 -- 172.21.15.53:0/1787472105 wait complete. 2023-07-09T21:52:03.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.734+0000 7f9bf17ff700 1 Processor -- start 2023-07-09T21:52:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.734+0000 7f9bf17ff700 1 -- start start 2023-07-09T21:52:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.735+0000 7f9bf17ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bec0b3ff0 0x7f9bec15bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.735+0000 7f9bf17ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bec0b43c0 0x7f9bec0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.735+0000 7f9bf17ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bec0d1220 0x7f9bec0b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:03.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.735+0000 7f9bf17ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0c6bd0 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.735+0000 7f9bf17ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0c7fd0 con 0x7f9bec0d1220 2023-07-09T21:52:03.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.735+0000 7f9bf17ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0cba00 con 0x7f9bec0b43c0 2023-07-09T21:52:03.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.735+0000 7f9beaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bec0b3ff0 0x7f9bec15bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:03.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.735+0000 7f9beaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bec0b3ff0 0x7f9bec15bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52406/0 (socket says 172.21.15.53:52406) 2023-07-09T21:52:03.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.735+0000 7f9beaffd700 1 -- 172.21.15.53:0/2699614680 learned_addr learned my addr 172.21.15.53:0/2699614680 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:03.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.736+0000 7f9beb7fe700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bec0d1220 0x7f9bec0b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:03.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.736+0000 7f9bea7fc700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bec0b43c0 0x7f9bec0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:03.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.736+0000 7f9beaffd700 1 -- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bec0b43c0 msgr2=0x7f9bec0ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.736+0000 7f9beaffd700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bec0b43c0 0x7f9bec0ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.736+0000 7f9beaffd700 1 -- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bec0d1220 msgr2=0x7f9bec0b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.736+0000 7f9beaffd700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bec0d1220 0x7f9bec0b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.736+0000 7f9beaffd700 1 -- 172.21.15.53:0/2699614680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4009b30 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.736+0000 7f9bea7fc700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bec0b43c0 0x7f9bec0ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:03.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.736+0000 7f9beaffd700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bec0b3ff0 0x7f9bec15bcd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00c4e0 tx=0x7f9bdc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:03.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.736+0000 7f9bd37fe700 1 -- 172.21.15.53:0/2699614680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0052d0 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.736+0000 7f9bd37fe700 1 -- 172.21.15.53:0/2699614680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc005430 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.736+0000 7f9bf17ff700 1 -- 172.21.15.53:0/2699614680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec0cae80 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.736+0000 7f9bd37fe700 1 -- 172.21.15.53:0/2699614680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0038c0 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.737+0000 7f9bf17ff700 1 -- 172.21.15.53:0/2699614680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec0cb440 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.738+0000 7f9bf17ff700 1 -- 172.21.15.53:0/2699614680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec0b7800 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.738+0000 7f9bd37fe700 1 -- 172.21.15.53:0/2699614680 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f9bdc003a20 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.739+0000 7f9bd37fe700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9bd806ad70 0x7f9bd806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.740+0000 7f9bd37fe700 1 -- 172.21.15.53:0/2699614680 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9bdc088a80 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.740+0000 7f9bea7fc700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9bd806ad70 0x7f9bd806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.741+0000 7f9bea7fc700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9bd806ad70 0x7f9bd806d220 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0c9e70 tx=0x7f9be0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.744+0000 7f9bd37fe700 1 -- 172.21.15.53:0/2699614680 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9bdc053a40 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.951+0000 7f9bf17ff700 1 -- 172.21.15.53:0/2699614680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9bec0d1910 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.951+0000 7f9bd37fe700 1 -- 172.21.15.53:0/2699614680 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9bdc057060 con 0x7f9bec0b3ff0 2023-07-09T21:52:03.954 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:52:03.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.953+0000 7f9bf17ff700 1 -- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9bd806ad70 msgr2=0x7f9bd806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.953+0000 7f9bf17ff700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9bd806ad70 0x7f9bd806d220 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0c9e70 tx=0x7f9be0009040 comp rx=0 tx=0).stop 2023-07-09T21:52:03.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.953+0000 7f9bf17ff700 1 -- 172.21.15.53:0/2699614680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bec0b3ff0 msgr2=0x7f9bec15bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:03.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.953+0000 7f9bf17ff700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bec0b3ff0 0x7f9bec15bcd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00c4e0 tx=0x7f9bdc00c8a0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.953+0000 7f9bf17ff700 1 -- 172.21.15.53:0/2699614680 shutdown_connections 2023-07-09T21:52:03.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.953+0000 7f9bf17ff700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9bd806ad70 0x7f9bd806d220 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.953+0000 7f9bf17ff700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bec0d1220 0x7f9bec0b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.953+0000 7f9bf17ff700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bec0b3ff0 0x7f9bec15bcd0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.954+0000 7f9bf17ff700 1 --2- 172.21.15.53:0/2699614680 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bec0b43c0 0x7f9bec0ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:03.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.954+0000 7f9bf17ff700 1 -- 172.21.15.53:0/2699614680 >> 172.21.15.53:0/2699614680 conn(0x7f9bec09c1b0 msgr2=0x7f9bec072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:03.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.954+0000 7f9bf17ff700 1 -- 172.21.15.53:0/2699614680 shutdown_connections 2023-07-09T21:52:03.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:03.954+0000 7f9bf17ff700 1 -- 172.21.15.53:0/2699614680 wait complete. 2023-07-09T21:52:03.974 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:52:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.171+0000 7f47d0fff700 1 Processor -- start 2023-07-09T21:52:04.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.171+0000 7f47d0fff700 1 -- start start 2023-07-09T21:52:04.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.173+0000 7f47d0fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47cc0b1e00 0x7f47cc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:04.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.173+0000 7f47d0fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0d2ce0 con 0x7f47cc0b2350 2023-07-09T21:52:04.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.173+0000 7f47d0fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0b3350 con 0x7f47cc0d1220 2023-07-09T21:52:04.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.173+0000 7f47d0fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0b3630 con 0x7f47cc0b1e00 2023-07-09T21:52:04.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.173+0000 7f47c3fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f47cc0b2350 0x7f47cc0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56270/0 (socket says 172.21.15.53:56270) 2023-07-09T21:52:04.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.173+0000 7f47c3fff700 1 -- 172.21.15.53:0/1157947874 learned_addr learned my addr 172.21.15.53:0/1157947874 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.174+0000 7f47ca59c700 1 --2- 172.21.15.53:0/1157947874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47cc0b1e00 0x7f47cc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.174+0000 7f47c9d9b700 1 -- 172.21.15.53:0/1157947874 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498593346 0 0) 0x7f47cc0d2ce0 con 0x7f47cc0b2350 2023-07-09T21:52:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.174+0000 7f47c9d9b700 1 -- 172.21.15.53:0/1157947874 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b80035b0 con 0x7f47cc0b2350 2023-07-09T21:52:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.174+0000 7f47c9d9b700 1 -- 172.21.15.53:0/1157947874 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657696287 0 0) 0x7f47cc0b3350 con 0x7f47cc0d1220 2023-07-09T21:52:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.174+0000 7f47c9d9b700 1 -- 172.21.15.53:0/1157947874 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47cc0d2ce0 con 0x7f47cc0d1220 2023-07-09T21:52:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.174+0000 7f47ca59c700 1 -- 172.21.15.53:0/1157947874 >> v1:172.21.15.184:6789/0 conn(0x7f47cc0d1220 legacy=0x7f47cc0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.174+0000 7f47ca59c700 1 -- 172.21.15.53:0/1157947874 >> v1:172.21.15.53:6789/0 conn(0x7f47cc0b2350 legacy=0x7f47cc0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.174+0000 7f47ca59c700 1 -- 172.21.15.53:0/1157947874 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0b3910 con 0x7f47cc0b1e00 2023-07-09T21:52:04.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.175+0000 7f47ca59c700 1 --2- 172.21.15.53:0/1157947874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47cc0b1e00 0x7f47cc0b43f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009850 tx=0x7f47bc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=355a12ae83996bf7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:04.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.175+0000 7f47c9d9b700 1 -- 172.21.15.53:0/1157947874 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc005e30 con 0x7f47cc0b1e00 2023-07-09T21:52:04.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.175+0000 7f47c9d9b700 1 -- 172.21.15.53:0/1157947874 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc006030 con 0x7f47cc0b1e00 2023-07-09T21:52:04.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.175+0000 7f47c9d9b700 1 -- 172.21.15.53:0/1157947874 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0063e0 con 0x7f47cc0b1e00 2023-07-09T21:52:04.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.175+0000 7f47d0fff700 1 -- 172.21.15.53:0/1157947874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47cc0b1e00 msgr2=0x7f47cc0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.175+0000 7f47d0fff700 1 --2- 172.21.15.53:0/1157947874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47cc0b1e00 0x7f47cc0b43f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009850 tx=0x7f47bc009b60 comp rx=0 tx=0).stop 2023-07-09T21:52:04.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.175+0000 7f47d0fff700 1 -- 172.21.15.53:0/1157947874 shutdown_connections 2023-07-09T21:52:04.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.175+0000 7f47d0fff700 1 --2- 172.21.15.53:0/1157947874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47cc0b1e00 0x7f47cc0b43f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.175+0000 7f47d0fff700 1 -- 172.21.15.53:0/1157947874 >> 172.21.15.53:0/1157947874 conn(0x7f47cc09c1d0 msgr2=0x7f47cc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:04.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.176+0000 7f47d0fff700 1 -- 172.21.15.53:0/1157947874 shutdown_connections 2023-07-09T21:52:04.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.176+0000 7f47d0fff700 1 -- 172.21.15.53:0/1157947874 wait complete. 2023-07-09T21:52:04.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.177+0000 7f47d0fff700 1 Processor -- start 2023-07-09T21:52:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.177+0000 7f47d0fff700 1 -- start start 2023-07-09T21:52:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.178+0000 7f47d0fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47cc0b1e00 0x7f47cc1586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.178+0000 7f47d0fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47cc0b2350 0x7f47cc0b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.178+0000 7f47d0fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47cc0d1220 0x7f47cc0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.178+0000 7f47d0fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0b6c30 con 0x7f47cc0b1e00 2023-07-09T21:52:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.178+0000 7f47d0fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0cd0b0 con 0x7f47cc0d1220 2023-07-09T21:52:04.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.178+0000 7f47d0fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0cc7c0 con 0x7f47cc0b2350 2023-07-09T21:52:04.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.179+0000 7f47ca59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47cc0b1e00 0x7f47cc1586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:04.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.179+0000 7f47ca59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47cc0b1e00 0x7f47cc1586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52420/0 (socket says 172.21.15.53:52420) 2023-07-09T21:52:04.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.179+0000 7f47ca59c700 1 -- 172.21.15.53:0/1376101368 learned_addr learned my addr 172.21.15.53:0/1376101368 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:04.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.179+0000 7f47c3fff700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47cc0b2350 0x7f47cc0b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:04.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.179+0000 7f47cad9d700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47cc0d1220 0x7f47cc0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.179+0000 7f47ca59c700 1 -- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47cc0b2350 msgr2=0x7f47cc0b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.179+0000 7f47ca59c700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47cc0b2350 0x7f47cc0b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.179+0000 7f47ca59c700 1 -- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47cc0d1220 msgr2=0x7f47cc0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.179+0000 7f47ca59c700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47cc0d1220 0x7f47cc0c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.179+0000 7f47ca59c700 1 -- 172.21.15.53:0/1376101368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc009430 con 0x7f47cc0b1e00 2023-07-09T21:52:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.179+0000 7f47cad9d700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47cc0d1220 0x7f47cc0c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.179+0000 7f47ca59c700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47cc0b1e00 0x7f47cc1586e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f47bc013040 tx=0x7f47bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:04.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.180+0000 7f47c2ffd700 1 -- 172.21.15.53:0/1376101368 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc006890 con 0x7f47cc0b1e00 2023-07-09T21:52:04.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.180+0000 7f47c2ffd700 1 -- 172.21.15.53:0/1376101368 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc020070 con 0x7f47cc0b1e00 2023-07-09T21:52:04.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.180+0000 7f47d0fff700 1 -- 172.21.15.53:0/1376101368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc0cca60 con 0x7f47cc0b1e00 2023-07-09T21:52:04.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.180+0000 7f47c2ffd700 1 -- 172.21.15.53:0/1376101368 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc025670 con 0x7f47cc0b1e00 2023-07-09T21:52:04.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.180+0000 7f47d0fff700 1 -- 172.21.15.53:0/1376101368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc0b6e60 con 0x7f47cc0b1e00 2023-07-09T21:52:04.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.181+0000 7f47d0fff700 1 -- 172.21.15.53:0/1376101368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc0cd260 con 0x7f47cc0b1e00 2023-07-09T21:52:04.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.182+0000 7f47c2ffd700 1 -- 172.21.15.53:0/1376101368 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f47bc022030 con 0x7f47cc0b1e00 2023-07-09T21:52:04.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.183+0000 7f47c2ffd700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f47ac06ad70 0x7f47ac06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:04.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.183+0000 7f47c2ffd700 1 -- 172.21.15.53:0/1376101368 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47bc08aa80 con 0x7f47cc0b1e00 2023-07-09T21:52:04.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.183+0000 7f47c3fff700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f47ac06ad70 0x7f47ac06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:04.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.184+0000 7f47c3fff700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f47ac06ad70 0x7f47ac06d220 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0a0d90 tx=0x7f47b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:04.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.187+0000 7f47c2ffd700 1 -- 172.21.15.53:0/1376101368 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f47cc0cd260 con 0x7f47cc0b1e00 2023-07-09T21:52:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.438+0000 7f47d0fff700 1 -- 172.21.15.53:0/1376101368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47cc0cd220 con 0x7f47cc0b1e00 2023-07-09T21:52:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.439+0000 7f47c2ffd700 1 -- 172.21.15.53:0/1376101368 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f47bc055ad0 con 0x7f47cc0b1e00 2023-07-09T21:52:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:04.442 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2100879728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2100879728},{"type":"v1","addr":"172.21.15.184:6837","nonce":2100879728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3650266673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3650266673},{"type":"v1","addr":"172.21.15.53:6834","nonce":3650266673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1905516924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1905516924},{"type":"v1","addr":"172.21.15.53:6835","nonce":1905516924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:51:41.406886+0000","modified":"2023-07-09T21:51:44.882338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5107},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5107":{"gid":5107,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6836/3388102458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3388102458},{"type":"v1","addr":"172.21.15.184:6836","nonce":3388102458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T21:52:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.441+0000 7f47d0fff700 1 -- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f47ac06ad70 msgr2=0x7f47ac06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.441+0000 7f47d0fff700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f47ac06ad70 0x7f47ac06d220 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0a0d90 tx=0x7f47b4009040 comp rx=0 tx=0).stop 2023-07-09T21:52:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.441+0000 7f47d0fff700 1 -- 172.21.15.53:0/1376101368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47cc0b1e00 msgr2=0x7f47cc1586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.441+0000 7f47d0fff700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47cc0b1e00 0x7f47cc1586e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f47bc013040 tx=0x7f47bc004750 comp rx=0 tx=0).stop 2023-07-09T21:52:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.441+0000 7f47d0fff700 1 -- 172.21.15.53:0/1376101368 shutdown_connections 2023-07-09T21:52:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.441+0000 7f47d0fff700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f47ac06ad70 0x7f47ac06d220 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.441+0000 7f47d0fff700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47cc0d1220 0x7f47cc0c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.441+0000 7f47d0fff700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47cc0b1e00 0x7f47cc1586e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.441+0000 7f47d0fff700 1 --2- 172.21.15.53:0/1376101368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47cc0b2350 0x7f47cc0b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.441+0000 7f47d0fff700 1 -- 172.21.15.53:0/1376101368 >> 172.21.15.53:0/1376101368 conn(0x7f47cc09c1d0 msgr2=0x7f47cc0b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.442+0000 7f47d0fff700 1 -- 172.21.15.53:0/1376101368 shutdown_connections 2023-07-09T21:52:04.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.442+0000 7f47d0fff700 1 -- 172.21.15.53:0/1376101368 wait complete. 2023-07-09T21:52:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 18 2023-07-09T21:52:04.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:52:04.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.662+0000 7f9db71ff700 1 Processor -- start 2023-07-09T21:52:04.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.662+0000 7f9db71ff700 1 -- start start 2023-07-09T21:52:04.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.664+0000 7f9db71ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db00d1220 0x7f9db00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:04.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.664+0000 7f9db71ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db00d2ce0 con 0x7f9db00b2350 2023-07-09T21:52:04.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.664+0000 7f9db71ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db00b3350 con 0x7f9db00b1e00 2023-07-09T21:52:04.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.664+0000 7f9db71ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00b3630 con 0x7f9db00d1220 2023-07-09T21:52:04.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.664+0000 7f9db579c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9db00b2350 0x7f9db00afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56284/0 (socket says 172.21.15.53:56284) 2023-07-09T21:52:04.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.664+0000 7f9db579c700 1 -- 172.21.15.53:0/1991598088 learned_addr learned my addr 172.21.15.53:0/1991598088 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.664+0000 7f9daffff700 1 --2- 172.21.15.53:0/1991598088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db00d1220 0x7f9db00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.665+0000 7f9daf7fe700 1 -- 172.21.15.53:0/1991598088 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800627718 0 0) 0x7f9db00d2ce0 con 0x7f9db00b2350 2023-07-09T21:52:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.665+0000 7f9daf7fe700 1 -- 172.21.15.53:0/1991598088 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da00035b0 con 0x7f9db00b2350 2023-07-09T21:52:04.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.665+0000 7f9daffff700 1 -- 172.21.15.53:0/1991598088 >> v1:172.21.15.184:6789/0 conn(0x7f9db00b1e00 legacy=0x7f9db00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.665+0000 7f9daf7fe700 1 -- 172.21.15.53:0/1991598088 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610530440 0 0) 0x7f9db00b3350 con 0x7f9db00b1e00 2023-07-09T21:52:04.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.665+0000 7f9daffff700 1 -- 172.21.15.53:0/1991598088 >> v1:172.21.15.53:6789/0 conn(0x7f9db00b2350 legacy=0x7f9db00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.665+0000 7f9daffff700 1 -- 172.21.15.53:0/1991598088 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db00b3910 con 0x7f9db00d1220 2023-07-09T21:52:04.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.665+0000 7f9daffff700 1 --2- 172.21.15.53:0/1991598088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db00d1220 0x7f9db00b43f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009870 tx=0x7f9d9c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8471e2588fea124 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:04.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.666+0000 7f9daf7fe700 1 -- 172.21.15.53:0/1991598088 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c011830 con 0x7f9db00d1220 2023-07-09T21:52:04.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.666+0000 7f9daf7fe700 1 -- 172.21.15.53:0/1991598088 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c011990 con 0x7f9db00d1220 2023-07-09T21:52:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.666+0000 7f9daf7fe700 1 -- 172.21.15.53:0/1991598088 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c011d00 con 0x7f9db00d1220 2023-07-09T21:52:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.666+0000 7f9db71ff700 1 -- 172.21.15.53:0/1991598088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db00d1220 msgr2=0x7f9db00b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.666+0000 7f9db71ff700 1 --2- 172.21.15.53:0/1991598088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db00d1220 0x7f9db00b43f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009870 tx=0x7f9d9c009b80 comp rx=0 tx=0).stop 2023-07-09T21:52:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.666+0000 7f9db71ff700 1 -- 172.21.15.53:0/1991598088 shutdown_connections 2023-07-09T21:52:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.666+0000 7f9db71ff700 1 --2- 172.21.15.53:0/1991598088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db00d1220 0x7f9db00b43f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.666+0000 7f9db71ff700 1 -- 172.21.15.53:0/1991598088 >> 172.21.15.53:0/1991598088 conn(0x7f9db009c1d0 msgr2=0x7f9db00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.666+0000 7f9db71ff700 1 -- 172.21.15.53:0/1991598088 shutdown_connections 2023-07-09T21:52:04.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.666+0000 7f9db71ff700 1 -- 172.21.15.53:0/1991598088 wait complete. 2023-07-09T21:52:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.668+0000 7f9db71ff700 1 Processor -- start 2023-07-09T21:52:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.668+0000 7f9db71ff700 1 -- start start 2023-07-09T21:52:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.669+0000 7f9db71ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db00b1e00 0x7f9db015f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.669+0000 7f9db71ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9db00b2350 0x7f9db00b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.669+0000 7f9db71ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9db00d1220 0x7f9db00ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.669+0000 7f9db71ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db015f6c0 con 0x7f9db00b2350 2023-07-09T21:52:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.669+0000 7f9db71ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db014f7a0 con 0x7f9db00d1220 2023-07-09T21:52:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.669+0000 7f9db71ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00cf960 con 0x7f9db00b1e00 2023-07-09T21:52:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.669+0000 7f9daffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9db00b2350 0x7f9db00b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.669+0000 7f9daffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9db00b2350 0x7f9db00b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52422/0 (socket says 172.21.15.53:52422) 2023-07-09T21:52:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.669+0000 7f9daffff700 1 -- 172.21.15.53:0/3124677821 learned_addr learned my addr 172.21.15.53:0/3124677821 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:04.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9db4f9b700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db00b1e00 0x7f9db015f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:04.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9db579c700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9db00d1220 0x7f9db00ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:04.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9daffff700 1 -- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db00b1e00 msgr2=0x7f9db015f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9daffff700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db00b1e00 0x7f9db015f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9daffff700 1 -- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9db00d1220 msgr2=0x7f9db00ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9daffff700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9db00d1220 0x7f9db00ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9daffff700 1 -- 172.21.15.53:0/3124677821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c0094a0 con 0x7f9db00b2350 2023-07-09T21:52:04.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9db4f9b700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db00b1e00 0x7f9db015f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:04.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9db579c700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9db00d1220 0x7f9db00ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:04.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9daffff700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9db00b2350 0x7f9db00b50a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0097c0 tx=0x7f9d9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:04.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9dad7fa700 1 -- 172.21.15.53:0/3124677821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0038a0 con 0x7f9db00b2350 2023-07-09T21:52:04.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9dad7fa700 1 -- 172.21.15.53:0/3124677821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c01e070 con 0x7f9db00b2350 2023-07-09T21:52:04.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9dad7fa700 1 -- 172.21.15.53:0/3124677821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c003c60 con 0x7f9db00b2350 2023-07-09T21:52:04.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.670+0000 7f9db71ff700 1 -- 172.21.15.53:0/3124677821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db00ce5c0 con 0x7f9db00b2350 2023-07-09T21:52:04.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.671+0000 7f9db71ff700 1 -- 172.21.15.53:0/3124677821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db00cfcb0 con 0x7f9db00b2350 2023-07-09T21:52:04.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.672+0000 7f9db71ff700 1 -- 172.21.15.53:0/3124677821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db004e280 con 0x7f9db00b2350 2023-07-09T21:52:04.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.673+0000 7f9dad7fa700 1 -- 172.21.15.53:0/3124677821 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f9d9c02d450 con 0x7f9db00b2350 2023-07-09T21:52:04.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.674+0000 7f9dad7fa700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9d9406ad70 0x7f9d9406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:04.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.674+0000 7f9dad7fa700 1 -- 172.21.15.53:0/3124677821 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f9d9c08a560 con 0x7f9db00b2350 2023-07-09T21:52:04.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.674+0000 7f9db4f9b700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9d9406ad70 0x7f9d9406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:04.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.675+0000 7f9db4f9b700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9d9406ad70 0x7f9d9406d220 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9da4000fb0 tx=0x7f9da4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:04.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.678+0000 7f9dad7fa700 1 -- 172.21.15.53:0/3124677821 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9d9c055590 con 0x7f9db00b2350 2023-07-09T21:52:04.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.888+0000 7f9db71ff700 1 -- 172.21.15.53:0/3124677821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9db00d0c70 con 0x7f9db00b2350 2023-07-09T21:52:04.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.889+0000 7f9dad7fa700 1 -- 172.21.15.53:0/3124677821 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18320 (secure 0 0 0) 0x7f9d9c058bb0 con 0x7f9db00b2350 2023-07-09T21:52:04.891 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:04.892 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":39,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:52:04.596796+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:51:39.793448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:51:40.342794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:52:04.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.891+0000 7f9db71ff700 1 -- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9d9406ad70 msgr2=0x7f9d9406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.891+0000 7f9db71ff700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9d9406ad70 0x7f9d9406d220 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9da4000fb0 tx=0x7f9da4009040 comp rx=0 tx=0).stop 2023-07-09T21:52:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.891+0000 7f9db71ff700 1 -- 172.21.15.53:0/3124677821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9db00b2350 msgr2=0x7f9db00b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.891+0000 7f9db71ff700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9db00b2350 0x7f9db00b50a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0097c0 tx=0x7f9d9c004750 comp rx=0 tx=0).stop 2023-07-09T21:52:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.891+0000 7f9db71ff700 1 -- 172.21.15.53:0/3124677821 shutdown_connections 2023-07-09T21:52:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.891+0000 7f9db71ff700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9d9406ad70 0x7f9d9406d220 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.891+0000 7f9db71ff700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9db00d1220 0x7f9db00ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.891+0000 7f9db71ff700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db00b1e00 0x7f9db015f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.891+0000 7f9db71ff700 1 --2- 172.21.15.53:0/3124677821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9db00b2350 0x7f9db00b50a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.891+0000 7f9db71ff700 1 -- 172.21.15.53:0/3124677821 >> 172.21.15.53:0/3124677821 conn(0x7f9db009c1d0 msgr2=0x7f9db006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.891+0000 7f9db71ff700 1 -- 172.21.15.53:0/3124677821 shutdown_connections 2023-07-09T21:52:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:04.891+0000 7f9db71ff700 1 -- 172.21.15.53:0/3124677821 wait complete. 2023-07-09T21:52:04.912 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T21:52:04.912 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:52:05.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.110+0000 7fc14b3ff700 1 Processor -- start 2023-07-09T21:52:05.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.110+0000 7fc14b3ff700 1 -- start start 2023-07-09T21:52:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.111+0000 7fc14b3ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc1440d1220 0x7fc1440b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.111+0000 7fc14b3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1440b2350 0x7fc1440afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.111+0000 7fc14b3ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1440d2ce0 con 0x7fc1440b1e00 2023-07-09T21:52:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.111+0000 7fc14b3ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1440b3350 con 0x7fc1440d1220 2023-07-09T21:52:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.111+0000 7fc14b3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440b3630 con 0x7fc1440b2350 2023-07-09T21:52:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.112+0000 7fc14999c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1440b2350 0x7fc1440afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:05.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.112+0000 7fc14919b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc1440b1e00 0x7fc1440d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:55852/0 (socket says 172.21.15.53:55852) 2023-07-09T21:52:05.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.112+0000 7fc14919b700 1 -- 172.21.15.53:0/1406501183 learned_addr learned my addr 172.21.15.53:0/1406501183 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:05.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.112+0000 7fc14899a700 1 --2- 172.21.15.53:0/1406501183 >> v2:172.21.15.184:3300/0 conn(0x7fc1440d1220 0x7fc1440b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:05.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.112+0000 7fc14999c700 1 -- 172.21.15.53:0/1406501183 >> v2:172.21.15.184:3300/0 conn(0x7fc1440d1220 msgr2=0x7fc1440b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:05.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.112+0000 7fc14999c700 1 --2- 172.21.15.53:0/1406501183 >> v2:172.21.15.184:3300/0 conn(0x7fc1440d1220 0x7fc1440b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.112+0000 7fc14999c700 1 -- 172.21.15.53:0/1406501183 >> v1:172.21.15.184:6789/0 conn(0x7fc1440b1e00 legacy=0x7fc1440d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.112+0000 7fc14999c700 1 -- 172.21.15.53:0/1406501183 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1440b3910 con 0x7fc1440b2350 2023-07-09T21:52:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.112+0000 7fc14899a700 1 --2- 172.21.15.53:0/1406501183 >> v2:172.21.15.184:3300/0 conn(0x7fc1440d1220 0x7fc1440b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:52:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.112+0000 7fc14999c700 1 --2- 172.21.15.53:0/1406501183 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1440b2350 0x7fc1440afac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009d90 tx=0x7fc13c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=804d869c424d0c3e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.113+0000 7fc13bfff700 1 -- 172.21.15.53:0/1406501183 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c00e070 con 0x7fc1440b2350 2023-07-09T21:52:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.113+0000 7fc13bfff700 1 -- 172.21.15.53:0/1406501183 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c00bb20 con 0x7fc1440b2350 2023-07-09T21:52:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.113+0000 7fc13bfff700 1 -- 172.21.15.53:0/1406501183 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c012430 con 0x7fc1440b2350 2023-07-09T21:52:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.113+0000 7fc14b3ff700 1 -- 172.21.15.53:0/1406501183 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1440b2350 msgr2=0x7fc1440afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.113+0000 7fc14b3ff700 1 --2- 172.21.15.53:0/1406501183 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1440b2350 0x7fc1440afac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009d90 tx=0x7fc13c00b330 comp rx=0 tx=0).stop 2023-07-09T21:52:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.113+0000 7fc14b3ff700 1 -- 172.21.15.53:0/1406501183 shutdown_connections 2023-07-09T21:52:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.113+0000 7fc14b3ff700 1 --2- 172.21.15.53:0/1406501183 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1440b2350 0x7fc1440afac0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.113+0000 7fc14b3ff700 1 --2- 172.21.15.53:0/1406501183 >> v2:172.21.15.184:3300/0 conn(0x7fc1440d1220 0x7fc1440b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.113+0000 7fc14b3ff700 1 -- 172.21.15.53:0/1406501183 >> 172.21.15.53:0/1406501183 conn(0x7fc14409c1d0 msgr2=0x7fc1440d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.113+0000 7fc14b3ff700 1 -- 172.21.15.53:0/1406501183 shutdown_connections 2023-07-09T21:52:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.113+0000 7fc14b3ff700 1 -- 172.21.15.53:0/1406501183 wait complete. 2023-07-09T21:52:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.115+0000 7fc14b3ff700 1 Processor -- start 2023-07-09T21:52:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.115+0000 7fc14b3ff700 1 -- start start 2023-07-09T21:52:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.116+0000 7fc14b3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1440b1e00 0x7fc1440cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.116+0000 7fc14b3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1440b2350 0x7fc1440c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.116+0000 7fc14b3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1440d1220 0x7fc144155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.116+0000 7fc14b3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440c8ff0 con 0x7fc1440b2350 2023-07-09T21:52:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.116+0000 7fc14b3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440b6980 con 0x7fc1440d1220 2023-07-09T21:52:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.116+0000 7fc14b3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440b6650 con 0x7fc1440b1e00 2023-07-09T21:52:05.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.117+0000 7fc14899a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1440b2350 0x7fc1440c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:05.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.117+0000 7fc14899a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1440b2350 0x7fc1440c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52430/0 (socket says 172.21.15.53:52430) 2023-07-09T21:52:05.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.117+0000 7fc14899a700 1 -- 172.21.15.53:0/2655904373 learned_addr learned my addr 172.21.15.53:0/2655904373 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:05.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.117+0000 7fc14919b700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1440b1e00 0x7fc1440cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:05.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.117+0000 7fc14999c700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1440d1220 0x7fc144155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:05.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.117+0000 7fc14899a700 1 -- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1440b1e00 msgr2=0x7fc1440cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:05.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.117+0000 7fc14899a700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1440b1e00 0x7fc1440cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.117+0000 7fc14899a700 1 -- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1440d1220 msgr2=0x7fc144155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.117+0000 7fc14899a700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1440d1220 0x7fc144155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.117+0000 7fc14899a700 1 -- 172.21.15.53:0/2655904373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1340094a0 con 0x7fc1440b2350 2023-07-09T21:52:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.117+0000 7fc14899a700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1440b2350 0x7fc1440c8050 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc13400e9b0 tx=0x7fc13400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.118+0000 7fc139ffb700 1 -- 172.21.15.53:0/2655904373 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13400ee50 con 0x7fc1440b2350 2023-07-09T21:52:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.118+0000 7fc139ffb700 1 -- 172.21.15.53:0/2655904373 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13400c850 con 0x7fc1440b2350 2023-07-09T21:52:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.118+0000 7fc139ffb700 1 -- 172.21.15.53:0/2655904373 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13400cc00 con 0x7fc1440b2350 2023-07-09T21:52:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.118+0000 7fc14b3ff700 1 -- 172.21.15.53:0/2655904373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13c009a70 con 0x7fc1440b2350 2023-07-09T21:52:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.118+0000 7fc14b3ff700 1 -- 172.21.15.53:0/2655904373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1440c8a30 con 0x7fc1440b2350 2023-07-09T21:52:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.119+0000 7fc14b3ff700 1 -- 172.21.15.53:0/2655904373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14404e280 con 0x7fc1440b2350 2023-07-09T21:52:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.120+0000 7fc139ffb700 1 -- 172.21.15.53:0/2655904373 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fc134013470 con 0x7fc1440b2350 2023-07-09T21:52:05.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.121+0000 7fc139ffb700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc12806ad70 0x7fc12806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:05.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.121+0000 7fc139ffb700 1 -- 172.21.15.53:0/2655904373 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fc134089230 con 0x7fc1440b2350 2023-07-09T21:52:05.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.121+0000 7fc14919b700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc12806ad70 0x7fc12806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:05.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.122+0000 7fc14919b700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc12806ad70 0x7fc12806d220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc140005960 tx=0x7fc140009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:05.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.125+0000 7fc139ffb700 1 -- 172.21.15.53:0/2655904373 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc134057c60 con 0x7fc1440b2350 2023-07-09T21:52:05.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.379+0000 7fc14b3ff700 1 -- 172.21.15.53:0/2655904373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1440b3bc0 con 0x7fc1440b2350 2023-07-09T21:52:05.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.379+0000 7fc139ffb700 1 -- 172.21.15.53:0/2655904373 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fc1340577f0 con 0x7fc1440b2350 2023-07-09T21:52:05.382 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:05.383 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2100879728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2100879728},{"type":"v1","addr":"172.21.15.184:6837","nonce":2100879728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3650266673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3650266673},{"type":"v1","addr":"172.21.15.53:6834","nonce":3650266673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1905516924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1905516924},{"type":"v1","addr":"172.21.15.53:6835","nonce":1905516924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:51:41.406886+0000","modified":"2023-07-09T21:51:44.882338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5107},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5107":{"gid":5107,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6836/3388102458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3388102458},{"type":"v1","addr":"172.21.15.184:6836","nonce":3388102458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T21:52:05.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.382+0000 7fc14b3ff700 1 -- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc12806ad70 msgr2=0x7fc12806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:05.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.382+0000 7fc14b3ff700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc12806ad70 0x7fc12806d220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc140005960 tx=0x7fc140009040 comp rx=0 tx=0).stop 2023-07-09T21:52:05.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.382+0000 7fc14b3ff700 1 -- 172.21.15.53:0/2655904373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1440b2350 msgr2=0x7fc1440c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:05.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.382+0000 7fc14b3ff700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1440b2350 0x7fc1440c8050 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc13400e9b0 tx=0x7fc13400ecc0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.382+0000 7fc14b3ff700 1 -- 172.21.15.53:0/2655904373 shutdown_connections 2023-07-09T21:52:05.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.382+0000 7fc14b3ff700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc12806ad70 0x7fc12806d220 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.382+0000 7fc14b3ff700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1440d1220 0x7fc144155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.382+0000 7fc14b3ff700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1440b1e00 0x7fc1440cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.382+0000 7fc14b3ff700 1 --2- 172.21.15.53:0/2655904373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1440b2350 0x7fc1440c8050 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.382+0000 7fc14b3ff700 1 -- 172.21.15.53:0/2655904373 >> 172.21.15.53:0/2655904373 conn(0x7fc14409c1d0 msgr2=0x7fc1440b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:05.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.382+0000 7fc14b3ff700 1 -- 172.21.15.53:0/2655904373 shutdown_connections 2023-07-09T21:52:05.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.382+0000 7fc14b3ff700 1 -- 172.21.15.53:0/2655904373 wait complete. 2023-07-09T21:52:05.386 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 18 2023-07-09T21:52:05.402 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:52:05.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.600+0000 7f6225bff700 1 Processor -- start 2023-07-09T21:52:05.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.600+0000 7f6225bff700 1 -- start start 2023-07-09T21:52:05.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.601+0000 7f6225bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62200b1e00 0x7f62200b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.601+0000 7f6225bff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62200d2ce0 con 0x7f62200d1220 2023-07-09T21:52:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.601+0000 7f6225bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62200b3350 con 0x7f62200b2350 2023-07-09T21:52:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.601+0000 7f6225bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62200b3630 con 0x7f62200b1e00 2023-07-09T21:52:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.602+0000 7f621ffff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f62200d1220 0x7f62200afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56300/0 (socket says 172.21.15.53:56300) 2023-07-09T21:52:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.602+0000 7f621ffff700 1 -- 172.21.15.53:0/370160998 learned_addr learned my addr 172.21.15.53:0/370160998 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:05.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.602+0000 7f621f7fe700 1 --2- 172.21.15.53:0/370160998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62200b1e00 0x7f62200b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:05.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.602+0000 7f621e7fc700 1 -- 172.21.15.53:0/370160998 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086468523 0 0) 0x7f62200d2ce0 con 0x7f62200d1220 2023-07-09T21:52:05.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.602+0000 7f621e7fc700 1 -- 172.21.15.53:0/370160998 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62080035b0 con 0x7f62200d1220 2023-07-09T21:52:05.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.602+0000 7f621e7fc700 1 -- 172.21.15.53:0/370160998 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716407861 0 0) 0x7f62200b3350 con 0x7f62200b2350 2023-07-09T21:52:05.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.602+0000 7f621e7fc700 1 -- 172.21.15.53:0/370160998 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62200d2ce0 con 0x7f62200b2350 2023-07-09T21:52:05.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.602+0000 7f621e7fc700 1 -- 172.21.15.53:0/370160998 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1147672732 0 0) 0x7f62080035b0 con 0x7f62200d1220 2023-07-09T21:52:05.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.602+0000 7f621f7fe700 1 -- 172.21.15.53:0/370160998 >> v1:172.21.15.184:6789/0 conn(0x7f62200b2350 legacy=0x7f62200d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:05.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.602+0000 7f621f7fe700 1 -- 172.21.15.53:0/370160998 >> v1:172.21.15.53:6789/0 conn(0x7f62200d1220 legacy=0x7f62200afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:05.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.602+0000 7f621f7fe700 1 -- 172.21.15.53:0/370160998 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62200b3910 con 0x7f62200b1e00 2023-07-09T21:52:05.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.603+0000 7f621f7fe700 1 --2- 172.21.15.53:0/370160998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62200b1e00 0x7f62200b43f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6210009850 tx=0x7f6210009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb227a515c9270ea server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:05.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.603+0000 7f621e7fc700 1 -- 172.21.15.53:0/370160998 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62180019f0 con 0x7f62200b1e00 2023-07-09T21:52:05.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.603+0000 7f621e7fc700 1 -- 172.21.15.53:0/370160998 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6210005c30 con 0x7f62200b1e00 2023-07-09T21:52:05.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.603+0000 7f621e7fc700 1 -- 172.21.15.53:0/370160998 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210004030 con 0x7f62200b1e00 2023-07-09T21:52:05.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.604+0000 7f6225bff700 1 -- 172.21.15.53:0/370160998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62200b1e00 msgr2=0x7f62200b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:05.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.604+0000 7f6225bff700 1 --2- 172.21.15.53:0/370160998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62200b1e00 0x7f62200b43f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6210009850 tx=0x7f6210009b60 comp rx=0 tx=0).stop 2023-07-09T21:52:05.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.604+0000 7f6225bff700 1 -- 172.21.15.53:0/370160998 shutdown_connections 2023-07-09T21:52:05.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.604+0000 7f6225bff700 1 --2- 172.21.15.53:0/370160998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62200b1e00 0x7f62200b43f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.604+0000 7f6225bff700 1 -- 172.21.15.53:0/370160998 >> 172.21.15.53:0/370160998 conn(0x7f622009c1d0 msgr2=0x7f62200d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:05.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.604+0000 7f6225bff700 1 -- 172.21.15.53:0/370160998 shutdown_connections 2023-07-09T21:52:05.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.604+0000 7f6225bff700 1 -- 172.21.15.53:0/370160998 wait complete. 2023-07-09T21:52:05.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.606+0000 7f6225bff700 1 Processor -- start 2023-07-09T21:52:05.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.606+0000 7f6225bff700 1 -- start start 2023-07-09T21:52:05.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.607+0000 7f6225bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62200b1e00 0x7f622014cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:05.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.607+0000 7f6225bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62200b2350 0x7f62200cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:05.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.607+0000 7f6225bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62200d1220 0x7f622006a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:05.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.607+0000 7f6225bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62200ce7c0 con 0x7f62200b2350 2023-07-09T21:52:05.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.607+0000 7f6225bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622014d470 con 0x7f62200b1e00 2023-07-09T21:52:05.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.607+0000 7f6225bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62200cad70 con 0x7f62200d1220 2023-07-09T21:52:05.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.607+0000 7f621effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62200b2350 0x7f62200cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:05.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.607+0000 7f621effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62200b2350 0x7f62200cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52438/0 (socket says 172.21.15.53:52438) 2023-07-09T21:52:05.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.607+0000 7f621effd700 1 -- 172.21.15.53:0/863760301 learned_addr learned my addr 172.21.15.53:0/863760301 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:05.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.607+0000 7f621f7fe700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62200b1e00 0x7f622014cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:05.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.607+0000 7f621ffff700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62200d1220 0x7f622006a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:05.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.608+0000 7f621effd700 1 -- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62200d1220 msgr2=0x7f622006a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:05.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.608+0000 7f621effd700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62200d1220 0x7f622006a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.608+0000 7f621effd700 1 -- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62200b1e00 msgr2=0x7f622014cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:05.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.608+0000 7f621effd700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62200b1e00 0x7f622014cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.608+0000 7f621effd700 1 -- 172.21.15.53:0/863760301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210009430 con 0x7f62200b2350 2023-07-09T21:52:05.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.608+0000 7f621effd700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62200b2350 0x7f62200cc820 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f621400c520 tx=0x7f621400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:05.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.611+0000 7f6207fff700 1 -- 172.21.15.53:0/863760301 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62140052d0 con 0x7f62200b2350 2023-07-09T21:52:05.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.611+0000 7f6225bff700 1 -- 172.21.15.53:0/863760301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62200cb050 con 0x7f62200b2350 2023-07-09T21:52:05.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.611+0000 7f6207fff700 1 -- 172.21.15.53:0/863760301 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6214005430 con 0x7f62200b2350 2023-07-09T21:52:05.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.611+0000 7f6207fff700 1 -- 172.21.15.53:0/863760301 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62140038c0 con 0x7f62200b2350 2023-07-09T21:52:05.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.611+0000 7f6225bff700 1 -- 172.21.15.53:0/863760301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62200cb330 con 0x7f62200b2350 2023-07-09T21:52:05.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.612+0000 7f6225bff700 1 -- 172.21.15.53:0/863760301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62200ce970 con 0x7f62200b2350 2023-07-09T21:52:05.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.613+0000 7f6207fff700 1 -- 172.21.15.53:0/863760301 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f6214003a20 con 0x7f62200b2350 2023-07-09T21:52:05.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.615+0000 7f6207fff700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f620c06ad70 0x7f620c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:05.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.615+0000 7f6207fff700 1 -- 172.21.15.53:0/863760301 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f6214088980 con 0x7f62200b2350 2023-07-09T21:52:05.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.616+0000 7f621f7fe700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f620c06ad70 0x7f620c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:05.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.616+0000 7f621f7fe700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f620c06ad70 0x7f620c06d220 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62100097a0 tx=0x7f6210008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:05.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.619+0000 7f6207fff700 1 -- 172.21.15.53:0/863760301 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f62200ce970 con 0x7f62200b2350 2023-07-09T21:52:05.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.875+0000 7f6225bff700 1 -- 172.21.15.53:0/863760301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62200ce970 con 0x7f62200b2350 2023-07-09T21:52:05.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.876+0000 7f6207fff700 1 -- 172.21.15.53:0/863760301 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f62200ce970 con 0x7f62200b2350 2023-07-09T21:52:05.879 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:05.879 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2100879728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2100879728},{"type":"v1","addr":"172.21.15.184:6837","nonce":2100879728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3650266673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3650266673},{"type":"v1","addr":"172.21.15.53:6834","nonce":3650266673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1905516924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1905516924},{"type":"v1","addr":"172.21.15.53:6835","nonce":1905516924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:51:41.406886+0000","modified":"2023-07-09T21:51:44.882338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5107},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5107":{"gid":5107,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6836/3388102458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3388102458},{"type":"v1","addr":"172.21.15.184:6836","nonce":3388102458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T21:52:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.878+0000 7f6225bff700 1 -- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f620c06ad70 msgr2=0x7f620c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.878+0000 7f6225bff700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f620c06ad70 0x7f620c06d220 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62100097a0 tx=0x7f6210008070 comp rx=0 tx=0).stop 2023-07-09T21:52:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.878+0000 7f6225bff700 1 -- 172.21.15.53:0/863760301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62200b2350 msgr2=0x7f62200cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:05.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.878+0000 7f6225bff700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62200b2350 0x7f62200cc820 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f621400c520 tx=0x7f621400c830 comp rx=0 tx=0).stop 2023-07-09T21:52:05.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.879+0000 7f6225bff700 1 -- 172.21.15.53:0/863760301 shutdown_connections 2023-07-09T21:52:05.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.879+0000 7f6225bff700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f620c06ad70 0x7f620c06d220 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.879+0000 7f6225bff700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62200d1220 0x7f622006a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.879+0000 7f6225bff700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62200b1e00 0x7f622014cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.879+0000 7f6225bff700 1 --2- 172.21.15.53:0/863760301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62200b2350 0x7f62200cc820 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:05.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.879+0000 7f6225bff700 1 -- 172.21.15.53:0/863760301 >> 172.21.15.53:0/863760301 conn(0x7f622009c1d0 msgr2=0x7f62200b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:05.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.879+0000 7f6225bff700 1 -- 172.21.15.53:0/863760301 shutdown_connections 2023-07-09T21:52:05.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:05.879+0000 7f6225bff700 1 -- 172.21.15.53:0/863760301 wait complete. 2023-07-09T21:52:05.883 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 18 2023-07-09T21:52:05.900 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:52:06.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.097+0000 7fe194fff700 1 Processor -- start 2023-07-09T21:52:06.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.097+0000 7fe194fff700 1 -- start start 2023-07-09T21:52:06.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.098+0000 7fe194fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1900d1220 0x7fe1900b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:06.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.098+0000 7fe194fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1900d2ce0 con 0x7fe1900b2350 2023-07-09T21:52:06.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.098+0000 7fe194fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1900b3350 con 0x7fe1900b1e00 2023-07-09T21:52:06.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.098+0000 7fe194fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900b3630 con 0x7fe1900d1220 2023-07-09T21:52:06.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.098+0000 7fe18ed9d700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe1900b2350 0x7fe1900afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56314/0 (socket says 172.21.15.53:56314) 2023-07-09T21:52:06.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.098+0000 7fe18ed9d700 1 -- 172.21.15.53:0/1434845587 learned_addr learned my addr 172.21.15.53:0/1434845587 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:06.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe187fff700 1 --2- 172.21.15.53:0/1434845587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1900d1220 0x7fe1900b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:06.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263085188 0 0) 0x7fe1900d2ce0 con 0x7fe1900b2350 2023-07-09T21:52:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe17c0035b0 con 0x7fe1900b2350 2023-07-09T21:52:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543390819 0 0) 0x7fe1900b3350 con 0x7fe1900b1e00 2023-07-09T21:52:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1900d2ce0 con 0x7fe1900b1e00 2023-07-09T21:52:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3936124950 0 0) 0x7fe17c0035b0 con 0x7fe1900b2350 2023-07-09T21:52:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1900d1220 msgr2=0x7fe1900b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 --2- 172.21.15.53:0/1434845587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1900d1220 0x7fe1900b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 >> v1:172.21.15.184:6789/0 conn(0x7fe1900b1e00 legacy=0x7fe1900d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1900b3910 con 0x7fe1900b2350 2023-07-09T21:52:06.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7fe1880019f0 con 0x7fe1900b2350 2023-07-09T21:52:06.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 >> v1:172.21.15.53:6789/0 conn(0x7fe1900b2350 legacy=0x7fe1900afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 --2- 172.21.15.53:0/1434845587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe17c003bc0 0x7fe17c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:06.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 --2- 172.21.15.53:0/1434845587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1900d1220 0x7fe17c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:06.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 --2- 172.21.15.53:0/1434845587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe17c004d90 0x7fe17c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:06.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900b3630 con 0x7fe17c003bc0 2023-07-09T21:52:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c00bba0 con 0x7fe17c004d90 2023-07-09T21:52:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.099+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c00bd10 con 0x7fe1900d1220 2023-07-09T21:52:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.100+0000 7fe18e59c700 1 --2- 172.21.15.53:0/1434845587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe17c003bc0 0x7fe17c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.100+0000 7fe187fff700 1 --2- 172.21.15.53:0/1434845587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1900d1220 0x7fe17c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.100+0000 7fe18ed9d700 1 --2- 172.21.15.53:0/1434845587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe17c004d90 0x7fe17c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.100+0000 7fe18e59c700 1 -- 172.21.15.53:0/1434845587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1900d1220 msgr2=0x7fe17c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.100+0000 7fe18e59c700 1 --2- 172.21.15.53:0/1434845587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1900d1220 0x7fe17c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.100+0000 7fe18e59c700 1 -- 172.21.15.53:0/1434845587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe17c004d90 msgr2=0x7fe17c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:06.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.100+0000 7fe18e59c700 1 --2- 172.21.15.53:0/1434845587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe17c004d90 0x7fe17c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.100+0000 7fe18e59c700 1 -- 172.21.15.53:0/1434845587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c0035b0 con 0x7fe17c003bc0 2023-07-09T21:52:06.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.100+0000 7fe187fff700 1 --2- 172.21.15.53:0/1434845587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1900d1220 0x7fe17c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:06.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.100+0000 7fe18e59c700 1 --2- 172.21.15.53:0/1434845587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe17c003bc0 0x7fe17c003fb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe1800019b0 tx=0x7fe17c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8b61c49d55e828 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:06.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.100+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800014a0 con 0x7fe17c003bc0 2023-07-09T21:52:06.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.100+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1800052d0 con 0x7fe17c003bc0 2023-07-09T21:52:06.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.100+0000 7fe18dd9b700 1 -- 172.21.15.53:0/1434845587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800036d0 con 0x7fe17c003bc0 2023-07-09T21:52:06.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.101+0000 7fe194fff700 1 -- 172.21.15.53:0/1434845587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe17c003bc0 msgr2=0x7fe17c003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.101+0000 7fe194fff700 1 --2- 172.21.15.53:0/1434845587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe17c003bc0 0x7fe17c003fb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe1800019b0 tx=0x7fe17c005880 comp rx=0 tx=0).stop 2023-07-09T21:52:06.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.101+0000 7fe18ed9d700 1 -- 172.21.15.53:0/1434845587 reap_dead start 2023-07-09T21:52:06.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.101+0000 7fe194fff700 1 -- 172.21.15.53:0/1434845587 shutdown_connections 2023-07-09T21:52:06.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.101+0000 7fe194fff700 1 -- 172.21.15.53:0/1434845587 >> 172.21.15.53:0/1434845587 conn(0x7fe19009c1d0 msgr2=0x7fe1900d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:06.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.101+0000 7fe194fff700 1 -- 172.21.15.53:0/1434845587 shutdown_connections 2023-07-09T21:52:06.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.101+0000 7fe194fff700 1 -- 172.21.15.53:0/1434845587 wait complete. 2023-07-09T21:52:06.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.103+0000 7fe194fff700 1 Processor -- start 2023-07-09T21:52:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.103+0000 7fe194fff700 1 -- start start 2023-07-09T21:52:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.104+0000 7fe194fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c003bc0 0x7fe1901589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.104+0000 7fe194fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1901f1790 0x7fe1900b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.104+0000 7fe194fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1901f1c00 0x7fe1900b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.104+0000 7fe194fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900c88b0 con 0x7fe1901f1c00 2023-07-09T21:52:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.104+0000 7fe194fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe190158f00 con 0x7fe1901f1790 2023-07-09T21:52:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.104+0000 7fe194fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19015e610 con 0x7fe17c003bc0 2023-07-09T21:52:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.104+0000 7fe18ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1901f1c00 0x7fe1900b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.104+0000 7fe18ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1901f1c00 0x7fe1900b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52456/0 (socket says 172.21.15.53:52456) 2023-07-09T21:52:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.104+0000 7fe18ed9d700 1 -- 172.21.15.53:0/1371367374 learned_addr learned my addr 172.21.15.53:0/1371367374 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:06.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.105+0000 7fe18e59c700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c003bc0 0x7fe1901589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:06.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.105+0000 7fe187fff700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1901f1790 0x7fe1900b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:06.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.105+0000 7fe18ed9d700 1 -- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c003bc0 msgr2=0x7fe1901589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.105+0000 7fe18ed9d700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c003bc0 0x7fe1901589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.105+0000 7fe18ed9d700 1 -- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1901f1790 msgr2=0x7fe1900b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.105+0000 7fe18ed9d700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1901f1790 0x7fe1900b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.105+0000 7fe18ed9d700 1 -- 172.21.15.53:0/1371367374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1900c7f10 con 0x7fe1901f1c00 2023-07-09T21:52:06.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.105+0000 7fe187fff700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1901f1790 0x7fe1900b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:06.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.105+0000 7fe18ed9d700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1901f1c00 0x7fe1900b11e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe1900c68a0 tx=0x7fe18800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:06.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.105+0000 7fe186ffd700 1 -- 172.21.15.53:0/1371367374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188017070 con 0x7fe1901f1c00 2023-07-09T21:52:06.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.105+0000 7fe186ffd700 1 -- 172.21.15.53:0/1371367374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18800ebe0 con 0x7fe1901f1c00 2023-07-09T21:52:06.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.106+0000 7fe186ffd700 1 -- 172.21.15.53:0/1371367374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800ed90 con 0x7fe1901f1c00 2023-07-09T21:52:06.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.106+0000 7fe194fff700 1 -- 172.21.15.53:0/1371367374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1900c81f0 con 0x7fe1901f1c00 2023-07-09T21:52:06.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.106+0000 7fe194fff700 1 -- 172.21.15.53:0/1371367374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19015d8a0 con 0x7fe1901f1c00 2023-07-09T21:52:06.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.107+0000 7fe194fff700 1 -- 172.21.15.53:0/1371367374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1900c89f0 con 0x7fe1901f1c00 2023-07-09T21:52:06.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.108+0000 7fe186ffd700 1 -- 172.21.15.53:0/1371367374 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fe188013420 con 0x7fe1901f1c00 2023-07-09T21:52:06.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.109+0000 7fe186ffd700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe17006ad70 0x7fe17006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:06.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.109+0000 7fe186ffd700 1 -- 172.21.15.53:0/1371367374 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fe188089090 con 0x7fe1901f1c00 2023-07-09T21:52:06.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.109+0000 7fe18e59c700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe17006ad70 0x7fe17006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:06.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.110+0000 7fe18e59c700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe17006ad70 0x7fe17006d220 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe180008fd0 tx=0x7fe18000a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:06.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.113+0000 7fe186ffd700 1 -- 172.21.15.53:0/1371367374 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe1900c89f0 con 0x7fe1901f1c00 2023-07-09T21:52:06.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.331+0000 7fe194fff700 1 -- 172.21.15.53:0/1371367374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1900c89f0 con 0x7fe1901f1c00 2023-07-09T21:52:06.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.332+0000 7fe186ffd700 1 -- 172.21.15.53:0/1371367374 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18320 (secure 0 0 0) 0x7fe1900c89f0 con 0x7fe1901f1c00 2023-07-09T21:52:06.335 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:06.336 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":40,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:52:05.605443+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:51:39.793448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:51:40.342794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:52:06.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.335+0000 7fe194fff700 1 -- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe17006ad70 msgr2=0x7fe17006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.335+0000 7fe194fff700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe17006ad70 0x7fe17006d220 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe180008fd0 tx=0x7fe18000a000 comp rx=0 tx=0).stop 2023-07-09T21:52:06.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.335+0000 7fe194fff700 1 -- 172.21.15.53:0/1371367374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1901f1c00 msgr2=0x7fe1900b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.335+0000 7fe194fff700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1901f1c00 0x7fe1900b11e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe1900c68a0 tx=0x7fe18800e440 comp rx=0 tx=0).stop 2023-07-09T21:52:06.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.335+0000 7fe194fff700 1 -- 172.21.15.53:0/1371367374 shutdown_connections 2023-07-09T21:52:06.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.335+0000 7fe194fff700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe17006ad70 0x7fe17006d220 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.335+0000 7fe194fff700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1901f1c00 0x7fe1900b11e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.335+0000 7fe194fff700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c003bc0 0x7fe1901589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.335+0000 7fe194fff700 1 --2- 172.21.15.53:0/1371367374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1901f1790 0x7fe1900b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.335+0000 7fe194fff700 1 -- 172.21.15.53:0/1371367374 >> 172.21.15.53:0/1371367374 conn(0x7fe19009c1d0 msgr2=0x7fe1900afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:06.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.335+0000 7fe194fff700 1 -- 172.21.15.53:0/1371367374 shutdown_connections 2023-07-09T21:52:06.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.335+0000 7fe194fff700 1 -- 172.21.15.53:0/1371367374 wait complete. 2023-07-09T21:52:06.356 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T21:52:06.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.555+0000 7f52857ff700 1 Processor -- start 2023-07-09T21:52:06.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.555+0000 7f52857ff700 1 -- start start 2023-07-09T21:52:06.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.556+0000 7f52857ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52800b43c0 0x7f52800b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:06.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.556+0000 7f52857ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52800b8e80 con 0x7f52800b3ff0 2023-07-09T21:52:06.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.556+0000 7f52857ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52800afaa0 con 0x7f52800d1220 2023-07-09T21:52:06.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.557+0000 7f52857ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52800afd80 con 0x7f52800b43c0 2023-07-09T21:52:06.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.557+0000 7f527effd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f52800b3ff0 0x7f52800d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56322/0 (socket says 172.21.15.53:56322) 2023-07-09T21:52:06.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.557+0000 7f527effd700 1 -- 172.21.15.53:0/1756349626 learned_addr learned my addr 172.21.15.53:0/1756349626 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:06.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.557+0000 7f527f7fe700 1 --2- 172.21.15.53:0/1756349626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52800b43c0 0x7f52800b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:06.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.557+0000 7f527dffb700 1 -- 172.21.15.53:0/1756349626 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259033305 0 0) 0x7f5270001110 con 0x7f52800b3ff0 2023-07-09T21:52:06.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.557+0000 7f527dffb700 1 -- 172.21.15.53:0/1756349626 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52680035b0 con 0x7f52800b3ff0 2023-07-09T21:52:06.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.557+0000 7f527dffb700 1 -- 172.21.15.53:0/1756349626 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123679470 0 0) 0x7f52800afaa0 con 0x7f52800d1220 2023-07-09T21:52:06.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.557+0000 7f527dffb700 1 -- 172.21.15.53:0/1756349626 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5270001110 con 0x7f52800d1220 2023-07-09T21:52:06.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.557+0000 7f527f7fe700 1 -- 172.21.15.53:0/1756349626 >> v1:172.21.15.184:6789/0 conn(0x7f52800d1220 legacy=0x7f52800b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.557+0000 7f527f7fe700 1 -- 172.21.15.53:0/1756349626 >> v1:172.21.15.53:6789/0 conn(0x7f52800b3ff0 legacy=0x7f52800d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.557+0000 7f527f7fe700 1 -- 172.21.15.53:0/1756349626 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52800b0060 con 0x7f52800b43c0 2023-07-09T21:52:06.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.558+0000 7f527f7fe700 1 --2- 172.21.15.53:0/1756349626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52800b43c0 0x7f52800b1530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5278009dc0 tx=0x7f527800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1897df72533e897a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:06.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.558+0000 7f527dffb700 1 -- 172.21.15.53:0/1756349626 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527800e070 con 0x7f52800b43c0 2023-07-09T21:52:06.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.558+0000 7f527dffb700 1 -- 172.21.15.53:0/1756349626 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527800bb20 con 0x7f52800b43c0 2023-07-09T21:52:06.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.558+0000 7f527dffb700 1 -- 172.21.15.53:0/1756349626 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5278012430 con 0x7f52800b43c0 2023-07-09T21:52:06.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.559+0000 7f52857ff700 1 -- 172.21.15.53:0/1756349626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52800b43c0 msgr2=0x7f52800b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.559+0000 7f52857ff700 1 --2- 172.21.15.53:0/1756349626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52800b43c0 0x7f52800b1530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5278009dc0 tx=0x7f527800b330 comp rx=0 tx=0).stop 2023-07-09T21:52:06.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.559+0000 7f52857ff700 1 -- 172.21.15.53:0/1756349626 shutdown_connections 2023-07-09T21:52:06.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.559+0000 7f52857ff700 1 --2- 172.21.15.53:0/1756349626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52800b43c0 0x7f52800b1530 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.559+0000 7f52857ff700 1 -- 172.21.15.53:0/1756349626 >> 172.21.15.53:0/1756349626 conn(0x7f528009c1b0 msgr2=0x7f52800d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:06.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.559+0000 7f52857ff700 1 -- 172.21.15.53:0/1756349626 shutdown_connections 2023-07-09T21:52:06.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.559+0000 7f52857ff700 1 -- 172.21.15.53:0/1756349626 wait complete. 2023-07-09T21:52:06.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.560+0000 7f52857ff700 1 Processor -- start 2023-07-09T21:52:06.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.561+0000 7f52857ff700 1 -- start start 2023-07-09T21:52:06.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.561+0000 7f52857ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52800b3ff0 0x7f52800cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:06.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.561+0000 7f52857ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52800b43c0 0x7f52800b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:06.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.561+0000 7f52857ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52800d1220 0x7f52800cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:06.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.561+0000 7f52857ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52800cb100 con 0x7f52800d1220 2023-07-09T21:52:06.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.561+0000 7f52857ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52800ccbe0 con 0x7f52800b3ff0 2023-07-09T21:52:06.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.561+0000 7f52857ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52800cb3a0 con 0x7f52800b43c0 2023-07-09T21:52:06.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.562+0000 7f527f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52800d1220 0x7f52800cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:06.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.562+0000 7f527f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52800d1220 0x7f52800cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52462/0 (socket says 172.21.15.53:52462) 2023-07-09T21:52:06.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.562+0000 7f527f7fe700 1 -- 172.21.15.53:0/3809722207 learned_addr learned my addr 172.21.15.53:0/3809722207 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:06.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.562+0000 7f527effd700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52800b3ff0 0x7f52800cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:06.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.562+0000 7f527e7fc700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52800b43c0 0x7f52800b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:06.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.562+0000 7f527f7fe700 1 -- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52800b43c0 msgr2=0x7f52800b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.562+0000 7f527f7fe700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52800b43c0 0x7f52800b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.562+0000 7f527f7fe700 1 -- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52800b3ff0 msgr2=0x7f52800cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.562+0000 7f527f7fe700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52800b3ff0 0x7f52800cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.562+0000 7f527f7fe700 1 -- 172.21.15.53:0/3809722207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5278009a70 con 0x7f52800d1220 2023-07-09T21:52:06.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.562+0000 7f527f7fe700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52800d1220 0x7f52800cc190 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f527800b370 tx=0x7f5278004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:06.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.563+0000 7f52677fe700 1 -- 172.21.15.53:0/3809722207 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527801b810 con 0x7f52800d1220 2023-07-09T21:52:06.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.563+0000 7f52677fe700 1 -- 172.21.15.53:0/3809722207 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5278020070 con 0x7f52800d1220 2023-07-09T21:52:06.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.563+0000 7f52677fe700 1 -- 172.21.15.53:0/3809722207 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527801bbf0 con 0x7f52800d1220 2023-07-09T21:52:06.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.563+0000 7f52857ff700 1 -- 172.21.15.53:0/3809722207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52800cb680 con 0x7f52800d1220 2023-07-09T21:52:06.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.563+0000 7f52857ff700 1 -- 172.21.15.53:0/3809722207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528015b950 con 0x7f52800d1220 2023-07-09T21:52:06.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.564+0000 7f52857ff700 1 -- 172.21.15.53:0/3809722207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52800cb8c0 con 0x7f52800d1220 2023-07-09T21:52:06.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.565+0000 7f52677fe700 1 -- 172.21.15.53:0/3809722207 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f527801bd50 con 0x7f52800d1220 2023-07-09T21:52:06.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.566+0000 7f52677fe700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f526c06ad70 0x7f526c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:06.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.566+0000 7f52677fe700 1 -- 172.21.15.53:0/3809722207 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f5278022070 con 0x7f52800d1220 2023-07-09T21:52:06.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.566+0000 7f527effd700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f526c06ad70 0x7f526c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:06.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.567+0000 7f527effd700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f526c06ad70 0x7f526c06d220 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5270000f60 tx=0x7f5270009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:06.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.570+0000 7f52677fe700 1 -- 172.21.15.53:0/3809722207 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5278056960 con 0x7f52800d1220 2023-07-09T21:52:06.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.825+0000 7f52857ff700 1 -- 172.21.15.53:0/3809722207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5280074350 con 0x7f52800d1220 2023-07-09T21:52:06.827 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-07-09T21:52:06.825+0000 7f231e3f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T21:52:06.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.830+0000 7f52677fe700 1 -- 172.21.15.53:0/3809722207 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5278059f80 con 0x7f52800d1220 2023-07-09T21:52:06.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.833+0000 7f52857ff700 1 -- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f526c06ad70 msgr2=0x7f526c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.833+0000 7f52857ff700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f526c06ad70 0x7f526c06d220 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5270000f60 tx=0x7f5270009040 comp rx=0 tx=0).stop 2023-07-09T21:52:06.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.833+0000 7f52857ff700 1 -- 172.21.15.53:0/3809722207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52800d1220 msgr2=0x7f52800cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:06.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.833+0000 7f52857ff700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52800d1220 0x7f52800cc190 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f527800b370 tx=0x7f5278004ad0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.833+0000 7f52857ff700 1 -- 172.21.15.53:0/3809722207 shutdown_connections 2023-07-09T21:52:06.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.833+0000 7f52857ff700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f526c06ad70 0x7f526c06d220 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.833+0000 7f52857ff700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52800d1220 0x7f52800cc190 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.833+0000 7f52857ff700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52800b3ff0 0x7f52800cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.833+0000 7f52857ff700 1 --2- 172.21.15.53:0/3809722207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52800b43c0 0x7f52800b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:06.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.833+0000 7f52857ff700 1 -- 172.21.15.53:0/3809722207 >> 172.21.15.53:0/3809722207 conn(0x7f528009c1b0 msgr2=0x7f52800b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:06.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.833+0000 7f52857ff700 1 -- 172.21.15.53:0/3809722207 shutdown_connections 2023-07-09T21:52:06.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:06.833+0000 7f52857ff700 1 -- 172.21.15.53:0/3809722207 wait complete. 2023-07-09T21:52:06.837 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T21:52:06.844 INFO:tasks.ceph.mds.d.smithi184.stderr: -5578> 2023-07-09T21:51:44.783+0000 7f89559f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:52:06.853 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T21:52:06.902 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-07-09T21:52:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.054+0000 7fd298fff700 1 Processor -- start 2023-07-09T21:52:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.054+0000 7fd298fff700 1 -- start start 2023-07-09T21:52:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.055+0000 7fd298fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2940b3ff0 0x7fd2940b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.055+0000 7fd298fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd2940d0f90 0x7fd2940b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:07.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.055+0000 7fd298fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2940b8e80 con 0x7fd2940d0b10 2023-07-09T21:52:07.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.055+0000 7fd298fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2940b1e30 con 0x7fd2940b3ff0 2023-07-09T21:52:07.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.055+0000 7fd298fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2940afaa0 con 0x7fd2940d0f90 2023-07-09T21:52:07.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.055+0000 7fd29259c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2940b3ff0 0x7fd2940b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:07.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.055+0000 7fd28bfff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd2940d0b10 0x7fd2940b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56338/0 (socket says 172.21.15.53:56338) 2023-07-09T21:52:07.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.055+0000 7fd28bfff700 1 -- 172.21.15.53:0/2554596082 learned_addr learned my addr 172.21.15.53:0/2554596082 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:07.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.056+0000 7fd292d9d700 1 --2- 172.21.15.53:0/2554596082 >> v2:172.21.15.184:3300/0 conn(0x7fd2940d0f90 0x7fd2940b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:07.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.056+0000 7fd29259c700 1 -- 172.21.15.53:0/2554596082 >> v2:172.21.15.184:3300/0 conn(0x7fd2940d0f90 msgr2=0x7fd2940b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:07.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.056+0000 7fd29259c700 1 --2- 172.21.15.53:0/2554596082 >> v2:172.21.15.184:3300/0 conn(0x7fd2940d0f90 0x7fd2940b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:07.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.056+0000 7fd29259c700 1 -- 172.21.15.53:0/2554596082 >> v1:172.21.15.53:6789/0 conn(0x7fd2940d0b10 legacy=0x7fd2940b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:07.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.056+0000 7fd29259c700 1 -- 172.21.15.53:0/2554596082 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2940afd80 con 0x7fd2940b3ff0 2023-07-09T21:52:07.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.056+0000 7fd292d9d700 1 --2- 172.21.15.53:0/2554596082 >> v2:172.21.15.184:3300/0 conn(0x7fd2940d0f90 0x7fd2940b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:07.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.056+0000 7fd291d9b700 1 -- 172.21.15.53:0/2554596082 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751489577 0 0) 0x7fd27c001110 con 0x7fd2940d0b10 2023-07-09T21:52:07.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.056+0000 7fd29259c700 1 --2- 172.21.15.53:0/2554596082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2940b3ff0 0x7fd2940b43c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd2940674e0 tx=0x7fd284009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7f965a72d2227e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:07.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.056+0000 7fd291d9b700 1 -- 172.21.15.53:0/2554596082 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284011830 con 0x7fd2940b3ff0 2023-07-09T21:52:07.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.056+0000 7fd291d9b700 1 -- 172.21.15.53:0/2554596082 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd284011990 con 0x7fd2940b3ff0 2023-07-09T21:52:07.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.056+0000 7fd291d9b700 1 -- 172.21.15.53:0/2554596082 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284011d20 con 0x7fd2940b3ff0 2023-07-09T21:52:07.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.057+0000 7fd298fff700 1 -- 172.21.15.53:0/2554596082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2940b3ff0 msgr2=0x7fd2940b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:07.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.057+0000 7fd298fff700 1 --2- 172.21.15.53:0/2554596082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2940b3ff0 0x7fd2940b43c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd2940674e0 tx=0x7fd284009b20 comp rx=0 tx=0).stop 2023-07-09T21:52:07.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.057+0000 7fd298fff700 1 -- 172.21.15.53:0/2554596082 shutdown_connections 2023-07-09T21:52:07.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.057+0000 7fd298fff700 1 --2- 172.21.15.53:0/2554596082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2940b3ff0 0x7fd2940b43c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:07.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.057+0000 7fd298fff700 1 --2- 172.21.15.53:0/2554596082 >> v2:172.21.15.184:3300/0 conn(0x7fd2940d0f90 0x7fd2940b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:07.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.057+0000 7fd298fff700 1 -- 172.21.15.53:0/2554596082 >> 172.21.15.53:0/2554596082 conn(0x7fd29409c1b0 msgr2=0x7fd2940d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:07.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.057+0000 7fd298fff700 1 -- 172.21.15.53:0/2554596082 shutdown_connections 2023-07-09T21:52:07.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.057+0000 7fd298fff700 1 -- 172.21.15.53:0/2554596082 wait complete. 2023-07-09T21:52:07.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.059+0000 7fd298fff700 1 Processor -- start 2023-07-09T21:52:07.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.059+0000 7fd298fff700 1 -- start start 2023-07-09T21:52:07.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.060+0000 7fd298fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2940b3ff0 0x7fd2941f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:07.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.060+0000 7fd298fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2940d0b10 0x7fd2940caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:07.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.060+0000 7fd298fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2940d0f90 0x7fd2940b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.060+0000 7fd298fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2941f2550 con 0x7fd2940d0b10 2023-07-09T21:52:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.060+0000 7fd298fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2941f2eb0 con 0x7fd2940d0f90 2023-07-09T21:52:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.060+0000 7fd298fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2940ca010 con 0x7fd2940b3ff0 2023-07-09T21:52:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.060+0000 7fd28bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2940d0b10 0x7fd2940caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.060+0000 7fd28bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2940d0b10 0x7fd2940caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52478/0 (socket says 172.21.15.53:52478) 2023-07-09T21:52:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.060+0000 7fd28bfff700 1 -- 172.21.15.53:0/1249235590 learned_addr learned my addr 172.21.15.53:0/1249235590 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.061+0000 7fd29259c700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2940b3ff0 0x7fd2941f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:07.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.061+0000 7fd292d9d700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2940d0f90 0x7fd2940b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:07.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.061+0000 7fd28bfff700 1 -- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2940b3ff0 msgr2=0x7fd2941f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:07.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.061+0000 7fd28bfff700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2940b3ff0 0x7fd2941f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:07.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.061+0000 7fd28bfff700 1 -- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2940d0f90 msgr2=0x7fd2940b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:07.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.061+0000 7fd28bfff700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2940d0f90 0x7fd2940b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:07.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.061+0000 7fd28bfff700 1 -- 172.21.15.53:0/1249235590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2840094a0 con 0x7fd2940d0b10 2023-07-09T21:52:07.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.061+0000 7fd28bfff700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2940d0b10 0x7fd2940caa20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00c760 tx=0x7fd27c00ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:07.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.061+0000 7fd28affd700 1 -- 172.21.15.53:0/1249235590 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c004c80 con 0x7fd2940d0b10 2023-07-09T21:52:07.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.061+0000 7fd28affd700 1 -- 172.21.15.53:0/1249235590 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c004de0 con 0x7fd2940d0b10 2023-07-09T21:52:07.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.061+0000 7fd298fff700 1 -- 172.21.15.53:0/1249235590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2940ca260 con 0x7fd2940d0b10 2023-07-09T21:52:07.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.061+0000 7fd28affd700 1 -- 172.21.15.53:0/1249235590 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c007310 con 0x7fd2940d0b10 2023-07-09T21:52:07.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.061+0000 7fd298fff700 1 -- 172.21.15.53:0/1249235590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2941f2170 con 0x7fd2940d0b10 2023-07-09T21:52:07.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.062+0000 7fd298fff700 1 -- 172.21.15.53:0/1249235590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2941f2690 con 0x7fd2940d0b10 2023-07-09T21:52:07.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.063+0000 7fd28affd700 1 -- 172.21.15.53:0/1249235590 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fd27c007470 con 0x7fd2940d0b10 2023-07-09T21:52:07.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.064+0000 7fd28affd700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd27406ad70 0x7fd27406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:07.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.064+0000 7fd28affd700 1 -- 172.21.15.53:0/1249235590 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fd27c0890f0 con 0x7fd2940d0b10 2023-07-09T21:52:07.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.065+0000 7fd29259c700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd27406ad70 0x7fd27406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:07.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.065+0000 7fd29259c700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd27406ad70 0x7fd27406d220 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd2840090b0 tx=0x7fd284008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:07.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.068+0000 7fd28affd700 1 -- 172.21.15.53:0/1249235590 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd2941f2690 con 0x7fd2940d0b10 2023-07-09T21:52:07.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.320+0000 7fd298fff700 1 -- 172.21.15.53:0/1249235590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd2940b8e80 con 0x7fd2940d0b10 2023-07-09T21:52:07.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.834+0000 7fd28affd700 1 -- 172.21.15.53:0/1249235590 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd2940b8e80 con 0x7fd2940d0b10 2023-07-09T21:52:07.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.837+0000 7fd298fff700 1 -- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd27406ad70 msgr2=0x7fd27406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:07.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.837+0000 7fd298fff700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd27406ad70 0x7fd27406d220 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd2840090b0 tx=0x7fd284008030 comp rx=0 tx=0).stop 2023-07-09T21:52:07.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.837+0000 7fd298fff700 1 -- 172.21.15.53:0/1249235590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2940d0b10 msgr2=0x7fd2940caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:07.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.837+0000 7fd298fff700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2940d0b10 0x7fd2940caa20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00c760 tx=0x7fd27c00ca70 comp rx=0 tx=0).stop 2023-07-09T21:52:07.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.837+0000 7fd298fff700 1 -- 172.21.15.53:0/1249235590 shutdown_connections 2023-07-09T21:52:07.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.837+0000 7fd298fff700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd27406ad70 0x7fd27406d220 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:07.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.837+0000 7fd298fff700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2940d0f90 0x7fd2940b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:07.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.837+0000 7fd298fff700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2940b3ff0 0x7fd2941f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:07.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.837+0000 7fd298fff700 1 --2- 172.21.15.53:0/1249235590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2940d0b10 0x7fd2940caa20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:07.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.837+0000 7fd298fff700 1 -- 172.21.15.53:0/1249235590 >> 172.21.15.53:0/1249235590 conn(0x7fd29409c1b0 msgr2=0x7fd2940b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:07.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.837+0000 7fd298fff700 1 -- 172.21.15.53:0/1249235590 shutdown_connections 2023-07-09T21:52:07.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:07.837+0000 7fd298fff700 1 -- 172.21.15.53:0/1249235590 wait complete. 2023-07-09T21:52:07.860 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T21:52:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.064+0000 7fa8a53ff700 1 Processor -- start 2023-07-09T21:52:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.064+0000 7fa8a53ff700 1 -- start start 2023-07-09T21:52:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.065+0000 7fa8a53ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa8a00d10c0 0x7fa8a00b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.065+0000 7fa8a53ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00af9b0 con 0x7fa8a015c8f0 2023-07-09T21:52:08.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.065+0000 7fa8a53ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00b45b0 con 0x7fa8a00b0c70 2023-07-09T21:52:08.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.065+0000 7fa8a53ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00afc50 con 0x7fa8a00d10c0 2023-07-09T21:52:08.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.065+0000 7fa89effd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa8a015c8f0 0x7fa8a00d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56350/0 (socket says 172.21.15.53:56350) 2023-07-09T21:52:08.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.065+0000 7fa89effd700 1 -- 172.21.15.53:0/1595235430 learned_addr learned my addr 172.21.15.53:0/1595235430 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:08.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.066+0000 7fa89e7fc700 1 --2- 172.21.15.53:0/1595235430 >> v2:172.21.15.184:3300/0 conn(0x7fa8a00d10c0 0x7fa8a00b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:08.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.066+0000 7fa89dffb700 1 -- 172.21.15.53:0/1595235430 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569097600 0 0) 0x7fa8a00af9b0 con 0x7fa8a015c8f0 2023-07-09T21:52:08.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.066+0000 7fa89dffb700 1 -- 172.21.15.53:0/1595235430 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8880035b0 con 0x7fa8a015c8f0 2023-07-09T21:52:08.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.066+0000 7fa89dffb700 1 -- 172.21.15.53:0/1595235430 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2230637027 0 0) 0x7fa8880035b0 con 0x7fa8a015c8f0 2023-07-09T21:52:08.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.066+0000 7fa89e7fc700 1 -- 172.21.15.53:0/1595235430 >> v1:172.21.15.184:6789/0 conn(0x7fa8a00b0c70 legacy=0x7fa8a00b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:08.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.066+0000 7fa89e7fc700 1 -- 172.21.15.53:0/1595235430 >> v1:172.21.15.53:6789/0 conn(0x7fa8a015c8f0 legacy=0x7fa8a00d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:08.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.066+0000 7fa89e7fc700 1 -- 172.21.15.53:0/1595235430 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00aff30 con 0x7fa8a00d10c0 2023-07-09T21:52:08.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.066+0000 7fa89e7fc700 1 --2- 172.21.15.53:0/1595235430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8a00d10c0 0x7fa8a00b0730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa894009870 tx=0x7fa894009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eed98a4a5ca9e02c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.067+0000 7fa89dffb700 1 -- 172.21.15.53:0/1595235430 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890001670 con 0x7fa8a00d10c0 2023-07-09T21:52:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.067+0000 7fa89dffb700 1 -- 172.21.15.53:0/1595235430 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894004030 con 0x7fa8a00d10c0 2023-07-09T21:52:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.067+0000 7fa89dffb700 1 -- 172.21.15.53:0/1595235430 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8940043a0 con 0x7fa8a00d10c0 2023-07-09T21:52:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.067+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1595235430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8a00d10c0 msgr2=0x7fa8a00b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.067+0000 7fa8a53ff700 1 --2- 172.21.15.53:0/1595235430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8a00d10c0 0x7fa8a00b0730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa894009870 tx=0x7fa894009b80 comp rx=0 tx=0).stop 2023-07-09T21:52:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.067+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1595235430 shutdown_connections 2023-07-09T21:52:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.067+0000 7fa8a53ff700 1 --2- 172.21.15.53:0/1595235430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8a00d10c0 0x7fa8a00b0730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.067+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1595235430 >> 172.21.15.53:0/1595235430 conn(0x7fa8a009c150 msgr2=0x7fa8a00d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.067+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1595235430 shutdown_connections 2023-07-09T21:52:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.067+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1595235430 wait complete. 2023-07-09T21:52:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.069+0000 7fa8a53ff700 1 Processor -- start 2023-07-09T21:52:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.069+0000 7fa8a53ff700 1 -- start start 2023-07-09T21:52:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.070+0000 7fa8a53ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8a00b0c70 0x7fa8a00a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.070+0000 7fa8a53ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8a00d10c0 0x7fa8a009f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.070+0000 7fa8a53ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8a015c8f0 0x7fa8a009dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.070+0000 7fa8a53ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00cd400 con 0x7fa8a015c8f0 2023-07-09T21:52:08.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.070+0000 7fa8a53ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a009e2d0 con 0x7fa8a00d10c0 2023-07-09T21:52:08.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.070+0000 7fa8a53ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a009e5b0 con 0x7fa8a00b0c70 2023-07-09T21:52:08.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.070+0000 7fa89f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8a015c8f0 0x7fa8a009dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:08.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.070+0000 7fa89f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8a015c8f0 0x7fa8a009dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52488/0 (socket says 172.21.15.53:52488) 2023-07-09T21:52:08.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.070+0000 7fa89f7fe700 1 -- 172.21.15.53:0/1659672256 learned_addr learned my addr 172.21.15.53:0/1659672256 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:08.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.071+0000 7fa89f7fe700 1 -- 172.21.15.53:0/1659672256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8a00b0c70 msgr2=0x7fa8a00a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:08.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.071+0000 7fa89f7fe700 1 --2- 172.21.15.53:0/1659672256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8a00b0c70 0x7fa8a00a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:08.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.071+0000 7fa89f7fe700 1 -- 172.21.15.53:0/1659672256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8a00d10c0 msgr2=0x7fa8a009f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:08.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.071+0000 7fa89f7fe700 1 --2- 172.21.15.53:0/1659672256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8a00d10c0 0x7fa8a009f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:08.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.071+0000 7fa89f7fe700 1 -- 172.21.15.53:0/1659672256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8940094a0 con 0x7fa8a015c8f0 2023-07-09T21:52:08.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.071+0000 7fa89f7fe700 1 --2- 172.21.15.53:0/1659672256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8a015c8f0 0x7fa8a009dc40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa89800cc50 tx=0x7fa89800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:08.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.071+0000 7fa8877fe700 1 -- 172.21.15.53:0/1659672256 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800ad80 con 0x7fa8a015c8f0 2023-07-09T21:52:08.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.071+0000 7fa8877fe700 1 -- 172.21.15.53:0/1659672256 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89800ce50 con 0x7fa8a015c8f0 2023-07-09T21:52:08.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.071+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1659672256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a009e890 con 0x7fa8a015c8f0 2023-07-09T21:52:08.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.071+0000 7fa8877fe700 1 -- 172.21.15.53:0/1659672256 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898003c40 con 0x7fa8a015c8f0 2023-07-09T21:52:08.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.071+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1659672256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a009ee50 con 0x7fa8a015c8f0 2023-07-09T21:52:08.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.072+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1659672256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a0074350 con 0x7fa8a015c8f0 2023-07-09T21:52:08.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.073+0000 7fa8877fe700 1 -- 172.21.15.53:0/1659672256 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fa8980050d0 con 0x7fa8a015c8f0 2023-07-09T21:52:08.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.074+0000 7fa8877fe700 1 --2- 172.21.15.53:0/1659672256 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa88c06ad70 0x7fa88c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:08.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.074+0000 7fa8877fe700 1 -- 172.21.15.53:0/1659672256 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fa898089680 con 0x7fa8a015c8f0 2023-07-09T21:52:08.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.075+0000 7fa89effd700 1 --2- 172.21.15.53:0/1659672256 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa88c06ad70 0x7fa88c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:08.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.075+0000 7fa89effd700 1 --2- 172.21.15.53:0/1659672256 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa88c06ad70 0x7fa88c06d220 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa890001eb0 tx=0x7fa890001980 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:08.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.078+0000 7fa8877fe700 1 -- 172.21.15.53:0/1659672256 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa898054650 con 0x7fa8a015c8f0 2023-07-09T21:52:08.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.283+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1659672256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa8a00d1c80 con 0x7fa8a015c8f0 2023-07-09T21:52:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.837+0000 7fa8877fe700 1 -- 172.21.15.53:0/1659672256 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa898057c70 con 0x7fa8a015c8f0 2023-07-09T21:52:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.841+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1659672256 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa88c06ad70 msgr2=0x7fa88c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.841+0000 7fa8a53ff700 1 --2- 172.21.15.53:0/1659672256 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa88c06ad70 0x7fa88c06d220 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa890001eb0 tx=0x7fa890001980 comp rx=0 tx=0).stop 2023-07-09T21:52:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.841+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1659672256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8a015c8f0 msgr2=0x7fa8a009dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.841+0000 7fa8a53ff700 1 --2- 172.21.15.53:0/1659672256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8a015c8f0 0x7fa8a009dc40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa89800cc50 tx=0x7fa89800a340 comp rx=0 tx=0).stop 2023-07-09T21:52:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.841+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1659672256 shutdown_connections 2023-07-09T21:52:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.841+0000 7fa8a53ff700 1 --2- 172.21.15.53:0/1659672256 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa88c06ad70 0x7fa88c06d220 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.841+0000 7fa8a53ff700 1 --2- 172.21.15.53:0/1659672256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8a015c8f0 0x7fa8a009dc40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.841+0000 7fa8a53ff700 1 --2- 172.21.15.53:0/1659672256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8a00b0c70 0x7fa8a00a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.841+0000 7fa8a53ff700 1 --2- 172.21.15.53:0/1659672256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8a00d10c0 0x7fa8a009f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.841+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1659672256 >> 172.21.15.53:0/1659672256 conn(0x7fa8a009c150 msgr2=0x7fa8a00b7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.842+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1659672256 shutdown_connections 2023-07-09T21:52:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:08.842+0000 7fa8a53ff700 1 -- 172.21.15.53:0/1659672256 wait complete. 2023-07-09T21:52:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-07-09T21:52:08.867 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T21:52:09.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.076+0000 7f16c15ff700 1 Processor -- start 2023-07-09T21:52:09.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.076+0000 7f16c15ff700 1 -- start start 2023-07-09T21:52:09.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.078+0000 7f16c15ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f16bc06c730 0x7f16bc070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:09.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.078+0000 7f16c15ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16bc06fdb0 con 0x7f16bc0c9860 2023-07-09T21:52:09.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.078+0000 7f16c15ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16bc0ae120 con 0x7f16bc06c2c0 2023-07-09T21:52:09.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.078+0000 7f16c15ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16bc159880 con 0x7f16bc06c730 2023-07-09T21:52:09.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.078+0000 7f16baffd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f16bc0c9860 0x7f16bc0cd1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56352/0 (socket says 172.21.15.53:56352) 2023-07-09T21:52:09.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.078+0000 7f16baffd700 1 -- 172.21.15.53:0/3305305729 learned_addr learned my addr 172.21.15.53:0/3305305729 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:09.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.078+0000 7f16bb7fe700 1 --2- 172.21.15.53:0/3305305729 >> v2:172.21.15.53:3300/0 conn(0x7f16bc06c730 0x7f16bc070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:09.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.078+0000 7f16ba7fc700 1 -- 172.21.15.53:0/3305305729 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234686067 0 0) 0x7f16bc06fdb0 con 0x7f16bc0c9860 2023-07-09T21:52:09.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.079+0000 7f16ba7fc700 1 -- 172.21.15.53:0/3305305729 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16a80057c0 con 0x7f16bc0c9860 2023-07-09T21:52:09.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.079+0000 7f16bb7fe700 1 -- 172.21.15.53:0/3305305729 >> v1:172.21.15.184:6789/0 conn(0x7f16bc06c2c0 legacy=0x7f16bc070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:09.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.079+0000 7f16bb7fe700 1 -- 172.21.15.53:0/3305305729 >> v1:172.21.15.53:6789/0 conn(0x7f16bc0c9860 legacy=0x7f16bc0cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:09.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.079+0000 7f16bb7fe700 1 -- 172.21.15.53:0/3305305729 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc0cd9a0 con 0x7f16bc06c730 2023-07-09T21:52:09.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.079+0000 7f16bb7fe700 1 --2- 172.21.15.53:0/3305305729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc06c730 0x7f16bc070950 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0c94a0 tx=0x7f16b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90c6de699d82741 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:09.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.079+0000 7f16ba7fc700 1 -- 172.21.15.53:0/3305305729 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b4016070 con 0x7f16bc06c730 2023-07-09T21:52:09.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.079+0000 7f16ba7fc700 1 -- 172.21.15.53:0/3305305729 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b400bb20 con 0x7f16bc06c730 2023-07-09T21:52:09.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.079+0000 7f16ba7fc700 1 -- 172.21.15.53:0/3305305729 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b400e070 con 0x7f16bc06c730 2023-07-09T21:52:09.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.080+0000 7f16c15ff700 1 -- 172.21.15.53:0/3305305729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc06c730 msgr2=0x7f16bc070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:09.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.080+0000 7f16c15ff700 1 --2- 172.21.15.53:0/3305305729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc06c730 0x7f16bc070950 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0c94a0 tx=0x7f16b400b330 comp rx=0 tx=0).stop 2023-07-09T21:52:09.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.080+0000 7f16c15ff700 1 -- 172.21.15.53:0/3305305729 shutdown_connections 2023-07-09T21:52:09.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.080+0000 7f16c15ff700 1 --2- 172.21.15.53:0/3305305729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc06c730 0x7f16bc070950 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:09.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.080+0000 7f16c15ff700 1 -- 172.21.15.53:0/3305305729 >> 172.21.15.53:0/3305305729 conn(0x7f16bc0cea00 msgr2=0x7f16bc0cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:09.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.080+0000 7f16c15ff700 1 -- 172.21.15.53:0/3305305729 shutdown_connections 2023-07-09T21:52:09.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.080+0000 7f16c15ff700 1 -- 172.21.15.53:0/3305305729 wait complete. 2023-07-09T21:52:09.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.082+0000 7f16c15ff700 1 Processor -- start 2023-07-09T21:52:09.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.082+0000 7f16c15ff700 1 -- start start 2023-07-09T21:52:09.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16c15ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16bc06c2c0 0x7f16bc1572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:09.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16c15ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc06c730 0x7f16bc158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:09.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16c15ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16bc0c9860 0x7f16bc1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:09.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16c15ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc158bf0 con 0x7f16bc06c730 2023-07-09T21:52:09.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16c15ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc1f3050 con 0x7f16bc0c9860 2023-07-09T21:52:09.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16c15ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc1577f0 con 0x7f16bc06c2c0 2023-07-09T21:52:09.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16b3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc06c730 0x7f16bc158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:09.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16b3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc06c730 0x7f16bc158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52516/0 (socket says 172.21.15.53:52516) 2023-07-09T21:52:09.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16b3fff700 1 -- 172.21.15.53:0/2249098741 learned_addr learned my addr 172.21.15.53:0/2249098741 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:09.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16bb7fe700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16bc0c9860 0x7f16bc1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:09.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16baffd700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16bc06c2c0 0x7f16bc1572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:09.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16b3fff700 1 -- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16bc06c2c0 msgr2=0x7f16bc1572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:09.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16b3fff700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16bc06c2c0 0x7f16bc1572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:09.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16b3fff700 1 -- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16bc0c9860 msgr2=0x7f16bc1586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:09.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16b3fff700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16bc0c9860 0x7f16bc1586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:09.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.083+0000 7f16b3fff700 1 -- 172.21.15.53:0/2249098741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b4009a70 con 0x7f16bc06c730 2023-07-09T21:52:09.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.084+0000 7f16b3fff700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc06c730 0x7f16bc158170 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f16a400c4e0 tx=0x7f16a400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:09.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.084+0000 7f16b37fe700 1 -- 172.21.15.53:0/2249098741 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a40052d0 con 0x7f16bc06c730 2023-07-09T21:52:09.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.084+0000 7f16b37fe700 1 -- 172.21.15.53:0/2249098741 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a4005430 con 0x7f16bc06c730 2023-07-09T21:52:09.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.084+0000 7f16c15ff700 1 -- 172.21.15.53:0/2249098741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16bc1f2740 con 0x7f16bc06c730 2023-07-09T21:52:09.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.084+0000 7f16b37fe700 1 -- 172.21.15.53:0/2249098741 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a40038c0 con 0x7f16bc06c730 2023-07-09T21:52:09.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.084+0000 7f16c15ff700 1 -- 172.21.15.53:0/2249098741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16bc1f2a00 con 0x7f16bc06c730 2023-07-09T21:52:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.085+0000 7f16c15ff700 1 -- 172.21.15.53:0/2249098741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16bc074350 con 0x7f16bc06c730 2023-07-09T21:52:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.086+0000 7f16b37fe700 1 -- 172.21.15.53:0/2249098741 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f16a4003a20 con 0x7f16bc06c730 2023-07-09T21:52:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.087+0000 7f16b37fe700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f169c06ad70 0x7f169c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.088+0000 7f16b37fe700 1 -- 172.21.15.53:0/2249098741 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5739+0+0 (secure 0 0 0) 0x7f16a4088760 con 0x7f16bc06c730 2023-07-09T21:52:09.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.088+0000 7f16baffd700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f169c06ad70 0x7f169c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:09.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.089+0000 7f16baffd700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f169c06ad70 0x7f169c06d220 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f16ac007fd0 tx=0x7f16ac007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.092+0000 7f16b37fe700 1 -- 172.21.15.53:0/2249098741 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f16a40538f0 con 0x7f16bc06c730 2023-07-09T21:52:09.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.301+0000 7f16c15ff700 1 -- 172.21.15.53:0/2249098741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f16bc06fa10 con 0x7f16bc06c730 2023-07-09T21:52:09.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.843+0000 7f16b37fe700 1 -- 172.21.15.53:0/2249098741 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7f16a4056f10 con 0x7f16bc06c730 2023-07-09T21:52:09.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.848+0000 7f16c15ff700 1 -- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f169c06ad70 msgr2=0x7f169c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:09.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.848+0000 7f16c15ff700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f169c06ad70 0x7f169c06d220 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f16ac007fd0 tx=0x7f16ac007dc0 comp rx=0 tx=0).stop 2023-07-09T21:52:09.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.848+0000 7f16c15ff700 1 -- 172.21.15.53:0/2249098741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc06c730 msgr2=0x7f16bc158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:09.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.848+0000 7f16c15ff700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc06c730 0x7f16bc158170 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f16a400c4e0 tx=0x7f16a400c7f0 comp rx=0 tx=0).stop 2023-07-09T21:52:09.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.848+0000 7f16c15ff700 1 -- 172.21.15.53:0/2249098741 shutdown_connections 2023-07-09T21:52:09.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.848+0000 7f16c15ff700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f169c06ad70 0x7f169c06d220 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:09.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.848+0000 7f16c15ff700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16bc0c9860 0x7f16bc1586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:09.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.848+0000 7f16c15ff700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16bc06c2c0 0x7f16bc1572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:09.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.848+0000 7f16c15ff700 1 --2- 172.21.15.53:0/2249098741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc06c730 0x7f16bc158170 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:09.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.848+0000 7f16c15ff700 1 -- 172.21.15.53:0/2249098741 >> 172.21.15.53:0/2249098741 conn(0x7f16bc0cea00 msgr2=0x7f16bc0711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:09.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.848+0000 7f16c15ff700 1 -- 172.21.15.53:0/2249098741 shutdown_connections 2023-07-09T21:52:09.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:09.848+0000 7f16c15ff700 1 -- 172.21.15.53:0/2249098741 wait complete. 2023-07-09T21:52:09.852 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-07-09T21:52:09.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T21:52:10.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.079+0000 7f1e377ff700 1 Processor -- start 2023-07-09T21:52:10.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.079+0000 7f1e377ff700 1 -- start start 2023-07-09T21:52:10.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.080+0000 7f1e377ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1e300d1220 0x7f1e300b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:10.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.080+0000 7f1e377ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e300b8e80 con 0x7f1e300b0e20 2023-07-09T21:52:10.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.080+0000 7f1e377ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e300afaa0 con 0x7f1e300b3ff0 2023-07-09T21:52:10.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.080+0000 7f1e377ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e300afd80 con 0x7f1e300d1220 2023-07-09T21:52:10.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.080+0000 7f1e35d9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1e300b0e20 0x7f1e300b1220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56362/0 (socket says 172.21.15.53:56362) 2023-07-09T21:52:10.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.080+0000 7f1e35d9c700 1 -- 172.21.15.53:0/2360602796 learned_addr learned my addr 172.21.15.53:0/2360602796 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:10.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.081+0000 7f1e34d9a700 1 --2- 172.21.15.53:0/2360602796 >> v2:172.21.15.184:3300/0 conn(0x7f1e300d1220 0x7f1e300b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:10.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.081+0000 7f1e27fff700 1 -- 172.21.15.53:0/2360602796 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866027956 0 0) 0x7f1e28001490 con 0x7f1e300b0e20 2023-07-09T21:52:10.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.081+0000 7f1e27fff700 1 -- 172.21.15.53:0/2360602796 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e1c0035b0 con 0x7f1e300b0e20 2023-07-09T21:52:10.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.081+0000 7f1e34d9a700 1 -- 172.21.15.53:0/2360602796 >> v1:172.21.15.184:6789/0 conn(0x7f1e300b3ff0 legacy=0x7f1e300d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.081+0000 7f1e34d9a700 1 -- 172.21.15.53:0/2360602796 >> v1:172.21.15.53:6789/0 conn(0x7f1e300b0e20 legacy=0x7f1e300b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.081+0000 7f1e34d9a700 1 -- 172.21.15.53:0/2360602796 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e300b0060 con 0x7f1e300d1220 2023-07-09T21:52:10.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.081+0000 7f1e34d9a700 1 --2- 172.21.15.53:0/2360602796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e300d1220 0x7f1e300b43c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009840 tx=0x7f1e20009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d47113c245cfa820 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:10.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.082+0000 7f1e27fff700 1 -- 172.21.15.53:0/2360602796 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20011830 con 0x7f1e300d1220 2023-07-09T21:52:10.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.082+0000 7f1e27fff700 1 -- 172.21.15.53:0/2360602796 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e20011990 con 0x7f1e300d1220 2023-07-09T21:52:10.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.082+0000 7f1e27fff700 1 -- 172.21.15.53:0/2360602796 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20011d00 con 0x7f1e300d1220 2023-07-09T21:52:10.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.082+0000 7f1e377ff700 1 -- 172.21.15.53:0/2360602796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e300d1220 msgr2=0x7f1e300b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.082+0000 7f1e377ff700 1 --2- 172.21.15.53:0/2360602796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e300d1220 0x7f1e300b43c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009840 tx=0x7f1e20009b50 comp rx=0 tx=0).stop 2023-07-09T21:52:10.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.082+0000 7f1e377ff700 1 -- 172.21.15.53:0/2360602796 shutdown_connections 2023-07-09T21:52:10.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.082+0000 7f1e377ff700 1 --2- 172.21.15.53:0/2360602796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e300d1220 0x7f1e300b43c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.082+0000 7f1e377ff700 1 -- 172.21.15.53:0/2360602796 >> 172.21.15.53:0/2360602796 conn(0x7f1e3009c1b0 msgr2=0x7f1e300d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:10.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.083+0000 7f1e377ff700 1 -- 172.21.15.53:0/2360602796 shutdown_connections 2023-07-09T21:52:10.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.083+0000 7f1e377ff700 1 -- 172.21.15.53:0/2360602796 wait complete. 2023-07-09T21:52:10.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.084+0000 7f1e377ff700 1 Processor -- start 2023-07-09T21:52:10.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.084+0000 7f1e377ff700 1 -- start start 2023-07-09T21:52:10.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.085+0000 7f1e377ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e300b0e20 0x7f1e301573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:10.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.085+0000 7f1e377ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e300b3ff0 0x7f1e30157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:10.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.085+0000 7f1e377ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e300d1220 0x7f1e30156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:10.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.085+0000 7f1e377ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300cbec0 con 0x7f1e300b3ff0 2023-07-09T21:52:10.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.085+0000 7f1e377ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301578f0 con 0x7f1e300d1220 2023-07-09T21:52:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.085+0000 7f1e377ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301584d0 con 0x7f1e300b0e20 2023-07-09T21:52:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.086+0000 7f1e34d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e300b3ff0 0x7f1e30157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.086+0000 7f1e34d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e300b3ff0 0x7f1e30157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52520/0 (socket says 172.21.15.53:52520) 2023-07-09T21:52:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.086+0000 7f1e34d9a700 1 -- 172.21.15.53:0/4154130498 learned_addr learned my addr 172.21.15.53:0/4154130498 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.086+0000 7f1e3559b700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e300b0e20 0x7f1e301573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.086+0000 7f1e35d9c700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e300d1220 0x7f1e30156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.086+0000 7f1e34d9a700 1 -- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e300b0e20 msgr2=0x7f1e301573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.086+0000 7f1e34d9a700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e300b0e20 0x7f1e301573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.086+0000 7f1e34d9a700 1 -- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e300d1220 msgr2=0x7f1e30156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.086+0000 7f1e34d9a700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e300d1220 0x7f1e30156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.086+0000 7f1e34d9a700 1 -- 172.21.15.53:0/4154130498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e200094a0 con 0x7f1e300b3ff0 2023-07-09T21:52:10.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.086+0000 7f1e35d9c700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e300d1220 0x7f1e30156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:10.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.086+0000 7f1e34d9a700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e300b3ff0 0x7f1e30157f90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009b90 tx=0x7f1e20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:10.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.087+0000 7f1e25ffb700 1 -- 172.21.15.53:0/4154130498 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e200036a0 con 0x7f1e300b3ff0 2023-07-09T21:52:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.087+0000 7f1e25ffb700 1 -- 172.21.15.53:0/4154130498 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2001e070 con 0x7f1e300b3ff0 2023-07-09T21:52:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.087+0000 7f1e377ff700 1 -- 172.21.15.53:0/4154130498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e300cb520 con 0x7f1e300b3ff0 2023-07-09T21:52:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.087+0000 7f1e25ffb700 1 -- 172.21.15.53:0/4154130498 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20003a60 con 0x7f1e300b3ff0 2023-07-09T21:52:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.087+0000 7f1e377ff700 1 -- 172.21.15.53:0/4154130498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e300cbae0 con 0x7f1e300b3ff0 2023-07-09T21:52:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.088+0000 7f1e377ff700 1 -- 172.21.15.53:0/4154130498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e300cc000 con 0x7f1e300b3ff0 2023-07-09T21:52:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.089+0000 7f1e25ffb700 1 -- 172.21.15.53:0/4154130498 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f1e20003bc0 con 0x7f1e300b3ff0 2023-07-09T21:52:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.090+0000 7f1e25ffb700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e1406ad70 0x7f1e1406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.090+0000 7f1e25ffb700 1 -- 172.21.15.53:0/4154130498 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1e20020070 con 0x7f1e300b3ff0 2023-07-09T21:52:10.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.090+0000 7f1e3559b700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e1406ad70 0x7f1e1406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:10.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.091+0000 7f1e3559b700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e1406ad70 0x7f1e1406d220 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1e3006bd10 tx=0x7f1e2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:10.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.094+0000 7f1e25ffb700 1 -- 172.21.15.53:0/4154130498 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1e300cc000 con 0x7f1e300b3ff0 2023-07-09T21:52:10.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.300+0000 7f1e377ff700 1 -- 172.21.15.53:0/4154130498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1e300cc000 con 0x7f1e300b3ff0 2023-07-09T21:52:10.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.304+0000 7f1e25ffb700 1 -- 172.21.15.53:0/4154130498 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1e300cc000 con 0x7f1e300b3ff0 2023-07-09T21:52:10.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.307+0000 7f1e377ff700 1 -- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e1406ad70 msgr2=0x7f1e1406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.307+0000 7f1e377ff700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e1406ad70 0x7f1e1406d220 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1e3006bd10 tx=0x7f1e2c009040 comp rx=0 tx=0).stop 2023-07-09T21:52:10.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.307+0000 7f1e377ff700 1 -- 172.21.15.53:0/4154130498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e300b3ff0 msgr2=0x7f1e30157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.307+0000 7f1e377ff700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e300b3ff0 0x7f1e30157f90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009b90 tx=0x7f1e20004750 comp rx=0 tx=0).stop 2023-07-09T21:52:10.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.307+0000 7f1e377ff700 1 -- 172.21.15.53:0/4154130498 shutdown_connections 2023-07-09T21:52:10.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.307+0000 7f1e377ff700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1e1406ad70 0x7f1e1406d220 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.307+0000 7f1e377ff700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e300d1220 0x7f1e30156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.307+0000 7f1e377ff700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e300b0e20 0x7f1e301573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.307+0000 7f1e377ff700 1 --2- 172.21.15.53:0/4154130498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e300b3ff0 0x7f1e30157f90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.307+0000 7f1e377ff700 1 -- 172.21.15.53:0/4154130498 >> 172.21.15.53:0/4154130498 conn(0x7f1e3009c1b0 msgr2=0x7f1e3006bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:10.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.307+0000 7f1e377ff700 1 -- 172.21.15.53:0/4154130498 shutdown_connections 2023-07-09T21:52:10.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.307+0000 7f1e377ff700 1 -- 172.21.15.53:0/4154130498 wait complete. 2023-07-09T21:52:10.328 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status' 2023-07-09T21:52:10.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.530+0000 7fd7d11ff700 1 Processor -- start 2023-07-09T21:52:10.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.530+0000 7fd7d11ff700 1 -- start start 2023-07-09T21:52:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.531+0000 7fd7d11ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd7cc0d1220 0x7fd7cc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.531+0000 7fd7d11ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7cc0d2ce0 con 0x7fd7cc0b1e00 2023-07-09T21:52:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.531+0000 7fd7d11ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7cc0b3350 con 0x7fd7cc0b2350 2023-07-09T21:52:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.531+0000 7fd7d11ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7cc0b3630 con 0x7fd7cc0d1220 2023-07-09T21:52:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.532+0000 7fd7ca59c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd7cc0d1220 0x7fd7cc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.532+0000 7fd7cad9d700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd7cc0b1e00 0x7fd7cc0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56376/0 (socket says 172.21.15.53:56376) 2023-07-09T21:52:10.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.532+0000 7fd7cad9d700 1 -- 172.21.15.53:0/2534888704 learned_addr learned my addr 172.21.15.53:0/2534888704 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.532+0000 7fd7ca59c700 1 -- 172.21.15.53:0/2534888704 >> v1:172.21.15.184:6789/0 conn(0x7fd7cc0b2350 legacy=0x7fd7cc0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.532+0000 7fd7ca59c700 1 -- 172.21.15.53:0/2534888704 >> v1:172.21.15.53:6789/0 conn(0x7fd7cc0b1e00 legacy=0x7fd7cc0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.532+0000 7fd7ca59c700 1 -- 172.21.15.53:0/2534888704 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc0b3910 con 0x7fd7cc0d1220 2023-07-09T21:52:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.532+0000 7fd7ca59c700 1 --2- 172.21.15.53:0/2534888704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0d1220 0x7fd7cc0b43f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009840 tx=0x7fd7c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b591c8b495db291c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.533+0000 7fd7c9d9b700 1 -- 172.21.15.53:0/2534888704 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0011830 con 0x7fd7cc0d1220 2023-07-09T21:52:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.533+0000 7fd7c9d9b700 1 -- 172.21.15.53:0/2534888704 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c0011990 con 0x7fd7cc0d1220 2023-07-09T21:52:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.533+0000 7fd7c9d9b700 1 -- 172.21.15.53:0/2534888704 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0011d20 con 0x7fd7cc0d1220 2023-07-09T21:52:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.533+0000 7fd7d11ff700 1 -- 172.21.15.53:0/2534888704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0d1220 msgr2=0x7fd7cc0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.533+0000 7fd7d11ff700 1 --2- 172.21.15.53:0/2534888704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0d1220 0x7fd7cc0b43f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009840 tx=0x7fd7c0009b50 comp rx=0 tx=0).stop 2023-07-09T21:52:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.533+0000 7fd7d11ff700 1 -- 172.21.15.53:0/2534888704 shutdown_connections 2023-07-09T21:52:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.533+0000 7fd7d11ff700 1 --2- 172.21.15.53:0/2534888704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0d1220 0x7fd7cc0b43f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.533+0000 7fd7d11ff700 1 -- 172.21.15.53:0/2534888704 >> 172.21.15.53:0/2534888704 conn(0x7fd7cc09c1d0 msgr2=0x7fd7cc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:10.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.533+0000 7fd7d11ff700 1 -- 172.21.15.53:0/2534888704 shutdown_connections 2023-07-09T21:52:10.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.533+0000 7fd7d11ff700 1 -- 172.21.15.53:0/2534888704 wait complete. 2023-07-09T21:52:10.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.535+0000 7fd7d11ff700 1 Processor -- start 2023-07-09T21:52:10.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.535+0000 7fd7d11ff700 1 -- start start 2023-07-09T21:52:10.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.536+0000 7fd7d11ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7cc0b1e00 0x7fd7cc14cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:10.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.536+0000 7fd7d11ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b2350 0x7fd7cc0c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:10.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.536+0000 7fd7d11ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7cc0d1220 0x7fd7cc0c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:10.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.536+0000 7fd7d11ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc0ccfb0 con 0x7fd7cc0b2350 2023-07-09T21:52:10.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.536+0000 7fd7d11ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc0cfed0 con 0x7fd7cc0d1220 2023-07-09T21:52:10.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.536+0000 7fd7d11ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc0cfbf0 con 0x7fd7cc0b1e00 2023-07-09T21:52:10.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.536+0000 7fd7ca59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b2350 0x7fd7cc0c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:10.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.536+0000 7fd7ca59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b2350 0x7fd7cc0c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52536/0 (socket says 172.21.15.53:52536) 2023-07-09T21:52:10.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.536+0000 7fd7ca59c700 1 -- 172.21.15.53:0/769694639 learned_addr learned my addr 172.21.15.53:0/769694639 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:10.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.537+0000 7fd7cad9d700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7cc0b1e00 0x7fd7cc14cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:10.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.537+0000 7fd7cb59e700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7cc0d1220 0x7fd7cc0c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:10.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.537+0000 7fd7ca59c700 1 -- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7cc0b1e00 msgr2=0x7fd7cc14cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.537+0000 7fd7ca59c700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7cc0b1e00 0x7fd7cc14cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.537+0000 7fd7ca59c700 1 -- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7cc0d1220 msgr2=0x7fd7cc0c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.537+0000 7fd7ca59c700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7cc0d1220 0x7fd7cc0c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.537+0000 7fd7ca59c700 1 -- 172.21.15.53:0/769694639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c00094a0 con 0x7fd7cc0b2350 2023-07-09T21:52:10.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.537+0000 7fd7cad9d700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7cc0b1e00 0x7fd7cc14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:10.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.537+0000 7fd7ca59c700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b2350 0x7fd7cc0c95a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00090b0 tx=0x7fd7c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:10.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.537+0000 7fd7b37fe700 1 -- 172.21.15.53:0/769694639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00045f0 con 0x7fd7cc0b2350 2023-07-09T21:52:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.537+0000 7fd7b37fe700 1 -- 172.21.15.53:0/769694639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c001e070 con 0x7fd7cc0b2350 2023-07-09T21:52:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.537+0000 7fd7b37fe700 1 -- 172.21.15.53:0/769694639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0003ac0 con 0x7fd7cc0b2350 2023-07-09T21:52:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.538+0000 7fd7d11ff700 1 -- 172.21.15.53:0/769694639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc0b6540 con 0x7fd7cc0b2350 2023-07-09T21:52:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.538+0000 7fd7d11ff700 1 -- 172.21.15.53:0/769694639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7cc0b6b00 con 0x7fd7cc0b2350 2023-07-09T21:52:10.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.539+0000 7fd7d11ff700 1 -- 172.21.15.53:0/769694639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7cc04e280 con 0x7fd7cc0b2350 2023-07-09T21:52:10.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.540+0000 7fd7b37fe700 1 -- 172.21.15.53:0/769694639 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fd7c0003c20 con 0x7fd7cc0b2350 2023-07-09T21:52:10.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.541+0000 7fd7b37fe700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd7b806ad70 0x7fd7b806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:10.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.541+0000 7fd7b37fe700 1 -- 172.21.15.53:0/769694639 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd7c0020070 con 0x7fd7cc0b2350 2023-07-09T21:52:10.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.541+0000 7fd7cad9d700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd7b806ad70 0x7fd7b806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.542+0000 7fd7cad9d700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd7b806ad70 0x7fd7b806d220 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0010e0 tx=0x7fd7bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.544+0000 7fd7b37fe700 1 -- 172.21.15.53:0/769694639 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd7c0055d20 con 0x7fd7cc0b2350 2023-07-09T21:52:10.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.833+0000 7fd7d11ff700 1 -- 172.21.15.53:0/769694639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]} v 0) v1 -- 0x7fd7cc08c5a0 con 0x7fd7cc0b2350 2023-07-09T21:52:10.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.844+0000 7fd7b37fe700 1 -- 172.21.15.53:0/769694639 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]}]=0 v124) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd7c002a0f0 con 0x7fd7cc0b2350 2023-07-09T21:52:10.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.846+0000 7fd7d11ff700 1 -- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd7b806ad70 msgr2=0x7fd7b806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.846+0000 7fd7d11ff700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd7b806ad70 0x7fd7b806d220 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0010e0 tx=0x7fd7bc009040 comp rx=0 tx=0).stop 2023-07-09T21:52:10.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.846+0000 7fd7d11ff700 1 -- 172.21.15.53:0/769694639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b2350 msgr2=0x7fd7cc0c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:10.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.846+0000 7fd7d11ff700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b2350 0x7fd7cc0c95a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00090b0 tx=0x7fd7c0004750 comp rx=0 tx=0).stop 2023-07-09T21:52:10.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.846+0000 7fd7d11ff700 1 -- 172.21.15.53:0/769694639 shutdown_connections 2023-07-09T21:52:10.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.846+0000 7fd7d11ff700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd7b806ad70 0x7fd7b806d220 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.846+0000 7fd7d11ff700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7cc0d1220 0x7fd7cc0c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.846+0000 7fd7d11ff700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7cc0b1e00 0x7fd7cc14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.846+0000 7fd7d11ff700 1 --2- 172.21.15.53:0/769694639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b2350 0x7fd7cc0c95a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:10.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.847+0000 7fd7d11ff700 1 -- 172.21.15.53:0/769694639 >> 172.21.15.53:0/769694639 conn(0x7fd7cc09c1d0 msgr2=0x7fd7cc0b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:10.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.847+0000 7fd7d11ff700 1 -- 172.21.15.53:0/769694639 shutdown_connections 2023-07-09T21:52:10.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:10.847+0000 7fd7d11ff700 1 -- 172.21.15.53:0/769694639 wait complete. 2023-07-09T21:52:10.867 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_unsupported_status (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... ok 2023-07-09T21:52:10.868 INFO:tasks.cephfs_test_runner:Starting test: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-07-09T21:52:10.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata' 2023-07-09T21:52:11.036 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:52:11.041 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:52:11.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.069+0000 7f989ddff700 1 Processor -- start 2023-07-09T21:52:11.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.070+0000 7f989ddff700 1 -- start start 2023-07-09T21:52:11.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.071+0000 7f989ddff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98980b1e00 0x7f98980b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.071+0000 7f989ddff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f98980b2350 0x7f98980d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.072+0000 7f989ddff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98980d14a0 con 0x7f98980d1050 2023-07-09T21:52:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.072+0000 7f989ddff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98980d2ce0 con 0x7f98980b2350 2023-07-09T21:52:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.072+0000 7f989ddff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98980b3350 con 0x7f98980b1e00 2023-07-09T21:52:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.072+0000 7f9897fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f98980d1050 0x7f98980afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56388/0 (socket says 172.21.15.53:56388) 2023-07-09T21:52:11.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.072+0000 7f9897fff700 1 -- 172.21.15.53:0/663861968 learned_addr learned my addr 172.21.15.53:0/663861968 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:11.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.072+0000 7f98977fe700 1 --2- 172.21.15.53:0/663861968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98980b1e00 0x7f98980b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:11.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.072+0000 7f988ffff700 1 --2- 172.21.15.53:0/663861968 >> v2:172.21.15.184:3300/0 conn(0x7f98980b2350 0x7f98980d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:11.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.072+0000 7f9896ffd700 1 -- 172.21.15.53:0/663861968 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416215614 0 0) 0x7f9890001490 con 0x7f98980d1050 2023-07-09T21:52:11.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.072+0000 7f9896ffd700 1 -- 172.21.15.53:0/663861968 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98840035b0 con 0x7f98980d1050 2023-07-09T21:52:11.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.072+0000 7f98977fe700 1 -- 172.21.15.53:0/663861968 >> v2:172.21.15.184:3300/0 conn(0x7f98980b2350 msgr2=0x7f98980d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:11.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.072+0000 7f98977fe700 1 --2- 172.21.15.53:0/663861968 >> v2:172.21.15.184:3300/0 conn(0x7f98980b2350 0x7f98980d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:11.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.072+0000 7f98977fe700 1 -- 172.21.15.53:0/663861968 >> v1:172.21.15.53:6789/0 conn(0x7f98980d1050 legacy=0x7f98980afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:11.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.073+0000 7f98977fe700 1 -- 172.21.15.53:0/663861968 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98980b3630 con 0x7f98980b1e00 2023-07-09T21:52:11.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.073+0000 7f988ffff700 1 --2- 172.21.15.53:0/663861968 >> v2:172.21.15.184:3300/0 conn(0x7f98980b2350 0x7f98980d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:52:11.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.073+0000 7f98977fe700 1 --2- 172.21.15.53:0/663861968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98980b1e00 0x7f98980b43f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9888009820 tx=0x7f9888009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f89559adc813c76b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:11.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.073+0000 7f9896ffd700 1 -- 172.21.15.53:0/663861968 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888005e30 con 0x7f98980b1e00 2023-07-09T21:52:11.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.073+0000 7f9896ffd700 1 -- 172.21.15.53:0/663861968 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9888006030 con 0x7f98980b1e00 2023-07-09T21:52:11.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.073+0000 7f9896ffd700 1 -- 172.21.15.53:0/663861968 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98880063c0 con 0x7f98980b1e00 2023-07-09T21:52:11.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.074+0000 7f989ddff700 1 -- 172.21.15.53:0/663861968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98980b1e00 msgr2=0x7f98980b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:11.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.074+0000 7f989ddff700 1 --2- 172.21.15.53:0/663861968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98980b1e00 0x7f98980b43f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9888009820 tx=0x7f9888009b30 comp rx=0 tx=0).stop 2023-07-09T21:52:11.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.074+0000 7f989ddff700 1 -- 172.21.15.53:0/663861968 shutdown_connections 2023-07-09T21:52:11.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.074+0000 7f989ddff700 1 --2- 172.21.15.53:0/663861968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98980b1e00 0x7f98980b43f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:11.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.074+0000 7f989ddff700 1 --2- 172.21.15.53:0/663861968 >> v2:172.21.15.184:3300/0 conn(0x7f98980b2350 0x7f98980d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:11.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.074+0000 7f989ddff700 1 -- 172.21.15.53:0/663861968 >> 172.21.15.53:0/663861968 conn(0x7f989809c1d0 msgr2=0x7f98980d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:11.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.074+0000 7f989ddff700 1 -- 172.21.15.53:0/663861968 shutdown_connections 2023-07-09T21:52:11.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.074+0000 7f989ddff700 1 -- 172.21.15.53:0/663861968 wait complete. 2023-07-09T21:52:11.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.076+0000 7f989ddff700 1 Processor -- start 2023-07-09T21:52:11.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.076+0000 7f989ddff700 1 -- start start 2023-07-09T21:52:11.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.077+0000 7f989ddff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980b1e00 0x7f9898150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:11.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.077+0000 7f989ddff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98980b2350 0x7f98980cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:11.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.077+0000 7f989ddff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98980d1050 0x7f98980b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:11.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.077+0000 7f989ddff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898151280 con 0x7f98980b1e00 2023-07-09T21:52:11.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.077+0000 7f989ddff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980cf370 con 0x7f98980b2350 2023-07-09T21:52:11.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.077+0000 7f989ddff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98980cf610 con 0x7f98980d1050 2023-07-09T21:52:11.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.078+0000 7f98977fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980b1e00 0x7f9898150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:11.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.078+0000 7f98977fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980b1e00 0x7f9898150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52548/0 (socket says 172.21.15.53:52548) 2023-07-09T21:52:11.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.078+0000 7f98977fe700 1 -- 172.21.15.53:0/1974526937 learned_addr learned my addr 172.21.15.53:0/1974526937 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:11.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.078+0000 7f988ffff700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98980b2350 0x7f98980cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:11.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.078+0000 7f9897fff700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98980d1050 0x7f98980b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:11.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.078+0000 7f98977fe700 1 -- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98980d1050 msgr2=0x7f98980b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:11.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.078+0000 7f98977fe700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98980d1050 0x7f98980b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:11.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.078+0000 7f98977fe700 1 -- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98980b2350 msgr2=0x7f98980cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:11.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.078+0000 7f98977fe700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98980b2350 0x7f98980cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:11.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.078+0000 7f98977fe700 1 -- 172.21.15.53:0/1974526937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98800094a0 con 0x7f98980b1e00 2023-07-09T21:52:11.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.078+0000 7f98977fe700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980b1e00 0x7f9898150d40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9888000c00 tx=0x7f9888004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:11.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.079+0000 7f9894ff9700 1 -- 172.21.15.53:0/1974526937 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98880063a0 con 0x7f98980b1e00 2023-07-09T21:52:11.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.079+0000 7f9894ff9700 1 -- 172.21.15.53:0/1974526937 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9888006500 con 0x7f98980b1e00 2023-07-09T21:52:11.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.079+0000 7f9894ff9700 1 -- 172.21.15.53:0/1974526937 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98880068b0 con 0x7f98980b1e00 2023-07-09T21:52:11.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.079+0000 7f989ddff700 1 -- 172.21.15.53:0/1974526937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9888009430 con 0x7f98980b1e00 2023-07-09T21:52:11.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.079+0000 7f989ddff700 1 -- 172.21.15.53:0/1974526937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98980cfbd0 con 0x7f98980b1e00 2023-07-09T21:52:11.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.080+0000 7f989ddff700 1 -- 172.21.15.53:0/1974526937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989804e280 con 0x7f98980b1e00 2023-07-09T21:52:11.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.081+0000 7f9894ff9700 1 -- 172.21.15.53:0/1974526937 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f9888022070 con 0x7f98980b1e00 2023-07-09T21:52:11.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.082+0000 7f9894ff9700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f987806ada0 0x7f987806d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:11.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.083+0000 7f9894ff9700 1 -- 172.21.15.53:0/1974526937 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f988808a800 con 0x7f98980b1e00 2023-07-09T21:52:11.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.083+0000 7f988ffff700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f987806ada0 0x7f987806d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:11.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.084+0000 7f988ffff700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f987806ada0 0x7f987806d250 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f98980c9c70 tx=0x7f9880009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:11.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.087+0000 7f9894ff9700 1 -- 172.21.15.53:0/1974526937 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9888055b70 con 0x7f98980b1e00 2023-07-09T21:52:11.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.387+0000 7f989ddff700 1 -- 172.21.15.53:0/1974526937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]} v 0) v1 -- 0x7f98980b1b60 con 0x7f98980b1e00 2023-07-09T21:52:11.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.849+0000 7f9894ff9700 1 -- 172.21.15.53:0/1974526937 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]}]=0 v125) v1 ==== 175+0+0 (secure 0 0 0) 0x7f9888059190 con 0x7f98980b1e00 2023-07-09T21:52:11.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.852+0000 7f989ddff700 1 -- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f987806ada0 msgr2=0x7f987806d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:11.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.852+0000 7f989ddff700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f987806ada0 0x7f987806d250 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f98980c9c70 tx=0x7f9880009210 comp rx=0 tx=0).stop 2023-07-09T21:52:11.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.852+0000 7f989ddff700 1 -- 172.21.15.53:0/1974526937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980b1e00 msgr2=0x7f9898150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:11.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.852+0000 7f989ddff700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980b1e00 0x7f9898150d40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9888000c00 tx=0x7f9888004750 comp rx=0 tx=0).stop 2023-07-09T21:52:11.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.852+0000 7f989ddff700 1 -- 172.21.15.53:0/1974526937 shutdown_connections 2023-07-09T21:52:11.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.852+0000 7f989ddff700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f987806ada0 0x7f987806d250 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:11.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.852+0000 7f989ddff700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98980d1050 0x7f98980b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:11.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.852+0000 7f989ddff700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980b1e00 0x7f9898150d40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:11.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.852+0000 7f989ddff700 1 --2- 172.21.15.53:0/1974526937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98980b2350 0x7f98980cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:11.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.852+0000 7f989ddff700 1 -- 172.21.15.53:0/1974526937 >> 172.21.15.53:0/1974526937 conn(0x7f989809c1d0 msgr2=0x7f98980b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:11.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.852+0000 7f989ddff700 1 -- 172.21.15.53:0/1974526937 shutdown_connections 2023-07-09T21:52:11.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:11.852+0000 7f989ddff700 1 -- 172.21.15.53:0/1974526937 wait complete. 2023-07-09T21:52:11.874 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T21:52:12.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.078+0000 7f8363dff700 1 Processor -- start 2023-07-09T21:52:12.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.078+0000 7f8363dff700 1 -- start start 2023-07-09T21:52:12.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.079+0000 7f8363dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f835c071650 0x7f835c0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.079+0000 7f8363dff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f835c160d60 con 0x7f835c1608e0 2023-07-09T21:52:12.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.079+0000 7f8363dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f835c0cdba0 con 0x7f835c069f30 2023-07-09T21:52:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.079+0000 7f8363dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835c0cf370 con 0x7f835c071650 2023-07-09T21:52:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.079+0000 7f836239c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f835c1608e0 0x7f835c167560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56402/0 (socket says 172.21.15.53:56402) 2023-07-09T21:52:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.079+0000 7f836239c700 1 -- 172.21.15.53:0/2899475700 learned_addr learned my addr 172.21.15.53:0/2899475700 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:12.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.079+0000 7f8361b9b700 1 --2- 172.21.15.53:0/2899475700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f835c071650 0x7f835c0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237311556 0 0) 0x7f8354001490 con 0x7f835c1608e0 2023-07-09T21:52:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83480035b0 con 0x7f835c1608e0 2023-07-09T21:52:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328546630 0 0) 0x7f835c0cdba0 con 0x7f835c069f30 2023-07-09T21:52:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8354001490 con 0x7f835c069f30 2023-07-09T21:52:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1835515511 0 0) 0x7f83480035b0 con 0x7f835c1608e0 2023-07-09T21:52:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f835c071650 msgr2=0x7f835c0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:12.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 --2- 172.21.15.53:0/2899475700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f835c071650 0x7f835c0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 >> v1:172.21.15.184:6789/0 conn(0x7f835c069f30 legacy=0x7f835c1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:12.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c0cf650 con 0x7f835c1608e0 2023-07-09T21:52:12.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f8354001b80 con 0x7f835c1608e0 2023-07-09T21:52:12.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 >> v1:172.21.15.53:6789/0 conn(0x7f835c1608e0 legacy=0x7f835c167560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:12.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 --2- 172.21.15.53:0/2899475700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8348003bc0 0x7f8348003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 --2- 172.21.15.53:0/2899475700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8348004850 0x7f8348004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 --2- 172.21.15.53:0/2899475700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f835c071650 0x7f8348005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c0cf370 con 0x7f8348003bc0 2023-07-09T21:52:12.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834800bac0 con 0x7f8348004850 2023-07-09T21:52:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834800bc30 con 0x7f835c071650 2023-07-09T21:52:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.080+0000 7f8361b9b700 1 --2- 172.21.15.53:0/2899475700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8348003bc0 0x7f8348003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.081+0000 7f836139a700 1 --2- 172.21.15.53:0/2899475700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8348004850 0x7f8348004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.081+0000 7f836239c700 1 --2- 172.21.15.53:0/2899475700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f835c071650 0x7f8348005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.081+0000 7f8361b9b700 1 -- 172.21.15.53:0/2899475700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f835c071650 msgr2=0x7f8348005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.081+0000 7f8361b9b700 1 --2- 172.21.15.53:0/2899475700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f835c071650 0x7f8348005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.081+0000 7f8361b9b700 1 -- 172.21.15.53:0/2899475700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8348004850 msgr2=0x7f8348004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.081+0000 7f8361b9b700 1 --2- 172.21.15.53:0/2899475700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8348004850 0x7f8348004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.081+0000 7f8361b9b700 1 -- 172.21.15.53:0/2899475700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83480035b0 con 0x7f8348003bc0 2023-07-09T21:52:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.081+0000 7f8361b9b700 1 --2- 172.21.15.53:0/2899475700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8348003bc0 0x7f8348003fb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8358009b60 tx=0x7f8348005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56510b2bec261ddb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:12.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.081+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835800e6c0 con 0x7f8348003bc0 2023-07-09T21:52:12.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.081+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835800e820 con 0x7f8348003bc0 2023-07-09T21:52:12.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.081+0000 7f8360b99700 1 -- 172.21.15.53:0/2899475700 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835800eb90 con 0x7f8348003bc0 2023-07-09T21:52:12.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.082+0000 7f8363dff700 1 -- 172.21.15.53:0/2899475700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8348003bc0 msgr2=0x7f8348003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:12.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.082+0000 7f8363dff700 1 --2- 172.21.15.53:0/2899475700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8348003bc0 0x7f8348003fb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8358009b60 tx=0x7f8348005880 comp rx=0 tx=0).stop 2023-07-09T21:52:12.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.082+0000 7f836239c700 1 -- 172.21.15.53:0/2899475700 reap_dead start 2023-07-09T21:52:12.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.082+0000 7f8363dff700 1 -- 172.21.15.53:0/2899475700 shutdown_connections 2023-07-09T21:52:12.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.082+0000 7f8363dff700 1 -- 172.21.15.53:0/2899475700 >> 172.21.15.53:0/2899475700 conn(0x7f835c0cc640 msgr2=0x7f835c0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:12.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.082+0000 7f8363dff700 1 -- 172.21.15.53:0/2899475700 shutdown_connections 2023-07-09T21:52:12.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.082+0000 7f8363dff700 1 -- 172.21.15.53:0/2899475700 wait complete. 2023-07-09T21:52:12.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.084+0000 7f8363dff700 1 Processor -- start 2023-07-09T21:52:12.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.084+0000 7f8363dff700 1 -- start start 2023-07-09T21:52:12.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.085+0000 7f8363dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8348003bc0 0x7f835c0ad610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.085+0000 7f8363dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f835c0b1bd0 0x7f835c14abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.085+0000 7f8363dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f835c0b2040 0x7f835c14b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.085+0000 7f8363dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c0b59a0 con 0x7f835c0b2040 2023-07-09T21:52:12.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.085+0000 7f8363dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c0b5100 con 0x7f8348003bc0 2023-07-09T21:52:12.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.085+0000 7f8363dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835c0b53e0 con 0x7f835c0b1bd0 2023-07-09T21:52:12.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.085+0000 7f836239c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f835c0b2040 0x7f835c14b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.085+0000 7f836239c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f835c0b2040 0x7f835c14b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52570/0 (socket says 172.21.15.53:52570) 2023-07-09T21:52:12.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.085+0000 7f836239c700 1 -- 172.21.15.53:0/1015219068 learned_addr learned my addr 172.21.15.53:0/1015219068 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:12.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.085+0000 7f8361b9b700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8348003bc0 0x7f835c0ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.085+0000 7f836139a700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f835c0b1bd0 0x7f835c14abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.086+0000 7f836239c700 1 -- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f835c0b1bd0 msgr2=0x7f835c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:12.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.086+0000 7f836239c700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f835c0b1bd0 0x7f835c14abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.086+0000 7f836239c700 1 -- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8348003bc0 msgr2=0x7f835c0ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:12.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.086+0000 7f836239c700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8348003bc0 0x7f835c0ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.086+0000 7f836239c700 1 -- 172.21.15.53:0/1015219068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c0b56c0 con 0x7f835c0b2040 2023-07-09T21:52:12.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.086+0000 7f836239c700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f835c0b2040 0x7f835c14b120 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8354001330 tx=0x7f8354007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:12.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.086+0000 7f83527fc700 1 -- 172.21.15.53:0/1015219068 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835400ee70 con 0x7f835c0b2040 2023-07-09T21:52:12.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.086+0000 7f83527fc700 1 -- 172.21.15.53:0/1015219068 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8354013420 con 0x7f835c0b2040 2023-07-09T21:52:12.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.086+0000 7f8363dff700 1 -- 172.21.15.53:0/1015219068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835c0af630 con 0x7f835c0b2040 2023-07-09T21:52:12.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.086+0000 7f83527fc700 1 -- 172.21.15.53:0/1015219068 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83540137d0 con 0x7f835c0b2040 2023-07-09T21:52:12.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.086+0000 7f8363dff700 1 -- 172.21.15.53:0/1015219068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835c0add30 con 0x7f835c0b2040 2023-07-09T21:52:12.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.087+0000 7f8363dff700 1 -- 172.21.15.53:0/1015219068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835c074350 con 0x7f835c0b2040 2023-07-09T21:52:12.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.088+0000 7f83527fc700 1 -- 172.21.15.53:0/1015219068 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f8354013930 con 0x7f835c0b2040 2023-07-09T21:52:12.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.091+0000 7f83527fc700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f834006ad70 0x7f834006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.091+0000 7f83527fc700 1 -- 172.21.15.53:0/1015219068 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f83540895a0 con 0x7f835c0b2040 2023-07-09T21:52:12.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.091+0000 7f8361b9b700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f834006ad70 0x7f834006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.091+0000 7f8361b9b700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f834006ad70 0x7f834006d220 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f83580090b0 tx=0x7f835801f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:12.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.095+0000 7f83527fc700 1 -- 172.21.15.53:0/1015219068 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f83540583a0 con 0x7f835c0b2040 2023-07-09T21:52:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.300+0000 7f8363dff700 1 -- 172.21.15.53:0/1015219068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f835c160d60 con 0x7f835c0b2040 2023-07-09T21:52:12.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.304+0000 7f83527fc700 1 -- 172.21.15.53:0/1015219068 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f835c160d60 con 0x7f835c0b2040 2023-07-09T21:52:12.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.307+0000 7f8363dff700 1 -- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f834006ad70 msgr2=0x7f834006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:12.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.307+0000 7f8363dff700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f834006ad70 0x7f834006d220 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f83580090b0 tx=0x7f835801f040 comp rx=0 tx=0).stop 2023-07-09T21:52:12.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.307+0000 7f8363dff700 1 -- 172.21.15.53:0/1015219068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f835c0b2040 msgr2=0x7f835c14b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:12.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.307+0000 7f8363dff700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f835c0b2040 0x7f835c14b120 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8354001330 tx=0x7f8354007c90 comp rx=0 tx=0).stop 2023-07-09T21:52:12.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.307+0000 7f8363dff700 1 -- 172.21.15.53:0/1015219068 shutdown_connections 2023-07-09T21:52:12.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.307+0000 7f8363dff700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f834006ad70 0x7f834006d220 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.307+0000 7f8363dff700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f835c0b2040 0x7f835c14b120 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.307+0000 7f8363dff700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8348003bc0 0x7f835c0ad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.307+0000 7f8363dff700 1 --2- 172.21.15.53:0/1015219068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f835c0b1bd0 0x7f835c14abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.307+0000 7f8363dff700 1 -- 172.21.15.53:0/1015219068 >> 172.21.15.53:0/1015219068 conn(0x7f835c0cc640 msgr2=0x7f835c0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.307+0000 7f8363dff700 1 -- 172.21.15.53:0/1015219068 shutdown_connections 2023-07-09T21:52:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.307+0000 7f8363dff700 1 -- 172.21.15.53:0/1015219068 wait complete. 2023-07-09T21:52:12.327 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:52:12.327 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:52:12.432 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:52:12.576 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:52:12.577 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:52:12.577 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:12.621 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348820k,nr_inodes=4087205,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-09T21:52:12.621 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:52:12.622 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:12.665 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345736k,nr_inodes=4086434,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-09T21:52:12.666 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:52:12.666 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:12.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348820k,nr_inodes=4087205,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-09T21:52:12.711 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:52:12.711 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:12.754 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345736k,nr_inodes=4086434,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-09T21:52:12.755 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T21:52:12.755 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:52:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.955+0000 7f70383ff700 1 Processor -- start 2023-07-09T21:52:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.955+0000 7f70383ff700 1 -- start start 2023-07-09T21:52:12.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.956+0000 7f70383ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f70300b1e00 0x7f70300b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.956+0000 7f70383ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70300b2350 0x7f70300d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.956+0000 7f70383ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70300d2ce0 con 0x7f70300d1050 2023-07-09T21:52:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.956+0000 7f70383ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70300d14d0 con 0x7f70300b2350 2023-07-09T21:52:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.956+0000 7f70383ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70300b3350 con 0x7f70300b1e00 2023-07-09T21:52:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.956+0000 7f703599a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70300b2350 0x7f70300d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.956+0000 7f703599a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70300b2350 0x7f70300d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47576/0 (socket says 172.21.15.53:47576) 2023-07-09T21:52:12.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.956+0000 7f703599a700 1 -- 172.21.15.53:0/140681153 learned_addr learned my addr 172.21.15.53:0/140681153 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:12.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.956+0000 7f703699c700 1 --1- 172.21.15.53:0/140681153 >> v1:172.21.15.53:6789/0 conn(0x7f70300d1050 0x7f70300afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39778/0 (socket says 172.21.15.53:39778) 2023-07-09T21:52:12.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.956+0000 7f703619b700 1 --2- 172.21.15.53:0/140681153 >> v2:172.21.15.184:3300/0 conn(0x7f70300b1e00 0x7f70300b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.957+0000 7f703599a700 1 -- 172.21.15.53:0/140681153 >> v2:172.21.15.184:3300/0 conn(0x7f70300b1e00 msgr2=0x7f70300b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:12.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.957+0000 7f703599a700 1 --2- 172.21.15.53:0/140681153 >> v2:172.21.15.184:3300/0 conn(0x7f70300b1e00 0x7f70300b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.957+0000 7f703599a700 1 -- 172.21.15.53:0/140681153 >> v1:172.21.15.53:6789/0 conn(0x7f70300d1050 legacy=0x7f70300afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:12.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.957+0000 7f703599a700 1 -- 172.21.15.53:0/140681153 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70300b3630 con 0x7f70300b2350 2023-07-09T21:52:12.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.957+0000 7f703619b700 1 --2- 172.21.15.53:0/140681153 >> v2:172.21.15.184:3300/0 conn(0x7f70300b1e00 0x7f70300b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:12.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.957+0000 7f703599a700 1 --2- 172.21.15.53:0/140681153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300b2350 0x7f70300d0b10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f703008d170 tx=0x7f7020009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4120e33ca7f7cee server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:12.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.957+0000 7f7035199700 1 -- 172.21.15.53:0/140681153 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702000b870 con 0x7f70300b2350 2023-07-09T21:52:12.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.957+0000 7f7035199700 1 -- 172.21.15.53:0/140681153 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702000b9d0 con 0x7f70300b2350 2023-07-09T21:52:12.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.957+0000 7f7035199700 1 -- 172.21.15.53:0/140681153 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702000bd60 con 0x7f70300b2350 2023-07-09T21:52:12.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.958+0000 7f70383ff700 1 -- 172.21.15.53:0/140681153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300b2350 msgr2=0x7f70300d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:12.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.958+0000 7f70383ff700 1 --2- 172.21.15.53:0/140681153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300b2350 0x7f70300d0b10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f703008d170 tx=0x7f7020009bd0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.958+0000 7f70383ff700 1 -- 172.21.15.53:0/140681153 shutdown_connections 2023-07-09T21:52:12.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.958+0000 7f70383ff700 1 --2- 172.21.15.53:0/140681153 >> v2:172.21.15.184:3300/0 conn(0x7f70300b1e00 0x7f70300b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.958+0000 7f70383ff700 1 --2- 172.21.15.53:0/140681153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300b2350 0x7f70300d0b10 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.958+0000 7f70383ff700 1 -- 172.21.15.53:0/140681153 >> 172.21.15.53:0/140681153 conn(0x7f703009c1d0 msgr2=0x7f70300d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:12.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.958+0000 7f70383ff700 1 -- 172.21.15.53:0/140681153 shutdown_connections 2023-07-09T21:52:12.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.958+0000 7f70383ff700 1 -- 172.21.15.53:0/140681153 wait complete. 2023-07-09T21:52:12.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.960+0000 7f70383ff700 1 Processor -- start 2023-07-09T21:52:12.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.960+0000 7f70383ff700 1 -- start start 2023-07-09T21:52:12.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f70383ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70300b1e00 0x7f7030155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f70383ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300b2350 0x7f70300c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f70383ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70300d1050 0x7f703015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f70383ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70300ce200 con 0x7f70300b2350 2023-07-09T21:52:12.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f70383ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70300cd5f0 con 0x7f70300d1050 2023-07-09T21:52:12.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f70383ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70300cd8d0 con 0x7f70300b1e00 2023-07-09T21:52:12.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f703599a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300b2350 0x7f70300c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f703599a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300b2350 0x7f70300c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47582/0 (socket says 172.21.15.53:47582) 2023-07-09T21:52:12.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f703599a700 1 -- 172.21.15.53:0/2493888133 learned_addr learned my addr 172.21.15.53:0/2493888133 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:12.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f703699c700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70300d1050 0x7f703015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f703619b700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70300b1e00 0x7f7030155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f703599a700 1 -- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70300b1e00 msgr2=0x7f7030155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:12.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f703599a700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70300b1e00 0x7f7030155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f703599a700 1 -- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70300d1050 msgr2=0x7f703015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:12.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f703599a700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70300d1050 0x7f703015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:12.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f703599a700 1 -- 172.21.15.53:0/2493888133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7020009550 con 0x7f70300b2350 2023-07-09T21:52:12.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.961+0000 7f703619b700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70300b1e00 0x7f7030155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:12.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.962+0000 7f703599a700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300b2350 0x7f70300c72f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7020000c00 tx=0x7f7020004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:12.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.962+0000 7f7026ffd700 1 -- 172.21.15.53:0/2493888133 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020004310 con 0x7f70300b2350 2023-07-09T21:52:12.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.962+0000 7f7026ffd700 1 -- 172.21.15.53:0/2493888133 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702001e070 con 0x7f70300b2350 2023-07-09T21:52:12.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.962+0000 7f7026ffd700 1 -- 172.21.15.53:0/2493888133 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70200036a0 con 0x7f70300b2350 2023-07-09T21:52:12.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.962+0000 7f70383ff700 1 -- 172.21.15.53:0/2493888133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70300cdbb0 con 0x7f70300b2350 2023-07-09T21:52:12.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.962+0000 7f70383ff700 1 -- 172.21.15.53:0/2493888133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70301559b0 con 0x7f70300b2350 2023-07-09T21:52:12.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.963+0000 7f70383ff700 1 -- 172.21.15.53:0/2493888133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703004e280 con 0x7f70300b2350 2023-07-09T21:52:12.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.964+0000 7f7026ffd700 1 -- 172.21.15.53:0/2493888133 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f7020020030 con 0x7f70300b2350 2023-07-09T21:52:12.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.965+0000 7f7026ffd700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f701406ad70 0x7f701406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:12.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.965+0000 7f7026ffd700 1 -- 172.21.15.53:0/2493888133 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f702008a1f0 con 0x7f70300b2350 2023-07-09T21:52:12.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.966+0000 7f703619b700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f701406ad70 0x7f701406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:12.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.966+0000 7f703619b700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f701406ad70 0x7f701406d220 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7030159a10 tx=0x7f702c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:12.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:12.970+0000 7f7026ffd700 1 -- 172.21.15.53:0/2493888133 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7020055680 con 0x7f70300b2350 2023-07-09T21:52:13.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.224+0000 7f70383ff700 1 -- 172.21.15.53:0/2493888133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f703008c5a0 con 0x7f70300b2350 2023-07-09T21:52:13.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.224+0000 7f7026ffd700 1 -- 172.21.15.53:0/2493888133 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f7020058ca0 con 0x7f70300b2350 2023-07-09T21:52:13.226 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:13.226 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2100879728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2100879728},{"type":"v1","addr":"172.21.15.184:6837","nonce":2100879728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3650266673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3650266673},{"type":"v1","addr":"172.21.15.53:6834","nonce":3650266673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1905516924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1905516924},{"type":"v1","addr":"172.21.15.53:6835","nonce":1905516924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/2145694096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":2145694096},{"type":"v1","addr":"172.21.15.184:6836","nonce":2145694096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[]} 2023-07-09T21:52:13.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.227+0000 7f70383ff700 1 -- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f701406ad70 msgr2=0x7f701406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:13.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.227+0000 7f70383ff700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f701406ad70 0x7f701406d220 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7030159a10 tx=0x7f702c008040 comp rx=0 tx=0).stop 2023-07-09T21:52:13.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.227+0000 7f70383ff700 1 -- 172.21.15.53:0/2493888133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300b2350 msgr2=0x7f70300c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:13.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.227+0000 7f70383ff700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300b2350 0x7f70300c72f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7020000c00 tx=0x7f7020004750 comp rx=0 tx=0).stop 2023-07-09T21:52:13.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.227+0000 7f70383ff700 1 -- 172.21.15.53:0/2493888133 shutdown_connections 2023-07-09T21:52:13.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.227+0000 7f70383ff700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f701406ad70 0x7f701406d220 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:13.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.227+0000 7f70383ff700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70300d1050 0x7f703015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:13.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.227+0000 7f70383ff700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70300b1e00 0x7f7030155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:13.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.227+0000 7f70383ff700 1 --2- 172.21.15.53:0/2493888133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300b2350 0x7f70300c72f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:13.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.227+0000 7f70383ff700 1 -- 172.21.15.53:0/2493888133 >> 172.21.15.53:0/2493888133 conn(0x7f703009c1d0 msgr2=0x7f70300b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:13.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.227+0000 7f70383ff700 1 -- 172.21.15.53:0/2493888133 shutdown_connections 2023-07-09T21:52:13.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.227+0000 7f70383ff700 1 -- 172.21.15.53:0/2493888133 wait complete. 2023-07-09T21:52:13.230 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 20 2023-07-09T21:52:13.246 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T21:52:13.246 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T21:52:13.246 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T21:52:13.247 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:52:13.247 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T21:52:13.247 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T21:52:13.247 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T21:52:13.248 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:52:13.248 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T21:52:13.248 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T21:52:13.248 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T21:52:13.249 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:52:13.249 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T21:52:13.249 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T21:52:13.249 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T21:52:13.249 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:52:13.262 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T21:52:13.262 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T21:52:13.263 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T21:52:13.264 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T21:52:13.265 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T21:52:13.265 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T21:52:13.266 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T21:52:13.266 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T21:52:13.306 INFO:tasks.ceph.mds.a:Started 2023-07-09T21:52:13.307 DEBUG:teuthology.parallel:result is None 2023-07-09T21:52:13.309 INFO:tasks.ceph.mds.c:Started 2023-07-09T21:52:13.309 DEBUG:teuthology.parallel:result is None 2023-07-09T21:52:13.310 INFO:tasks.ceph.mds.d:Started 2023-07-09T21:52:13.310 DEBUG:teuthology.parallel:result is None 2023-07-09T21:52:13.312 INFO:tasks.ceph.mds.b:Started 2023-07-09T21:52:13.312 DEBUG:teuthology.parallel:result is None 2023-07-09T21:52:13.313 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T21:52:13.453 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-07-09T21:52:13.454 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-07-09T21:52:13.456 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-07-09T21:52:13.457 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-07-09T21:52:13.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.520+0000 7f13e5dff700 1 Processor -- start 2023-07-09T21:52:13.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.520+0000 7f13e5dff700 1 -- start start 2023-07-09T21:52:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.521+0000 7f13e5dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13e00b1910 0x7f13e0071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.521+0000 7f13e5dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13e00b1d60 0x7f13e00716b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.521+0000 7f13e5dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e006bcc0 con 0x7f13e006c9f0 2023-07-09T21:52:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.521+0000 7f13e5dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e015ddf0 con 0x7f13e00b1d60 2023-07-09T21:52:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.521+0000 7f13e5dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e006c4e0 con 0x7f13e00b1910 2023-07-09T21:52:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.522+0000 7f13deffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13e00b1910 0x7f13e0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:13.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.522+0000 7f13df7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f13e006c9f0 0x7f13e006b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:56176/0 (socket says 172.21.15.53:56176) 2023-07-09T21:52:13.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.522+0000 7f13deffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13e00b1910 0x7f13e0071170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:55526/0 (socket says 172.21.15.53:55526) 2023-07-09T21:52:13.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.522+0000 7f13dffff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13e00b1d60 0x7f13e00716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:13.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.522+0000 7f13df7fe700 1 -- 172.21.15.53:0/1334011080 learned_addr learned my addr 172.21.15.53:0/1334011080 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.522+0000 7f13de7fc700 1 -- 172.21.15.53:0/1334011080 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535250065 0 0) 0x7f13e006bcc0 con 0x7f13e006c9f0 2023-07-09T21:52:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.522+0000 7f13de7fc700 1 -- 172.21.15.53:0/1334011080 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c80035b0 con 0x7f13e006c9f0 2023-07-09T21:52:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.522+0000 7f13dffff700 1 -- 172.21.15.53:0/1334011080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13e00b1910 msgr2=0x7f13e0071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.522+0000 7f13dffff700 1 --2- 172.21.15.53:0/1334011080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13e00b1910 0x7f13e0071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.522+0000 7f13dffff700 1 -- 172.21.15.53:0/1334011080 >> v1:172.21.15.184:6789/0 conn(0x7f13e006c9f0 legacy=0x7f13e006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.522+0000 7f13dffff700 1 -- 172.21.15.53:0/1334011080 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e006bf20 con 0x7f13e00b1d60 2023-07-09T21:52:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.522+0000 7f13deffd700 1 --2- 172.21.15.53:0/1334011080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13e00b1910 0x7f13e0071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:52:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.523+0000 7f13dffff700 1 --2- 172.21.15.53:0/1334011080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e00b1d60 0x7f13e00716b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f13d8009d90 tx=0x7f13d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40cc4d8cc6be992d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.523+0000 7f13de7fc700 1 -- 172.21.15.53:0/1334011080 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d800e070 con 0x7f13e00b1d60 2023-07-09T21:52:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.523+0000 7f13de7fc700 1 -- 172.21.15.53:0/1334011080 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d800bb20 con 0x7f13e00b1d60 2023-07-09T21:52:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.523+0000 7f13de7fc700 1 -- 172.21.15.53:0/1334011080 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8012430 con 0x7f13e00b1d60 2023-07-09T21:52:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.523+0000 7f13e5dff700 1 -- 172.21.15.53:0/1334011080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e00b1d60 msgr2=0x7f13e00716b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.523+0000 7f13e5dff700 1 --2- 172.21.15.53:0/1334011080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e00b1d60 0x7f13e00716b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f13d8009d90 tx=0x7f13d800b330 comp rx=0 tx=0).stop 2023-07-09T21:52:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.523+0000 7f13e5dff700 1 -- 172.21.15.53:0/1334011080 shutdown_connections 2023-07-09T21:52:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.523+0000 7f13e5dff700 1 --2- 172.21.15.53:0/1334011080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e00b1d60 0x7f13e00716b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.523+0000 7f13e5dff700 1 --2- 172.21.15.53:0/1334011080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13e00b1910 0x7f13e0071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.523+0000 7f13e5dff700 1 -- 172.21.15.53:0/1334011080 >> 172.21.15.53:0/1334011080 conn(0x7f13e00b05d0 msgr2=0x7f13e00b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:13.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.523+0000 7f13e5dff700 1 -- 172.21.15.53:0/1334011080 shutdown_connections 2023-07-09T21:52:13.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.524+0000 7f13e5dff700 1 -- 172.21.15.53:0/1334011080 wait complete. 2023-07-09T21:52:13.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.526+0000 7f13e5dff700 1 Processor -- start 2023-07-09T21:52:13.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.526+0000 7f13e5dff700 1 -- start start 2023-07-09T21:52:13.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.527+0000 7f13e5dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13e006c9f0 0x7f13e0159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.527+0000 7f13e5dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13e00b1910 0x7f13e01efc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.527+0000 7f13e5dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e00b1d60 0x7f13e00c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.527+0000 7f13e5dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00c7180 con 0x7f13e006c9f0 2023-07-09T21:52:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.527+0000 7f13e5dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00c7460 con 0x7f13e00b1d60 2023-07-09T21:52:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.527+0000 7f13e5dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00c7740 con 0x7f13e00b1910 2023-07-09T21:52:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.528+0000 7f13df7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13e006c9f0 0x7f13e0159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.528+0000 7f13df7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13e006c9f0 0x7f13e0159de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47610/0 (socket says 172.21.15.53:47610) 2023-07-09T21:52:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.528+0000 7f13df7fe700 1 -- 172.21.15.53:0/294457880 learned_addr learned my addr 172.21.15.53:0/294457880 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.528+0000 7f13deffd700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13e00b1910 0x7f13e01efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.528+0000 7f13dffff700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e00b1d60 0x7f13e00c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.528+0000 7f13df7fe700 1 -- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13e00b1910 msgr2=0x7f13e01efc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.528+0000 7f13df7fe700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13e00b1910 0x7f13e01efc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.528+0000 7f13df7fe700 1 -- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e00b1d60 msgr2=0x7f13e00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.528+0000 7f13df7fe700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e00b1d60 0x7f13e00c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.528+0000 7f13df7fe700 1 -- 172.21.15.53:0/294457880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d40094a0 con 0x7f13e006c9f0 2023-07-09T21:52:13.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.528+0000 7f13df7fe700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13e006c9f0 0x7f13e0159de0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c700 tx=0x7f13d000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:13.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.529+0000 7f13c7fff700 1 -- 172.21.15.53:0/294457880 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0005d70 con 0x7f13e006c9f0 2023-07-09T21:52:13.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.529+0000 7f13c7fff700 1 -- 172.21.15.53:0/294457880 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d00070d0 con 0x7f13e006c9f0 2023-07-09T21:52:13.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.529+0000 7f13c7fff700 1 -- 172.21.15.53:0/294457880 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0007460 con 0x7f13e006c9f0 2023-07-09T21:52:13.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.529+0000 7f13e5dff700 1 -- 172.21.15.53:0/294457880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d8009a70 con 0x7f13e006c9f0 2023-07-09T21:52:13.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.529+0000 7f13e5dff700 1 -- 172.21.15.53:0/294457880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e00c7d00 con 0x7f13e006c9f0 2023-07-09T21:52:13.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.530+0000 7f13e5dff700 1 -- 172.21.15.53:0/294457880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e0074350 con 0x7f13e006c9f0 2023-07-09T21:52:13.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.531+0000 7f13c7fff700 1 -- 172.21.15.53:0/294457880 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f13d00075c0 con 0x7f13e006c9f0 2023-07-09T21:52:13.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.532+0000 7f13c7fff700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f13cc06ad70 0x7f13cc06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:13.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.532+0000 7f13c7fff700 1 -- 172.21.15.53:0/294457880 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f13d0088750 con 0x7f13e006c9f0 2023-07-09T21:52:13.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.533+0000 7f13deffd700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f13cc06ad70 0x7f13cc06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:13.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.533+0000 7f13deffd700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f13cc06ad70 0x7f13cc06d220 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f13e00b3bf0 tx=0x7f13d4009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:13.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.537+0000 7f13c7fff700 1 -- 172.21.15.53:0/294457880 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f13d00539a0 con 0x7f13e006c9f0 2023-07-09T21:52:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.761+0000 7f13e5dff700 1 -- 172.21.15.53:0/294457880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f13e015d2d0 con 0x7f13e006c9f0 2023-07-09T21:52:13.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.860+0000 7f13c7fff700 1 -- 172.21.15.53:0/294457880 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) v1 ==== 97+0+0 (secure 0 0 0) 0x7f13d0017080 con 0x7f13e006c9f0 2023-07-09T21:52:13.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.862+0000 7f13e5dff700 1 -- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f13cc06ad70 msgr2=0x7f13cc06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:13.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.862+0000 7f13e5dff700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f13cc06ad70 0x7f13cc06d220 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f13e00b3bf0 tx=0x7f13d4009210 comp rx=0 tx=0).stop 2023-07-09T21:52:13.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.862+0000 7f13e5dff700 1 -- 172.21.15.53:0/294457880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13e006c9f0 msgr2=0x7f13e0159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:13.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.862+0000 7f13e5dff700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13e006c9f0 0x7f13e0159de0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c700 tx=0x7f13d000ca10 comp rx=0 tx=0).stop 2023-07-09T21:52:13.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.863+0000 7f13e5dff700 1 -- 172.21.15.53:0/294457880 shutdown_connections 2023-07-09T21:52:13.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.863+0000 7f13e5dff700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f13cc06ad70 0x7f13cc06d220 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:13.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.863+0000 7f13e5dff700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e00b1d60 0x7f13e00c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:13.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.863+0000 7f13e5dff700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13e006c9f0 0x7f13e0159de0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:13.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.863+0000 7f13e5dff700 1 --2- 172.21.15.53:0/294457880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13e00b1910 0x7f13e01efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:13.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.863+0000 7f13e5dff700 1 -- 172.21.15.53:0/294457880 >> 172.21.15.53:0/294457880 conn(0x7f13e00b05d0 msgr2=0x7f13e00b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:13.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.863+0000 7f13e5dff700 1 -- 172.21.15.53:0/294457880 shutdown_connections 2023-07-09T21:52:13.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:13.863+0000 7f13e5dff700 1 -- 172.21.15.53:0/294457880 wait complete. 2023-07-09T21:52:13.866 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2023-07-09T21:52:13.884 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T21:52:14.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.082+0000 7fc3aa3ff700 1 Processor -- start 2023-07-09T21:52:14.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.083+0000 7fc3aa3ff700 1 -- start start 2023-07-09T21:52:14.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.084+0000 7fc3aa3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3a40d1220 0x7fc3a40b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:14.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.084+0000 7fc3aa3ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a40d2ce0 con 0x7fc3a40b1e00 2023-07-09T21:52:14.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.084+0000 7fc3aa3ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a40b3350 con 0x7fc3a40b2350 2023-07-09T21:52:14.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.084+0000 7fc3aa3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40b3630 con 0x7fc3a40d1220 2023-07-09T21:52:14.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.084+0000 7fc3a3fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc3a40b1e00 0x7fc3a40d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39790/0 (socket says 172.21.15.53:39790) 2023-07-09T21:52:14.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.084+0000 7fc3a3fff700 1 -- 172.21.15.53:0/2057177392 learned_addr learned my addr 172.21.15.53:0/2057177392 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:14.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.084+0000 7fc3a37fe700 1 --2- 172.21.15.53:0/2057177392 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3a40d1220 0x7fc3a40b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:14.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.085+0000 7fc3a2ffd700 1 -- 172.21.15.53:0/2057177392 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59630452 0 0) 0x7fc3a40d2ce0 con 0x7fc3a40b1e00 2023-07-09T21:52:14.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.085+0000 7fc3a2ffd700 1 -- 172.21.15.53:0/2057177392 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc38c0035b0 con 0x7fc3a40b1e00 2023-07-09T21:52:14.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.085+0000 7fc3a2ffd700 1 -- 172.21.15.53:0/2057177392 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779132298 0 0) 0x7fc3a40b3350 con 0x7fc3a40b2350 2023-07-09T21:52:14.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.085+0000 7fc3a2ffd700 1 -- 172.21.15.53:0/2057177392 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a40d2ce0 con 0x7fc3a40b2350 2023-07-09T21:52:14.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.085+0000 7fc3a37fe700 1 -- 172.21.15.53:0/2057177392 >> v1:172.21.15.184:6789/0 conn(0x7fc3a40b2350 legacy=0x7fc3a40afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.085+0000 7fc3a37fe700 1 -- 172.21.15.53:0/2057177392 >> v1:172.21.15.53:6789/0 conn(0x7fc3a40b1e00 legacy=0x7fc3a40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.085+0000 7fc3a37fe700 1 -- 172.21.15.53:0/2057177392 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40b3910 con 0x7fc3a40d1220 2023-07-09T21:52:14.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.085+0000 7fc3a37fe700 1 --2- 172.21.15.53:0/2057177392 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3a40d1220 0x7fc3a40b43f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc398009870 tx=0x7fc398009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c80642dd0609c88c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:14.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.085+0000 7fc3a2ffd700 1 -- 172.21.15.53:0/2057177392 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398011830 con 0x7fc3a40d1220 2023-07-09T21:52:14.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.086+0000 7fc3a2ffd700 1 -- 172.21.15.53:0/2057177392 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc398011990 con 0x7fc3a40d1220 2023-07-09T21:52:14.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.086+0000 7fc3a2ffd700 1 -- 172.21.15.53:0/2057177392 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398011d20 con 0x7fc3a40d1220 2023-07-09T21:52:14.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.086+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/2057177392 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3a40d1220 msgr2=0x7fc3a40b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.086+0000 7fc3aa3ff700 1 --2- 172.21.15.53:0/2057177392 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3a40d1220 0x7fc3a40b43f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc398009870 tx=0x7fc398009b80 comp rx=0 tx=0).stop 2023-07-09T21:52:14.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.086+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/2057177392 shutdown_connections 2023-07-09T21:52:14.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.086+0000 7fc3aa3ff700 1 --2- 172.21.15.53:0/2057177392 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3a40d1220 0x7fc3a40b43f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.086+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/2057177392 >> 172.21.15.53:0/2057177392 conn(0x7fc3a409c1d0 msgr2=0x7fc3a40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:14.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.086+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/2057177392 shutdown_connections 2023-07-09T21:52:14.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.086+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/2057177392 wait complete. 2023-07-09T21:52:14.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.089+0000 7fc3aa3ff700 1 Processor -- start 2023-07-09T21:52:14.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.089+0000 7fc3aa3ff700 1 -- start start 2023-07-09T21:52:14.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.090+0000 7fc3aa3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a40b1e00 0x7fc3a414a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:14.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.090+0000 7fc3aa3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3a40b2350 0x7fc3a415f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:14.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.090+0000 7fc3aa3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a40d1220 0x7fc3a415d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:14.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.090+0000 7fc3aa3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40c9420 con 0x7fc3a40b1e00 2023-07-09T21:52:14.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.090+0000 7fc3aa3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a415fc00 con 0x7fc3a40d1220 2023-07-09T21:52:14.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.090+0000 7fc3aa3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40c8810 con 0x7fc3a40b2350 2023-07-09T21:52:14.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.090+0000 7fc3a3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a40b1e00 0x7fc3a414a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:14.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.090+0000 7fc3a3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a40b1e00 0x7fc3a414a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47622/0 (socket says 172.21.15.53:47622) 2023-07-09T21:52:14.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.090+0000 7fc3a3fff700 1 -- 172.21.15.53:0/1156301722 learned_addr learned my addr 172.21.15.53:0/1156301722 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:14.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.091+0000 7fc3a3fff700 1 -- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3a40b2350 msgr2=0x7fc3a415f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.091+0000 7fc3a3fff700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3a40b2350 0x7fc3a415f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.091+0000 7fc3a3fff700 1 -- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a40d1220 msgr2=0x7fc3a415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.091+0000 7fc3a899c700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a40d1220 0x7fc3a415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:14.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.091+0000 7fc3a3fff700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a40d1220 0x7fc3a415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.091+0000 7fc3a3fff700 1 -- 172.21.15.53:0/1156301722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3980094a0 con 0x7fc3a40b1e00 2023-07-09T21:52:14.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.091+0000 7fc3a899c700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a40d1220 0x7fc3a415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:14.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.091+0000 7fc3a3fff700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a40b1e00 0x7fc3a414a4e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc39400c700 tx=0x7fc39400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:14.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.091+0000 7fc3a0ff9700 1 -- 172.21.15.53:0/1156301722 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3940074e0 con 0x7fc3a40b1e00 2023-07-09T21:52:14.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.091+0000 7fc3a0ff9700 1 -- 172.21.15.53:0/1156301722 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394007640 con 0x7fc3a40b1e00 2023-07-09T21:52:14.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.091+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/1156301722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a40c8af0 con 0x7fc3a40b1e00 2023-07-09T21:52:14.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.091+0000 7fc3a0ff9700 1 -- 172.21.15.53:0/1156301722 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394005a30 con 0x7fc3a40b1e00 2023-07-09T21:52:14.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.091+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/1156301722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a40c90b0 con 0x7fc3a40b1e00 2023-07-09T21:52:14.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.092+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/1156301722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a40b2990 con 0x7fc3a40b1e00 2023-07-09T21:52:14.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.093+0000 7fc3a0ff9700 1 -- 172.21.15.53:0/1156301722 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fc394005b90 con 0x7fc3a40b1e00 2023-07-09T21:52:14.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.094+0000 7fc3a0ff9700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc39006ad70 0x7fc39006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:14.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.094+0000 7fc3a0ff9700 1 -- 172.21.15.53:0/1156301722 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc3940886b0 con 0x7fc3a40b1e00 2023-07-09T21:52:14.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.095+0000 7fc3a37fe700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc39006ad70 0x7fc39006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:14.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.095+0000 7fc3a37fe700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc39006ad70 0x7fc39006d220 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40d1610 tx=0x7fc398010000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:14.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.099+0000 7fc3a0ff9700 1 -- 172.21.15.53:0/1156301722 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc394053a80 con 0x7fc3a40b1e00 2023-07-09T21:52:14.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.389+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/1156301722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc3a404e280 con 0x7fc3a40b1e00 2023-07-09T21:52:14.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.389+0000 7fc3a0ff9700 1 -- 172.21.15.53:0/1156301722 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc394007e60 con 0x7fc3a40b1e00 2023-07-09T21:52:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:14.391 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-07-09T21:52:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2023-07-09T21:52:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2023-07-09T21:52:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBaK6tkzRxYDRAAimNrYVSgnlKa/LcrJM21Og==", 2023-07-09T21:52:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:52:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-07-09T21:52:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-07-09T21:52:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2023-07-09T21:52:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBaK6tkki/UJRAAsJcmnMjVZOJNndECUAkiVg==", 2023-07-09T21:52:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:52:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-07-09T21:52:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-07-09T21:52:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2023-07-09T21:52:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBaK6tkhe7KGRAAoeCtYxjFHSSnSUZwu4nZ9A==", 2023-07-09T21:52:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:52:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-07-09T21:52:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-07-09T21:52:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2023-07-09T21:52:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBaK6tkRxOwMRAA+WhKRURpXJz9LaBKWuzEJw==", 2023-07-09T21:52:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:52:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-07-09T21:52:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-07-09T21:52:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2023-07-09T21:52:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBdK6tkdB3PGBAAFoeYIhy2uqAJUSbLbJdRTQ==", 2023-07-09T21:52:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:52:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:52:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2023-07-09T21:52:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBgK6tk19Y+HxAA91lQzKiiljQEMVmfr2bxWw==", 2023-07-09T21:52:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:52:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:52:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2023-07-09T21:52:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBjK6tkNiE1JhAAWcZYxoAyD+PVfSI/0KnFfA==", 2023-07-09T21:52:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:52:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:52:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2023-07-09T21:52:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBmK6tkPAJJLhAARFLACX0SY7u+6K1BOmSmdA==", 2023-07-09T21:52:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:52:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:52:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2023-07-09T21:52:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBtK6tksG3BDRAARy/avAmY0FyArpZdnZY/sQ==", 2023-07-09T21:52:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:52:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:52:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2023-07-09T21:52:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBwK6tkAHBNFBAA7ikYVig77uKzs7LWtMS8WA==", 2023-07-09T21:52:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:52:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:52:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2023-07-09T21:52:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBzK6tk9g9sGxAA//58pDJnkGJ32EBykgrJiA==", 2023-07-09T21:52:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:52:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:52:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2023-07-09T21:52:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQB2K6tkBBQ0IRAACJjUm5wbHKWR6p6ILZCCww==", 2023-07-09T21:52:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-07-09T21:52:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-07-09T21:52:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2023-07-09T21:52:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBbK6tkVu19ABAApbFrRRJdrT0qBJ/fG9bEVA==", 2023-07-09T21:52:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:52:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2023-07-09T21:52:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T21:52:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2023-07-09T21:52:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBbK6tksBxtEBAAqiQuZQNUaBcgRM4F/pgJXg==", 2023-07-09T21:52:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:52:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-07-09T21:52:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-07-09T21:52:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-07-09T21:52:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2023-07-09T21:52:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBbK6tkuTXHCBAAygsg7Xz9oRO8nT8glKJU4Q==", 2023-07-09T21:52:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:52:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-07-09T21:52:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-07-09T21:52:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-07-09T21:52:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2023-07-09T21:52:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBbK6tkiMUjGBAADn+j9WGS506PTPaSG9MJGA==", 2023-07-09T21:52:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-07-09T21:52:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-07-09T21:52:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-07-09T21:52:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-07-09T21:52:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2023-07-09T21:52:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBZK6tkUtHVDxAASQNCwvv3CraD6lYBpWf8vQ==", 2023-07-09T21:52:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-07-09T21:52:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-07-09T21:52:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-07-09T21:52:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2023-07-09T21:52:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBaK6tkwFBVBRAACJgXwd/fdCczDXJ/14KcKQ==", 2023-07-09T21:52:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-07-09T21:52:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-07-09T21:52:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2023-07-09T21:52:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBZK6tkteqHNxAA4inbbYz6IZ2Yc+cfFCe7hQ==", 2023-07-09T21:52:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-07-09T21:52:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-07-09T21:52:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-07-09T21:52:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-07-09T21:52:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-07-09T21:52:14.416 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-07-09T21:52:14.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.392+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc39006ad70 msgr2=0x7fc39006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.392+0000 7fc3aa3ff700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc39006ad70 0x7fc39006d220 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40d1610 tx=0x7fc398010000 comp rx=0 tx=0).stop 2023-07-09T21:52:14.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.392+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/1156301722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a40b1e00 msgr2=0x7fc3a414a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.392+0000 7fc3aa3ff700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a40b1e00 0x7fc3a414a4e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc39400c700 tx=0x7fc39400cac0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.392+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/1156301722 shutdown_connections 2023-07-09T21:52:14.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.392+0000 7fc3aa3ff700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc39006ad70 0x7fc39006d220 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.392+0000 7fc3aa3ff700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a40d1220 0x7fc3a415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.392+0000 7fc3aa3ff700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a40b1e00 0x7fc3a414a4e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.392+0000 7fc3aa3ff700 1 --2- 172.21.15.53:0/1156301722 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3a40b2350 0x7fc3a415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.392+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/1156301722 >> 172.21.15.53:0/1156301722 conn(0x7fc3a409c1d0 msgr2=0x7fc3a40afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.392+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/1156301722 shutdown_connections 2023-07-09T21:52:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.392+0000 7fc3aa3ff700 1 -- 172.21.15.53:0/1156301722 wait complete. 2023-07-09T21:52:14.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:52:14.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.619+0000 7fa7f83ff700 1 Processor -- start 2023-07-09T21:52:14.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.619+0000 7fa7f83ff700 1 -- start start 2023-07-09T21:52:14.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.620+0000 7fa7f83ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa7f00b4510 0x7fa7f00b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.620+0000 7fa7f83ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f00b7f50 con 0x7fa7f00d1220 2023-07-09T21:52:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.620+0000 7fa7f83ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f00b7340 con 0x7fa7f00cd590 2023-07-09T21:52:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.620+0000 7fa7f83ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f00b48e0 con 0x7fa7f00b4510 2023-07-09T21:52:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.621+0000 7fa7f619b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa7f00b4510 0x7fa7f00b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.621+0000 7fa7f699c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa7f00d1220 0x7fa7f00b83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39796/0 (socket says 172.21.15.53:39796) 2023-07-09T21:52:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.621+0000 7fa7f699c700 1 -- 172.21.15.53:0/1784842964 learned_addr learned my addr 172.21.15.53:0/1784842964 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:14.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.621+0000 7fa7f619b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa7f00b4510 0x7fa7f00b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47632/0 (socket says 172.21.15.53:47632) 2023-07-09T21:52:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.621+0000 7fa7f5199700 1 -- 172.21.15.53:0/1784842964 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907354749 0 0) 0x7fa7f00b7f50 con 0x7fa7f00d1220 2023-07-09T21:52:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.621+0000 7fa7f619b700 1 -- 172.21.15.53:0/1784842964 >> v1:172.21.15.184:6789/0 conn(0x7fa7f00cd590 legacy=0x7fa7f00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.621+0000 7fa7f619b700 1 -- 172.21.15.53:0/1784842964 >> v1:172.21.15.53:6789/0 conn(0x7fa7f00d1220 legacy=0x7fa7f00b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.621+0000 7fa7f619b700 1 -- 172.21.15.53:0/1784842964 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f00b7620 con 0x7fa7f00b4510 2023-07-09T21:52:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.621+0000 7fa7f619b700 1 --2- 172.21.15.53:0/1784842964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f00b4510 0x7fa7f00b6c80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009830 tx=0x7fa7ec009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbf942d7637f61f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.621+0000 7fa7f5199700 1 -- 172.21.15.53:0/1784842964 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec011830 con 0x7fa7f00b4510 2023-07-09T21:52:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.622+0000 7fa7f5199700 1 -- 172.21.15.53:0/1784842964 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec011990 con 0x7fa7f00b4510 2023-07-09T21:52:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.622+0000 7fa7f5199700 1 -- 172.21.15.53:0/1784842964 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec011d40 con 0x7fa7f00b4510 2023-07-09T21:52:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.622+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1784842964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f00b4510 msgr2=0x7fa7f00b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.622+0000 7fa7f83ff700 1 --2- 172.21.15.53:0/1784842964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f00b4510 0x7fa7f00b6c80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009830 tx=0x7fa7ec009b40 comp rx=0 tx=0).stop 2023-07-09T21:52:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.622+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1784842964 shutdown_connections 2023-07-09T21:52:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.622+0000 7fa7f83ff700 1 --2- 172.21.15.53:0/1784842964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f00b4510 0x7fa7f00b6c80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.622+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1784842964 >> 172.21.15.53:0/1784842964 conn(0x7fa7f009c1d0 msgr2=0x7fa7f00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.622+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1784842964 shutdown_connections 2023-07-09T21:52:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.622+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1784842964 wait complete. 2023-07-09T21:52:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.624+0000 7fa7f83ff700 1 Processor -- start 2023-07-09T21:52:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.624+0000 7fa7f83ff700 1 -- start start 2023-07-09T21:52:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.625+0000 7fa7f83ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f00b4510 0x7fa7f014dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.625+0000 7fa7f83ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7f00cd590 0x7fa7f00c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.625+0000 7fa7f83ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f00d1220 0x7fa7f00ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.625+0000 7fa7f83ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f00c7480 con 0x7fa7f00d1220 2023-07-09T21:52:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.625+0000 7fa7f83ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f00c98c0 con 0x7fa7f00cd590 2023-07-09T21:52:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.625+0000 7fa7f83ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f00c7690 con 0x7fa7f00b4510 2023-07-09T21:52:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.625+0000 7fa7f699c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f00d1220 0x7fa7f00ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.625+0000 7fa7f699c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f00d1220 0x7fa7f00ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47636/0 (socket says 172.21.15.53:47636) 2023-07-09T21:52:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.625+0000 7fa7f699c700 1 -- 172.21.15.53:0/1173982621 learned_addr learned my addr 172.21.15.53:0/1173982621 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.626+0000 7fa7f699c700 1 -- 172.21.15.53:0/1173982621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f00b4510 msgr2=0x7fa7f014dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.626+0000 7fa7f699c700 1 --2- 172.21.15.53:0/1173982621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f00b4510 0x7fa7f014dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.626+0000 7fa7f699c700 1 -- 172.21.15.53:0/1173982621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7f00cd590 msgr2=0x7fa7f00c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.626+0000 7fa7f699c700 1 --2- 172.21.15.53:0/1173982621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7f00cd590 0x7fa7f00c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.626+0000 7fa7f699c700 1 -- 172.21.15.53:0/1173982621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec009440 con 0x7fa7f00d1220 2023-07-09T21:52:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.626+0000 7fa7f699c700 1 --2- 172.21.15.53:0/1173982621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f00d1220 0x7fa7f00ca010 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800cb60 tx=0x7fa7e800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.626+0000 7fa7e6ffd700 1 -- 172.21.15.53:0/1173982621 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e800aaf0 con 0x7fa7f00d1220 2023-07-09T21:52:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.626+0000 7fa7e6ffd700 1 -- 172.21.15.53:0/1173982621 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e800ac50 con 0x7fa7f00d1220 2023-07-09T21:52:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.626+0000 7fa7e6ffd700 1 -- 172.21.15.53:0/1173982621 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e80070d0 con 0x7fa7f00d1220 2023-07-09T21:52:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.626+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1173982621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f00c7970 con 0x7fa7f00d1220 2023-07-09T21:52:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.626+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1173982621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f00c7f30 con 0x7fa7f00d1220 2023-07-09T21:52:14.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.627+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1173982621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f004e280 con 0x7fa7f00d1220 2023-07-09T21:52:14.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.628+0000 7fa7e6ffd700 1 -- 172.21.15.53:0/1173982621 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fa7e8007230 con 0x7fa7f00d1220 2023-07-09T21:52:14.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.629+0000 7fa7e6ffd700 1 --2- 172.21.15.53:0/1173982621 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa7d406ad70 0x7fa7d406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:14.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.629+0000 7fa7e6ffd700 1 -- 172.21.15.53:0/1173982621 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa7e8088d70 con 0x7fa7f00d1220 2023-07-09T21:52:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.630+0000 7fa7f619b700 1 --2- 172.21.15.53:0/1173982621 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa7d406ad70 0x7fa7d406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.631+0000 7fa7f619b700 1 --2- 172.21.15.53:0/1173982621 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa7d406ad70 0x7fa7d406d220 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009b80 tx=0x7fa7ec010000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:14.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.633+0000 7fa7e6ffd700 1 -- 172.21.15.53:0/1173982621 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa7e8054110 con 0x7fa7f00d1220 2023-07-09T21:52:14.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.842+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1173982621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7f00d0e30 con 0x7fa7f00d1220 2023-07-09T21:52:14.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.843+0000 7fa7e6ffd700 1 -- 172.21.15.53:0/1173982621 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14615 (secure 0 0 0) 0x7fa7e8057730 con 0x7fa7f00d1220 2023-07-09T21:52:14.845 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:14.845 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":47,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:52:13.867177+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:52:14.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.845+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1173982621 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa7d406ad70 msgr2=0x7fa7d406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.845+0000 7fa7f83ff700 1 --2- 172.21.15.53:0/1173982621 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa7d406ad70 0x7fa7d406d220 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009b80 tx=0x7fa7ec010000 comp rx=0 tx=0).stop 2023-07-09T21:52:14.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.845+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1173982621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f00d1220 msgr2=0x7fa7f00ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:14.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.845+0000 7fa7f83ff700 1 --2- 172.21.15.53:0/1173982621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f00d1220 0x7fa7f00ca010 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800cb60 tx=0x7fa7e800cf20 comp rx=0 tx=0).stop 2023-07-09T21:52:14.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.845+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1173982621 shutdown_connections 2023-07-09T21:52:14.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.845+0000 7fa7f83ff700 1 --2- 172.21.15.53:0/1173982621 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa7d406ad70 0x7fa7d406d220 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.845+0000 7fa7f83ff700 1 --2- 172.21.15.53:0/1173982621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f00d1220 0x7fa7f00ca010 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.845+0000 7fa7f83ff700 1 --2- 172.21.15.53:0/1173982621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f00b4510 0x7fa7f014dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.845+0000 7fa7f83ff700 1 --2- 172.21.15.53:0/1173982621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7f00cd590 0x7fa7f00c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:14.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.845+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1173982621 >> 172.21.15.53:0/1173982621 conn(0x7fa7f009c1d0 msgr2=0x7fa7f00cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:14.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.846+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1173982621 shutdown_connections 2023-07-09T21:52:14.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:14.846+0000 7fa7f83ff700 1 -- 172.21.15.53:0/1173982621 wait complete. 2023-07-09T21:52:14.868 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:52:14.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:52:15.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.069+0000 7f1a52fff700 1 Processor -- start 2023-07-09T21:52:15.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.070+0000 7f1a52fff700 1 -- start start 2023-07-09T21:52:15.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a52fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1a4c0d1220 0x7f1a4c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a52fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0b0e20 0x7f1a4c0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a52fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c0b8e80 con 0x7f1a4c0b3ff0 2023-07-09T21:52:15.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a52fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c0afaa0 con 0x7f1a4c0d1220 2023-07-09T21:52:15.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a52fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c0afd80 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a4bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1a4c0d1220 0x7f1a4c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a4bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1a4c0d1220 0x7f1a4c0b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47650/0 (socket says 172.21.15.53:47650) 2023-07-09T21:52:15.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a4bfff700 1 -- 172.21.15.53:0/3160488933 learned_addr learned my addr 172.21.15.53:0/3160488933 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:15.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a50d9b700 1 --1- 172.21.15.53:0/3160488933 >> v1:172.21.15.53:6789/0 conn(0x7f1a4c0b3ff0 0x7f1a4c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39800/0 (socket says 172.21.15.53:39800) 2023-07-09T21:52:15.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a5159c700 1 --2- 172.21.15.53:0/3160488933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0b0e20 0x7f1a4c0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a4bfff700 1 -- 172.21.15.53:0/3160488933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0b0e20 msgr2=0x7f1a4c0b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:15.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a4bfff700 1 --2- 172.21.15.53:0/3160488933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0b0e20 0x7f1a4c0b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a4bfff700 1 -- 172.21.15.53:0/3160488933 >> v1:172.21.15.53:6789/0 conn(0x7f1a4c0b3ff0 legacy=0x7f1a4c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.071+0000 7f1a4bfff700 1 -- 172.21.15.53:0/3160488933 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c0b0060 con 0x7f1a4c0d1220 2023-07-09T21:52:15.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.072+0000 7f1a5159c700 1 --2- 172.21.15.53:0/3160488933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0b0e20 0x7f1a4c0b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:15.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.072+0000 7f1a4bfff700 1 --2- 172.21.15.53:0/3160488933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a4c0d1220 0x7f1a4c0b43c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1a380098f0 tx=0x7f1a38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e43e284bca7054 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:15.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.072+0000 7f1a4b7fe700 1 -- 172.21.15.53:0/3160488933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800b8a0 con 0x7f1a4c0d1220 2023-07-09T21:52:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.072+0000 7f1a4b7fe700 1 -- 172.21.15.53:0/3160488933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3800ba00 con 0x7f1a4c0d1220 2023-07-09T21:52:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.072+0000 7f1a4b7fe700 1 -- 172.21.15.53:0/3160488933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800bd90 con 0x7f1a4c0d1220 2023-07-09T21:52:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.072+0000 7f1a52fff700 1 -- 172.21.15.53:0/3160488933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a4c0d1220 msgr2=0x7f1a4c0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.072+0000 7f1a52fff700 1 --2- 172.21.15.53:0/3160488933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a4c0d1220 0x7f1a4c0b43c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1a380098f0 tx=0x7f1a38009c00 comp rx=0 tx=0).stop 2023-07-09T21:52:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.073+0000 7f1a52fff700 1 -- 172.21.15.53:0/3160488933 shutdown_connections 2023-07-09T21:52:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.073+0000 7f1a52fff700 1 --2- 172.21.15.53:0/3160488933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0b0e20 0x7f1a4c0b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.073+0000 7f1a52fff700 1 --2- 172.21.15.53:0/3160488933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a4c0d1220 0x7f1a4c0b43c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.073+0000 7f1a52fff700 1 -- 172.21.15.53:0/3160488933 >> 172.21.15.53:0/3160488933 conn(0x7f1a4c09c1b0 msgr2=0x7f1a4c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.073+0000 7f1a52fff700 1 -- 172.21.15.53:0/3160488933 shutdown_connections 2023-07-09T21:52:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.073+0000 7f1a52fff700 1 -- 172.21.15.53:0/3160488933 wait complete. 2023-07-09T21:52:15.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.074+0000 7f1a52fff700 1 Processor -- start 2023-07-09T21:52:15.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.075+0000 7f1a52fff700 1 -- start start 2023-07-09T21:52:15.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.075+0000 7f1a52fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a4c0b0e20 0x7f1a4c156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.075+0000 7f1a52fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0b3ff0 0x7f1a4c0d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.075+0000 7f1a52fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0d1220 0x7f1a4c144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.075+0000 7f1a52fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c156ec0 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.075+0000 7f1a52fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c0cfe50 con 0x7f1a4c0d1220 2023-07-09T21:52:15.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.075+0000 7f1a52fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c145ab0 con 0x7f1a4c0b3ff0 2023-07-09T21:52:15.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.076+0000 7f1a50d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a4c0b0e20 0x7f1a4c156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.076+0000 7f1a50d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a4c0b0e20 0x7f1a4c156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47666/0 (socket says 172.21.15.53:47666) 2023-07-09T21:52:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.076+0000 7f1a50d9b700 1 -- 172.21.15.53:0/2678777669 learned_addr learned my addr 172.21.15.53:0/2678777669 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.076+0000 7f1a5159c700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0d1220 0x7f1a4c144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.076+0000 7f1a4bfff700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0b3ff0 0x7f1a4c0d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.076+0000 7f1a50d9b700 1 -- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0b3ff0 msgr2=0x7f1a4c0d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.076+0000 7f1a50d9b700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0b3ff0 0x7f1a4c0d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.076+0000 7f1a50d9b700 1 -- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0d1220 msgr2=0x7f1a4c144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.076+0000 7f1a50d9b700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0d1220 0x7f1a4c144ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.076+0000 7f1a50d9b700 1 -- 172.21.15.53:0/2678777669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a38009550 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.076+0000 7f1a50d9b700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a4c0b0e20 0x7f1a4c156980 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c520 tx=0x7f1a4000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.077+0000 7f1a497fa700 1 -- 172.21.15.53:0/2678777669 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40005cb0 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.077+0000 7f1a497fa700 1 -- 172.21.15.53:0/2678777669 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a40005e10 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.077+0000 7f1a52fff700 1 -- 172.21.15.53:0/2678777669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4c145d90 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.077+0000 7f1a497fa700 1 -- 172.21.15.53:0/2678777669 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a400072d0 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.077+0000 7f1a52fff700 1 -- 172.21.15.53:0/2678777669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c0d0820 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.078+0000 7f1a52fff700 1 -- 172.21.15.53:0/2678777669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4c074350 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.079+0000 7f1a497fa700 1 -- 172.21.15.53:0/2678777669 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f1a40007430 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.080+0000 7f1a497fa700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1a3006ada0 0x7f1a3006d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.080+0000 7f1a497fa700 1 -- 172.21.15.53:0/2678777669 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1a400885d0 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.080+0000 7f1a4bfff700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1a3006ada0 0x7f1a3006d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.081+0000 7f1a4bfff700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1a3006ada0 0x7f1a3006d250 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1a38014040 tx=0x7f1a38008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:15.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.084+0000 7f1a497fa700 1 -- 172.21.15.53:0/2678777669 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1a40053880 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.289+0000 7f1a52fff700 1 -- 172.21.15.53:0/2678777669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a4c0b8e80 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.289+0000 7f1a497fa700 1 -- 172.21.15.53:0/2678777669 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a4c0b8e80 con 0x7f1a4c0b0e20 2023-07-09T21:52:15.291 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:52:15.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.291+0000 7f1a52fff700 1 -- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1a3006ada0 msgr2=0x7f1a3006d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.291+0000 7f1a52fff700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1a3006ada0 0x7f1a3006d250 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1a38014040 tx=0x7f1a38008030 comp rx=0 tx=0).stop 2023-07-09T21:52:15.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.291+0000 7f1a52fff700 1 -- 172.21.15.53:0/2678777669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a4c0b0e20 msgr2=0x7f1a4c156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.291+0000 7f1a52fff700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a4c0b0e20 0x7f1a4c156980 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c520 tx=0x7f1a4000c8e0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.292+0000 7f1a52fff700 1 -- 172.21.15.53:0/2678777669 shutdown_connections 2023-07-09T21:52:15.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.292+0000 7f1a52fff700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1a3006ada0 0x7f1a3006d250 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.292+0000 7f1a52fff700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0d1220 0x7f1a4c144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.292+0000 7f1a52fff700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a4c0b0e20 0x7f1a4c156980 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.292+0000 7f1a52fff700 1 --2- 172.21.15.53:0/2678777669 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0b3ff0 0x7f1a4c0d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.292+0000 7f1a52fff700 1 -- 172.21.15.53:0/2678777669 >> 172.21.15.53:0/2678777669 conn(0x7f1a4c09c1b0 msgr2=0x7f1a4c0b6030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:15.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.292+0000 7f1a52fff700 1 -- 172.21.15.53:0/2678777669 shutdown_connections 2023-07-09T21:52:15.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.292+0000 7f1a52fff700 1 -- 172.21.15.53:0/2678777669 wait complete. 2023-07-09T21:52:15.311 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:52:15.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.513+0000 7f5cdb9ff700 1 Processor -- start 2023-07-09T21:52:15.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.513+0000 7f5cdb9ff700 1 -- start start 2023-07-09T21:52:15.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.514+0000 7f5cdb9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cd4071880 0x7f5cd40cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.514+0000 7f5cdb9ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd406bcc0 con 0x7f5cd40b1910 2023-07-09T21:52:15.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.514+0000 7f5cdb9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd415ddf0 con 0x7f5cd406c9f0 2023-07-09T21:52:15.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.514+0000 7f5cdb9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd406c4e0 con 0x7f5cd4071880 2023-07-09T21:52:15.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.514+0000 7f5cd8f9a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5cd40b1910 0x7f5cd4071170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39802/0 (socket says 172.21.15.53:39802) 2023-07-09T21:52:15.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.514+0000 7f5cd8f9a700 1 -- 172.21.15.53:0/1313390623 learned_addr learned my addr 172.21.15.53:0/1313390623 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:15.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.514+0000 7f5cd9f9c700 1 --2- 172.21.15.53:0/1313390623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cd4071880 0x7f5cd40cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.515+0000 7f5ccbfff700 1 -- 172.21.15.53:0/1313390623 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532071921 0 0) 0x7f5cd406bcc0 con 0x7f5cd40b1910 2023-07-09T21:52:15.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.515+0000 7f5ccbfff700 1 -- 172.21.15.53:0/1313390623 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc00035b0 con 0x7f5cd40b1910 2023-07-09T21:52:15.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.515+0000 7f5ccbfff700 1 -- 172.21.15.53:0/1313390623 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445113087 0 0) 0x7f5cd415ddf0 con 0x7f5cd406c9f0 2023-07-09T21:52:15.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.515+0000 7f5ccbfff700 1 -- 172.21.15.53:0/1313390623 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd406bcc0 con 0x7f5cd406c9f0 2023-07-09T21:52:15.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.515+0000 7f5cd9f9c700 1 -- 172.21.15.53:0/1313390623 >> v1:172.21.15.184:6789/0 conn(0x7f5cd406c9f0 legacy=0x7f5cd406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.515+0000 7f5cd9f9c700 1 -- 172.21.15.53:0/1313390623 >> v1:172.21.15.53:6789/0 conn(0x7f5cd40b1910 legacy=0x7f5cd4071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.515+0000 7f5cd9f9c700 1 -- 172.21.15.53:0/1313390623 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd406bf20 con 0x7f5cd4071880 2023-07-09T21:52:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.515+0000 7f5cd9f9c700 1 --2- 172.21.15.53:0/1313390623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cd4071880 0x7f5cd40cb3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009dc0 tx=0x7f5ccc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7dd507d662c4691 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.516+0000 7f5ccbfff700 1 -- 172.21.15.53:0/1313390623 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00e070 con 0x7f5cd4071880 2023-07-09T21:52:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.516+0000 7f5ccbfff700 1 -- 172.21.15.53:0/1313390623 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc00bb20 con 0x7f5cd4071880 2023-07-09T21:52:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.516+0000 7f5ccbfff700 1 -- 172.21.15.53:0/1313390623 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc012430 con 0x7f5cd4071880 2023-07-09T21:52:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.516+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1313390623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cd4071880 msgr2=0x7f5cd40cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.516+0000 7f5cdb9ff700 1 --2- 172.21.15.53:0/1313390623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cd4071880 0x7f5cd40cb3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009dc0 tx=0x7f5ccc00b330 comp rx=0 tx=0).stop 2023-07-09T21:52:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.516+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1313390623 shutdown_connections 2023-07-09T21:52:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.516+0000 7f5cdb9ff700 1 --2- 172.21.15.53:0/1313390623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cd4071880 0x7f5cd40cb3e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.516+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1313390623 >> 172.21.15.53:0/1313390623 conn(0x7f5cd40b05d0 msgr2=0x7f5cd40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.516+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1313390623 shutdown_connections 2023-07-09T21:52:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.516+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1313390623 wait complete. 2023-07-09T21:52:15.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.518+0000 7f5cdb9ff700 1 Processor -- start 2023-07-09T21:52:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.518+0000 7f5cdb9ff700 1 -- start start 2023-07-09T21:52:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.519+0000 7f5cdb9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cd406c9f0 0x7f5cd4153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.519+0000 7f5cdb9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cd4071880 0x7f5cd40cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.519+0000 7f5cdb9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cd40b1910 0x7f5cd40cef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.519+0000 7f5cdb9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd41f1dd0 con 0x7f5cd406c9f0 2023-07-09T21:52:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.519+0000 7f5cdb9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd41f2070 con 0x7f5cd4071880 2023-07-09T21:52:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.519+0000 7f5cdb9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd41f2350 con 0x7f5cd40b1910 2023-07-09T21:52:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.519+0000 7f5cd979b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cd406c9f0 0x7f5cd4153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.519+0000 7f5cd979b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cd406c9f0 0x7f5cd4153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47668/0 (socket says 172.21.15.53:47668) 2023-07-09T21:52:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.519+0000 7f5cd979b700 1 -- 172.21.15.53:0/1177233086 learned_addr learned my addr 172.21.15.53:0/1177233086 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.520+0000 7f5cd8f9a700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cd4071880 0x7f5cd40cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.520+0000 7f5cd9f9c700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cd40b1910 0x7f5cd40cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.520+0000 7f5cd979b700 1 -- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cd40b1910 msgr2=0x7f5cd40cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.520+0000 7f5cd979b700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cd40b1910 0x7f5cd40cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.520+0000 7f5cd979b700 1 -- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cd4071880 msgr2=0x7f5cd40cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.520+0000 7f5cd979b700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cd4071880 0x7f5cd40cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.520+0000 7f5cd979b700 1 -- 172.21.15.53:0/1177233086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc009a70 con 0x7f5cd406c9f0 2023-07-09T21:52:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.520+0000 7f5cd979b700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cd406c9f0 0x7f5cd4153f20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000c700 tx=0x7f5cd000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.520+0000 7f5cc9ffb700 1 -- 172.21.15.53:0/1177233086 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd00052d0 con 0x7f5cd406c9f0 2023-07-09T21:52:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.520+0000 7f5cc9ffb700 1 -- 172.21.15.53:0/1177233086 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd0005430 con 0x7f5cd406c9f0 2023-07-09T21:52:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.520+0000 7f5cc9ffb700 1 -- 172.21.15.53:0/1177233086 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0003880 con 0x7f5cd406c9f0 2023-07-09T21:52:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.520+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1177233086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd41f2630 con 0x7f5cd406c9f0 2023-07-09T21:52:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.521+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1177233086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd4154460 con 0x7f5cd406c9f0 2023-07-09T21:52:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.521+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1177233086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd406d760 con 0x7f5cd406c9f0 2023-07-09T21:52:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.522+0000 7f5cc9ffb700 1 -- 172.21.15.53:0/1177233086 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f5cd00039e0 con 0x7f5cd406c9f0 2023-07-09T21:52:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.523+0000 7f5cc9ffb700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5cb806ad70 0x7f5cb806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.523+0000 7f5cc9ffb700 1 -- 172.21.15.53:0/1177233086 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5cd0088640 con 0x7f5cd406c9f0 2023-07-09T21:52:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.524+0000 7f5cd8f9a700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5cb806ad70 0x7f5cb806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.524+0000 7f5cd8f9a700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5cb806ad70 0x7f5cb806d220 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40011e0 tx=0x7f5cc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.527+0000 7f5cc9ffb700 1 -- 172.21.15.53:0/1177233086 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5cd0053a10 con 0x7f5cd406c9f0 2023-07-09T21:52:15.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.733+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1177233086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5cd4074350 con 0x7f5cd406c9f0 2023-07-09T21:52:15.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.733+0000 7f5cc9ffb700 1 -- 172.21.15.53:0/1177233086 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5cd0057030 con 0x7f5cd406c9f0 2023-07-09T21:52:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:52:15.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.736+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5cb806ad70 msgr2=0x7f5cb806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.736+0000 7f5cdb9ff700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5cb806ad70 0x7f5cb806d220 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40011e0 tx=0x7f5cc4009040 comp rx=0 tx=0).stop 2023-07-09T21:52:15.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.736+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1177233086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cd406c9f0 msgr2=0x7f5cd4153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.736+0000 7f5cdb9ff700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cd406c9f0 0x7f5cd4153f20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000c700 tx=0x7f5cd000cac0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.736+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1177233086 shutdown_connections 2023-07-09T21:52:15.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.736+0000 7f5cdb9ff700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5cb806ad70 0x7f5cb806d220 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.736+0000 7f5cdb9ff700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cd40b1910 0x7f5cd40cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.736+0000 7f5cdb9ff700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cd406c9f0 0x7f5cd4153f20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.736+0000 7f5cdb9ff700 1 --2- 172.21.15.53:0/1177233086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cd4071880 0x7f5cd40cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.736+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1177233086 >> 172.21.15.53:0/1177233086 conn(0x7f5cd40b05d0 msgr2=0x7f5cd406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:15.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.736+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1177233086 shutdown_connections 2023-07-09T21:52:15.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.736+0000 7f5cdb9ff700 1 -- 172.21.15.53:0/1177233086 wait complete. 2023-07-09T21:52:15.756 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T21:52:15.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.954+0000 7fa2519ff700 1 Processor -- start 2023-07-09T21:52:15.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.955+0000 7fa2519ff700 1 -- start start 2023-07-09T21:52:15.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.956+0000 7fa2519ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa24c0cef50 0x7fa24c0d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.956+0000 7fa2519ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa24c06cbc0 0x7fa24c0d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.956+0000 7fa2519ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24c06c360 con 0x7fa24c06c7f0 2023-07-09T21:52:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.956+0000 7fa2519ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24c0d12b0 con 0x7fa24c06cbc0 2023-07-09T21:52:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.956+0000 7fa2519ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c06ba50 con 0x7fa24c0cef50 2023-07-09T21:52:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.956+0000 7fa24affd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa24c06c7f0 0x7fa24c0ce840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39810/0 (socket says 172.21.15.53:39810) 2023-07-09T21:52:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.956+0000 7fa24affd700 1 -- 172.21.15.53:0/3270572778 learned_addr learned my addr 172.21.15.53:0/3270572778 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:15.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.956+0000 7fa24b7fe700 1 --2- 172.21.15.53:0/3270572778 >> v2:172.21.15.184:3300/0 conn(0x7fa24c06cbc0 0x7fa24c0d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.956+0000 7fa243fff700 1 --2- 172.21.15.53:0/3270572778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa24c0cef50 0x7fa24c0d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.957+0000 7fa24a7fc700 1 -- 172.21.15.53:0/3270572778 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14258912 0 0) 0x7fa24c06c360 con 0x7fa24c06c7f0 2023-07-09T21:52:15.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.957+0000 7fa24a7fc700 1 -- 172.21.15.53:0/3270572778 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2380035b0 con 0x7fa24c06c7f0 2023-07-09T21:52:15.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.957+0000 7fa24b7fe700 1 -- 172.21.15.53:0/3270572778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa24c0cef50 msgr2=0x7fa24c0d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.957+0000 7fa24b7fe700 1 --2- 172.21.15.53:0/3270572778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa24c0cef50 0x7fa24c0d0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.957+0000 7fa24b7fe700 1 -- 172.21.15.53:0/3270572778 >> v1:172.21.15.53:6789/0 conn(0x7fa24c06c7f0 legacy=0x7fa24c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.957+0000 7fa24b7fe700 1 -- 172.21.15.53:0/3270572778 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c0d1b70 con 0x7fa24c06cbc0 2023-07-09T21:52:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.957+0000 7fa243fff700 1 --2- 172.21.15.53:0/3270572778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa24c0cef50 0x7fa24c0d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:52:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.957+0000 7fa24b7fe700 1 --2- 172.21.15.53:0/3270572778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa24c06cbc0 0x7fa24c0d0d70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa244009dc0 tx=0x7fa24400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99f9cc22d5ad549a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.958+0000 7fa24a7fc700 1 -- 172.21.15.53:0/3270572778 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400e070 con 0x7fa24c06cbc0 2023-07-09T21:52:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.958+0000 7fa24a7fc700 1 -- 172.21.15.53:0/3270572778 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24400bae0 con 0x7fa24c06cbc0 2023-07-09T21:52:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.958+0000 7fa24a7fc700 1 -- 172.21.15.53:0/3270572778 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400be90 con 0x7fa24c06cbc0 2023-07-09T21:52:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.958+0000 7fa2519ff700 1 -- 172.21.15.53:0/3270572778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa24c06cbc0 msgr2=0x7fa24c0d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.958+0000 7fa2519ff700 1 --2- 172.21.15.53:0/3270572778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa24c06cbc0 0x7fa24c0d0d70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa244009dc0 tx=0x7fa24400b330 comp rx=0 tx=0).stop 2023-07-09T21:52:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.958+0000 7fa2519ff700 1 -- 172.21.15.53:0/3270572778 shutdown_connections 2023-07-09T21:52:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.958+0000 7fa2519ff700 1 --2- 172.21.15.53:0/3270572778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa24c06cbc0 0x7fa24c0d0d70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.958+0000 7fa2519ff700 1 --2- 172.21.15.53:0/3270572778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa24c0cef50 0x7fa24c0d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.958+0000 7fa2519ff700 1 -- 172.21.15.53:0/3270572778 >> 172.21.15.53:0/3270572778 conn(0x7fa24c0664f0 msgr2=0x7fa24c099fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.958+0000 7fa2519ff700 1 -- 172.21.15.53:0/3270572778 shutdown_connections 2023-07-09T21:52:15.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.958+0000 7fa2519ff700 1 -- 172.21.15.53:0/3270572778 wait complete. 2023-07-09T21:52:15.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.960+0000 7fa2519ff700 1 Processor -- start 2023-07-09T21:52:15.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.960+0000 7fa2519ff700 1 -- start start 2023-07-09T21:52:15.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.961+0000 7fa2519ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa24c06c7f0 0x7fa24c0cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.961+0000 7fa2519ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa24c06cbc0 0x7fa24c158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.961+0000 7fa2519ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa24c0cef50 0x7fa24c0cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.961+0000 7fa2519ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c158da0 con 0x7fa24c06c7f0 2023-07-09T21:52:15.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.961+0000 7fa2519ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0cc270 con 0x7fa24c06cbc0 2023-07-09T21:52:15.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.961+0000 7fa2519ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0cc550 con 0x7fa24c0cef50 2023-07-09T21:52:15.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.961+0000 7fa24affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa24c06c7f0 0x7fa24c0cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.961+0000 7fa24affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa24c06c7f0 0x7fa24c0cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47678/0 (socket says 172.21.15.53:47678) 2023-07-09T21:52:15.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.961+0000 7fa24affd700 1 -- 172.21.15.53:0/2371939433 learned_addr learned my addr 172.21.15.53:0/2371939433 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:15.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.962+0000 7fa243fff700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa24c06cbc0 0x7fa24c158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.962+0000 7fa24b7fe700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa24c0cef50 0x7fa24c0cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.962+0000 7fa24affd700 1 -- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa24c0cef50 msgr2=0x7fa24c0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.962+0000 7fa24affd700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa24c0cef50 0x7fa24c0cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.962+0000 7fa24affd700 1 -- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa24c06cbc0 msgr2=0x7fa24c158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:15.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.962+0000 7fa24affd700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa24c06cbc0 0x7fa24c158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:15.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.962+0000 7fa24affd700 1 -- 172.21.15.53:0/2371939433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2340094a0 con 0x7fa24c06c7f0 2023-07-09T21:52:15.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.962+0000 7fa24affd700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa24c06c7f0 0x7fa24c0cbc60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c700 tx=0x7fa23c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:15.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.962+0000 7fa248ff9700 1 -- 172.21.15.53:0/2371939433 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c005d70 con 0x7fa24c06c7f0 2023-07-09T21:52:15.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.962+0000 7fa248ff9700 1 -- 172.21.15.53:0/2371939433 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c0070d0 con 0x7fa24c06c7f0 2023-07-09T21:52:15.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.962+0000 7fa248ff9700 1 -- 172.21.15.53:0/2371939433 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c007460 con 0x7fa24c06c7f0 2023-07-09T21:52:15.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.962+0000 7fa2519ff700 1 -- 172.21.15.53:0/2371939433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa244009a70 con 0x7fa24c06c7f0 2023-07-09T21:52:15.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.962+0000 7fa2519ff700 1 -- 172.21.15.53:0/2371939433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c0b51f0 con 0x7fa24c06c7f0 2023-07-09T21:52:15.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.963+0000 7fa2519ff700 1 -- 172.21.15.53:0/2371939433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c04e280 con 0x7fa24c06c7f0 2023-07-09T21:52:15.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.965+0000 7fa248ff9700 1 -- 172.21.15.53:0/2371939433 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fa23c0075c0 con 0x7fa24c06c7f0 2023-07-09T21:52:15.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.965+0000 7fa248ff9700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa22c06ad70 0x7fa22c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:15.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.965+0000 7fa248ff9700 1 -- 172.21.15.53:0/2371939433 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa23c088860 con 0x7fa24c06c7f0 2023-07-09T21:52:15.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.966+0000 7fa243fff700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa22c06ad70 0x7fa22c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:15.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.967+0000 7fa243fff700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa22c06ad70 0x7fa22c06d220 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0cc1a0 tx=0x7fa234008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:15.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:15.970+0000 7fa248ff9700 1 -- 172.21.15.53:0/2371939433 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa23c053b80 con 0x7fa24c06c7f0 2023-07-09T21:52:16.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.182+0000 7fa2519ff700 1 -- 172.21.15.53:0/2371939433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa24c0b5380 con 0x7fa24c06c7f0 2023-07-09T21:52:16.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.183+0000 7fa248ff9700 1 -- 172.21.15.53:0/2371939433 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa23c074e60 con 0x7fa24c06c7f0 2023-07-09T21:52:16.184 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:16.185 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-07-09T21:52:16.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:16.185 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-07-09T21:52:16.185 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-07-09T21:52:16.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-07-09T21:52:16.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:16.185 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-07-09T21:52:16.186 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-07-09T21:52:16.186 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:16.186 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-07-09T21:52:16.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.185+0000 7fa2519ff700 1 -- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa22c06ad70 msgr2=0x7fa22c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:16.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.185+0000 7fa2519ff700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa22c06ad70 0x7fa22c06d220 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0cc1a0 tx=0x7fa234008040 comp rx=0 tx=0).stop 2023-07-09T21:52:16.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.185+0000 7fa2519ff700 1 -- 172.21.15.53:0/2371939433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa24c06c7f0 msgr2=0x7fa24c0cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:16.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.185+0000 7fa2519ff700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa24c06c7f0 0x7fa24c0cbc60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c700 tx=0x7fa23c00cac0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.185+0000 7fa2519ff700 1 -- 172.21.15.53:0/2371939433 shutdown_connections 2023-07-09T21:52:16.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.185+0000 7fa2519ff700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa22c06ad70 0x7fa22c06d220 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.185+0000 7fa2519ff700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa24c0cef50 0x7fa24c0cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.185+0000 7fa2519ff700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa24c06c7f0 0x7fa24c0cbc60 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.185+0000 7fa2519ff700 1 --2- 172.21.15.53:0/2371939433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa24c06cbc0 0x7fa24c158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.185+0000 7fa2519ff700 1 -- 172.21.15.53:0/2371939433 >> 172.21.15.53:0/2371939433 conn(0x7fa24c0664f0 msgr2=0x7fa24c0b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:16.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.185+0000 7fa2519ff700 1 -- 172.21.15.53:0/2371939433 shutdown_connections 2023-07-09T21:52:16.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.185+0000 7fa2519ff700 1 -- 172.21.15.53:0/2371939433 wait complete. 2023-07-09T21:52:16.205 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T21:52:16.205 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T21:52:16.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.408+0000 7f16ab9ff700 1 Processor -- start 2023-07-09T21:52:16.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.408+0000 7f16ab9ff700 1 -- start start 2023-07-09T21:52:16.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.409+0000 7f16ab9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16a40d28a0 0x7f16a415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:16.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.409+0000 7f16ab9ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f16a40d0a30 0x7f16a40d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:16.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.409+0000 7f16ab9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f16a4160350 0x7f16a41607d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:16.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.409+0000 7f16ab9ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a40d3de0 con 0x7f16a40d0a30 2023-07-09T21:52:16.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.409+0000 7f16ab9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a415ccf0 con 0x7f16a4160350 2023-07-09T21:52:16.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.409+0000 7f16ab9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40d13e0 con 0x7f16a40d28a0 2023-07-09T21:52:16.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.409+0000 7f16a8f9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f16a40d0a30 0x7f16a40d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:16.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.409+0000 7f16a8f9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f16a40d0a30 0x7f16a40d0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47680/0 (socket says 172.21.15.53:47680) 2023-07-09T21:52:16.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.409+0000 7f16a8f9a700 1 -- 172.21.15.53:0/2166075264 learned_addr learned my addr 172.21.15.53:0/2166075264 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:16.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.409+0000 7f16a979b700 1 --2- 172.21.15.53:0/2166075264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16a40d28a0 0x7f16a415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:16.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.409+0000 7f16a9f9c700 1 --2- 172.21.15.53:0/2166075264 >> v2:172.21.15.184:3300/0 conn(0x7f16a4160350 0x7f16a41607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:16.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.410+0000 7f16a8f9a700 1 -- 172.21.15.53:0/2166075264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16a40d28a0 msgr2=0x7f16a415c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:16.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.410+0000 7f16a8f9a700 1 --2- 172.21.15.53:0/2166075264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16a40d28a0 0x7f16a415c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.410+0000 7f16a8f9a700 1 -- 172.21.15.53:0/2166075264 >> v2:172.21.15.184:3300/0 conn(0x7f16a4160350 msgr2=0x7f16a41607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:16.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.410+0000 7f16a8f9a700 1 --2- 172.21.15.53:0/2166075264 >> v2:172.21.15.184:3300/0 conn(0x7f16a4160350 0x7f16a41607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.410+0000 7f16a8f9a700 1 -- 172.21.15.53:0/2166075264 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a40d2c70 con 0x7f16a40d0a30 2023-07-09T21:52:16.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.410+0000 7f16a979b700 1 --2- 172.21.15.53:0/2166075264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16a40d28a0 0x7f16a415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:16.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.410+0000 7f16a9f9c700 1 --2- 172.21.15.53:0/2166075264 >> v2:172.21.15.184:3300/0 conn(0x7f16a4160350 0x7f16a41607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:16.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.410+0000 7f16a8f9a700 1 --2- 172.21.15.53:0/2166075264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16a40d0a30 0x7f16a40d0ea0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f16a408d670 tx=0x7f1694009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90e0fe5b0371c17 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:16.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.410+0000 7f169bfff700 1 -- 172.21.15.53:0/2166075264 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169400b860 con 0x7f16a40d0a30 2023-07-09T21:52:16.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.410+0000 7f169bfff700 1 -- 172.21.15.53:0/2166075264 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169400b9c0 con 0x7f16a40d0a30 2023-07-09T21:52:16.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.410+0000 7f169bfff700 1 -- 172.21.15.53:0/2166075264 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169400bd50 con 0x7f16a40d0a30 2023-07-09T21:52:16.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.411+0000 7f16ab9ff700 1 -- 172.21.15.53:0/2166075264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16a40d0a30 msgr2=0x7f16a40d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:16.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.411+0000 7f16ab9ff700 1 --2- 172.21.15.53:0/2166075264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16a40d0a30 0x7f16a40d0ea0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f16a408d670 tx=0x7f1694009c00 comp rx=0 tx=0).stop 2023-07-09T21:52:16.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.411+0000 7f16ab9ff700 1 -- 172.21.15.53:0/2166075264 shutdown_connections 2023-07-09T21:52:16.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.411+0000 7f16ab9ff700 1 --2- 172.21.15.53:0/2166075264 >> v2:172.21.15.184:3300/0 conn(0x7f16a4160350 0x7f16a41607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.411+0000 7f16ab9ff700 1 --2- 172.21.15.53:0/2166075264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16a40d28a0 0x7f16a415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.411+0000 7f16ab9ff700 1 --2- 172.21.15.53:0/2166075264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16a40d0a30 0x7f16a40d0ea0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.411+0000 7f16ab9ff700 1 -- 172.21.15.53:0/2166075264 >> 172.21.15.53:0/2166075264 conn(0x7f16a409c1b0 msgr2=0x7f16a40d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:16.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.411+0000 7f16ab9ff700 1 -- 172.21.15.53:0/2166075264 shutdown_connections 2023-07-09T21:52:16.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.411+0000 7f16ab9ff700 1 -- 172.21.15.53:0/2166075264 wait complete. 2023-07-09T21:52:16.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.413+0000 7f16ab9ff700 1 Processor -- start 2023-07-09T21:52:16.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.413+0000 7f16ab9ff700 1 -- start start 2023-07-09T21:52:16.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16ab9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16a40d0a30 0x7f16a40b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:16.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16ab9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16a40d28a0 0x7f16a40ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:16.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16ab9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16a4160350 0x7f16a40ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:16.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16ab9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40b7280 con 0x7f16a40d0a30 2023-07-09T21:52:16.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16ab9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40b6670 con 0x7f16a40d28a0 2023-07-09T21:52:16.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16ab9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40b6950 con 0x7f16a4160350 2023-07-09T21:52:16.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16a979b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16a40d0a30 0x7f16a40b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16a979b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16a40d0a30 0x7f16a40b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47690/0 (socket says 172.21.15.53:47690) 2023-07-09T21:52:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16a979b700 1 -- 172.21.15.53:0/3096141237 learned_addr learned my addr 172.21.15.53:0/3096141237 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16a8f9a700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16a40d28a0 0x7f16a40ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16a9f9c700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16a4160350 0x7f16a40ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16a979b700 1 -- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16a4160350 msgr2=0x7f16a40ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16a979b700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16a4160350 0x7f16a40ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16a979b700 1 -- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16a40d28a0 msgr2=0x7f16a40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16a979b700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16a40d28a0 0x7f16a40ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16a979b700 1 -- 172.21.15.53:0/3096141237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694009550 con 0x7f16a40d0a30 2023-07-09T21:52:16.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16a8f9a700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16a40d28a0 0x7f16a40ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:16.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.414+0000 7f16a9f9c700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16a4160350 0x7f16a40ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:16.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.415+0000 7f16a979b700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16a40d0a30 0x7f16a40b5c90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f16a000e810 tx=0x7f16a000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:16.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.415+0000 7f1699ffb700 1 -- 172.21.15.53:0/3096141237 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a0004230 con 0x7f16a40d0a30 2023-07-09T21:52:16.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.415+0000 7f1699ffb700 1 -- 172.21.15.53:0/3096141237 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a0004390 con 0x7f16a40d0a30 2023-07-09T21:52:16.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.415+0000 7f16ab9ff700 1 -- 172.21.15.53:0/3096141237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a40b6c30 con 0x7f16a40d0a30 2023-07-09T21:52:16.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.415+0000 7f1699ffb700 1 -- 172.21.15.53:0/3096141237 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a00036a0 con 0x7f16a40d0a30 2023-07-09T21:52:16.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.415+0000 7f16ab9ff700 1 -- 172.21.15.53:0/3096141237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a4159ad0 con 0x7f16a40d0a30 2023-07-09T21:52:16.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.416+0000 7f16ab9ff700 1 -- 172.21.15.53:0/3096141237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a4074350 con 0x7f16a40d0a30 2023-07-09T21:52:16.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.417+0000 7f1699ffb700 1 -- 172.21.15.53:0/3096141237 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f16a0003800 con 0x7f16a40d0a30 2023-07-09T21:52:16.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.419+0000 7f1699ffb700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f168806ad70 0x7f168806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:16.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.419+0000 7f1699ffb700 1 -- 172.21.15.53:0/3096141237 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f16a0088c80 con 0x7f16a40d0a30 2023-07-09T21:52:16.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.419+0000 7f16a8f9a700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f168806ad70 0x7f168806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:16.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.420+0000 7f16a8f9a700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f168806ad70 0x7f168806d220 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1694000c00 tx=0x7f1694008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:16.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.423+0000 7f1699ffb700 1 -- 172.21.15.53:0/3096141237 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f16a0054010 con 0x7f16a40d0a30 2023-07-09T21:52:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.631+0000 7f16ab9ff700 1 -- 172.21.15.53:0/3096141237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f16a406cee0 con 0x7f16a40d0a30 2023-07-09T21:52:16.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.879+0000 7f1699ffb700 1 -- 172.21.15.53:0/3096141237 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7f16a0057630 con 0x7f16a40d0a30 2023-07-09T21:52:16.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.883+0000 7f16ab9ff700 1 -- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f168806ad70 msgr2=0x7f168806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:16.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.883+0000 7f16ab9ff700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f168806ad70 0x7f168806d220 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1694000c00 tx=0x7f1694008030 comp rx=0 tx=0).stop 2023-07-09T21:52:16.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.883+0000 7f16ab9ff700 1 -- 172.21.15.53:0/3096141237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16a40d0a30 msgr2=0x7f16a40b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:16.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.883+0000 7f16ab9ff700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16a40d0a30 0x7f16a40b5c90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f16a000e810 tx=0x7f16a000ebd0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.883+0000 7f16ab9ff700 1 -- 172.21.15.53:0/3096141237 shutdown_connections 2023-07-09T21:52:16.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.883+0000 7f16ab9ff700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f168806ad70 0x7f168806d220 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.883+0000 7f16ab9ff700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16a4160350 0x7f16a40ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.883+0000 7f16ab9ff700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16a40d0a30 0x7f16a40b5c90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.883+0000 7f16ab9ff700 1 --2- 172.21.15.53:0/3096141237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16a40d28a0 0x7f16a40ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:16.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.883+0000 7f16ab9ff700 1 -- 172.21.15.53:0/3096141237 >> 172.21.15.53:0/3096141237 conn(0x7f16a409c1b0 msgr2=0x7f16a406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:16.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.883+0000 7f16ab9ff700 1 -- 172.21.15.53:0/3096141237 shutdown_connections 2023-07-09T21:52:16.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:16.884+0000 7f16ab9ff700 1 -- 172.21.15.53:0/3096141237 wait complete. 2023-07-09T21:52:16.888 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-07-09T21:52:16.906 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T21:52:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.112+0000 7f32b45ff700 1 Processor -- start 2023-07-09T21:52:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.112+0000 7f32b45ff700 1 -- start start 2023-07-09T21:52:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.113+0000 7f32b45ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32ac0b3ff0 0x7f32ac0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.113+0000 7f32b45ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f32ac0d0f90 0x7f32ac0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.113+0000 7f32b45ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac0b8e80 con 0x7f32ac0d0b10 2023-07-09T21:52:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.113+0000 7f32b45ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac0b1e30 con 0x7f32ac0b3ff0 2023-07-09T21:52:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.113+0000 7f32b45ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac0afaa0 con 0x7f32ac0d0f90 2023-07-09T21:52:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.113+0000 7f32b239b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32ac0b3ff0 0x7f32ac0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.113+0000 7f32b239b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32ac0b3ff0 0x7f32ac0b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47698/0 (socket says 172.21.15.53:47698) 2023-07-09T21:52:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.113+0000 7f32b239b700 1 -- 172.21.15.53:0/3969266409 learned_addr learned my addr 172.21.15.53:0/3969266409 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.114+0000 7f32b239b700 1 -- 172.21.15.53:0/3969266409 >> v2:172.21.15.184:3300/0 conn(0x7f32ac0d0f90 msgr2=0x7f32ac0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.114+0000 7f32b239b700 1 --2- 172.21.15.53:0/3969266409 >> v2:172.21.15.184:3300/0 conn(0x7f32ac0d0f90 0x7f32ac0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.114+0000 7f32b239b700 1 -- 172.21.15.53:0/3969266409 >> v1:172.21.15.184:6789/0 conn(0x7f32ac0d0b10 legacy=0x7f32ac0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.114+0000 7f32b239b700 1 -- 172.21.15.53:0/3969266409 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac0afd80 con 0x7f32ac0b3ff0 2023-07-09T21:52:17.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.114+0000 7f32b239b700 1 --2- 172.21.15.53:0/3969266409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32ac0b3ff0 0x7f32ac0b43c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0674e0 tx=0x7f32a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e076c7a7ab1237 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.114+0000 7f32b1399700 1 -- 172.21.15.53:0/3969266409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8004230 con 0x7f32ac0b3ff0 2023-07-09T21:52:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.114+0000 7f32b1399700 1 -- 172.21.15.53:0/3969266409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a8004390 con 0x7f32ac0b3ff0 2023-07-09T21:52:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.114+0000 7f32b1399700 1 -- 172.21.15.53:0/3969266409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a80036a0 con 0x7f32ac0b3ff0 2023-07-09T21:52:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.115+0000 7f32b45ff700 1 -- 172.21.15.53:0/3969266409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32ac0b3ff0 msgr2=0x7f32ac0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.115+0000 7f32b45ff700 1 --2- 172.21.15.53:0/3969266409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32ac0b3ff0 0x7f32ac0b43c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0674e0 tx=0x7f32a8009bd0 comp rx=0 tx=0).stop 2023-07-09T21:52:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.115+0000 7f32b45ff700 1 -- 172.21.15.53:0/3969266409 shutdown_connections 2023-07-09T21:52:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.115+0000 7f32b45ff700 1 --2- 172.21.15.53:0/3969266409 >> v2:172.21.15.184:3300/0 conn(0x7f32ac0d0f90 0x7f32ac0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.115+0000 7f32b45ff700 1 --2- 172.21.15.53:0/3969266409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32ac0b3ff0 0x7f32ac0b43c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.115+0000 7f32b45ff700 1 -- 172.21.15.53:0/3969266409 >> 172.21.15.53:0/3969266409 conn(0x7f32ac09c1b0 msgr2=0x7f32ac0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.115+0000 7f32b45ff700 1 -- 172.21.15.53:0/3969266409 shutdown_connections 2023-07-09T21:52:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.115+0000 7f32b45ff700 1 -- 172.21.15.53:0/3969266409 wait complete. 2023-07-09T21:52:17.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.117+0000 7f32b45ff700 1 Processor -- start 2023-07-09T21:52:17.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.117+0000 7f32b45ff700 1 -- start start 2023-07-09T21:52:17.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.118+0000 7f32b45ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32ac0b3ff0 0x7f32ac1574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:17.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.118+0000 7f32b45ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32ac0d0b10 0x7f32ac0cff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.118+0000 7f32b45ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32ac0d0f90 0x7f32ac0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.118+0000 7f32b45ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac157a20 con 0x7f32ac0d0b10 2023-07-09T21:52:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.118+0000 7f32b45ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac1f39c0 con 0x7f32ac0d0f90 2023-07-09T21:52:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.118+0000 7f32b45ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac1f3ca0 con 0x7f32ac0b3ff0 2023-07-09T21:52:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.118+0000 7f32b1b9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32ac0d0b10 0x7f32ac0cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.118+0000 7f32b1b9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32ac0d0b10 0x7f32ac0cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47700/0 (socket says 172.21.15.53:47700) 2023-07-09T21:52:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.118+0000 7f32b1b9a700 1 -- 172.21.15.53:0/1253167461 learned_addr learned my addr 172.21.15.53:0/1253167461 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32b239b700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32ac0b3ff0 0x7f32ac1574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32b1b9a700 1 -- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32ac0b3ff0 msgr2=0x7f32ac1574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32b2b9c700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32ac0d0f90 0x7f32ac0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32b1b9a700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32ac0b3ff0 0x7f32ac1574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32b1b9a700 1 -- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32ac0d0f90 msgr2=0x7f32ac0ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32b1b9a700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32ac0d0f90 0x7f32ac0ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32b1b9a700 1 -- 172.21.15.53:0/1253167461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a8009550 con 0x7f32ac0d0b10 2023-07-09T21:52:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32b239b700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32ac0b3ff0 0x7f32ac1574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32b2b9c700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32ac0d0f90 0x7f32ac0ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32b1b9a700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32ac0d0b10 0x7f32ac0cff80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c4a0 tx=0x7f329c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32a2ffd700 1 -- 172.21.15.53:0/1253167461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c0054e0 con 0x7f32ac0d0b10 2023-07-09T21:52:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32a2ffd700 1 -- 172.21.15.53:0/1253167461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c003680 con 0x7f32ac0d0b10 2023-07-09T21:52:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32b45ff700 1 -- 172.21.15.53:0/1253167461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac1f3f80 con 0x7f32ac0d0b10 2023-07-09T21:52:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32a2ffd700 1 -- 172.21.15.53:0/1253167461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c003a30 con 0x7f32ac0d0b10 2023-07-09T21:52:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.119+0000 7f32b45ff700 1 -- 172.21.15.53:0/1253167461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac1f4540 con 0x7f32ac0d0b10 2023-07-09T21:52:17.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.120+0000 7f32b45ff700 1 -- 172.21.15.53:0/1253167461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ac074350 con 0x7f32ac0d0b10 2023-07-09T21:52:17.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.122+0000 7f32a2ffd700 1 -- 172.21.15.53:0/1253167461 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f329c003b90 con 0x7f32ac0d0b10 2023-07-09T21:52:17.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.123+0000 7f32a2ffd700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f329006ad70 0x7f329006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:17.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.123+0000 7f32a2ffd700 1 -- 172.21.15.53:0/1253167461 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f329c0883d0 con 0x7f32ac0d0b10 2023-07-09T21:52:17.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.123+0000 7f32b239b700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f329006ad70 0x7f329006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:17.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.124+0000 7f32b239b700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f329006ad70 0x7f329006d220 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009c10 tx=0x7f32a8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:17.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.128+0000 7f32a2ffd700 1 -- 172.21.15.53:0/1253167461 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f329c053670 con 0x7f32ac0d0b10 2023-07-09T21:52:17.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.334+0000 7f32b45ff700 1 -- 172.21.15.53:0/1253167461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f32ac0b2220 con 0x7f32ac0d0b10 2023-07-09T21:52:17.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.887+0000 7f32a2ffd700 1 -- 172.21.15.53:0/1253167461 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) v1 ==== 170+0+0 (secure 0 0 0) 0x7f329c056c90 con 0x7f32ac0d0b10 2023-07-09T21:52:17.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.892+0000 7f32b45ff700 1 -- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f329006ad70 msgr2=0x7f329006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:17.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.892+0000 7f32b45ff700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f329006ad70 0x7f329006d220 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009c10 tx=0x7f32a8008030 comp rx=0 tx=0).stop 2023-07-09T21:52:17.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.892+0000 7f32b45ff700 1 -- 172.21.15.53:0/1253167461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32ac0d0b10 msgr2=0x7f32ac0cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:17.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.892+0000 7f32b45ff700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32ac0d0b10 0x7f32ac0cff80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c4a0 tx=0x7f329c00c860 comp rx=0 tx=0).stop 2023-07-09T21:52:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.892+0000 7f32b45ff700 1 -- 172.21.15.53:0/1253167461 shutdown_connections 2023-07-09T21:52:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.892+0000 7f32b45ff700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f329006ad70 0x7f329006d220 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.892+0000 7f32b45ff700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32ac0d0f90 0x7f32ac0ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.892+0000 7f32b45ff700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32ac0b3ff0 0x7f32ac1574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.892+0000 7f32b45ff700 1 --2- 172.21.15.53:0/1253167461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32ac0d0b10 0x7f32ac0cff80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.892+0000 7f32b45ff700 1 -- 172.21.15.53:0/1253167461 >> 172.21.15.53:0/1253167461 conn(0x7f32ac09c1b0 msgr2=0x7f32ac15edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:17.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.894+0000 7f32b45ff700 1 -- 172.21.15.53:0/1253167461 shutdown_connections 2023-07-09T21:52:17.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:17.898+0000 7f32b45ff700 1 -- 172.21.15.53:0/1253167461 wait complete. 2023-07-09T21:52:17.906 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-07-09T21:52:17.929 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T21:52:18.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.135+0000 7fa83a9ff700 1 Processor -- start 2023-07-09T21:52:18.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.135+0000 7fa83a9ff700 1 -- start start 2023-07-09T21:52:18.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.136+0000 7fa83a9ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8340d1220 0x7fa8340b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:18.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.136+0000 7fa83a9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8340b0e20 0x7fa8340b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:18.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.136+0000 7fa83a9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8340b8e80 con 0x7fa8340b3ff0 2023-07-09T21:52:18.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.136+0000 7fa83a9ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8340afaa0 con 0x7fa8340d1220 2023-07-09T21:52:18.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.136+0000 7fa83a9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8340afd80 con 0x7fa8340b0e20 2023-07-09T21:52:18.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.136+0000 7fa8337fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8340d1220 0x7fa8340b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:18.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.136+0000 7fa8337fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8340d1220 0x7fa8340b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47710/0 (socket says 172.21.15.53:47710) 2023-07-09T21:52:18.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.136+0000 7fa8337fe700 1 -- 172.21.15.53:0/3233231508 learned_addr learned my addr 172.21.15.53:0/3233231508 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:18.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.137+0000 7fa838f9c700 1 --2- 172.21.15.53:0/3233231508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8340b0e20 0x7fa8340b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:18.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.137+0000 7fa8337fe700 1 -- 172.21.15.53:0/3233231508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8340b0e20 msgr2=0x7fa8340b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:18.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.137+0000 7fa8337fe700 1 --2- 172.21.15.53:0/3233231508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8340b0e20 0x7fa8340b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:18.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.137+0000 7fa8337fe700 1 -- 172.21.15.53:0/3233231508 >> v1:172.21.15.184:6789/0 conn(0x7fa8340b3ff0 legacy=0x7fa8340d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:18.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.137+0000 7fa8337fe700 1 -- 172.21.15.53:0/3233231508 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8340b0060 con 0x7fa8340d1220 2023-07-09T21:52:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.137+0000 7fa8337fe700 1 --2- 172.21.15.53:0/3233231508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8340d1220 0x7fa8340b43c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa8280098f0 tx=0x7fa828009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1a4f47d42f2125 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.137+0000 7fa832ffd700 1 -- 172.21.15.53:0/3233231508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828011830 con 0x7fa8340d1220 2023-07-09T21:52:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.137+0000 7fa832ffd700 1 -- 172.21.15.53:0/3233231508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa828011990 con 0x7fa8340d1220 2023-07-09T21:52:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.138+0000 7fa832ffd700 1 -- 172.21.15.53:0/3233231508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828011d20 con 0x7fa8340d1220 2023-07-09T21:52:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.138+0000 7fa83a9ff700 1 -- 172.21.15.53:0/3233231508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8340d1220 msgr2=0x7fa8340b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.138+0000 7fa83a9ff700 1 --2- 172.21.15.53:0/3233231508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8340d1220 0x7fa8340b43c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa8280098f0 tx=0x7fa828009c00 comp rx=0 tx=0).stop 2023-07-09T21:52:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.138+0000 7fa83a9ff700 1 -- 172.21.15.53:0/3233231508 shutdown_connections 2023-07-09T21:52:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.138+0000 7fa83a9ff700 1 --2- 172.21.15.53:0/3233231508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8340b0e20 0x7fa8340b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:18.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.138+0000 7fa83a9ff700 1 --2- 172.21.15.53:0/3233231508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8340d1220 0x7fa8340b43c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:18.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.138+0000 7fa83a9ff700 1 -- 172.21.15.53:0/3233231508 >> 172.21.15.53:0/3233231508 conn(0x7fa83409c1b0 msgr2=0x7fa8340d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:18.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.138+0000 7fa83a9ff700 1 -- 172.21.15.53:0/3233231508 shutdown_connections 2023-07-09T21:52:18.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.138+0000 7fa83a9ff700 1 -- 172.21.15.53:0/3233231508 wait complete. 2023-07-09T21:52:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.140+0000 7fa83a9ff700 1 Processor -- start 2023-07-09T21:52:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.140+0000 7fa83a9ff700 1 -- start start 2023-07-09T21:52:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.141+0000 7fa83a9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8340b0e20 0x7fa834157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.141+0000 7fa83a9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8340b3ff0 0x7fa8340b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.141+0000 7fa83a9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8340d1220 0x7fa8340b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.141+0000 7fa83a9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83415f4a0 con 0x7fa8340b3ff0 2023-07-09T21:52:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.141+0000 7fa83a9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83415f780 con 0x7fa8340d1220 2023-07-09T21:52:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.141+0000 7fa83a9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83415fa60 con 0x7fa8340b0e20 2023-07-09T21:52:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.141+0000 7fa8337fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8340b3ff0 0x7fa8340b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.141+0000 7fa8337fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8340b3ff0 0x7fa8340b6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47718/0 (socket says 172.21.15.53:47718) 2023-07-09T21:52:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.141+0000 7fa8337fe700 1 -- 172.21.15.53:0/46846514 learned_addr learned my addr 172.21.15.53:0/46846514 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.141+0000 7fa833fff700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8340b0e20 0x7fa834157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.142+0000 7fa838f9c700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8340d1220 0x7fa8340b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.142+0000 7fa8337fe700 1 -- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8340b0e20 msgr2=0x7fa834157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:18.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.142+0000 7fa8337fe700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8340b0e20 0x7fa834157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:18.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.142+0000 7fa8337fe700 1 -- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8340d1220 msgr2=0x7fa8340b6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:18.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.142+0000 7fa8337fe700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8340d1220 0x7fa8340b6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:18.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.142+0000 7fa8337fe700 1 -- 172.21.15.53:0/46846514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa828009550 con 0x7fa8340b3ff0 2023-07-09T21:52:18.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.142+0000 7fa8337fe700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8340b3ff0 0x7fa8340b6610 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa828009c40 tx=0x7fa828004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:18.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.142+0000 7fa830ff9700 1 -- 172.21.15.53:0/46846514 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828004590 con 0x7fa8340b3ff0 2023-07-09T21:52:18.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.142+0000 7fa830ff9700 1 -- 172.21.15.53:0/46846514 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82801e070 con 0x7fa8340b3ff0 2023-07-09T21:52:18.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.142+0000 7fa830ff9700 1 -- 172.21.15.53:0/46846514 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8280038e0 con 0x7fa8340b3ff0 2023-07-09T21:52:18.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.142+0000 7fa83a9ff700 1 -- 172.21.15.53:0/46846514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8340ca190 con 0x7fa8340b3ff0 2023-07-09T21:52:18.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.143+0000 7fa83a9ff700 1 -- 172.21.15.53:0/46846514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83415e6f0 con 0x7fa8340b3ff0 2023-07-09T21:52:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.143+0000 7fa83a9ff700 1 -- 172.21.15.53:0/46846514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8340c9ff0 con 0x7fa8340b3ff0 2023-07-09T21:52:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.145+0000 7fa830ff9700 1 -- 172.21.15.53:0/46846514 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fa828003a40 con 0x7fa8340b3ff0 2023-07-09T21:52:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.146+0000 7fa830ff9700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa82006ad70 0x7fa82006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.146+0000 7fa830ff9700 1 -- 172.21.15.53:0/46846514 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fa82808a5d0 con 0x7fa8340b3ff0 2023-07-09T21:52:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.146+0000 7fa833fff700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa82006ad70 0x7fa82006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.147+0000 7fa833fff700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa82006ad70 0x7fa82006d220 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa8341f5680 tx=0x7fa824009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:18.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.149+0000 7fa830ff9700 1 -- 172.21.15.53:0/46846514 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa828055700 con 0x7fa8340b3ff0 2023-07-09T21:52:18.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.404+0000 7fa83a9ff700 1 -- 172.21.15.53:0/46846514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa8340c9ff0 con 0x7fa8340b3ff0 2023-07-09T21:52:18.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.900+0000 7fa830ff9700 1 -- 172.21.15.53:0/46846514 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v23) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa8340c9ff0 con 0x7fa8340b3ff0 2023-07-09T21:52:18.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.907+0000 7fa83a9ff700 1 -- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa82006ad70 msgr2=0x7fa82006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:18.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.907+0000 7fa83a9ff700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa82006ad70 0x7fa82006d220 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa8341f5680 tx=0x7fa824009040 comp rx=0 tx=0).stop 2023-07-09T21:52:18.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.907+0000 7fa83a9ff700 1 -- 172.21.15.53:0/46846514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8340b3ff0 msgr2=0x7fa8340b6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:18.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.907+0000 7fa83a9ff700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8340b3ff0 0x7fa8340b6610 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa828009c40 tx=0x7fa828004750 comp rx=0 tx=0).stop 2023-07-09T21:52:18.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.908+0000 7fa83a9ff700 1 -- 172.21.15.53:0/46846514 shutdown_connections 2023-07-09T21:52:18.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.908+0000 7fa83a9ff700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa82006ad70 0x7fa82006d220 secure :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa8341f5680 tx=0x7fa824009040 comp rx=0 tx=0).stop 2023-07-09T21:52:18.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.908+0000 7fa83a9ff700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8340d1220 0x7fa8340b6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:18.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.908+0000 7fa83a9ff700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8340b0e20 0x7fa834157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:18.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.908+0000 7fa83a9ff700 1 --2- 172.21.15.53:0/46846514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8340b3ff0 0x7fa8340b6610 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:18.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.908+0000 7fa83a9ff700 1 -- 172.21.15.53:0/46846514 >> 172.21.15.53:0/46846514 conn(0x7fa83409c1b0 msgr2=0x7fa8340b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:18.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.912+0000 7fa83a9ff700 1 -- 172.21.15.53:0/46846514 shutdown_connections 2023-07-09T21:52:18.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:18.912+0000 7fa83a9ff700 1 -- 172.21.15.53:0/46846514 wait complete. 2023-07-09T21:52:18.924 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 7 and data pool 8 2023-07-09T21:52:18.943 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:52:19.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.143+0000 7fecbe9ff700 1 Processor -- start 2023-07-09T21:52:19.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.143+0000 7fecbe9ff700 1 -- start start 2023-07-09T21:52:19.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.144+0000 7fecbe9ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fecb80b3e90 0x7fecb815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:19.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.144+0000 7fecbe9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815ae00 0x7fecb8150c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:19.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.144+0000 7fecbe9ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb80ce110 con 0x7fecb815e890 2023-07-09T21:52:19.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.144+0000 7fecbe9ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb815b660 con 0x7fecb80b3e90 2023-07-09T21:52:19.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.144+0000 7fecbe9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80ce360 con 0x7fecb815ae00 2023-07-09T21:52:19.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.145+0000 7fecb77fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fecb80b3e90 0x7fecb815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:19.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.145+0000 7fecb77fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fecb80b3e90 0x7fecb815a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47730/0 (socket says 172.21.15.53:47730) 2023-07-09T21:52:19.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.145+0000 7fecb77fe700 1 -- 172.21.15.53:0/579951029 learned_addr learned my addr 172.21.15.53:0/579951029 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:19.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.145+0000 7fecb7fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fecb815e890 0x7fecb80b3780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39822/0 (socket says 172.21.15.53:39822) 2023-07-09T21:52:19.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.145+0000 7fecbcf9c700 1 --2- 172.21.15.53:0/579951029 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815ae00 0x7fecb8150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:19.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.145+0000 7fecb77fe700 1 -- 172.21.15.53:0/579951029 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815ae00 msgr2=0x7fecb8150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:19.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.145+0000 7fecb77fe700 1 --2- 172.21.15.53:0/579951029 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815ae00 0x7fecb8150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.145+0000 7fecb77fe700 1 -- 172.21.15.53:0/579951029 >> v1:172.21.15.53:6789/0 conn(0x7fecb815e890 legacy=0x7fecb80b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:19.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.145+0000 7fecb77fe700 1 -- 172.21.15.53:0/579951029 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb80ce640 con 0x7fecb80b3e90 2023-07-09T21:52:19.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.145+0000 7fecb6ffd700 1 -- 172.21.15.53:0/579951029 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340013896 0 0) 0x7fecb80ce110 con 0x7fecb815e890 2023-07-09T21:52:19.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.145+0000 7fecb77fe700 1 --2- 172.21.15.53:0/579951029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecb80b3e90 0x7fecb815a8c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fecac0098f0 tx=0x7fecac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79308bc4df8ffa80 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:19.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.146+0000 7fecb6ffd700 1 -- 172.21.15.53:0/579951029 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00b8a0 con 0x7fecb80b3e90 2023-07-09T21:52:19.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.146+0000 7fecb6ffd700 1 -- 172.21.15.53:0/579951029 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac00ba00 con 0x7fecb80b3e90 2023-07-09T21:52:19.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.146+0000 7fecb6ffd700 1 -- 172.21.15.53:0/579951029 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00bd90 con 0x7fecb80b3e90 2023-07-09T21:52:19.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.146+0000 7fecbe9ff700 1 -- 172.21.15.53:0/579951029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecb80b3e90 msgr2=0x7fecb815a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:19.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.146+0000 7fecbe9ff700 1 --2- 172.21.15.53:0/579951029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecb80b3e90 0x7fecb815a8c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fecac0098f0 tx=0x7fecac009c00 comp rx=0 tx=0).stop 2023-07-09T21:52:19.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.146+0000 7fecbe9ff700 1 -- 172.21.15.53:0/579951029 shutdown_connections 2023-07-09T21:52:19.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.146+0000 7fecbe9ff700 1 --2- 172.21.15.53:0/579951029 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815ae00 0x7fecb8150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.146+0000 7fecbe9ff700 1 --2- 172.21.15.53:0/579951029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecb80b3e90 0x7fecb815a8c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.146+0000 7fecbe9ff700 1 -- 172.21.15.53:0/579951029 >> 172.21.15.53:0/579951029 conn(0x7fecb8069f30 msgr2=0x7fecb806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:19.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.146+0000 7fecbe9ff700 1 -- 172.21.15.53:0/579951029 shutdown_connections 2023-07-09T21:52:19.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.146+0000 7fecbe9ff700 1 -- 172.21.15.53:0/579951029 wait complete. 2023-07-09T21:52:19.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.149+0000 7fecbe9ff700 1 Processor -- start 2023-07-09T21:52:19.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.149+0000 7fecbe9ff700 1 -- start start 2023-07-09T21:52:19.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.150+0000 7fecbe9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecb80b3e90 0x7fecb814d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:19.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.150+0000 7fecbe9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815ae00 0x7fecb806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:19.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.150+0000 7fecbe9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb815e890 0x7fecb80ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:19.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.150+0000 7fecbe9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80709f0 con 0x7fecb80b3e90 2023-07-09T21:52:19.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.150+0000 7fecbe9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb806fd70 con 0x7fecb815e890 2023-07-09T21:52:19.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.150+0000 7fecbe9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8070050 con 0x7fecb815ae00 2023-07-09T21:52:19.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.151+0000 7fecb7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecb80b3e90 0x7fecb814d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:19.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.151+0000 7fecb7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecb80b3e90 0x7fecb814d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47738/0 (socket says 172.21.15.53:47738) 2023-07-09T21:52:19.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.151+0000 7fecb7fff700 1 -- 172.21.15.53:0/3320893522 learned_addr learned my addr 172.21.15.53:0/3320893522 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:19.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.151+0000 7fecb7fff700 1 -- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815ae00 msgr2=0x7fecb806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:19.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.151+0000 7fecb77fe700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815ae00 0x7fecb806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:19.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.151+0000 7fecb7fff700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815ae00 0x7fecb806bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.151+0000 7fecb7fff700 1 -- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb815e890 msgr2=0x7fecb80ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.151+0000 7fecb7fff700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb815e890 0x7fecb80ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.151+0000 7fecb7fff700 1 -- 172.21.15.53:0/3320893522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac009550 con 0x7fecb80b3e90 2023-07-09T21:52:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.151+0000 7fecb77fe700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815ae00 0x7fecb806bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.151+0000 7fecb7fff700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecb80b3e90 0x7fecb814d630 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7feca80011e0 tx=0x7feca800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.151+0000 7fecb4ff9700 1 -- 172.21.15.53:0/3320893522 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8004c80 con 0x7fecb80b3e90 2023-07-09T21:52:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.152+0000 7fecb4ff9700 1 -- 172.21.15.53:0/3320893522 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca8004e00 con 0x7fecb80b3e90 2023-07-09T21:52:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.152+0000 7fecbe9ff700 1 -- 172.21.15.53:0/3320893522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb8070330 con 0x7fecb80b3e90 2023-07-09T21:52:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.152+0000 7fecb4ff9700 1 -- 172.21.15.53:0/3320893522 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8007310 con 0x7fecb80b3e90 2023-07-09T21:52:19.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.152+0000 7fecbe9ff700 1 -- 172.21.15.53:0/3320893522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb814db70 con 0x7fecb80b3e90 2023-07-09T21:52:19.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.153+0000 7fecbe9ff700 1 -- 172.21.15.53:0/3320893522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb804e280 con 0x7fecb80b3e90 2023-07-09T21:52:19.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.154+0000 7fecb4ff9700 1 -- 172.21.15.53:0/3320893522 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7feca8007470 con 0x7fecb80b3e90 2023-07-09T21:52:19.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.155+0000 7fecb4ff9700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7feca406ad70 0x7feca406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:19.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.155+0000 7fecb4ff9700 1 -- 172.21.15.53:0/3320893522 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feca80892e0 con 0x7fecb80b3e90 2023-07-09T21:52:19.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.156+0000 7fecb77fe700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7feca406ad70 0x7feca406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:19.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.156+0000 7fecb77fe700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7feca406ad70 0x7feca406d220 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fecb80b4280 tx=0x7fecac008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.160+0000 7fecb4ff9700 1 -- 172.21.15.53:0/3320893522 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feca8054330 con 0x7fecb80b3e90 2023-07-09T21:52:19.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.367+0000 7fecbe9ff700 1 -- 172.21.15.53:0/3320893522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecb806d240 con 0x7fecb80b3e90 2023-07-09T21:52:19.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.368+0000 7fecb4ff9700 1 -- 172.21.15.53:0/3320893522 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18340 (secure 0 0 0) 0x7feca8057950 con 0x7fecb80b3e90 2023-07-09T21:52:19.370 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:19.370 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":50,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:52:18.405360+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:52:16.672667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:52:17.375922+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:52:19.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.370+0000 7fecbe9ff700 1 -- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7feca406ad70 msgr2=0x7feca406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:19.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.370+0000 7fecbe9ff700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7feca406ad70 0x7feca406d220 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fecb80b4280 tx=0x7fecac008030 comp rx=0 tx=0).stop 2023-07-09T21:52:19.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.370+0000 7fecbe9ff700 1 -- 172.21.15.53:0/3320893522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecb80b3e90 msgr2=0x7fecb814d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:19.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.370+0000 7fecbe9ff700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecb80b3e90 0x7fecb814d630 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7feca80011e0 tx=0x7feca800cae0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.370+0000 7fecbe9ff700 1 -- 172.21.15.53:0/3320893522 shutdown_connections 2023-07-09T21:52:19.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.370+0000 7fecbe9ff700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7feca406ad70 0x7feca406d220 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.370+0000 7fecbe9ff700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb815e890 0x7fecb80ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.370+0000 7fecbe9ff700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecb80b3e90 0x7fecb814d630 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.370+0000 7fecbe9ff700 1 --2- 172.21.15.53:0/3320893522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815ae00 0x7fecb806bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.370+0000 7fecbe9ff700 1 -- 172.21.15.53:0/3320893522 >> 172.21.15.53:0/3320893522 conn(0x7fecb8069f30 msgr2=0x7fecb8154290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:19.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.371+0000 7fecbe9ff700 1 -- 172.21.15.53:0/3320893522 shutdown_connections 2023-07-09T21:52:19.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.371+0000 7fecbe9ff700 1 -- 172.21.15.53:0/3320893522 wait complete. 2023-07-09T21:52:19.390 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:52:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.590+0000 7f5e0b7ff700 1 Processor -- start 2023-07-09T21:52:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.590+0000 7f5e0b7ff700 1 -- start start 2023-07-09T21:52:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.591+0000 7f5e0b7ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5e040b3e90 0x7f5e0415a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.592+0000 7f5e0b7ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5e0415ae00 0x7f5e04150c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.592+0000 7f5e0b7ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e040ce110 con 0x7f5e0415e890 2023-07-09T21:52:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.592+0000 7f5e0b7ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0415b660 con 0x7f5e0415ae00 2023-07-09T21:52:19.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.592+0000 7f5e0b7ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e040ce360 con 0x7f5e040b3e90 2023-07-09T21:52:19.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.592+0000 7f5e09d9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5e0415ae00 0x7f5e04150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:19.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.592+0000 7f5e09d9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5e0415ae00 0x7f5e04150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47752/0 (socket says 172.21.15.53:47752) 2023-07-09T21:52:19.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.592+0000 7f5e09d9c700 1 -- 172.21.15.53:0/1653126988 learned_addr learned my addr 172.21.15.53:0/1653126988 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:19.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.592+0000 7f5e08d9a700 1 --2- 172.21.15.53:0/1653126988 >> v2:172.21.15.184:3300/0 conn(0x7f5e040b3e90 0x7f5e0415a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:19.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.592+0000 7f5e09d9c700 1 -- 172.21.15.53:0/1653126988 >> v2:172.21.15.184:3300/0 conn(0x7f5e040b3e90 msgr2=0x7f5e0415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.592+0000 7f5e09d9c700 1 --2- 172.21.15.53:0/1653126988 >> v2:172.21.15.184:3300/0 conn(0x7f5e040b3e90 0x7f5e0415a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.592+0000 7f5e09d9c700 1 -- 172.21.15.53:0/1653126988 >> v1:172.21.15.53:6789/0 conn(0x7f5e0415e890 legacy=0x7f5e040b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.592+0000 7f5dfbfff700 1 -- 172.21.15.53:0/1653126988 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261478451 0 0) 0x7f5e040ce110 con 0x7f5e0415e890 2023-07-09T21:52:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.592+0000 7f5e09d9c700 1 -- 172.21.15.53:0/1653126988 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e040ce640 con 0x7f5e0415ae00 2023-07-09T21:52:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.593+0000 7f5e08d9a700 1 --2- 172.21.15.53:0/1653126988 >> v2:172.21.15.184:3300/0 conn(0x7f5e040b3e90 0x7f5e0415a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.593+0000 7f5e09d9c700 1 --2- 172.21.15.53:0/1653126988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e0415ae00 0x7f5e04150c40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5e0406b730 tx=0x7f5dfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625e9103d38c62a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.593+0000 7f5dfbfff700 1 -- 172.21.15.53:0/1653126988 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00e070 con 0x7f5e0415ae00 2023-07-09T21:52:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.593+0000 7f5dfbfff700 1 -- 172.21.15.53:0/1653126988 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc00b9c0 con 0x7f5e0415ae00 2023-07-09T21:52:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.593+0000 7f5dfbfff700 1 -- 172.21.15.53:0/1653126988 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00bd70 con 0x7f5e0415ae00 2023-07-09T21:52:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.594+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/1653126988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e0415ae00 msgr2=0x7f5e04150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.594+0000 7f5e0b7ff700 1 --2- 172.21.15.53:0/1653126988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e0415ae00 0x7f5e04150c40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5e0406b730 tx=0x7f5dfc00b330 comp rx=0 tx=0).stop 2023-07-09T21:52:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.594+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/1653126988 shutdown_connections 2023-07-09T21:52:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.594+0000 7f5e0b7ff700 1 --2- 172.21.15.53:0/1653126988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e0415ae00 0x7f5e04150c40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.594+0000 7f5e0b7ff700 1 --2- 172.21.15.53:0/1653126988 >> v2:172.21.15.184:3300/0 conn(0x7f5e040b3e90 0x7f5e0415a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.594+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/1653126988 >> 172.21.15.53:0/1653126988 conn(0x7f5e04069f30 msgr2=0x7f5e0406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.594+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/1653126988 shutdown_connections 2023-07-09T21:52:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.594+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/1653126988 wait complete. 2023-07-09T21:52:19.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.596+0000 7f5e0b7ff700 1 Processor -- start 2023-07-09T21:52:19.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.596+0000 7f5e0b7ff700 1 -- start start 2023-07-09T21:52:19.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e0b7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e040b3e90 0x7f5e0414c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:19.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e0b7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e0415ae00 0x7f5e041508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e0b7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e0415e890 0x7f5e041534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e0b7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040af390 con 0x7f5e0415ae00 2023-07-09T21:52:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e0b7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040ae780 con 0x7f5e0415e890 2023-07-09T21:52:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e0b7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040aea60 con 0x7f5e040b3e90 2023-07-09T21:52:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e08d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e0415ae00 0x7f5e041508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:19.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e08d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e0415ae00 0x7f5e041508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47756/0 (socket says 172.21.15.53:47756) 2023-07-09T21:52:19.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e08d9a700 1 -- 172.21.15.53:0/907796627 learned_addr learned my addr 172.21.15.53:0/907796627 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:19.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e0959b700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e040b3e90 0x7f5e0414c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:19.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e09d9c700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e0415e890 0x7f5e041534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:19.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e08d9a700 1 -- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e040b3e90 msgr2=0x7f5e0414c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:19.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e08d9a700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e040b3e90 0x7f5e0414c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e08d9a700 1 -- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e0415e890 msgr2=0x7f5e041534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:19.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e08d9a700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e0415e890 0x7f5e041534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.597+0000 7f5e08d9a700 1 -- 172.21.15.53:0/907796627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc009b30 con 0x7f5e0415ae00 2023-07-09T21:52:19.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.598+0000 7f5e08d9a700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e0415ae00 0x7f5e041508d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5df400e7a0 tx=0x7f5df400eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:19.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.598+0000 7f5df9ffb700 1 -- 172.21.15.53:0/907796627 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4013610 con 0x7f5e0415ae00 2023-07-09T21:52:19.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.598+0000 7f5df9ffb700 1 -- 172.21.15.53:0/907796627 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df4013770 con 0x7f5e0415ae00 2023-07-09T21:52:19.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.598+0000 7f5df9ffb700 1 -- 172.21.15.53:0/907796627 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4013b00 con 0x7f5e0415ae00 2023-07-09T21:52:19.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.598+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/907796627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e040aed40 con 0x7f5e0415ae00 2023-07-09T21:52:19.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.598+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/907796627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0414ca20 con 0x7f5e0415ae00 2023-07-09T21:52:19.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.599+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/907796627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0404e280 con 0x7f5e0415ae00 2023-07-09T21:52:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.600+0000 7f5df9ffb700 1 -- 172.21.15.53:0/907796627 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f5df4013c60 con 0x7f5e0415ae00 2023-07-09T21:52:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.601+0000 7f5df9ffb700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5de806ad70 0x7f5de806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.601+0000 7f5df9ffb700 1 -- 172.21.15.53:0/907796627 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5df4089300 con 0x7f5e0415ae00 2023-07-09T21:52:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.602+0000 7f5e0959b700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5de806ad70 0x7f5de806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.602+0000 7f5e0959b700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5de806ad70 0x7f5de806d220 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5e00000f60 tx=0x7f5e00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:19.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.605+0000 7f5df9ffb700 1 -- 172.21.15.53:0/907796627 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5df4057c40 con 0x7f5e0415ae00 2023-07-09T21:52:19.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.814+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/907796627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e040ce920 con 0x7f5e0415ae00 2023-07-09T21:52:19.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.815+0000 7f5df9ffb700 1 -- 172.21.15.53:0/907796627 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18340 (secure 0 0 0) 0x7f5df40577d0 con 0x7f5e0415ae00 2023-07-09T21:52:19.817 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:19.817 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":50,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:52:18.405360+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:52:16.672667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:52:17.375922+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:52:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.818+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5de806ad70 msgr2=0x7f5de806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.818+0000 7f5e0b7ff700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5de806ad70 0x7f5de806d220 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5e00000f60 tx=0x7f5e00009040 comp rx=0 tx=0).stop 2023-07-09T21:52:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.818+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/907796627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e0415ae00 msgr2=0x7f5e041508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:19.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.818+0000 7f5e0b7ff700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e0415ae00 0x7f5e041508d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5df400e7a0 tx=0x7f5df400eb60 comp rx=0 tx=0).stop 2023-07-09T21:52:19.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.818+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/907796627 shutdown_connections 2023-07-09T21:52:19.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.818+0000 7f5e0b7ff700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5de806ad70 0x7f5de806d220 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.818+0000 7f5e0b7ff700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e0415e890 0x7f5e041534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.818+0000 7f5e0b7ff700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e040b3e90 0x7f5e0414c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.818+0000 7f5e0b7ff700 1 --2- 172.21.15.53:0/907796627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e0415ae00 0x7f5e041508d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:19.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.818+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/907796627 >> 172.21.15.53:0/907796627 conn(0x7f5e04069f30 msgr2=0x7f5e04159300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:19.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.818+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/907796627 shutdown_connections 2023-07-09T21:52:19.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:19.818+0000 7f5e0b7ff700 1 -- 172.21.15.53:0/907796627 wait complete. 2023-07-09T21:52:19.838 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T21:52:20.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.043+0000 7fb9325ff700 1 Processor -- start 2023-07-09T21:52:20.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.043+0000 7fb9325ff700 1 -- start start 2023-07-09T21:52:20.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.044+0000 7fb9325ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb92c0b31e0 0x7fb92c06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:20.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.044+0000 7fb9325ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92c15ca90 con 0x7fb92c0b2d40 2023-07-09T21:52:20.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.044+0000 7fb9325ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92c06b0e0 con 0x7fb92c15c6c0 2023-07-09T21:52:20.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.044+0000 7fb9325ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92c0d0370 con 0x7fb92c0b31e0 2023-07-09T21:52:20.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.044+0000 7fb92b7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb92c0b2d40 0x7fb92c06b8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39840/0 (socket says 172.21.15.53:39840) 2023-07-09T21:52:20.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.044+0000 7fb92b7fe700 1 -- 172.21.15.53:0/3707404661 learned_addr learned my addr 172.21.15.53:0/3707404661 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:20.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.044+0000 7fb930b9c700 1 --2- 172.21.15.53:0/3707404661 >> v2:172.21.15.184:3300/0 conn(0x7fb92c0b31e0 0x7fb92c06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:20.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.045+0000 7fb92affd700 1 -- 172.21.15.53:0/3707404661 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070781537 0 0) 0x7fb920001110 con 0x7fb92c0b2d40 2023-07-09T21:52:20.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.045+0000 7fb92affd700 1 -- 172.21.15.53:0/3707404661 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9140035b0 con 0x7fb92c0b2d40 2023-07-09T21:52:20.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.045+0000 7fb92affd700 1 -- 172.21.15.53:0/3707404661 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397058478 0 0) 0x7fb92c06b0e0 con 0x7fb92c15c6c0 2023-07-09T21:52:20.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.045+0000 7fb92affd700 1 -- 172.21.15.53:0/3707404661 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb920001110 con 0x7fb92c15c6c0 2023-07-09T21:52:20.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.045+0000 7fb930b9c700 1 -- 172.21.15.53:0/3707404661 >> v1:172.21.15.184:6789/0 conn(0x7fb92c15c6c0 legacy=0x7fb92c0b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:20.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.045+0000 7fb930b9c700 1 -- 172.21.15.53:0/3707404661 >> v1:172.21.15.53:6789/0 conn(0x7fb92c0b2d40 legacy=0x7fb92c06b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:20.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.045+0000 7fb930b9c700 1 -- 172.21.15.53:0/3707404661 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c0d0650 con 0x7fb92c0b31e0 2023-07-09T21:52:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.045+0000 7fb930b9c700 1 --2- 172.21.15.53:0/3707404661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb92c0b31e0 0x7fb92c06bfb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb924009d90 tx=0x7fb92400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=674e8b240de9569e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.046+0000 7fb92affd700 1 -- 172.21.15.53:0/3707404661 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400e070 con 0x7fb92c0b31e0 2023-07-09T21:52:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.046+0000 7fb92affd700 1 -- 172.21.15.53:0/3707404661 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92400bb20 con 0x7fb92c0b31e0 2023-07-09T21:52:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.046+0000 7fb92affd700 1 -- 172.21.15.53:0/3707404661 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924012430 con 0x7fb92c0b31e0 2023-07-09T21:52:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.046+0000 7fb9325ff700 1 -- 172.21.15.53:0/3707404661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb92c0b31e0 msgr2=0x7fb92c06bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.046+0000 7fb9325ff700 1 --2- 172.21.15.53:0/3707404661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb92c0b31e0 0x7fb92c06bfb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb924009d90 tx=0x7fb92400b330 comp rx=0 tx=0).stop 2023-07-09T21:52:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.046+0000 7fb9325ff700 1 -- 172.21.15.53:0/3707404661 shutdown_connections 2023-07-09T21:52:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.046+0000 7fb9325ff700 1 --2- 172.21.15.53:0/3707404661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb92c0b31e0 0x7fb92c06bfb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.046+0000 7fb9325ff700 1 -- 172.21.15.53:0/3707404661 >> 172.21.15.53:0/3707404661 conn(0x7fb92c06d980 msgr2=0x7fb92c06dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.046+0000 7fb9325ff700 1 -- 172.21.15.53:0/3707404661 shutdown_connections 2023-07-09T21:52:20.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.046+0000 7fb9325ff700 1 -- 172.21.15.53:0/3707404661 wait complete. 2023-07-09T21:52:20.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.048+0000 7fb9325ff700 1 Processor -- start 2023-07-09T21:52:20.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.048+0000 7fb9325ff700 1 -- start start 2023-07-09T21:52:20.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.049+0000 7fb9325ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb92c0b2d40 0x7fb92c0af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:20.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.049+0000 7fb9325ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb92c0b31e0 0x7fb92c156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:20.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.049+0000 7fb9325ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb92c15c6c0 0x7fb92c0ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:20.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.049+0000 7fb9325ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c0af600 con 0x7fb92c15c6c0 2023-07-09T21:52:20.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.049+0000 7fb9325ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c157810 con 0x7fb92c0b2d40 2023-07-09T21:52:20.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.049+0000 7fb9325ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c0ae290 con 0x7fb92c0b31e0 2023-07-09T21:52:20.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.049+0000 7fb930b9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb92c15c6c0 0x7fb92c0ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:20.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.049+0000 7fb930b9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb92c15c6c0 0x7fb92c0ae720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47770/0 (socket says 172.21.15.53:47770) 2023-07-09T21:52:20.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.049+0000 7fb930b9c700 1 -- 172.21.15.53:0/628327488 learned_addr learned my addr 172.21.15.53:0/628327488 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:20.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.050+0000 7fb92bfff700 1 --2- 172.21.15.53:0/628327488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb92c0b2d40 0x7fb92c0af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:20.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.050+0000 7fb930b9c700 1 -- 172.21.15.53:0/628327488 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb92c0b31e0 msgr2=0x7fb92c156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:20.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.050+0000 7fb930b9c700 1 --2- 172.21.15.53:0/628327488 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb92c0b31e0 0x7fb92c156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:20.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.050+0000 7fb930b9c700 1 -- 172.21.15.53:0/628327488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb92c0b2d40 msgr2=0x7fb92c0af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:20.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.050+0000 7fb930b9c700 1 --2- 172.21.15.53:0/628327488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb92c0b2d40 0x7fb92c0af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:20.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.050+0000 7fb930b9c700 1 -- 172.21.15.53:0/628327488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb924009a70 con 0x7fb92c15c6c0 2023-07-09T21:52:20.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.050+0000 7fb930b9c700 1 --2- 172.21.15.53:0/628327488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb92c15c6c0 0x7fb92c0ae720 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb924013000 tx=0x7fb924004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:20.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.050+0000 7fb928ff9700 1 -- 172.21.15.53:0/628327488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92401b810 con 0x7fb92c15c6c0 2023-07-09T21:52:20.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.050+0000 7fb928ff9700 1 -- 172.21.15.53:0/628327488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb924020070 con 0x7fb92c15c6c0 2023-07-09T21:52:20.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.050+0000 7fb9325ff700 1 -- 172.21.15.53:0/628327488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92c0af830 con 0x7fb92c15c6c0 2023-07-09T21:52:20.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.050+0000 7fb928ff9700 1 -- 172.21.15.53:0/628327488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92401bbb0 con 0x7fb92c15c6c0 2023-07-09T21:52:20.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.051+0000 7fb9325ff700 1 -- 172.21.15.53:0/628327488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92c0ad960 con 0x7fb92c15c6c0 2023-07-09T21:52:20.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.052+0000 7fb9325ff700 1 -- 172.21.15.53:0/628327488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92c074350 con 0x7fb92c15c6c0 2023-07-09T21:52:20.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.052+0000 7fb928ff9700 1 -- 172.21.15.53:0/628327488 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fb92401bd10 con 0x7fb92c15c6c0 2023-07-09T21:52:20.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.054+0000 7fb928ff9700 1 --2- 172.21.15.53:0/628327488 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb91806ad70 0x7fb91806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:20.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.054+0000 7fb928ff9700 1 -- 172.21.15.53:0/628327488 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb924022070 con 0x7fb92c15c6c0 2023-07-09T21:52:20.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.054+0000 7fb92bfff700 1 --2- 172.21.15.53:0/628327488 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb91806ad70 0x7fb91806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:20.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.055+0000 7fb92bfff700 1 --2- 172.21.15.53:0/628327488 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb91806ad70 0x7fb91806d220 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0011e0 tx=0x7fb91c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:20.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.058+0000 7fb928ff9700 1 -- 172.21.15.53:0/628327488 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb924056580 con 0x7fb92c15c6c0 2023-07-09T21:52:20.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.312+0000 7fb9325ff700 1 -- 172.21.15.53:0/628327488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb92c0ae3d0 con 0x7fb92c15c6c0 2023-07-09T21:52:20.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.902+0000 7fb928ff9700 1 -- 172.21.15.53:0/628327488 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb924059ba0 con 0x7fb92c15c6c0 2023-07-09T21:52:20.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.905+0000 7fb9325ff700 1 -- 172.21.15.53:0/628327488 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb91806ad70 msgr2=0x7fb91806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.905+0000 7fb9325ff700 1 --2- 172.21.15.53:0/628327488 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb91806ad70 0x7fb91806d220 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0011e0 tx=0x7fb91c009040 comp rx=0 tx=0).stop 2023-07-09T21:52:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.905+0000 7fb9325ff700 1 -- 172.21.15.53:0/628327488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb92c15c6c0 msgr2=0x7fb92c0ae720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.905+0000 7fb9325ff700 1 --2- 172.21.15.53:0/628327488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb92c15c6c0 0x7fb92c0ae720 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb924013000 tx=0x7fb924004ad0 comp rx=0 tx=0).stop 2023-07-09T21:52:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.905+0000 7fb9325ff700 1 -- 172.21.15.53:0/628327488 shutdown_connections 2023-07-09T21:52:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.905+0000 7fb9325ff700 1 --2- 172.21.15.53:0/628327488 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb91806ad70 0x7fb91806d220 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.905+0000 7fb9325ff700 1 --2- 172.21.15.53:0/628327488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb92c15c6c0 0x7fb92c0ae720 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:20.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.905+0000 7fb9325ff700 1 --2- 172.21.15.53:0/628327488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb92c0b2d40 0x7fb92c0af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:20.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.905+0000 7fb9325ff700 1 --2- 172.21.15.53:0/628327488 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb92c0b31e0 0x7fb92c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:20.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.905+0000 7fb9325ff700 1 -- 172.21.15.53:0/628327488 >> 172.21.15.53:0/628327488 conn(0x7fb92c06d980 msgr2=0x7fb92c157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:20.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.905+0000 7fb9325ff700 1 -- 172.21.15.53:0/628327488 shutdown_connections 2023-07-09T21:52:20.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:20.905+0000 7fb9325ff700 1 -- 172.21.15.53:0/628327488 wait complete. 2023-07-09T21:52:20.928 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T21:52:20.928 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T21:52:21.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.133+0000 7f5566fff700 1 Processor -- start 2023-07-09T21:52:21.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.133+0000 7f5566fff700 1 -- start start 2023-07-09T21:52:21.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.135+0000 7f5566fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55600b3ff0 0x7f55600b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:21.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.135+0000 7f5566fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f55600d0f60 0x7f55600b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:21.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.135+0000 7f5566fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55600b8e80 con 0x7f55600d0b10 2023-07-09T21:52:21.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.135+0000 7f5566fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55600b1e30 con 0x7f55600d0f60 2023-07-09T21:52:21.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.135+0000 7f5566fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55600afaa0 con 0x7f55600b3ff0 2023-07-09T21:52:21.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.135+0000 7f555ffff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f55600d0b10 0x7f55600b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39842/0 (socket says 172.21.15.53:39842) 2023-07-09T21:52:21.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.135+0000 7f555ffff700 1 -- 172.21.15.53:0/733468659 learned_addr learned my addr 172.21.15.53:0/733468659 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:21.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.135+0000 7f556559c700 1 --2- 172.21.15.53:0/733468659 >> v2:172.21.15.184:3300/0 conn(0x7f55600d0f60 0x7f55600b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:21.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.135+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509542381 0 0) 0x7f554c001110 con 0x7f55600d0b10 2023-07-09T21:52:21.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.135+0000 7f5564d9b700 1 --2- 172.21.15.53:0/733468659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55600b3ff0 0x7f55600b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:21.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.135+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55500035b0 con 0x7f55600d0b10 2023-07-09T21:52:21.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 651083951 0 0) 0x7f55500035b0 con 0x7f55600d0b10 2023-07-09T21:52:21.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55600b3ff0 msgr2=0x7f55600b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:21.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 --2- 172.21.15.53:0/733468659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55600b3ff0 0x7f55600b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:21.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 >> v2:172.21.15.184:3300/0 conn(0x7f55600d0f60 msgr2=0x7f55600b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:21.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 --2- 172.21.15.53:0/733468659 >> v2:172.21.15.184:3300/0 conn(0x7f55600d0f60 0x7f55600b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:21.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600afd80 con 0x7f55600d0b10 2023-07-09T21:52:21.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f554c001800 con 0x7f55600d0b10 2023-07-09T21:52:21.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 >> v1:172.21.15.53:6789/0 conn(0x7f55600d0b10 legacy=0x7f55600b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:21.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 --2- 172.21.15.53:0/733468659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5550003a00 0x7f5550003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:21.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 --2- 172.21.15.53:0/733468659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5550004430 0x7f55500048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:21.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 --2- 172.21.15.53:0/733468659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55600b3ff0 0x7f5550004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:21.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600b1e30 con 0x7f5550004430 2023-07-09T21:52:21.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600afaa0 con 0x7f5550003a00 2023-07-09T21:52:21.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555000ba10 con 0x7f55600b3ff0 2023-07-09T21:52:21.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f555ffff700 1 --2- 172.21.15.53:0/733468659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5550004430 0x7f55500048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:21.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f556559c700 1 --2- 172.21.15.53:0/733468659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55600b3ff0 0x7f5550004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:21.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.136+0000 7f5564d9b700 1 --2- 172.21.15.53:0/733468659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5550003a00 0x7f5550003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:21.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.137+0000 7f555ffff700 1 -- 172.21.15.53:0/733468659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55600b3ff0 msgr2=0x7f5550004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.137+0000 7f555ffff700 1 --2- 172.21.15.53:0/733468659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55600b3ff0 0x7f5550004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.137+0000 7f555ffff700 1 -- 172.21.15.53:0/733468659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5550003a00 msgr2=0x7f5550003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.137+0000 7f555ffff700 1 --2- 172.21.15.53:0/733468659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5550003a00 0x7f5550003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.137+0000 7f555ffff700 1 -- 172.21.15.53:0/733468659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55500035b0 con 0x7f5550004430 2023-07-09T21:52:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.137+0000 7f555ffff700 1 --2- 172.21.15.53:0/733468659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5550004430 0x7f55500048f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f554c00c2f0 tx=0x7f5550005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cc6d8fe92bc76b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.137+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00ce30 con 0x7f5550004430 2023-07-09T21:52:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.137+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c005960 con 0x7f5550004430 2023-07-09T21:52:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.137+0000 7f555f7fe700 1 -- 172.21.15.53:0/733468659 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c005d10 con 0x7f5550004430 2023-07-09T21:52:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.138+0000 7f5566fff700 1 -- 172.21.15.53:0/733468659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5550004430 msgr2=0x7f55500048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.138+0000 7f5566fff700 1 --2- 172.21.15.53:0/733468659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5550004430 0x7f55500048f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f554c00c2f0 tx=0x7f5550005880 comp rx=0 tx=0).stop 2023-07-09T21:52:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.138+0000 7f556559c700 1 -- 172.21.15.53:0/733468659 reap_dead start 2023-07-09T21:52:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.138+0000 7f5566fff700 1 -- 172.21.15.53:0/733468659 shutdown_connections 2023-07-09T21:52:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.138+0000 7f5566fff700 1 -- 172.21.15.53:0/733468659 >> 172.21.15.53:0/733468659 conn(0x7f556009c1b0 msgr2=0x7f55600d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.138+0000 7f5566fff700 1 -- 172.21.15.53:0/733468659 shutdown_connections 2023-07-09T21:52:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.138+0000 7f5566fff700 1 -- 172.21.15.53:0/733468659 wait complete. 2023-07-09T21:52:21.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.140+0000 7f5566fff700 1 Processor -- start 2023-07-09T21:52:21.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.140+0000 7f5566fff700 1 -- start start 2023-07-09T21:52:21.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.141+0000 7f5566fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5550004430 0x7f55600ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:21.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.141+0000 7f5566fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55600ccd60 0x7f55601f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:21.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.141+0000 7f5566fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f556015a5d0 0x7f5560151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.141+0000 7f5566fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600cb990 con 0x7f556015a5d0 2023-07-09T21:52:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.141+0000 7f5566fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55601f2940 con 0x7f55600ccd60 2023-07-09T21:52:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.141+0000 7f5566fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5560151870 con 0x7f5550004430 2023-07-09T21:52:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.141+0000 7f556559c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f556015a5d0 0x7f5560151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.141+0000 7f556559c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f556015a5d0 0x7f5560151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47780/0 (socket says 172.21.15.53:47780) 2023-07-09T21:52:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.141+0000 7f556559c700 1 -- 172.21.15.53:0/1820208730 learned_addr learned my addr 172.21.15.53:0/1820208730 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:21.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.141+0000 7f5564d9b700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5550004430 0x7f55600ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:21.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.141+0000 7f555ffff700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55600ccd60 0x7f55601f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:21.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.142+0000 7f556559c700 1 -- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5550004430 msgr2=0x7f55600ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:21.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.142+0000 7f556559c700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5550004430 0x7f55600ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:21.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.142+0000 7f556559c700 1 -- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55600ccd60 msgr2=0x7f55601f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:21.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.142+0000 7f556559c700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55600ccd60 0x7f55601f2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:21.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.142+0000 7f556559c700 1 -- 172.21.15.53:0/1820208730 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600cece0 con 0x7f556015a5d0 2023-07-09T21:52:21.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.142+0000 7f556559c700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f556015a5d0 0x7f5560151330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f55600d1330 tx=0x7f5558011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.142+0000 7f555d7fa700 1 -- 172.21.15.53:0/1820208730 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800e040 con 0x7f556015a5d0 2023-07-09T21:52:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.142+0000 7f555d7fa700 1 -- 172.21.15.53:0/1820208730 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555800f040 con 0x7f556015a5d0 2023-07-09T21:52:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.142+0000 7f555d7fa700 1 -- 172.21.15.53:0/1820208730 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800fdb0 con 0x7f556015a5d0 2023-07-09T21:52:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.142+0000 7f5566fff700 1 -- 172.21.15.53:0/1820208730 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55600cd200 con 0x7f556015a5d0 2023-07-09T21:52:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.142+0000 7f5566fff700 1 -- 172.21.15.53:0/1820208730 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55600cf260 con 0x7f556015a5d0 2023-07-09T21:52:21.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.143+0000 7f5566fff700 1 -- 172.21.15.53:0/1820208730 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5560074350 con 0x7f556015a5d0 2023-07-09T21:52:21.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.144+0000 7f555d7fa700 1 -- 172.21.15.53:0/1820208730 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f5558022460 con 0x7f556015a5d0 2023-07-09T21:52:21.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.145+0000 7f555d7fa700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f554406ad70 0x7f554406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:21.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.145+0000 7f555d7fa700 1 -- 172.21.15.53:0/1820208730 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5558089d20 con 0x7f556015a5d0 2023-07-09T21:52:21.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.146+0000 7f5564d9b700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f554406ad70 0x7f554406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:21.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.146+0000 7f5564d9b700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f554406ad70 0x7f554406d220 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5554009a60 tx=0x7f5554008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:21.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.150+0000 7f555d7fa700 1 -- 172.21.15.53:0/1820208730 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5558054bd0 con 0x7f556015a5d0 2023-07-09T21:52:21.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.406+0000 7f5566fff700 1 -- 172.21.15.53:0/1820208730 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f556008bb50 con 0x7f556015a5d0 2023-07-09T21:52:21.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.911+0000 7f555d7fa700 1 -- 172.21.15.53:0/1820208730 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) v1 ==== 122+0+0 (secure 0 0 0) 0x7f55580581f0 con 0x7f556015a5d0 2023-07-09T21:52:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.915+0000 7f5566fff700 1 -- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f554406ad70 msgr2=0x7f554406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.915+0000 7f5566fff700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f554406ad70 0x7f554406d220 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5554009a60 tx=0x7f5554008040 comp rx=0 tx=0).stop 2023-07-09T21:52:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.915+0000 7f5566fff700 1 -- 172.21.15.53:0/1820208730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f556015a5d0 msgr2=0x7f5560151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.915+0000 7f5566fff700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f556015a5d0 0x7f5560151330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f55600d1330 tx=0x7f5558011f80 comp rx=0 tx=0).stop 2023-07-09T21:52:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.915+0000 7f5566fff700 1 -- 172.21.15.53:0/1820208730 shutdown_connections 2023-07-09T21:52:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.915+0000 7f5566fff700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f554406ad70 0x7f554406d220 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.915+0000 7f5566fff700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f556015a5d0 0x7f5560151330 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.915+0000 7f5566fff700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5550004430 0x7f55600ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.915+0000 7f5566fff700 1 --2- 172.21.15.53:0/1820208730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55600ccd60 0x7f55601f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.915+0000 7f5566fff700 1 -- 172.21.15.53:0/1820208730 >> 172.21.15.53:0/1820208730 conn(0x7f556009c1b0 msgr2=0x7f55600b5220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.915+0000 7f5566fff700 1 -- 172.21.15.53:0/1820208730 shutdown_connections 2023-07-09T21:52:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:21.915+0000 7f5566fff700 1 -- 172.21.15.53:0/1820208730 wait complete. 2023-07-09T21:52:21.937 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T21:52:21.937 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:52:22.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.138+0000 7f79f41ff700 1 Processor -- start 2023-07-09T21:52:22.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.139+0000 7f79f41ff700 1 -- start start 2023-07-09T21:52:22.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.140+0000 7f79f41ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec0d1220 0x7f79ec0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:22.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.140+0000 7f79f41ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f79ec0b2350 0x7f79ec0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:22.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.140+0000 7f79f41ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ec0d2ce0 con 0x7f79ec0b1e00 2023-07-09T21:52:22.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.140+0000 7f79f41ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ec0b3350 con 0x7f79ec0b2350 2023-07-09T21:52:22.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.140+0000 7f79f41ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0b3630 con 0x7f79ec0d1220 2023-07-09T21:52:22.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.140+0000 7f79f279c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f79ec0b2350 0x7f79ec0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:22.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.140+0000 7f79f279c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f79ec0b2350 0x7f79ec0afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47790/0 (socket says 172.21.15.53:47790) 2023-07-09T21:52:22.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.140+0000 7f79f279c700 1 -- 172.21.15.53:0/1949569028 learned_addr learned my addr 172.21.15.53:0/1949569028 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:22.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.140+0000 7f79f179a700 1 --2- 172.21.15.53:0/1949569028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec0d1220 0x7f79ec0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:22.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.141+0000 7f79f279c700 1 -- 172.21.15.53:0/1949569028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec0d1220 msgr2=0x7f79ec0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:22.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.141+0000 7f79f279c700 1 --2- 172.21.15.53:0/1949569028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec0d1220 0x7f79ec0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.141+0000 7f79f279c700 1 -- 172.21.15.53:0/1949569028 >> v1:172.21.15.184:6789/0 conn(0x7f79ec0b1e00 legacy=0x7f79ec0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:22.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.141+0000 7f79f279c700 1 -- 172.21.15.53:0/1949569028 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec0b3910 con 0x7f79ec0b2350 2023-07-09T21:52:22.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.141+0000 7f79f279c700 1 --2- 172.21.15.53:0/1949569028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ec0b2350 0x7f79ec0afac0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009e50 tx=0x7f79e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc648be9e8e468c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:22.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.141+0000 7f79f0f99700 1 -- 172.21.15.53:0/1949569028 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400e070 con 0x7f79ec0b2350 2023-07-09T21:52:22.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.141+0000 7f79f0f99700 1 -- 172.21.15.53:0/1949569028 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e400b910 con 0x7f79ec0b2350 2023-07-09T21:52:22.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.141+0000 7f79f0f99700 1 -- 172.21.15.53:0/1949569028 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400bcc0 con 0x7f79ec0b2350 2023-07-09T21:52:22.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.142+0000 7f79f41ff700 1 -- 172.21.15.53:0/1949569028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ec0b2350 msgr2=0x7f79ec0afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:22.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.142+0000 7f79f41ff700 1 --2- 172.21.15.53:0/1949569028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ec0b2350 0x7f79ec0afac0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009e50 tx=0x7f79e400b330 comp rx=0 tx=0).stop 2023-07-09T21:52:22.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.142+0000 7f79f41ff700 1 -- 172.21.15.53:0/1949569028 shutdown_connections 2023-07-09T21:52:22.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.142+0000 7f79f41ff700 1 --2- 172.21.15.53:0/1949569028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ec0b2350 0x7f79ec0afac0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.142+0000 7f79f41ff700 1 --2- 172.21.15.53:0/1949569028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec0d1220 0x7f79ec0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.142+0000 7f79f41ff700 1 -- 172.21.15.53:0/1949569028 >> 172.21.15.53:0/1949569028 conn(0x7f79ec09c1d0 msgr2=0x7f79ec0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:22.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.142+0000 7f79f41ff700 1 -- 172.21.15.53:0/1949569028 shutdown_connections 2023-07-09T21:52:22.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.142+0000 7f79f41ff700 1 -- 172.21.15.53:0/1949569028 wait complete. 2023-07-09T21:52:22.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.144+0000 7f79f41ff700 1 Processor -- start 2023-07-09T21:52:22.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.144+0000 7f79f41ff700 1 -- start start 2023-07-09T21:52:22.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f41ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79ec0b1e00 0x7f79ec1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:22.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f41ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ec0b2350 0x7f79ec0b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:22.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f41ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec0d1220 0x7f79ec14a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:22.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f41ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0c6c10 con 0x7f79ec0b2350 2023-07-09T21:52:22.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f41ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0c6ef0 con 0x7f79ec0b1e00 2023-07-09T21:52:22.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f41ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0c71d0 con 0x7f79ec0d1220 2023-07-09T21:52:22.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f179a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ec0b2350 0x7f79ec0b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:22.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f179a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ec0b2350 0x7f79ec0b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47798/0 (socket says 172.21.15.53:47798) 2023-07-09T21:52:22.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f179a700 1 -- 172.21.15.53:0/20971944 learned_addr learned my addr 172.21.15.53:0/20971944 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:22.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f1f9b700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79ec0b1e00 0x7f79ec1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:22.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f279c700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec0d1220 0x7f79ec14a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:22.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f179a700 1 -- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec0d1220 msgr2=0x7f79ec14a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:22.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f179a700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec0d1220 0x7f79ec14a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f179a700 1 -- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79ec0b1e00 msgr2=0x7f79ec1579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:22.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f179a700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79ec0b1e00 0x7f79ec1579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.145+0000 7f79f179a700 1 -- 172.21.15.53:0/20971944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e4009b30 con 0x7f79ec0b2350 2023-07-09T21:52:22.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.146+0000 7f79f179a700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ec0b2350 0x7f79ec0b0d60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00e840 tx=0x7f79dc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:22.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.146+0000 7f79e27fc700 1 -- 172.21.15.53:0/20971944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc009590 con 0x7f79ec0b2350 2023-07-09T21:52:22.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.146+0000 7f79e27fc700 1 -- 172.21.15.53:0/20971944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc013680 con 0x7f79ec0b2350 2023-07-09T21:52:22.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.146+0000 7f79f41ff700 1 -- 172.21.15.53:0/20971944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ec0c74b0 con 0x7f79ec0b2350 2023-07-09T21:52:22.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.146+0000 7f79e27fc700 1 -- 172.21.15.53:0/20971944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc013a30 con 0x7f79ec0b2350 2023-07-09T21:52:22.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.146+0000 7f79f41ff700 1 -- 172.21.15.53:0/20971944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ec14a890 con 0x7f79ec0b2350 2023-07-09T21:52:22.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.147+0000 7f79f41ff700 1 -- 172.21.15.53:0/20971944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ec04e280 con 0x7f79ec0b2350 2023-07-09T21:52:22.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.148+0000 7f79e27fc700 1 -- 172.21.15.53:0/20971944 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f79dc013b90 con 0x7f79ec0b2350 2023-07-09T21:52:22.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.149+0000 7f79e27fc700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f79d006ad70 0x7f79d006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:22.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.149+0000 7f79e27fc700 1 -- 172.21.15.53:0/20971944 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79dc089470 con 0x7f79ec0b2350 2023-07-09T21:52:22.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.150+0000 7f79f1f9b700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f79d006ad70 0x7f79d006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:22.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.150+0000 7f79f1f9b700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f79d006ad70 0x7f79d006d220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f79ec06c030 tx=0x7f79e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:22.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.153+0000 7f79e27fc700 1 -- 172.21.15.53:0/20971944 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f79dc057f50 con 0x7f79ec0b2350 2023-07-09T21:52:22.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.409+0000 7f79f41ff700 1 -- 172.21.15.53:0/20971944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79ec0cd300 con 0x7f79ec0b2350 2023-07-09T21:52:22.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.410+0000 7f79e27fc700 1 -- 172.21.15.53:0/20971944 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f79dc057ae0 con 0x7f79ec0b2350 2023-07-09T21:52:22.411 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:22.411 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2286885595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2286885595},{"type":"v1","addr":"172.21.15.184:6837","nonce":2286885595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2019231045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2019231045},{"type":"v1","addr":"172.21.15.53:6834","nonce":2019231045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/1440999283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1440999283},{"type":"v1","addr":"172.21.15.184:6836","nonce":1440999283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:52:18.405674+0000","modified":"2023-07-09T21:52:21.909106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3167613257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3167613257},{"type":"v1","addr":"172.21.15.53:6835","nonce":3167613257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T21:52:22.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.412+0000 7f79f41ff700 1 -- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f79d006ad70 msgr2=0x7f79d006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:22.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.412+0000 7f79f41ff700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f79d006ad70 0x7f79d006d220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f79ec06c030 tx=0x7f79e8009040 comp rx=0 tx=0).stop 2023-07-09T21:52:22.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.412+0000 7f79f41ff700 1 -- 172.21.15.53:0/20971944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ec0b2350 msgr2=0x7f79ec0b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:22.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.412+0000 7f79f41ff700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ec0b2350 0x7f79ec0b0d60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00e840 tx=0x7f79dc00ec00 comp rx=0 tx=0).stop 2023-07-09T21:52:22.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.412+0000 7f79f41ff700 1 -- 172.21.15.53:0/20971944 shutdown_connections 2023-07-09T21:52:22.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.412+0000 7f79f41ff700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f79d006ad70 0x7f79d006d220 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.412+0000 7f79f41ff700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec0d1220 0x7f79ec14a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.412+0000 7f79f41ff700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79ec0b1e00 0x7f79ec1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.412+0000 7f79f41ff700 1 --2- 172.21.15.53:0/20971944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ec0b2350 0x7f79ec0b0d60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.412+0000 7f79f41ff700 1 -- 172.21.15.53:0/20971944 >> 172.21.15.53:0/20971944 conn(0x7f79ec09c1d0 msgr2=0x7f79ec06b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:22.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.412+0000 7f79f41ff700 1 -- 172.21.15.53:0/20971944 shutdown_connections 2023-07-09T21:52:22.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.413+0000 7f79f41ff700 1 -- 172.21.15.53:0/20971944 wait complete. 2023-07-09T21:52:22.416 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 27 2023-07-09T21:52:22.432 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:52:22.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.632+0000 7f68b4dff700 1 Processor -- start 2023-07-09T21:52:22.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.632+0000 7f68b4dff700 1 -- start start 2023-07-09T21:52:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.633+0000 7f68b4dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f68b00d1220 0x7f68b00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.633+0000 7f68b4dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68b00b2350 0x7f68b00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.633+0000 7f68b4dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b00d2ce0 con 0x7f68b00b1e00 2023-07-09T21:52:22.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.633+0000 7f68b4dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b00b3350 con 0x7f68b00b2350 2023-07-09T21:52:22.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.633+0000 7f68b4dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b00b3630 con 0x7f68b00d1220 2023-07-09T21:52:22.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.633+0000 7f68aed9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68b00b2350 0x7f68b00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:22.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.633+0000 7f68aed9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68b00b2350 0x7f68b00afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47812/0 (socket says 172.21.15.53:47812) 2023-07-09T21:52:22.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.633+0000 7f68aed9d700 1 -- 172.21.15.53:0/3367944776 learned_addr learned my addr 172.21.15.53:0/3367944776 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:22.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.633+0000 7f68a7fff700 1 --2- 172.21.15.53:0/3367944776 >> v2:172.21.15.184:3300/0 conn(0x7f68b00d1220 0x7f68b00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:22.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.634+0000 7f68aed9d700 1 -- 172.21.15.53:0/3367944776 >> v2:172.21.15.184:3300/0 conn(0x7f68b00d1220 msgr2=0x7f68b00b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:22.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.634+0000 7f68aed9d700 1 --2- 172.21.15.53:0/3367944776 >> v2:172.21.15.184:3300/0 conn(0x7f68b00d1220 0x7f68b00b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.634+0000 7f68aed9d700 1 -- 172.21.15.53:0/3367944776 >> v1:172.21.15.184:6789/0 conn(0x7f68b00b1e00 legacy=0x7f68b00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:22.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.634+0000 7f68aed9d700 1 -- 172.21.15.53:0/3367944776 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00b3910 con 0x7f68b00b2350 2023-07-09T21:52:22.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.634+0000 7f68aed9d700 1 --2- 172.21.15.53:0/3367944776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b00b2350 0x7f68b00afac0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f68b0072140 tx=0x7f68a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391833e8638fb892 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:22.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.634+0000 7f68add9b700 1 -- 172.21.15.53:0/3367944776 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a800e070 con 0x7f68b00b2350 2023-07-09T21:52:22.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.634+0000 7f68add9b700 1 -- 172.21.15.53:0/3367944776 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a800b9c0 con 0x7f68b00b2350 2023-07-09T21:52:22.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.634+0000 7f68add9b700 1 -- 172.21.15.53:0/3367944776 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a800bd70 con 0x7f68b00b2350 2023-07-09T21:52:22.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.635+0000 7f68b4dff700 1 -- 172.21.15.53:0/3367944776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b00b2350 msgr2=0x7f68b00afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:22.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.635+0000 7f68b4dff700 1 --2- 172.21.15.53:0/3367944776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b00b2350 0x7f68b00afac0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f68b0072140 tx=0x7f68a800b330 comp rx=0 tx=0).stop 2023-07-09T21:52:22.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.635+0000 7f68b4dff700 1 -- 172.21.15.53:0/3367944776 shutdown_connections 2023-07-09T21:52:22.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.635+0000 7f68b4dff700 1 --2- 172.21.15.53:0/3367944776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b00b2350 0x7f68b00afac0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.635+0000 7f68b4dff700 1 --2- 172.21.15.53:0/3367944776 >> v2:172.21.15.184:3300/0 conn(0x7f68b00d1220 0x7f68b00b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.635+0000 7f68b4dff700 1 -- 172.21.15.53:0/3367944776 >> 172.21.15.53:0/3367944776 conn(0x7f68b009c1d0 msgr2=0x7f68b00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:22.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.635+0000 7f68b4dff700 1 -- 172.21.15.53:0/3367944776 shutdown_connections 2023-07-09T21:52:22.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.635+0000 7f68b4dff700 1 -- 172.21.15.53:0/3367944776 wait complete. 2023-07-09T21:52:22.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.637+0000 7f68b4dff700 1 Processor -- start 2023-07-09T21:52:22.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.638+0000 7f68b4dff700 1 -- start start 2023-07-09T21:52:22.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.639+0000 7f68b4dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68b00b1e00 0x7f68b0155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:22.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.639+0000 7f68b4dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68b00b2350 0x7f68b015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:22.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.639+0000 7f68b4dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b00d1220 0x7f68b015b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:22.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.639+0000 7f68b4dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b01562b0 con 0x7f68b00d1220 2023-07-09T21:52:22.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.639+0000 7f68b4dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b0159a80 con 0x7f68b00b1e00 2023-07-09T21:52:22.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.639+0000 7f68b4dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b0159d60 con 0x7f68b00b2350 2023-07-09T21:52:22.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.639+0000 7f68aed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b00d1220 0x7f68b015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:22.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.639+0000 7f68aed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b00d1220 0x7f68b015b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47824/0 (socket says 172.21.15.53:47824) 2023-07-09T21:52:22.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.639+0000 7f68aed9d700 1 -- 172.21.15.53:0/2347947752 learned_addr learned my addr 172.21.15.53:0/2347947752 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:22.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.639+0000 7f68ae59c700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68b00b1e00 0x7f68b0155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:22.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.639+0000 7f68a7fff700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68b00b2350 0x7f68b015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.640+0000 7f68aed9d700 1 -- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68b00b2350 msgr2=0x7f68b015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.640+0000 7f68aed9d700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68b00b2350 0x7f68b015b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.640+0000 7f68aed9d700 1 -- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68b00b1e00 msgr2=0x7f68b0155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.640+0000 7f68aed9d700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68b00b1e00 0x7f68b0155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.640+0000 7f68aed9d700 1 -- 172.21.15.53:0/2347947752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a8009b30 con 0x7f68b00d1220 2023-07-09T21:52:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.640+0000 7f68aed9d700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b00d1220 0x7f68b015b810 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f68a800b370 tx=0x7f68a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.640+0000 7f68a6ffd700 1 -- 172.21.15.53:0/2347947752 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8004880 con 0x7f68b00d1220 2023-07-09T21:52:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.640+0000 7f68a6ffd700 1 -- 172.21.15.53:0/2347947752 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a80099b0 con 0x7f68b00d1220 2023-07-09T21:52:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.640+0000 7f68a6ffd700 1 -- 172.21.15.53:0/2347947752 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a801c680 con 0x7f68b00d1220 2023-07-09T21:52:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.640+0000 7f68b4dff700 1 -- 172.21.15.53:0/2347947752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b015a040 con 0x7f68b00d1220 2023-07-09T21:52:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.641+0000 7f68b4dff700 1 -- 172.21.15.53:0/2347947752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b015a600 con 0x7f68b00d1220 2023-07-09T21:52:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.642+0000 7f68b4dff700 1 -- 172.21.15.53:0/2347947752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b015a7c0 con 0x7f68b00d1220 2023-07-09T21:52:22.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.642+0000 7f68a6ffd700 1 -- 172.21.15.53:0/2347947752 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f68a801c7e0 con 0x7f68b00d1220 2023-07-09T21:52:22.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.643+0000 7f68a6ffd700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f689006ad70 0x7f689006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:22.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.643+0000 7f68a6ffd700 1 -- 172.21.15.53:0/2347947752 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68a808af20 con 0x7f68b00d1220 2023-07-09T21:52:22.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.644+0000 7f68ae59c700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f689006ad70 0x7f689006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.644+0000 7f68ae59c700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f689006ad70 0x7f689006d220 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f68a0000fb0 tx=0x7f68a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.648+0000 7f68a6ffd700 1 -- 172.21.15.53:0/2347947752 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f68a8055e60 con 0x7f68b00d1220 2023-07-09T21:52:22.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.855+0000 7f68b4dff700 1 -- 172.21.15.53:0/2347947752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68b004e280 con 0x7f68b00d1220 2023-07-09T21:52:22.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.857+0000 7f68a6ffd700 1 -- 172.21.15.53:0/2347947752 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f68a8059480 con 0x7f68b00d1220 2023-07-09T21:52:22.858 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:22.858 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":51,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:52:19.894140+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:52:16.672667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:52:17.375922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:52:22.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.859+0000 7f68b4dff700 1 -- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f689006ad70 msgr2=0x7f689006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:22.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.859+0000 7f68b4dff700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f689006ad70 0x7f689006d220 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f68a0000fb0 tx=0x7f68a0009040 comp rx=0 tx=0).stop 2023-07-09T21:52:22.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.859+0000 7f68b4dff700 1 -- 172.21.15.53:0/2347947752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b00d1220 msgr2=0x7f68b015b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:22.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.859+0000 7f68b4dff700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b00d1220 0x7f68b015b810 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f68a800b370 tx=0x7f68a8004ad0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.859+0000 7f68b4dff700 1 -- 172.21.15.53:0/2347947752 shutdown_connections 2023-07-09T21:52:22.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.859+0000 7f68b4dff700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f689006ad70 0x7f689006d220 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.859+0000 7f68b4dff700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b00d1220 0x7f68b015b810 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.859+0000 7f68b4dff700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68b00b1e00 0x7f68b0155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.859+0000 7f68b4dff700 1 --2- 172.21.15.53:0/2347947752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68b00b2350 0x7f68b015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:22.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.859+0000 7f68b4dff700 1 -- 172.21.15.53:0/2347947752 >> 172.21.15.53:0/2347947752 conn(0x7f68b009c1d0 msgr2=0x7f68b00b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:22.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.859+0000 7f68b4dff700 1 -- 172.21.15.53:0/2347947752 shutdown_connections 2023-07-09T21:52:22.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:22.859+0000 7f68b4dff700 1 -- 172.21.15.53:0/2347947752 wait complete. 2023-07-09T21:52:22.878 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T21:52:22.879 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:52:23.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.080+0000 7f9aee7ff700 1 Processor -- start 2023-07-09T21:52:23.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.080+0000 7f9aee7ff700 1 -- start start 2023-07-09T21:52:23.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.082+0000 7f9aee7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae80b2350 0x7f9ae80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.082+0000 7f9aee7ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae80d2ce0 con 0x7f9ae80b1e00 2023-07-09T21:52:23.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.082+0000 7f9aee7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae80b3350 con 0x7f9ae80d1220 2023-07-09T21:52:23.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.082+0000 7f9aee7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80b3630 con 0x7f9ae80b2350 2023-07-09T21:52:23.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.082+0000 7f9ae7fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9ae80b1e00 0x7f9ae80d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46420/0 (socket says 172.21.15.53:46420) 2023-07-09T21:52:23.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.082+0000 7f9ae7fff700 1 -- 172.21.15.53:0/3622714003 learned_addr learned my addr 172.21.15.53:0/3622714003 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:23.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.082+0000 7f9aecd9c700 1 --2- 172.21.15.53:0/3622714003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae80b2350 0x7f9ae80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.082+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474034693 0 0) 0x7f9ae80d2ce0 con 0x7f9ae80b1e00 2023-07-09T21:52:23.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.082+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ad00035b0 con 0x7f9ae80b1e00 2023-07-09T21:52:23.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2540055742 0 0) 0x7f9ad00035b0 con 0x7f9ae80b1e00 2023-07-09T21:52:23.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae80b2350 msgr2=0x7f9ae80b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:23.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae6ffd700 1 --2- 172.21.15.53:0/3622714003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae80b2350 0x7f9ae80b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 >> v1:172.21.15.184:6789/0 conn(0x7f9ae80d1220 legacy=0x7f9ae80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:23.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae80b3910 con 0x7f9ae80b1e00 2023-07-09T21:52:23.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f9ad80017f0 con 0x7f9ae80b1e00 2023-07-09T21:52:23.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 >> v1:172.21.15.53:6789/0 conn(0x7f9ae80b1e00 legacy=0x7f9ae80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:23.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae6ffd700 1 --2- 172.21.15.53:0/3622714003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad0003a30 0x7f9ad0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae6ffd700 1 --2- 172.21.15.53:0/3622714003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae80b2350 0x7f9ad0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae6ffd700 1 --2- 172.21.15.53:0/3622714003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ad0004d90 0x7f9ad0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80b3630 con 0x7f9ad0004d90 2023-07-09T21:52:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad000bba0 con 0x7f9ad0003a30 2023-07-09T21:52:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad000bd60 con 0x7f9ae80b2350 2023-07-09T21:52:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9aecd9c700 1 --2- 172.21.15.53:0/3622714003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ad0004d90 0x7f9ad0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae77fe700 1 --2- 172.21.15.53:0/3622714003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae80b2350 0x7f9ad0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.083+0000 7f9ae7fff700 1 --2- 172.21.15.53:0/3622714003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad0003a30 0x7f9ad0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.084+0000 7f9aecd9c700 1 -- 172.21.15.53:0/3622714003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae80b2350 msgr2=0x7f9ad0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:23.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.084+0000 7f9aecd9c700 1 --2- 172.21.15.53:0/3622714003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae80b2350 0x7f9ad0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.084+0000 7f9aecd9c700 1 -- 172.21.15.53:0/3622714003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad0003a30 msgr2=0x7f9ad0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:23.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.084+0000 7f9aecd9c700 1 --2- 172.21.15.53:0/3622714003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad0003a30 0x7f9ad0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.084+0000 7f9aecd9c700 1 -- 172.21.15.53:0/3622714003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad00035b0 con 0x7f9ad0004d90 2023-07-09T21:52:23.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.084+0000 7f9aecd9c700 1 --2- 172.21.15.53:0/3622714003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ad0004d90 0x7f9ad0005200 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009fc0 tx=0x7f9ad0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a02638bbda415b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:23.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.084+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae000ec30 con 0x7f9ad0004d90 2023-07-09T21:52:23.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.084+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae000f040 con 0x7f9ad0004d90 2023-07-09T21:52:23.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.084+0000 7f9ae6ffd700 1 -- 172.21.15.53:0/3622714003 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0014480 con 0x7f9ad0004d90 2023-07-09T21:52:23.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.085+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3622714003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ad0004d90 msgr2=0x7f9ad0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:23.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.085+0000 7f9aee7ff700 1 --2- 172.21.15.53:0/3622714003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ad0004d90 0x7f9ad0005200 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009fc0 tx=0x7f9ad0005880 comp rx=0 tx=0).stop 2023-07-09T21:52:23.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.085+0000 7f9aecd9c700 1 -- 172.21.15.53:0/3622714003 reap_dead start 2023-07-09T21:52:23.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.085+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3622714003 shutdown_connections 2023-07-09T21:52:23.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.085+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3622714003 >> 172.21.15.53:0/3622714003 conn(0x7f9ae809c1d0 msgr2=0x7f9ae80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:23.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.085+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3622714003 shutdown_connections 2023-07-09T21:52:23.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.085+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3622714003 wait complete. 2023-07-09T21:52:23.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.087+0000 7f9aee7ff700 1 Processor -- start 2023-07-09T21:52:23.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.087+0000 7f9aee7ff700 1 -- start start 2023-07-09T21:52:23.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aee7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad0004d90 0x7f9ae80c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aee7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae8154910 0x7f9ae8154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aee7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ae80c8d80 0x7f9ae80c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aee7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae8156480 con 0x7f9ae80c8d80 2023-07-09T21:52:23.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aee7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae81552c0 con 0x7f9ad0004d90 2023-07-09T21:52:23.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aee7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80c7330 con 0x7f9ae8154910 2023-07-09T21:52:23.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aecd9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ae80c8d80 0x7f9ae80c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aecd9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ae80c8d80 0x7f9ae80c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34702/0 (socket says 172.21.15.53:34702) 2023-07-09T21:52:23.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aecd9c700 1 -- 172.21.15.53:0/3840592234 learned_addr learned my addr 172.21.15.53:0/3840592234 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:23.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9ae7fff700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad0004d90 0x7f9ae80c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9ae77fe700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae8154910 0x7f9ae8154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aecd9c700 1 -- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae8154910 msgr2=0x7f9ae8154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:23.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aecd9c700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae8154910 0x7f9ae8154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aecd9c700 1 -- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad0004d90 msgr2=0x7f9ae80c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:23.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aecd9c700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad0004d90 0x7f9ae80c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9aecd9c700 1 -- 172.21.15.53:0/3840592234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae80c7050 con 0x7f9ae80c8d80 2023-07-09T21:52:23.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9ae7fff700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad0004d90 0x7f9ae80c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:23.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.088+0000 7f9ae77fe700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae8154910 0x7f9ae8154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:23.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.089+0000 7f9aecd9c700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ae80c8d80 0x7f9ae80c91f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0005830 tx=0x7f9ae0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:23.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.089+0000 7f9ae4ff9700 1 -- 172.21.15.53:0/3840592234 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0014890 con 0x7f9ae80c8d80 2023-07-09T21:52:23.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.089+0000 7f9ae4ff9700 1 -- 172.21.15.53:0/3840592234 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae0014a30 con 0x7f9ae80c8d80 2023-07-09T21:52:23.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.089+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3840592234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae8155dc0 con 0x7f9ae80c8d80 2023-07-09T21:52:23.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.089+0000 7f9ae4ff9700 1 -- 172.21.15.53:0/3840592234 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0014de0 con 0x7f9ae80c8d80 2023-07-09T21:52:23.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.089+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3840592234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae80c9730 con 0x7f9ae80c8d80 2023-07-09T21:52:23.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.090+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3840592234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae81565c0 con 0x7f9ae80c8d80 2023-07-09T21:52:23.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.091+0000 7f9ae4ff9700 1 -- 172.21.15.53:0/3840592234 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f9ae0023020 con 0x7f9ae80c8d80 2023-07-09T21:52:23.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.092+0000 7f9ae4ff9700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9ad406ad70 0x7f9ad406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.092+0000 7f9ae4ff9700 1 -- 172.21.15.53:0/3840592234 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ae008a950 con 0x7f9ae80c8d80 2023-07-09T21:52:23.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.093+0000 7f9ae7fff700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9ad406ad70 0x7f9ad406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.093+0000 7f9ae7fff700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9ad406ad70 0x7f9ad406d220 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8000c00 tx=0x7f9ad8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:23.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.096+0000 7f9ae4ff9700 1 -- 172.21.15.53:0/3840592234 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9ae81565c0 con 0x7f9ae80c8d80 2023-07-09T21:52:23.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.305+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3840592234 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ae8155c40 con 0x7f9ad406ad70 2023-07-09T21:52:23.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.317+0000 7f9ae4ff9700 1 -- 172.21.15.53:0/3840592234 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307485 (secure 0 0 0) 0x7f9ad8005d50 con 0x7f9ad406ad70 2023-07-09T21:52:23.321 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:23.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.320+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9ad406ad70 msgr2=0x7f9ad406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:23.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.320+0000 7f9aee7ff700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9ad406ad70 0x7f9ad406d220 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8000c00 tx=0x7f9ad8009040 comp rx=0 tx=0).stop 2023-07-09T21:52:23.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.320+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3840592234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ae80c8d80 msgr2=0x7f9ae80c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:23.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.320+0000 7f9aee7ff700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ae80c8d80 0x7f9ae80c91f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0005830 tx=0x7f9ae0009750 comp rx=0 tx=0).stop 2023-07-09T21:52:23.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.321+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3840592234 shutdown_connections 2023-07-09T21:52:23.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.321+0000 7f9aee7ff700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9ad406ad70 0x7f9ad406d220 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.321+0000 7f9aee7ff700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ae80c8d80 0x7f9ae80c91f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.321+0000 7f9aee7ff700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad0004d90 0x7f9ae80c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.321+0000 7f9aee7ff700 1 --2- 172.21.15.53:0/3840592234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ae8154910 0x7f9ae8154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.321+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3840592234 >> 172.21.15.53:0/3840592234 conn(0x7f9ae809c1d0 msgr2=0x7f9ae8158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:23.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.321+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3840592234 shutdown_connections 2023-07-09T21:52:23.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.321+0000 7f9aee7ff700 1 -- 172.21.15.53:0/3840592234 wait complete. 2023-07-09T21:52:23.328 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:52:23.340 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-07-09T21:52:22.879902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225248,"kb_used_data":5536,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754749472,"statfs":{"total":773094113280,"available":772863459328,"internally_reserved":0,"allocated":5668864,"data_stored":3086576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001308"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.903687+0000","last_change":"2023-07-09T21:52:18.896951+0000","last_active":"2023-07-09T21:52:18.903687+0000","last_peered":"2023-07-09T21:52:18.903687+0000","last_clean":"2023-07-09T21:52:18.903687+0000","last_became_active":"2023-07-09T21:52:18.896617+0000","last_became_peered":"2023-07-09T21:52:18.896617+0000","last_unstale":"2023-07-09T21:52:18.903687+0000","last_undegraded":"2023-07-09T21:52:18.903687+0000","last_fullsized":"2023-07-09T21:52:18.903687+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:06:54.804905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894881+0000","last_change":"2023-07-09T21:52:17.894881+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894881+0000","last_undegraded":"2023-07-09T21:52:17.894881+0000","last_fullsized":"2023-07-09T21:52:17.894881+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897443+0000","last_change":"2023-07-09T21:52:17.897443+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897443+0000","last_undegraded":"2023-07-09T21:52:17.897443+0000","last_fullsized":"2023-07-09T21:52:17.897443+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893933+0000","last_change":"2023-07-09T21:52:17.893933+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893933+0000","last_undegraded":"2023-07-09T21:52:17.893933+0000","last_fullsized":"2023-07-09T21:52:17.893933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.909927+0000","last_change":"2023-07-09T21:52:18.906085+0000","last_active":"2023-07-09T21:52:18.909927+0000","last_peered":"2023-07-09T21:52:18.909927+0000","last_clean":"2023-07-09T21:52:18.909927+0000","last_became_active":"2023-07-09T21:52:18.905771+0000","last_became_peered":"2023-07-09T21:52:18.905771+0000","last_unstale":"2023-07-09T21:52:18.909927+0000","last_undegraded":"2023-07-09T21:52:18.909927+0000","last_fullsized":"2023-07-09T21:52:18.909927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:26:23.107762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.921492+0000","last_change":"2023-07-09T21:52:18.909739+0000","last_active":"2023-07-09T21:52:18.921492+0000","last_peered":"2023-07-09T21:52:18.921492+0000","last_clean":"2023-07-09T21:52:18.921492+0000","last_became_active":"2023-07-09T21:52:18.906431+0000","last_became_peered":"2023-07-09T21:52:18.906431+0000","last_unstale":"2023-07-09T21:52:18.921492+0000","last_undegraded":"2023-07-09T21:52:18.921492+0000","last_fullsized":"2023-07-09T21:52:18.921492+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:38:10.323423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.899030+0000","last_change":"2023-07-09T21:52:17.899030+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.899030+0000","last_undegraded":"2023-07-09T21:52:17.899030+0000","last_fullsized":"2023-07-09T21:52:17.899030+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892045+0000","last_change":"2023-07-09T21:52:17.892045+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892045+0000","last_undegraded":"2023-07-09T21:52:17.892045+0000","last_fullsized":"2023-07-09T21:52:17.892045+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894172+0000","last_change":"2023-07-09T21:52:17.894172+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894172+0000","last_undegraded":"2023-07-09T21:52:17.894172+0000","last_fullsized":"2023-07-09T21:52:17.894172+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.913102+0000","last_change":"2023-07-09T21:52:18.905734+0000","last_active":"2023-07-09T21:52:18.913102+0000","last_peered":"2023-07-09T21:52:18.913102+0000","last_clean":"2023-07-09T21:52:18.913102+0000","last_became_active":"2023-07-09T21:52:18.905379+0000","last_became_peered":"2023-07-09T21:52:18.905379+0000","last_unstale":"2023-07-09T21:52:18.913102+0000","last_undegraded":"2023-07-09T21:52:18.913102+0000","last_fullsized":"2023-07-09T21:52:18.913102+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:54.518646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897343+0000","last_change":"2023-07-09T21:52:17.897343+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897343+0000","last_undegraded":"2023-07-09T21:52:17.897343+0000","last_fullsized":"2023-07-09T21:52:17.897343+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891282+0000","last_change":"2023-07-09T21:52:17.891282+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891282+0000","last_undegraded":"2023-07-09T21:52:17.891282+0000","last_fullsized":"2023-07-09T21:52:17.891282+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.921153+0000","last_change":"2023-07-09T21:52:18.906003+0000","last_active":"2023-07-09T21:52:18.921153+0000","last_peered":"2023-07-09T21:52:18.921153+0000","last_clean":"2023-07-09T21:52:18.921153+0000","last_became_active":"2023-07-09T21:52:18.905760+0000","last_became_peered":"2023-07-09T21:52:18.905760+0000","last_unstale":"2023-07-09T21:52:18.921153+0000","last_undegraded":"2023-07-09T21:52:18.921153+0000","last_fullsized":"2023-07-09T21:52:18.921153+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:48:19.857604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897968+0000","last_change":"2023-07-09T21:52:17.897968+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897968+0000","last_undegraded":"2023-07-09T21:52:17.897968+0000","last_fullsized":"2023-07-09T21:52:17.897968+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893772+0000","last_change":"2023-07-09T21:52:17.893772+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893772+0000","last_undegraded":"2023-07-09T21:52:17.893772+0000","last_fullsized":"2023-07-09T21:52:17.893772+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.916614+0000","last_change":"2023-07-09T21:52:18.906627+0000","last_active":"2023-07-09T21:52:18.916614+0000","last_peered":"2023-07-09T21:52:18.916614+0000","last_clean":"2023-07-09T21:52:18.916614+0000","last_became_active":"2023-07-09T21:52:18.906352+0000","last_became_peered":"2023-07-09T21:52:18.906352+0000","last_unstale":"2023-07-09T21:52:18.916614+0000","last_undegraded":"2023-07-09T21:52:18.916614+0000","last_fullsized":"2023-07-09T21:52:18.916614+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:56:25.759336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.901501+0000","last_change":"2023-07-09T21:52:17.901501+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.901501+0000","last_undegraded":"2023-07-09T21:52:17.901501+0000","last_fullsized":"2023-07-09T21:52:17.901501+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894401+0000","last_change":"2023-07-09T21:52:17.894401+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894401+0000","last_undegraded":"2023-07-09T21:52:17.894401+0000","last_fullsized":"2023-07-09T21:52:17.894401+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896966+0000","last_change":"2023-07-09T21:52:17.896966+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896966+0000","last_undegraded":"2023-07-09T21:52:17.896966+0000","last_fullsized":"2023-07-09T21:52:17.896966+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895814+0000","last_change":"2023-07-09T21:52:17.895814+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895814+0000","last_undegraded":"2023-07-09T21:52:17.895814+0000","last_fullsized":"2023-07-09T21:52:17.895814+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894824+0000","last_change":"2023-07-09T21:52:17.894824+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894824+0000","last_undegraded":"2023-07-09T21:52:17.894824+0000","last_fullsized":"2023-07-09T21:52:17.894824+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892776+0000","last_change":"2023-07-09T21:52:17.892776+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892776+0000","last_undegraded":"2023-07-09T21:52:17.892776+0000","last_fullsized":"2023-07-09T21:52:17.892776+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897885+0000","last_change":"2023-07-09T21:52:17.897885+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897885+0000","last_undegraded":"2023-07-09T21:52:17.897885+0000","last_fullsized":"2023-07-09T21:52:17.897885+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.898974+0000","last_change":"2023-07-09T21:52:17.898974+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.898974+0000","last_undegraded":"2023-07-09T21:52:17.898974+0000","last_fullsized":"2023-07-09T21:52:17.898974+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897689+0000","last_change":"2023-07-09T21:52:17.897689+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897689+0000","last_undegraded":"2023-07-09T21:52:17.897689+0000","last_fullsized":"2023-07-09T21:52:17.897689+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893441+0000","last_change":"2023-07-09T21:52:17.893441+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893441+0000","last_undegraded":"2023-07-09T21:52:17.893441+0000","last_fullsized":"2023-07-09T21:52:17.893441+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.928117+0000","last_change":"2023-07-09T21:52:18.926059+0000","last_active":"2023-07-09T21:52:18.928117+0000","last_peered":"2023-07-09T21:52:18.928117+0000","last_clean":"2023-07-09T21:52:18.928117+0000","last_became_active":"2023-07-09T21:52:18.925784+0000","last_became_peered":"2023-07-09T21:52:18.925784+0000","last_unstale":"2023-07-09T21:52:18.928117+0000","last_undegraded":"2023-07-09T21:52:18.928117+0000","last_fullsized":"2023-07-09T21:52:18.928117+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:54:22.307888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895023+0000","last_change":"2023-07-09T21:52:17.895023+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895023+0000","last_undegraded":"2023-07-09T21:52:17.895023+0000","last_fullsized":"2023-07-09T21:52:17.895023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896082+0000","last_change":"2023-07-09T21:52:17.896082+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896082+0000","last_undegraded":"2023-07-09T21:52:17.896082+0000","last_fullsized":"2023-07-09T21:52:17.896082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896237+0000","last_change":"2023-07-09T21:52:17.896237+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896237+0000","last_undegraded":"2023-07-09T21:52:17.896237+0000","last_fullsized":"2023-07-09T21:52:17.896237+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.898105+0000","last_change":"2023-07-09T21:52:17.898105+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.898105+0000","last_undegraded":"2023-07-09T21:52:17.898105+0000","last_fullsized":"2023-07-09T21:52:17.898105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892847+0000","last_change":"2023-07-09T21:52:17.892847+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892847+0000","last_undegraded":"2023-07-09T21:52:17.892847+0000","last_fullsized":"2023-07-09T21:52:17.892847+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893853+0000","last_change":"2023-07-09T21:52:17.893853+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893853+0000","last_undegraded":"2023-07-09T21:52:17.893853+0000","last_fullsized":"2023-07-09T21:52:17.893853+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912675+0000","last_change":"2023-07-09T21:52:17.905074+0000","last_active":"2023-07-09T21:52:17.912675+0000","last_peered":"2023-07-09T21:52:17.912675+0000","last_clean":"2023-07-09T21:52:17.912675+0000","last_became_active":"2023-07-09T21:52:17.904791+0000","last_became_peered":"2023-07-09T21:52:17.904791+0000","last_unstale":"2023-07-09T21:52:17.912675+0000","last_undegraded":"2023-07-09T21:52:17.912675+0000","last_fullsized":"2023-07-09T21:52:17.912675+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:42:18.230865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891253+0000","last_change":"2023-07-09T21:52:17.891253+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891253+0000","last_undegraded":"2023-07-09T21:52:17.891253+0000","last_fullsized":"2023-07-09T21:52:17.891253+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.926314+0000","last_change":"2023-07-09T21:52:17.903525+0000","last_active":"2023-07-09T21:52:18.926314+0000","last_peered":"2023-07-09T21:52:18.926314+0000","last_clean":"2023-07-09T21:52:18.926314+0000","last_became_active":"2023-07-09T21:52:17.900909+0000","last_became_peered":"2023-07-09T21:52:17.900909+0000","last_unstale":"2023-07-09T21:52:18.926314+0000","last_undegraded":"2023-07-09T21:52:18.926314+0000","last_fullsized":"2023-07-09T21:52:18.926314+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:21:52.052315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895397+0000","last_change":"2023-07-09T21:52:17.895397+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895397+0000","last_undegraded":"2023-07-09T21:52:17.895397+0000","last_fullsized":"2023-07-09T21:52:17.895397+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.925131+0000","last_change":"2023-07-09T21:52:17.909999+0000","last_active":"2023-07-09T21:52:18.925131+0000","last_peered":"2023-07-09T21:52:18.925131+0000","last_clean":"2023-07-09T21:52:18.925131+0000","last_became_active":"2023-07-09T21:52:17.909580+0000","last_became_peered":"2023-07-09T21:52:17.909580+0000","last_unstale":"2023-07-09T21:52:18.925131+0000","last_undegraded":"2023-07-09T21:52:18.925131+0000","last_fullsized":"2023-07-09T21:52:18.925131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:25.952731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892858+0000","last_change":"2023-07-09T21:52:17.892858+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892858+0000","last_undegraded":"2023-07-09T21:52:17.892858+0000","last_fullsized":"2023-07-09T21:52:17.892858+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.907556+0000","last_change":"2023-07-09T21:52:17.903946+0000","last_active":"2023-07-09T21:52:17.907556+0000","last_peered":"2023-07-09T21:52:17.907556+0000","last_clean":"2023-07-09T21:52:17.907556+0000","last_became_active":"2023-07-09T21:52:17.903690+0000","last_became_peered":"2023-07-09T21:52:17.903690+0000","last_unstale":"2023-07-09T21:52:17.907556+0000","last_undegraded":"2023-07-09T21:52:17.907556+0000","last_fullsized":"2023-07-09T21:52:17.907556+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:10:56.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.928388+0000","last_change":"2023-07-09T21:52:18.925285+0000","last_active":"2023-07-09T21:52:18.928388+0000","last_peered":"2023-07-09T21:52:18.928388+0000","last_clean":"2023-07-09T21:52:18.928388+0000","last_became_active":"2023-07-09T21:52:18.924973+0000","last_became_peered":"2023-07-09T21:52:18.924973+0000","last_unstale":"2023-07-09T21:52:18.928388+0000","last_undegraded":"2023-07-09T21:52:18.928388+0000","last_fullsized":"2023-07-09T21:52:18.928388+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:09:17.629077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.915950+0000","last_change":"2023-07-09T21:52:17.914742+0000","last_active":"2023-07-09T21:52:17.915950+0000","last_peered":"2023-07-09T21:52:17.915950+0000","last_clean":"2023-07-09T21:52:17.915950+0000","last_became_active":"2023-07-09T21:52:17.914452+0000","last_became_peered":"2023-07-09T21:52:17.914452+0000","last_unstale":"2023-07-09T21:52:17.915950+0000","last_undegraded":"2023-07-09T21:52:17.915950+0000","last_fullsized":"2023-07-09T21:52:17.915950+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:00.889871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895429+0000","last_change":"2023-07-09T21:52:17.895429+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895429+0000","last_undegraded":"2023-07-09T21:52:17.895429+0000","last_fullsized":"2023-07-09T21:52:17.895429+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.916522+0000","last_change":"2023-07-09T21:52:17.901241+0000","last_active":"2023-07-09T21:52:18.916522+0000","last_peered":"2023-07-09T21:52:18.916522+0000","last_clean":"2023-07-09T21:52:18.916522+0000","last_became_active":"2023-07-09T21:52:17.900934+0000","last_became_peered":"2023-07-09T21:52:17.900934+0000","last_unstale":"2023-07-09T21:52:18.916522+0000","last_undegraded":"2023-07-09T21:52:18.916522+0000","last_fullsized":"2023-07-09T21:52:18.916522+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:10:39.535148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896760+0000","last_change":"2023-07-09T21:52:17.896760+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896760+0000","last_undegraded":"2023-07-09T21:52:17.896760+0000","last_fullsized":"2023-07-09T21:52:17.896760+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912702+0000","last_change":"2023-07-09T21:52:17.905888+0000","last_active":"2023-07-09T21:52:17.912702+0000","last_peered":"2023-07-09T21:52:17.912702+0000","last_clean":"2023-07-09T21:52:17.912702+0000","last_became_active":"2023-07-09T21:52:17.905601+0000","last_became_peered":"2023-07-09T21:52:17.905601+0000","last_unstale":"2023-07-09T21:52:17.912702+0000","last_undegraded":"2023-07-09T21:52:17.912702+0000","last_fullsized":"2023-07-09T21:52:17.912702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:11.342048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894467+0000","last_change":"2023-07-09T21:52:17.894467+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894467+0000","last_undegraded":"2023-07-09T21:52:17.894467+0000","last_fullsized":"2023-07-09T21:52:17.894467+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912774+0000","last_change":"2023-07-09T21:52:17.908242+0000","last_active":"2023-07-09T21:52:17.912774+0000","last_peered":"2023-07-09T21:52:17.912774+0000","last_clean":"2023-07-09T21:52:17.912774+0000","last_became_active":"2023-07-09T21:52:17.907897+0000","last_became_peered":"2023-07-09T21:52:17.907897+0000","last_unstale":"2023-07-09T21:52:17.912774+0000","last_undegraded":"2023-07-09T21:52:17.912774+0000","last_fullsized":"2023-07-09T21:52:17.912774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:39:54.273358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.919811+0000","last_change":"2023-07-09T21:52:18.916918+0000","last_active":"2023-07-09T21:52:18.919811+0000","last_peered":"2023-07-09T21:52:18.919811+0000","last_clean":"2023-07-09T21:52:18.919811+0000","last_became_active":"2023-07-09T21:52:18.916633+0000","last_became_peered":"2023-07-09T21:52:18.916633+0000","last_unstale":"2023-07-09T21:52:18.919811+0000","last_undegraded":"2023-07-09T21:52:18.919811+0000","last_fullsized":"2023-07-09T21:52:18.919811+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:49.611360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.905628+0000","last_change":"2023-07-09T21:52:17.902773+0000","last_active":"2023-07-09T21:52:17.905628+0000","last_peered":"2023-07-09T21:52:17.905628+0000","last_clean":"2023-07-09T21:52:17.905628+0000","last_became_active":"2023-07-09T21:52:17.902245+0000","last_became_peered":"2023-07-09T21:52:17.902245+0000","last_unstale":"2023-07-09T21:52:17.905628+0000","last_undegraded":"2023-07-09T21:52:17.905628+0000","last_fullsized":"2023-07-09T21:52:17.905628+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:23:31.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891996+0000","last_change":"2023-07-09T21:52:17.891996+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891996+0000","last_undegraded":"2023-07-09T21:52:17.891996+0000","last_fullsized":"2023-07-09T21:52:17.891996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.897292+0000","last_change":"2023-07-09T21:52:17.907414+0000","last_active":"2023-07-09T21:52:18.897292+0000","last_peered":"2023-07-09T21:52:18.897292+0000","last_clean":"2023-07-09T21:52:18.897292+0000","last_became_active":"2023-07-09T21:52:17.906862+0000","last_became_peered":"2023-07-09T21:52:17.906862+0000","last_unstale":"2023-07-09T21:52:18.897292+0000","last_undegraded":"2023-07-09T21:52:18.897292+0000","last_fullsized":"2023-07-09T21:52:18.897292+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:12:51.306577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895637+0000","last_change":"2023-07-09T21:52:17.895637+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895637+0000","last_undegraded":"2023-07-09T21:52:17.895637+0000","last_fullsized":"2023-07-09T21:52:17.895637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.919431+0000","last_change":"2023-07-09T21:52:17.916134+0000","last_active":"2023-07-09T21:52:17.919431+0000","last_peered":"2023-07-09T21:52:17.919431+0000","last_clean":"2023-07-09T21:52:17.919431+0000","last_became_active":"2023-07-09T21:52:17.915830+0000","last_became_peered":"2023-07-09T21:52:17.915830+0000","last_unstale":"2023-07-09T21:52:17.919431+0000","last_undegraded":"2023-07-09T21:52:17.919431+0000","last_fullsized":"2023-07-09T21:52:17.919431+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:40:31.700445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.917698+0000","last_change":"2023-07-09T21:52:18.913106+0000","last_active":"2023-07-09T21:52:18.917698+0000","last_peered":"2023-07-09T21:52:18.917698+0000","last_clean":"2023-07-09T21:52:18.917698+0000","last_became_active":"2023-07-09T21:52:18.912827+0000","last_became_peered":"2023-07-09T21:52:18.912827+0000","last_unstale":"2023-07-09T21:52:18.917698+0000","last_undegraded":"2023-07-09T21:52:18.917698+0000","last_fullsized":"2023-07-09T21:52:18.917698+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:39.589410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.915152+0000","last_change":"2023-07-09T21:52:17.906739+0000","last_active":"2023-07-09T21:52:17.915152+0000","last_peered":"2023-07-09T21:52:17.915152+0000","last_clean":"2023-07-09T21:52:17.915152+0000","last_became_active":"2023-07-09T21:52:17.906459+0000","last_became_peered":"2023-07-09T21:52:17.906459+0000","last_unstale":"2023-07-09T21:52:17.915152+0000","last_undegraded":"2023-07-09T21:52:17.915152+0000","last_fullsized":"2023-07-09T21:52:17.915152+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:07:25.576893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891845+0000","last_change":"2023-07-09T21:52:17.891845+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891845+0000","last_undegraded":"2023-07-09T21:52:17.891845+0000","last_fullsized":"2023-07-09T21:52:17.891845+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912909+0000","last_change":"2023-07-09T21:52:17.908750+0000","last_active":"2023-07-09T21:52:17.912909+0000","last_peered":"2023-07-09T21:52:17.912909+0000","last_clean":"2023-07-09T21:52:17.912909+0000","last_became_active":"2023-07-09T21:52:17.908498+0000","last_became_peered":"2023-07-09T21:52:17.908498+0000","last_unstale":"2023-07-09T21:52:17.912909+0000","last_undegraded":"2023-07-09T21:52:17.912909+0000","last_fullsized":"2023-07-09T21:52:17.912909+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:37:35.072028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896492+0000","last_change":"2023-07-09T21:52:17.896492+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896492+0000","last_undegraded":"2023-07-09T21:52:17.896492+0000","last_fullsized":"2023-07-09T21:52:17.896492+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.916580+0000","last_change":"2023-07-09T21:52:17.913662+0000","last_active":"2023-07-09T21:52:17.916580+0000","last_peered":"2023-07-09T21:52:17.916580+0000","last_clean":"2023-07-09T21:52:17.916580+0000","last_became_active":"2023-07-09T21:52:17.913376+0000","last_became_peered":"2023-07-09T21:52:17.913376+0000","last_unstale":"2023-07-09T21:52:17.916580+0000","last_undegraded":"2023-07-09T21:52:17.916580+0000","last_fullsized":"2023-07-09T21:52:17.916580+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:16:51.455702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897182+0000","last_change":"2023-07-09T21:52:17.897182+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897182+0000","last_undegraded":"2023-07-09T21:52:17.897182+0000","last_fullsized":"2023-07-09T21:52:17.897182+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912824+0000","last_change":"2023-07-09T21:52:17.906064+0000","last_active":"2023-07-09T21:52:17.912824+0000","last_peered":"2023-07-09T21:52:17.912824+0000","last_clean":"2023-07-09T21:52:17.912824+0000","last_became_active":"2023-07-09T21:52:17.905765+0000","last_became_peered":"2023-07-09T21:52:17.905765+0000","last_unstale":"2023-07-09T21:52:17.912824+0000","last_undegraded":"2023-07-09T21:52:17.912824+0000","last_fullsized":"2023-07-09T21:52:17.912824+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:15:03.562144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897286+0000","last_change":"2023-07-09T21:52:17.897286+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897286+0000","last_undegraded":"2023-07-09T21:52:17.897286+0000","last_fullsized":"2023-07-09T21:52:17.897286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.914788+0000","last_change":"2023-07-09T21:52:17.906688+0000","last_active":"2023-07-09T21:52:17.914788+0000","last_peered":"2023-07-09T21:52:17.914788+0000","last_clean":"2023-07-09T21:52:17.914788+0000","last_became_active":"2023-07-09T21:52:17.906355+0000","last_became_peered":"2023-07-09T21:52:17.906355+0000","last_unstale":"2023-07-09T21:52:17.914788+0000","last_undegraded":"2023-07-09T21:52:17.914788+0000","last_fullsized":"2023-07-09T21:52:17.914788+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:37:30.965031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891413+0000","last_change":"2023-07-09T21:52:17.891413+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891413+0000","last_undegraded":"2023-07-09T21:52:17.891413+0000","last_fullsized":"2023-07-09T21:52:17.891413+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.917352+0000","last_change":"2023-07-09T21:52:17.915757+0000","last_active":"2023-07-09T21:52:17.917352+0000","last_peered":"2023-07-09T21:52:17.917352+0000","last_clean":"2023-07-09T21:52:17.917352+0000","last_became_active":"2023-07-09T21:52:17.915396+0000","last_became_peered":"2023-07-09T21:52:17.915396+0000","last_unstale":"2023-07-09T21:52:17.917352+0000","last_undegraded":"2023-07-09T21:52:17.917352+0000","last_fullsized":"2023-07-09T21:52:17.917352+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:39.110613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.928099+0000","last_change":"2023-07-09T21:52:18.926116+0000","last_active":"2023-07-09T21:52:18.928099+0000","last_peered":"2023-07-09T21:52:18.928099+0000","last_clean":"2023-07-09T21:52:18.928099+0000","last_became_active":"2023-07-09T21:52:18.925663+0000","last_became_peered":"2023-07-09T21:52:18.925663+0000","last_unstale":"2023-07-09T21:52:18.928099+0000","last_undegraded":"2023-07-09T21:52:18.928099+0000","last_fullsized":"2023-07-09T21:52:18.928099+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:03:51.789345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.913725+0000","last_change":"2023-07-09T21:52:17.908662+0000","last_active":"2023-07-09T21:52:17.913725+0000","last_peered":"2023-07-09T21:52:17.913725+0000","last_clean":"2023-07-09T21:52:17.913725+0000","last_became_active":"2023-07-09T21:52:17.908390+0000","last_became_peered":"2023-07-09T21:52:17.908390+0000","last_unstale":"2023-07-09T21:52:17.913725+0000","last_undegraded":"2023-07-09T21:52:17.913725+0000","last_fullsized":"2023-07-09T21:52:17.913725+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:43:58.667439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.928389+0000","last_change":"2023-07-09T21:52:18.925491+0000","last_active":"2023-07-09T21:52:18.928389+0000","last_peered":"2023-07-09T21:52:18.928389+0000","last_clean":"2023-07-09T21:52:18.928389+0000","last_became_active":"2023-07-09T21:52:18.925165+0000","last_became_peered":"2023-07-09T21:52:18.925165+0000","last_unstale":"2023-07-09T21:52:18.928389+0000","last_undegraded":"2023-07-09T21:52:18.928389+0000","last_fullsized":"2023-07-09T21:52:18.928389+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:35:19.222250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912643+0000","last_change":"2023-07-09T21:52:17.905001+0000","last_active":"2023-07-09T21:52:17.912643+0000","last_peered":"2023-07-09T21:52:17.912643+0000","last_clean":"2023-07-09T21:52:17.912643+0000","last_became_active":"2023-07-09T21:52:17.904624+0000","last_became_peered":"2023-07-09T21:52:17.904624+0000","last_unstale":"2023-07-09T21:52:17.912643+0000","last_undegraded":"2023-07-09T21:52:17.912643+0000","last_fullsized":"2023-07-09T21:52:17.912643+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:54:30.292420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.896519+0000","last_change":"2023-07-09T21:52:18.894463+0000","last_active":"2023-07-09T21:52:18.896519+0000","last_peered":"2023-07-09T21:52:18.896519+0000","last_clean":"2023-07-09T21:52:18.896519+0000","last_became_active":"2023-07-09T21:52:18.894175+0000","last_became_peered":"2023-07-09T21:52:18.894175+0000","last_unstale":"2023-07-09T21:52:18.896519+0000","last_undegraded":"2023-07-09T21:52:18.896519+0000","last_fullsized":"2023-07-09T21:52:18.896519+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:10:51.118899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912588+0000","last_change":"2023-07-09T21:52:17.904083+0000","last_active":"2023-07-09T21:52:17.912588+0000","last_peered":"2023-07-09T21:52:17.912588+0000","last_clean":"2023-07-09T21:52:17.912588+0000","last_became_active":"2023-07-09T21:52:17.903804+0000","last_became_peered":"2023-07-09T21:52:17.903804+0000","last_unstale":"2023-07-09T21:52:17.912588+0000","last_undegraded":"2023-07-09T21:52:17.912588+0000","last_fullsized":"2023-07-09T21:52:17.912588+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:41.123866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893003+0000","last_change":"2023-07-09T21:52:17.893003+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893003+0000","last_undegraded":"2023-07-09T21:52:17.893003+0000","last_fullsized":"2023-07-09T21:52:17.893003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.927982+0000","last_change":"2023-07-09T21:52:17.901130+0000","last_active":"2023-07-09T21:52:18.927982+0000","last_peered":"2023-07-09T21:52:18.927982+0000","last_clean":"2023-07-09T21:52:18.927982+0000","last_became_active":"2023-07-09T21:52:17.900760+0000","last_became_peered":"2023-07-09T21:52:17.900760+0000","last_unstale":"2023-07-09T21:52:18.927982+0000","last_undegraded":"2023-07-09T21:52:18.927982+0000","last_fullsized":"2023-07-09T21:52:18.927982+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:25:10.181482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897055+0000","last_change":"2023-07-09T21:52:17.897055+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897055+0000","last_undegraded":"2023-07-09T21:52:17.897055+0000","last_fullsized":"2023-07-09T21:52:17.897055+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.914799+0000","last_change":"2023-07-09T21:52:17.903707+0000","last_active":"2023-07-09T21:52:17.914799+0000","last_peered":"2023-07-09T21:52:17.914799+0000","last_clean":"2023-07-09T21:52:17.914799+0000","last_became_active":"2023-07-09T21:52:17.903434+0000","last_became_peered":"2023-07-09T21:52:17.903434+0000","last_unstale":"2023-07-09T21:52:17.914799+0000","last_undegraded":"2023-07-09T21:52:17.914799+0000","last_fullsized":"2023-07-09T21:52:17.914799+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:11.148078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896838+0000","last_change":"2023-07-09T21:52:17.896838+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896838+0000","last_undegraded":"2023-07-09T21:52:17.896838+0000","last_fullsized":"2023-07-09T21:52:17.896838+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.917373+0000","last_change":"2023-07-09T21:52:17.916113+0000","last_active":"2023-07-09T21:52:17.917373+0000","last_peered":"2023-07-09T21:52:17.917373+0000","last_clean":"2023-07-09T21:52:17.917373+0000","last_became_active":"2023-07-09T21:52:17.915785+0000","last_became_peered":"2023-07-09T21:52:17.915785+0000","last_unstale":"2023-07-09T21:52:17.917373+0000","last_undegraded":"2023-07-09T21:52:17.917373+0000","last_fullsized":"2023-07-09T21:52:17.917373+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:39.204660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.923015+0000","last_change":"2023-07-09T21:52:18.920034+0000","last_active":"2023-07-09T21:52:18.923015+0000","last_peered":"2023-07-09T21:52:18.923015+0000","last_clean":"2023-07-09T21:52:18.923015+0000","last_became_active":"2023-07-09T21:52:18.919780+0000","last_became_peered":"2023-07-09T21:52:18.919780+0000","last_unstale":"2023-07-09T21:52:18.923015+0000","last_undegraded":"2023-07-09T21:52:18.923015+0000","last_fullsized":"2023-07-09T21:52:18.923015+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:12:09.611456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.913861+0000","last_change":"2023-07-09T21:52:17.906386+0000","last_active":"2023-07-09T21:52:17.913861+0000","last_peered":"2023-07-09T21:52:17.913861+0000","last_clean":"2023-07-09T21:52:17.913861+0000","last_became_active":"2023-07-09T21:52:17.906124+0000","last_became_peered":"2023-07-09T21:52:17.906124+0000","last_unstale":"2023-07-09T21:52:17.913861+0000","last_undegraded":"2023-07-09T21:52:17.913861+0000","last_fullsized":"2023-07-09T21:52:17.913861+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:07:31.780909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897337+0000","last_change":"2023-07-09T21:52:17.897337+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897337+0000","last_undegraded":"2023-07-09T21:52:17.897337+0000","last_fullsized":"2023-07-09T21:52:17.897337+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.895309+0000","last_change":"2023-07-09T21:52:17.900770+0000","last_active":"2023-07-09T21:52:18.895309+0000","last_peered":"2023-07-09T21:52:18.895309+0000","last_clean":"2023-07-09T21:52:18.895309+0000","last_became_active":"2023-07-09T21:52:17.900421+0000","last_became_peered":"2023-07-09T21:52:17.900421+0000","last_unstale":"2023-07-09T21:52:18.895309+0000","last_undegraded":"2023-07-09T21:52:18.895309+0000","last_fullsized":"2023-07-09T21:52:18.895309+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:25:21.334696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.889045+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:52:18.889045+0000","last_peered":"2023-07-09T21:52:18.889045+0000","last_clean":"2023-07-09T21:52:18.889045+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:52:18.889045+0000","last_undegraded":"2023-07-09T21:52:18.889045+0000","last_fullsized":"2023-07-09T21:52:18.889045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:10:16.058227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892399+0000","last_change":"2023-07-09T21:52:17.892399+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892399+0000","last_undegraded":"2023-07-09T21:52:17.892399+0000","last_fullsized":"2023-07-09T21:52:17.892399+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.913545+0000","last_change":"2023-07-09T21:52:17.907945+0000","last_active":"2023-07-09T21:52:17.913545+0000","last_peered":"2023-07-09T21:52:17.913545+0000","last_clean":"2023-07-09T21:52:17.913545+0000","last_became_active":"2023-07-09T21:52:17.907687+0000","last_became_peered":"2023-07-09T21:52:17.907687+0000","last_unstale":"2023-07-09T21:52:17.913545+0000","last_undegraded":"2023-07-09T21:52:17.913545+0000","last_fullsized":"2023-07-09T21:52:17.913545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:52.181586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.890975+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:52:17.890975+0000","last_peered":"2023-07-09T21:52:17.890975+0000","last_clean":"2023-07-09T21:52:17.890975+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:52:17.890975+0000","last_undegraded":"2023-07-09T21:52:17.890975+0000","last_fullsized":"2023-07-09T21:52:17.890975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:21:31.603089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892416+0000","last_change":"2023-07-09T21:52:17.892416+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892416+0000","last_undegraded":"2023-07-09T21:52:17.892416+0000","last_fullsized":"2023-07-09T21:52:17.892416+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912936+0000","last_change":"2023-07-09T21:52:17.909086+0000","last_active":"2023-07-09T21:52:17.912936+0000","last_peered":"2023-07-09T21:52:17.912936+0000","last_clean":"2023-07-09T21:52:17.912936+0000","last_became_active":"2023-07-09T21:52:17.907325+0000","last_became_peered":"2023-07-09T21:52:17.907325+0000","last_unstale":"2023-07-09T21:52:17.912936+0000","last_undegraded":"2023-07-09T21:52:17.912936+0000","last_fullsized":"2023-07-09T21:52:17.912936+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:43:42.844895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.902085+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:52:17.902085+0000","last_peered":"2023-07-09T21:52:17.902085+0000","last_clean":"2023-07-09T21:52:17.902085+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:52:17.902085+0000","last_undegraded":"2023-07-09T21:52:17.902085+0000","last_fullsized":"2023-07-09T21:52:17.902085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:55:01.994943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894408+0000","last_change":"2023-07-09T21:52:17.894408+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894408+0000","last_undegraded":"2023-07-09T21:52:17.894408+0000","last_fullsized":"2023-07-09T21:52:17.894408+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912914+0000","last_change":"2023-07-09T21:52:17.908857+0000","last_active":"2023-07-09T21:52:17.912914+0000","last_peered":"2023-07-09T21:52:17.912914+0000","last_clean":"2023-07-09T21:52:17.912914+0000","last_became_active":"2023-07-09T21:52:17.907842+0000","last_became_peered":"2023-07-09T21:52:17.907842+0000","last_unstale":"2023-07-09T21:52:17.912914+0000","last_undegraded":"2023-07-09T21:52:17.912914+0000","last_fullsized":"2023-07-09T21:52:17.912914+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:38:46.077337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.891884+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:52:17.891884+0000","last_peered":"2023-07-09T21:52:17.891884+0000","last_clean":"2023-07-09T21:52:17.891884+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:52:17.891884+0000","last_undegraded":"2023-07-09T21:52:17.891884+0000","last_fullsized":"2023-07-09T21:52:17.891884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:38:31.353644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.897496+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:52:17.897496+0000","last_peered":"2023-07-09T21:52:17.897496+0000","last_clean":"2023-07-09T21:52:17.897496+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:52:17.897496+0000","last_undegraded":"2023-07-09T21:52:17.897496+0000","last_fullsized":"2023-07-09T21:52:17.897496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:48.827423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.925030+0000","last_change":"2023-07-09T21:52:18.921385+0000","last_active":"2023-07-09T21:52:18.925030+0000","last_peered":"2023-07-09T21:52:18.925030+0000","last_clean":"2023-07-09T21:52:18.925030+0000","last_became_active":"2023-07-09T21:52:18.911170+0000","last_became_peered":"2023-07-09T21:52:18.911170+0000","last_unstale":"2023-07-09T21:52:18.925030+0000","last_undegraded":"2023-07-09T21:52:18.925030+0000","last_fullsized":"2023-07-09T21:52:18.925030+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:31:12.671286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.916623+0000","last_change":"2023-07-09T21:52:17.913375+0000","last_active":"2023-07-09T21:52:17.916623+0000","last_peered":"2023-07-09T21:52:17.916623+0000","last_clean":"2023-07-09T21:52:17.916623+0000","last_became_active":"2023-07-09T21:52:17.913062+0000","last_became_peered":"2023-07-09T21:52:17.913062+0000","last_unstale":"2023-07-09T21:52:17.916623+0000","last_undegraded":"2023-07-09T21:52:17.916623+0000","last_fullsized":"2023-07-09T21:52:17.916623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:29:19.233060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.897684+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:52:17.897684+0000","last_peered":"2023-07-09T21:52:17.897684+0000","last_clean":"2023-07-09T21:52:17.897684+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:52:17.897684+0000","last_undegraded":"2023-07-09T21:52:17.897684+0000","last_fullsized":"2023-07-09T21:52:17.897684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:47:08.444583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891841+0000","last_change":"2023-07-09T21:52:17.891841+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891841+0000","last_undegraded":"2023-07-09T21:52:17.891841+0000","last_fullsized":"2023-07-09T21:52:17.891841+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.909928+0000","last_change":"2023-07-09T21:52:17.905141+0000","last_active":"2023-07-09T21:52:17.909928+0000","last_peered":"2023-07-09T21:52:17.909928+0000","last_clean":"2023-07-09T21:52:17.909928+0000","last_became_active":"2023-07-09T21:52:17.904855+0000","last_became_peered":"2023-07-09T21:52:17.904855+0000","last_unstale":"2023-07-09T21:52:17.909928+0000","last_undegraded":"2023-07-09T21:52:17.909928+0000","last_fullsized":"2023-07-09T21:52:17.909928+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:49:08.791384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.898354+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:52:17.898354+0000","last_peered":"2023-07-09T21:52:17.898354+0000","last_clean":"2023-07-09T21:52:17.898354+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:52:17.898354+0000","last_undegraded":"2023-07-09T21:52:17.898354+0000","last_fullsized":"2023-07-09T21:52:17.898354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:07:42.879585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.900222+0000","last_change":"2023-07-09T21:52:17.900222+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.900222+0000","last_undegraded":"2023-07-09T21:52:17.900222+0000","last_fullsized":"2023-07-09T21:52:17.900222+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.914898+0000","last_change":"2023-07-09T21:52:17.908430+0000","last_active":"2023-07-09T21:52:17.914898+0000","last_peered":"2023-07-09T21:52:17.914898+0000","last_clean":"2023-07-09T21:52:17.914898+0000","last_became_active":"2023-07-09T21:52:17.908191+0000","last_became_peered":"2023-07-09T21:52:17.908191+0000","last_unstale":"2023-07-09T21:52:17.914898+0000","last_undegraded":"2023-07-09T21:52:17.914898+0000","last_fullsized":"2023-07-09T21:52:17.914898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:00:29.609406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.889868+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:52:18.889868+0000","last_peered":"2023-07-09T21:52:18.889868+0000","last_clean":"2023-07-09T21:52:18.889868+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:52:18.889868+0000","last_undegraded":"2023-07-09T21:52:18.889868+0000","last_fullsized":"2023-07-09T21:52:18.889868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:30.415219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891448+0000","last_change":"2023-07-09T21:52:17.891448+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891448+0000","last_undegraded":"2023-07-09T21:52:17.891448+0000","last_fullsized":"2023-07-09T21:52:17.891448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.915523+0000","last_change":"2023-07-09T21:52:17.913781+0000","last_active":"2023-07-09T21:52:17.915523+0000","last_peered":"2023-07-09T21:52:17.915523+0000","last_clean":"2023-07-09T21:52:17.915523+0000","last_became_active":"2023-07-09T21:52:17.913487+0000","last_became_peered":"2023-07-09T21:52:17.913487+0000","last_unstale":"2023-07-09T21:52:17.915523+0000","last_undegraded":"2023-07-09T21:52:17.915523+0000","last_fullsized":"2023-07-09T21:52:17.915523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:55:53.352569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.896521+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:52:17.896521+0000","last_peered":"2023-07-09T21:52:17.896521+0000","last_clean":"2023-07-09T21:52:17.896521+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:52:17.896521+0000","last_undegraded":"2023-07-09T21:52:17.896521+0000","last_fullsized":"2023-07-09T21:52:17.896521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:52:10.511336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":243201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95099999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.45900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81999999999999995,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.67400000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.79000000000000004,"15min":0.82099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78700000000000003,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97099999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.60399999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92900000000000005,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.503},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89200000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.622}]},{"osd":6,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":1.214,"15min":1.214},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.68700000000000006}]}]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":569344,"data_stored":243201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52000000000000002,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55500000000000005,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.53700000000000003,"15min":0.55600000000000005},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56699999999999995,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.60599999999999998,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.63300000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.42299999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.68100000000000005,"15min":0.70899999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63400000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60399999999999998,"5min":3.129,"15min":3.129},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94499999999999995,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.749},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.998,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91200000000000003,"5min":1.929,"15min":1.929},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.85099999999999998,"15min":0.86399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97599999999999998,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.86599999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93500000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.95199999999999996,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":2.766,"15min":2.766},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.93400000000000005,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.93200000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":557056,"data_stored":236573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":1.232,"15min":1.3700000000000001},"min":{"1min":0.28899999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":16.946000000000002,"15min":16.946000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.93200000000000005,"15min":1.0089999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":9.5449999999999999,"15min":9.5449999999999999},"last":0.52700000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.92100000000000004,"15min":0.99399999999999999},"min":{"1min":0.38200000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65200000000000002,"5min":9.6950000000000003,"15min":9.6950000000000003},"last":0.435},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.95099999999999996,"15min":1.0329999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63200000000000001,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.995,"15min":1.077},"min":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69199999999999995,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.327,"15min":1.4630000000000001},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73599999999999999,"5min":17.004000000000001,"15min":17.004000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.048,"15min":1.1000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.081,"5min":6.2510000000000003,"15min":6.2510000000000003},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.2849999999999999,"15min":1.3680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2050000000000001,"5min":9.6630000000000003,"15min":9.6630000000000003},"last":0.97099999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":1.091,"15min":1.139},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2370000000000001,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.2849999999999999,"15min":1.369},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.1619999999999999,"5min":9.5879999999999992,"15min":9.5879999999999992},"last":0.93100000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":1.2849999999999999,"15min":1.371},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.048,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":1.266,"15min":1.349},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0529999999999999,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":0.91200000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.2250000000000001,"15min":1.2969999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.103,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.1160000000000001,"15min":1.1659999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.163,"5min":6.2169999999999996,"15min":6.2169999999999996},"last":0.89900000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1150976,"data_stored":826941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.92200000000000004,"15min":1.01},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55000000000000004,"5min":11.949999999999999,"15min":11.949999999999999},"last":3.4849999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60199999999999998,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73899999999999999,"5min":1.212,"15min":1.212},"last":3.0819999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":1.488}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":1.4179999999999999,"15min":1.5720000000000001},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":23.010999999999999,"15min":23.010999999999999},"last":3.9569999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90900000000000003,"15min":0.97499999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65100000000000002,"5min":10.952,"15min":10.952},"last":4.226}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":1.696,"15min":1.859},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":22.974,"15min":22.974},"last":3.1349999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":1.264,"15min":1.3520000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":3.2109999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52300000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":1.589,"15min":1.589},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.748,"5min":1.6890000000000001,"15min":1.8460000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":22.933,"15min":22.933},"last":3.2450000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93100000000000005,"5min":1.623,"15min":1.623},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.6830000000000001,"15min":1.8400000000000001},"min":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98199999999999998,"5min":22.867999999999999,"15min":22.867999999999999},"last":3.1749999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.1639999999999999,"15min":1.23},"min":{"1min":0.57499999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.93300000000000005,"5min":10.907999999999999,"15min":10.907999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83299999999999996,"15min":0.83999999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.99299999999999999,"5min":1.546,"15min":1.546},"last":0.63400000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1150976,"data_stored":826941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.61399999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85799999999999998,"5min":1.464,"15min":1.464},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94999999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89100000000000001,"5min":1.121,"15min":1.121},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.78600000000000003,"15min":0.80400000000000005},"min":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70799999999999996,"15min":0.71699999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.091,"15min":1.091},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96599999999999997,"5min":1.405,"15min":1.405},"last":0.67200000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.95399999999999996,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.443},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70399999999999996,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82799999999999996,"5min":1.341,"15min":1.341},"last":0.497}]},{"osd":5,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.443,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.871,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.52400000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88100000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.68700000000000006}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":557056,"data_stored":236573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57599999999999996,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68200000000000005,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.53800000000000003,"5min":1.21,"15min":1.21},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.54900000000000004,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.433}]},{"osd":2,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60699999999999998,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.56100000000000005,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.44900000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.016,"5min":1.258,"15min":1.258},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0049999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95599999999999996,"5min":1.486,"15min":1.486},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98999999999999999,"5min":1.327,"15min":1.327},"last":0.71799999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":1.302,"15min":1.302},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.86199999999999999,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":0.78300000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.04,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.008,"5min":1.349,"15min":1.349},"last":0.68000000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":557056,"data_stored":236573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.74199999999999999,"15min":0.69999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":7.9779999999999998,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.78700000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":7.8650000000000002,"5min":7.8650000000000002,"15min":7.8650000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.421,"15min":1.421},"last":0.83399999999999996}]},{"osd":2,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.73199999999999998,"15min":0.68200000000000005},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":7.9390000000000001,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88300000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1799999999999999,"5min":1.597,"15min":1.597},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.93700000000000006,"5min":1.216,"15min":1.216},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91200000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0609999999999999,"5min":1.069,"15min":1.069},"last":0.62}]},{"osd":6,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":1.093,"15min":1.093},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.81799999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.038,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76800000000000002,"15min":0.76300000000000001},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.054,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.86299999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":557056,"data_stored":236573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.54400000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84799999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54700000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.86399999999999999,"5min":1.113,"15min":1.113},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84199999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.59699999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85599999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.46800000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63400000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93400000000000005,"5min":1.018,"15min":1.018},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95099999999999996,"5min":1.171,"15min":1.171},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98199999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.754,"15min":0.749},"min":{"1min":0.56699999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96399999999999997,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76400000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.999,"5min":1.133,"15min":1.133},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.022,"5min":1.123,"15min":1.123},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:52:23.349 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:52:23.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.579+0000 7fe04f1ff700 1 Processor -- start 2023-07-09T21:52:23.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.580+0000 7fe04f1ff700 1 -- start start 2023-07-09T21:52:23.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.581+0000 7fe04f1ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe04815a5f0 0x7fe0480ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.581+0000 7fe04f1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe04806d8e0 0x7fe0480b0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.581+0000 7fe04f1ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0480cdbe0 con 0x7fe0480b0480 2023-07-09T21:52:23.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.581+0000 7fe04f1ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0480cd420 con 0x7fe04815a5f0 2023-07-09T21:52:23.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.581+0000 7fe04f1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480b0e60 con 0x7fe04806d8e0 2023-07-09T21:52:23.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.581+0000 7fe04cf9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe04815a5f0 0x7fe0480ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.581+0000 7fe04cf9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe04815a5f0 0x7fe0480ad9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34708/0 (socket says 172.21.15.53:34708) 2023-07-09T21:52:23.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.581+0000 7fe04cf9b700 1 -- 172.21.15.53:0/502983912 learned_addr learned my addr 172.21.15.53:0/502983912 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:23.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.581+0000 7fe04d79c700 1 --2- 172.21.15.53:0/502983912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe04806d8e0 0x7fe0480b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.581+0000 7fe04cf9b700 1 -- 172.21.15.53:0/502983912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe04806d8e0 msgr2=0x7fe0480b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:23.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.581+0000 7fe04cf9b700 1 --2- 172.21.15.53:0/502983912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe04806d8e0 0x7fe0480b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.582+0000 7fe04cf9b700 1 -- 172.21.15.53:0/502983912 >> v1:172.21.15.53:6789/0 conn(0x7fe0480b0480 legacy=0x7fe04806f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:23.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.582+0000 7fe04cf9b700 1 -- 172.21.15.53:0/502983912 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480cc4c0 con 0x7fe04815a5f0 2023-07-09T21:52:23.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.582+0000 7fe04cf9b700 1 --2- 172.21.15.53:0/502983912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe04815a5f0 0x7fe0480ad9d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0098f0 tx=0x7fe03c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4066626b021f011 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:23.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.582+0000 7fe0477fe700 1 -- 172.21.15.53:0/502983912 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c011830 con 0x7fe04815a5f0 2023-07-09T21:52:23.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.582+0000 7fe0477fe700 1 -- 172.21.15.53:0/502983912 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c011990 con 0x7fe04815a5f0 2023-07-09T21:52:23.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.582+0000 7fe0477fe700 1 -- 172.21.15.53:0/502983912 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c011d20 con 0x7fe04815a5f0 2023-07-09T21:52:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.582+0000 7fe04f1ff700 1 -- 172.21.15.53:0/502983912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe04815a5f0 msgr2=0x7fe0480ad9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.582+0000 7fe04f1ff700 1 --2- 172.21.15.53:0/502983912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe04815a5f0 0x7fe0480ad9d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0098f0 tx=0x7fe03c009c00 comp rx=0 tx=0).stop 2023-07-09T21:52:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.583+0000 7fe04f1ff700 1 -- 172.21.15.53:0/502983912 shutdown_connections 2023-07-09T21:52:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.583+0000 7fe04f1ff700 1 --2- 172.21.15.53:0/502983912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe04806d8e0 0x7fe0480b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.583+0000 7fe04f1ff700 1 --2- 172.21.15.53:0/502983912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe04815a5f0 0x7fe0480ad9d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.583+0000 7fe04f1ff700 1 -- 172.21.15.53:0/502983912 >> 172.21.15.53:0/502983912 conn(0x7fe0480ce980 msgr2=0x7fe0480ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.583+0000 7fe04f1ff700 1 -- 172.21.15.53:0/502983912 shutdown_connections 2023-07-09T21:52:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.583+0000 7fe04f1ff700 1 -- 172.21.15.53:0/502983912 wait complete. 2023-07-09T21:52:23.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.584+0000 7fe04f1ff700 1 Processor -- start 2023-07-09T21:52:23.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.585+0000 7fe04f1ff700 1 -- start start 2023-07-09T21:52:23.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04f1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0480b0480 0x7fe04814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04f1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0480b18b0 0x7fe048154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04f1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0480b1d20 0x7fe048155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04f1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480b2f10 con 0x7fe0480b1d20 2023-07-09T21:52:23.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04f1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480b2290 con 0x7fe0480b18b0 2023-07-09T21:52:23.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04f1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480b2570 con 0x7fe0480b0480 2023-07-09T21:52:23.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04d79c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0480b1d20 0x7fe048155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04d79c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0480b1d20 0x7fe048155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34722/0 (socket says 172.21.15.53:34722) 2023-07-09T21:52:23.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04d79c700 1 -- 172.21.15.53:0/2807198634 learned_addr learned my addr 172.21.15.53:0/2807198634 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04cf9b700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0480b0480 0x7fe04814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe047fff700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0480b18b0 0x7fe048154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04d79c700 1 -- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0480b0480 msgr2=0x7fe04814ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04d79c700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0480b0480 0x7fe04814ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04d79c700 1 -- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0480b18b0 msgr2=0x7fe048154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04d79c700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0480b18b0 0x7fe048154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.586+0000 7fe04d79c700 1 -- 172.21.15.53:0/2807198634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c009550 con 0x7fe0480b1d20 2023-07-09T21:52:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.587+0000 7fe04d79c700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0480b1d20 0x7fe048155380 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe04000efc0 tx=0x7fe04000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.587+0000 7fe0457fa700 1 -- 172.21.15.53:0/2807198634 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe040009ea0 con 0x7fe0480b1d20 2023-07-09T21:52:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.587+0000 7fe0457fa700 1 -- 172.21.15.53:0/2807198634 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04000f040 con 0x7fe0480b1d20 2023-07-09T21:52:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.587+0000 7fe0457fa700 1 -- 172.21.15.53:0/2807198634 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04000ced0 con 0x7fe0480b1d20 2023-07-09T21:52:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.587+0000 7fe04f1ff700 1 -- 172.21.15.53:0/2807198634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0480b2850 con 0x7fe0480b1d20 2023-07-09T21:52:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.587+0000 7fe04f1ff700 1 -- 172.21.15.53:0/2807198634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0481504e0 con 0x7fe0480b1d20 2023-07-09T21:52:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.588+0000 7fe04f1ff700 1 -- 172.21.15.53:0/2807198634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0480b3050 con 0x7fe0480b1d20 2023-07-09T21:52:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.589+0000 7fe0457fa700 1 -- 172.21.15.53:0/2807198634 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fe040014480 con 0x7fe0480b1d20 2023-07-09T21:52:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.590+0000 7fe0457fa700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe02c06ad70 0x7fe02c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.590+0000 7fe0457fa700 1 -- 172.21.15.53:0/2807198634 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe040089e60 con 0x7fe0480b1d20 2023-07-09T21:52:23.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.591+0000 7fe04cf9b700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe02c06ad70 0x7fe02c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:23.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.591+0000 7fe04cf9b700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe02c06ad70 0x7fe02c06d220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe03c014040 tx=0x7fe03c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:23.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.594+0000 7fe0457fa700 1 -- 172.21.15.53:0/2807198634 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe0480b3050 con 0x7fe0480b1d20 2023-07-09T21:52:23.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.799+0000 7fe04f1ff700 1 -- 172.21.15.53:0/2807198634 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0480cca80 con 0x7fe02c06ad70 2023-07-09T21:52:23.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.808+0000 7fe0457fa700 1 -- 172.21.15.53:0/2807198634 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307485 (secure 0 0 0) 0x7fe03c011b80 con 0x7fe02c06ad70 2023-07-09T21:52:23.813 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:23.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.812+0000 7fe04f1ff700 1 -- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe02c06ad70 msgr2=0x7fe02c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:23.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.812+0000 7fe04f1ff700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe02c06ad70 0x7fe02c06d220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe03c014040 tx=0x7fe03c008030 comp rx=0 tx=0).stop 2023-07-09T21:52:23.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.812+0000 7fe04f1ff700 1 -- 172.21.15.53:0/2807198634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0480b1d20 msgr2=0x7fe048155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:23.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.812+0000 7fe04f1ff700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0480b1d20 0x7fe048155380 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe04000efc0 tx=0x7fe04000c3a0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.813+0000 7fe04f1ff700 1 -- 172.21.15.53:0/2807198634 shutdown_connections 2023-07-09T21:52:23.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.813+0000 7fe04f1ff700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe02c06ad70 0x7fe02c06d220 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.813+0000 7fe04f1ff700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0480b1d20 0x7fe048155380 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.813+0000 7fe04f1ff700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0480b0480 0x7fe04814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.813+0000 7fe04f1ff700 1 --2- 172.21.15.53:0/2807198634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0480b18b0 0x7fe048154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:23.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.813+0000 7fe04f1ff700 1 -- 172.21.15.53:0/2807198634 >> 172.21.15.53:0/2807198634 conn(0x7fe0480ce980 msgr2=0x7fe0480af4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:23.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.813+0000 7fe04f1ff700 1 -- 172.21.15.53:0/2807198634 shutdown_connections 2023-07-09T21:52:23.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:23.813+0000 7fe04f1ff700 1 -- 172.21.15.53:0/2807198634 wait complete. 2023-07-09T21:52:23.816 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:52:23.832 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-07-09T21:52:22.879902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225248,"kb_used_data":5536,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754749472,"statfs":{"total":773094113280,"available":772863459328,"internally_reserved":0,"allocated":5668864,"data_stored":3086576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001308"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.903687+0000","last_change":"2023-07-09T21:52:18.896951+0000","last_active":"2023-07-09T21:52:18.903687+0000","last_peered":"2023-07-09T21:52:18.903687+0000","last_clean":"2023-07-09T21:52:18.903687+0000","last_became_active":"2023-07-09T21:52:18.896617+0000","last_became_peered":"2023-07-09T21:52:18.896617+0000","last_unstale":"2023-07-09T21:52:18.903687+0000","last_undegraded":"2023-07-09T21:52:18.903687+0000","last_fullsized":"2023-07-09T21:52:18.903687+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:06:54.804905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894881+0000","last_change":"2023-07-09T21:52:17.894881+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894881+0000","last_undegraded":"2023-07-09T21:52:17.894881+0000","last_fullsized":"2023-07-09T21:52:17.894881+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897443+0000","last_change":"2023-07-09T21:52:17.897443+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897443+0000","last_undegraded":"2023-07-09T21:52:17.897443+0000","last_fullsized":"2023-07-09T21:52:17.897443+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893933+0000","last_change":"2023-07-09T21:52:17.893933+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893933+0000","last_undegraded":"2023-07-09T21:52:17.893933+0000","last_fullsized":"2023-07-09T21:52:17.893933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.909927+0000","last_change":"2023-07-09T21:52:18.906085+0000","last_active":"2023-07-09T21:52:18.909927+0000","last_peered":"2023-07-09T21:52:18.909927+0000","last_clean":"2023-07-09T21:52:18.909927+0000","last_became_active":"2023-07-09T21:52:18.905771+0000","last_became_peered":"2023-07-09T21:52:18.905771+0000","last_unstale":"2023-07-09T21:52:18.909927+0000","last_undegraded":"2023-07-09T21:52:18.909927+0000","last_fullsized":"2023-07-09T21:52:18.909927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:26:23.107762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.921492+0000","last_change":"2023-07-09T21:52:18.909739+0000","last_active":"2023-07-09T21:52:18.921492+0000","last_peered":"2023-07-09T21:52:18.921492+0000","last_clean":"2023-07-09T21:52:18.921492+0000","last_became_active":"2023-07-09T21:52:18.906431+0000","last_became_peered":"2023-07-09T21:52:18.906431+0000","last_unstale":"2023-07-09T21:52:18.921492+0000","last_undegraded":"2023-07-09T21:52:18.921492+0000","last_fullsized":"2023-07-09T21:52:18.921492+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:38:10.323423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.899030+0000","last_change":"2023-07-09T21:52:17.899030+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.899030+0000","last_undegraded":"2023-07-09T21:52:17.899030+0000","last_fullsized":"2023-07-09T21:52:17.899030+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892045+0000","last_change":"2023-07-09T21:52:17.892045+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892045+0000","last_undegraded":"2023-07-09T21:52:17.892045+0000","last_fullsized":"2023-07-09T21:52:17.892045+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894172+0000","last_change":"2023-07-09T21:52:17.894172+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894172+0000","last_undegraded":"2023-07-09T21:52:17.894172+0000","last_fullsized":"2023-07-09T21:52:17.894172+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.913102+0000","last_change":"2023-07-09T21:52:18.905734+0000","last_active":"2023-07-09T21:52:18.913102+0000","last_peered":"2023-07-09T21:52:18.913102+0000","last_clean":"2023-07-09T21:52:18.913102+0000","last_became_active":"2023-07-09T21:52:18.905379+0000","last_became_peered":"2023-07-09T21:52:18.905379+0000","last_unstale":"2023-07-09T21:52:18.913102+0000","last_undegraded":"2023-07-09T21:52:18.913102+0000","last_fullsized":"2023-07-09T21:52:18.913102+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:54.518646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897343+0000","last_change":"2023-07-09T21:52:17.897343+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897343+0000","last_undegraded":"2023-07-09T21:52:17.897343+0000","last_fullsized":"2023-07-09T21:52:17.897343+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891282+0000","last_change":"2023-07-09T21:52:17.891282+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891282+0000","last_undegraded":"2023-07-09T21:52:17.891282+0000","last_fullsized":"2023-07-09T21:52:17.891282+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.921153+0000","last_change":"2023-07-09T21:52:18.906003+0000","last_active":"2023-07-09T21:52:18.921153+0000","last_peered":"2023-07-09T21:52:18.921153+0000","last_clean":"2023-07-09T21:52:18.921153+0000","last_became_active":"2023-07-09T21:52:18.905760+0000","last_became_peered":"2023-07-09T21:52:18.905760+0000","last_unstale":"2023-07-09T21:52:18.921153+0000","last_undegraded":"2023-07-09T21:52:18.921153+0000","last_fullsized":"2023-07-09T21:52:18.921153+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:48:19.857604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897968+0000","last_change":"2023-07-09T21:52:17.897968+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897968+0000","last_undegraded":"2023-07-09T21:52:17.897968+0000","last_fullsized":"2023-07-09T21:52:17.897968+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893772+0000","last_change":"2023-07-09T21:52:17.893772+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893772+0000","last_undegraded":"2023-07-09T21:52:17.893772+0000","last_fullsized":"2023-07-09T21:52:17.893772+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.916614+0000","last_change":"2023-07-09T21:52:18.906627+0000","last_active":"2023-07-09T21:52:18.916614+0000","last_peered":"2023-07-09T21:52:18.916614+0000","last_clean":"2023-07-09T21:52:18.916614+0000","last_became_active":"2023-07-09T21:52:18.906352+0000","last_became_peered":"2023-07-09T21:52:18.906352+0000","last_unstale":"2023-07-09T21:52:18.916614+0000","last_undegraded":"2023-07-09T21:52:18.916614+0000","last_fullsized":"2023-07-09T21:52:18.916614+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:56:25.759336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.901501+0000","last_change":"2023-07-09T21:52:17.901501+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.901501+0000","last_undegraded":"2023-07-09T21:52:17.901501+0000","last_fullsized":"2023-07-09T21:52:17.901501+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894401+0000","last_change":"2023-07-09T21:52:17.894401+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894401+0000","last_undegraded":"2023-07-09T21:52:17.894401+0000","last_fullsized":"2023-07-09T21:52:17.894401+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896966+0000","last_change":"2023-07-09T21:52:17.896966+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896966+0000","last_undegraded":"2023-07-09T21:52:17.896966+0000","last_fullsized":"2023-07-09T21:52:17.896966+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895814+0000","last_change":"2023-07-09T21:52:17.895814+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895814+0000","last_undegraded":"2023-07-09T21:52:17.895814+0000","last_fullsized":"2023-07-09T21:52:17.895814+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894824+0000","last_change":"2023-07-09T21:52:17.894824+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894824+0000","last_undegraded":"2023-07-09T21:52:17.894824+0000","last_fullsized":"2023-07-09T21:52:17.894824+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892776+0000","last_change":"2023-07-09T21:52:17.892776+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892776+0000","last_undegraded":"2023-07-09T21:52:17.892776+0000","last_fullsized":"2023-07-09T21:52:17.892776+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897885+0000","last_change":"2023-07-09T21:52:17.897885+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897885+0000","last_undegraded":"2023-07-09T21:52:17.897885+0000","last_fullsized":"2023-07-09T21:52:17.897885+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.898974+0000","last_change":"2023-07-09T21:52:17.898974+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.898974+0000","last_undegraded":"2023-07-09T21:52:17.898974+0000","last_fullsized":"2023-07-09T21:52:17.898974+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897689+0000","last_change":"2023-07-09T21:52:17.897689+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897689+0000","last_undegraded":"2023-07-09T21:52:17.897689+0000","last_fullsized":"2023-07-09T21:52:17.897689+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893441+0000","last_change":"2023-07-09T21:52:17.893441+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893441+0000","last_undegraded":"2023-07-09T21:52:17.893441+0000","last_fullsized":"2023-07-09T21:52:17.893441+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.928117+0000","last_change":"2023-07-09T21:52:18.926059+0000","last_active":"2023-07-09T21:52:18.928117+0000","last_peered":"2023-07-09T21:52:18.928117+0000","last_clean":"2023-07-09T21:52:18.928117+0000","last_became_active":"2023-07-09T21:52:18.925784+0000","last_became_peered":"2023-07-09T21:52:18.925784+0000","last_unstale":"2023-07-09T21:52:18.928117+0000","last_undegraded":"2023-07-09T21:52:18.928117+0000","last_fullsized":"2023-07-09T21:52:18.928117+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:54:22.307888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895023+0000","last_change":"2023-07-09T21:52:17.895023+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895023+0000","last_undegraded":"2023-07-09T21:52:17.895023+0000","last_fullsized":"2023-07-09T21:52:17.895023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896082+0000","last_change":"2023-07-09T21:52:17.896082+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896082+0000","last_undegraded":"2023-07-09T21:52:17.896082+0000","last_fullsized":"2023-07-09T21:52:17.896082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896237+0000","last_change":"2023-07-09T21:52:17.896237+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896237+0000","last_undegraded":"2023-07-09T21:52:17.896237+0000","last_fullsized":"2023-07-09T21:52:17.896237+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.898105+0000","last_change":"2023-07-09T21:52:17.898105+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.898105+0000","last_undegraded":"2023-07-09T21:52:17.898105+0000","last_fullsized":"2023-07-09T21:52:17.898105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892847+0000","last_change":"2023-07-09T21:52:17.892847+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892847+0000","last_undegraded":"2023-07-09T21:52:17.892847+0000","last_fullsized":"2023-07-09T21:52:17.892847+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893853+0000","last_change":"2023-07-09T21:52:17.893853+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893853+0000","last_undegraded":"2023-07-09T21:52:17.893853+0000","last_fullsized":"2023-07-09T21:52:17.893853+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912675+0000","last_change":"2023-07-09T21:52:17.905074+0000","last_active":"2023-07-09T21:52:17.912675+0000","last_peered":"2023-07-09T21:52:17.912675+0000","last_clean":"2023-07-09T21:52:17.912675+0000","last_became_active":"2023-07-09T21:52:17.904791+0000","last_became_peered":"2023-07-09T21:52:17.904791+0000","last_unstale":"2023-07-09T21:52:17.912675+0000","last_undegraded":"2023-07-09T21:52:17.912675+0000","last_fullsized":"2023-07-09T21:52:17.912675+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:42:18.230865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891253+0000","last_change":"2023-07-09T21:52:17.891253+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891253+0000","last_undegraded":"2023-07-09T21:52:17.891253+0000","last_fullsized":"2023-07-09T21:52:17.891253+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.926314+0000","last_change":"2023-07-09T21:52:17.903525+0000","last_active":"2023-07-09T21:52:18.926314+0000","last_peered":"2023-07-09T21:52:18.926314+0000","last_clean":"2023-07-09T21:52:18.926314+0000","last_became_active":"2023-07-09T21:52:17.900909+0000","last_became_peered":"2023-07-09T21:52:17.900909+0000","last_unstale":"2023-07-09T21:52:18.926314+0000","last_undegraded":"2023-07-09T21:52:18.926314+0000","last_fullsized":"2023-07-09T21:52:18.926314+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:21:52.052315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895397+0000","last_change":"2023-07-09T21:52:17.895397+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895397+0000","last_undegraded":"2023-07-09T21:52:17.895397+0000","last_fullsized":"2023-07-09T21:52:17.895397+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.925131+0000","last_change":"2023-07-09T21:52:17.909999+0000","last_active":"2023-07-09T21:52:18.925131+0000","last_peered":"2023-07-09T21:52:18.925131+0000","last_clean":"2023-07-09T21:52:18.925131+0000","last_became_active":"2023-07-09T21:52:17.909580+0000","last_became_peered":"2023-07-09T21:52:17.909580+0000","last_unstale":"2023-07-09T21:52:18.925131+0000","last_undegraded":"2023-07-09T21:52:18.925131+0000","last_fullsized":"2023-07-09T21:52:18.925131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:25.952731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892858+0000","last_change":"2023-07-09T21:52:17.892858+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892858+0000","last_undegraded":"2023-07-09T21:52:17.892858+0000","last_fullsized":"2023-07-09T21:52:17.892858+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.907556+0000","last_change":"2023-07-09T21:52:17.903946+0000","last_active":"2023-07-09T21:52:17.907556+0000","last_peered":"2023-07-09T21:52:17.907556+0000","last_clean":"2023-07-09T21:52:17.907556+0000","last_became_active":"2023-07-09T21:52:17.903690+0000","last_became_peered":"2023-07-09T21:52:17.903690+0000","last_unstale":"2023-07-09T21:52:17.907556+0000","last_undegraded":"2023-07-09T21:52:17.907556+0000","last_fullsized":"2023-07-09T21:52:17.907556+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:10:56.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.928388+0000","last_change":"2023-07-09T21:52:18.925285+0000","last_active":"2023-07-09T21:52:18.928388+0000","last_peered":"2023-07-09T21:52:18.928388+0000","last_clean":"2023-07-09T21:52:18.928388+0000","last_became_active":"2023-07-09T21:52:18.924973+0000","last_became_peered":"2023-07-09T21:52:18.924973+0000","last_unstale":"2023-07-09T21:52:18.928388+0000","last_undegraded":"2023-07-09T21:52:18.928388+0000","last_fullsized":"2023-07-09T21:52:18.928388+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:09:17.629077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.915950+0000","last_change":"2023-07-09T21:52:17.914742+0000","last_active":"2023-07-09T21:52:17.915950+0000","last_peered":"2023-07-09T21:52:17.915950+0000","last_clean":"2023-07-09T21:52:17.915950+0000","last_became_active":"2023-07-09T21:52:17.914452+0000","last_became_peered":"2023-07-09T21:52:17.914452+0000","last_unstale":"2023-07-09T21:52:17.915950+0000","last_undegraded":"2023-07-09T21:52:17.915950+0000","last_fullsized":"2023-07-09T21:52:17.915950+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:00.889871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895429+0000","last_change":"2023-07-09T21:52:17.895429+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895429+0000","last_undegraded":"2023-07-09T21:52:17.895429+0000","last_fullsized":"2023-07-09T21:52:17.895429+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.916522+0000","last_change":"2023-07-09T21:52:17.901241+0000","last_active":"2023-07-09T21:52:18.916522+0000","last_peered":"2023-07-09T21:52:18.916522+0000","last_clean":"2023-07-09T21:52:18.916522+0000","last_became_active":"2023-07-09T21:52:17.900934+0000","last_became_peered":"2023-07-09T21:52:17.900934+0000","last_unstale":"2023-07-09T21:52:18.916522+0000","last_undegraded":"2023-07-09T21:52:18.916522+0000","last_fullsized":"2023-07-09T21:52:18.916522+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:10:39.535148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896760+0000","last_change":"2023-07-09T21:52:17.896760+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896760+0000","last_undegraded":"2023-07-09T21:52:17.896760+0000","last_fullsized":"2023-07-09T21:52:17.896760+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912702+0000","last_change":"2023-07-09T21:52:17.905888+0000","last_active":"2023-07-09T21:52:17.912702+0000","last_peered":"2023-07-09T21:52:17.912702+0000","last_clean":"2023-07-09T21:52:17.912702+0000","last_became_active":"2023-07-09T21:52:17.905601+0000","last_became_peered":"2023-07-09T21:52:17.905601+0000","last_unstale":"2023-07-09T21:52:17.912702+0000","last_undegraded":"2023-07-09T21:52:17.912702+0000","last_fullsized":"2023-07-09T21:52:17.912702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:11.342048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894467+0000","last_change":"2023-07-09T21:52:17.894467+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894467+0000","last_undegraded":"2023-07-09T21:52:17.894467+0000","last_fullsized":"2023-07-09T21:52:17.894467+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912774+0000","last_change":"2023-07-09T21:52:17.908242+0000","last_active":"2023-07-09T21:52:17.912774+0000","last_peered":"2023-07-09T21:52:17.912774+0000","last_clean":"2023-07-09T21:52:17.912774+0000","last_became_active":"2023-07-09T21:52:17.907897+0000","last_became_peered":"2023-07-09T21:52:17.907897+0000","last_unstale":"2023-07-09T21:52:17.912774+0000","last_undegraded":"2023-07-09T21:52:17.912774+0000","last_fullsized":"2023-07-09T21:52:17.912774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:39:54.273358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.919811+0000","last_change":"2023-07-09T21:52:18.916918+0000","last_active":"2023-07-09T21:52:18.919811+0000","last_peered":"2023-07-09T21:52:18.919811+0000","last_clean":"2023-07-09T21:52:18.919811+0000","last_became_active":"2023-07-09T21:52:18.916633+0000","last_became_peered":"2023-07-09T21:52:18.916633+0000","last_unstale":"2023-07-09T21:52:18.919811+0000","last_undegraded":"2023-07-09T21:52:18.919811+0000","last_fullsized":"2023-07-09T21:52:18.919811+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:49.611360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.905628+0000","last_change":"2023-07-09T21:52:17.902773+0000","last_active":"2023-07-09T21:52:17.905628+0000","last_peered":"2023-07-09T21:52:17.905628+0000","last_clean":"2023-07-09T21:52:17.905628+0000","last_became_active":"2023-07-09T21:52:17.902245+0000","last_became_peered":"2023-07-09T21:52:17.902245+0000","last_unstale":"2023-07-09T21:52:17.905628+0000","last_undegraded":"2023-07-09T21:52:17.905628+0000","last_fullsized":"2023-07-09T21:52:17.905628+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:23:31.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891996+0000","last_change":"2023-07-09T21:52:17.891996+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891996+0000","last_undegraded":"2023-07-09T21:52:17.891996+0000","last_fullsized":"2023-07-09T21:52:17.891996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.897292+0000","last_change":"2023-07-09T21:52:17.907414+0000","last_active":"2023-07-09T21:52:18.897292+0000","last_peered":"2023-07-09T21:52:18.897292+0000","last_clean":"2023-07-09T21:52:18.897292+0000","last_became_active":"2023-07-09T21:52:17.906862+0000","last_became_peered":"2023-07-09T21:52:17.906862+0000","last_unstale":"2023-07-09T21:52:18.897292+0000","last_undegraded":"2023-07-09T21:52:18.897292+0000","last_fullsized":"2023-07-09T21:52:18.897292+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:12:51.306577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895637+0000","last_change":"2023-07-09T21:52:17.895637+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895637+0000","last_undegraded":"2023-07-09T21:52:17.895637+0000","last_fullsized":"2023-07-09T21:52:17.895637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.919431+0000","last_change":"2023-07-09T21:52:17.916134+0000","last_active":"2023-07-09T21:52:17.919431+0000","last_peered":"2023-07-09T21:52:17.919431+0000","last_clean":"2023-07-09T21:52:17.919431+0000","last_became_active":"2023-07-09T21:52:17.915830+0000","last_became_peered":"2023-07-09T21:52:17.915830+0000","last_unstale":"2023-07-09T21:52:17.919431+0000","last_undegraded":"2023-07-09T21:52:17.919431+0000","last_fullsized":"2023-07-09T21:52:17.919431+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:40:31.700445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.917698+0000","last_change":"2023-07-09T21:52:18.913106+0000","last_active":"2023-07-09T21:52:18.917698+0000","last_peered":"2023-07-09T21:52:18.917698+0000","last_clean":"2023-07-09T21:52:18.917698+0000","last_became_active":"2023-07-09T21:52:18.912827+0000","last_became_peered":"2023-07-09T21:52:18.912827+0000","last_unstale":"2023-07-09T21:52:18.917698+0000","last_undegraded":"2023-07-09T21:52:18.917698+0000","last_fullsized":"2023-07-09T21:52:18.917698+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:39.589410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.915152+0000","last_change":"2023-07-09T21:52:17.906739+0000","last_active":"2023-07-09T21:52:17.915152+0000","last_peered":"2023-07-09T21:52:17.915152+0000","last_clean":"2023-07-09T21:52:17.915152+0000","last_became_active":"2023-07-09T21:52:17.906459+0000","last_became_peered":"2023-07-09T21:52:17.906459+0000","last_unstale":"2023-07-09T21:52:17.915152+0000","last_undegraded":"2023-07-09T21:52:17.915152+0000","last_fullsized":"2023-07-09T21:52:17.915152+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:07:25.576893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891845+0000","last_change":"2023-07-09T21:52:17.891845+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891845+0000","last_undegraded":"2023-07-09T21:52:17.891845+0000","last_fullsized":"2023-07-09T21:52:17.891845+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912909+0000","last_change":"2023-07-09T21:52:17.908750+0000","last_active":"2023-07-09T21:52:17.912909+0000","last_peered":"2023-07-09T21:52:17.912909+0000","last_clean":"2023-07-09T21:52:17.912909+0000","last_became_active":"2023-07-09T21:52:17.908498+0000","last_became_peered":"2023-07-09T21:52:17.908498+0000","last_unstale":"2023-07-09T21:52:17.912909+0000","last_undegraded":"2023-07-09T21:52:17.912909+0000","last_fullsized":"2023-07-09T21:52:17.912909+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:37:35.072028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896492+0000","last_change":"2023-07-09T21:52:17.896492+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896492+0000","last_undegraded":"2023-07-09T21:52:17.896492+0000","last_fullsized":"2023-07-09T21:52:17.896492+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.916580+0000","last_change":"2023-07-09T21:52:17.913662+0000","last_active":"2023-07-09T21:52:17.916580+0000","last_peered":"2023-07-09T21:52:17.916580+0000","last_clean":"2023-07-09T21:52:17.916580+0000","last_became_active":"2023-07-09T21:52:17.913376+0000","last_became_peered":"2023-07-09T21:52:17.913376+0000","last_unstale":"2023-07-09T21:52:17.916580+0000","last_undegraded":"2023-07-09T21:52:17.916580+0000","last_fullsized":"2023-07-09T21:52:17.916580+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:16:51.455702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897182+0000","last_change":"2023-07-09T21:52:17.897182+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897182+0000","last_undegraded":"2023-07-09T21:52:17.897182+0000","last_fullsized":"2023-07-09T21:52:17.897182+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912824+0000","last_change":"2023-07-09T21:52:17.906064+0000","last_active":"2023-07-09T21:52:17.912824+0000","last_peered":"2023-07-09T21:52:17.912824+0000","last_clean":"2023-07-09T21:52:17.912824+0000","last_became_active":"2023-07-09T21:52:17.905765+0000","last_became_peered":"2023-07-09T21:52:17.905765+0000","last_unstale":"2023-07-09T21:52:17.912824+0000","last_undegraded":"2023-07-09T21:52:17.912824+0000","last_fullsized":"2023-07-09T21:52:17.912824+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:15:03.562144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897286+0000","last_change":"2023-07-09T21:52:17.897286+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897286+0000","last_undegraded":"2023-07-09T21:52:17.897286+0000","last_fullsized":"2023-07-09T21:52:17.897286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.914788+0000","last_change":"2023-07-09T21:52:17.906688+0000","last_active":"2023-07-09T21:52:17.914788+0000","last_peered":"2023-07-09T21:52:17.914788+0000","last_clean":"2023-07-09T21:52:17.914788+0000","last_became_active":"2023-07-09T21:52:17.906355+0000","last_became_peered":"2023-07-09T21:52:17.906355+0000","last_unstale":"2023-07-09T21:52:17.914788+0000","last_undegraded":"2023-07-09T21:52:17.914788+0000","last_fullsized":"2023-07-09T21:52:17.914788+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:37:30.965031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891413+0000","last_change":"2023-07-09T21:52:17.891413+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891413+0000","last_undegraded":"2023-07-09T21:52:17.891413+0000","last_fullsized":"2023-07-09T21:52:17.891413+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.917352+0000","last_change":"2023-07-09T21:52:17.915757+0000","last_active":"2023-07-09T21:52:17.917352+0000","last_peered":"2023-07-09T21:52:17.917352+0000","last_clean":"2023-07-09T21:52:17.917352+0000","last_became_active":"2023-07-09T21:52:17.915396+0000","last_became_peered":"2023-07-09T21:52:17.915396+0000","last_unstale":"2023-07-09T21:52:17.917352+0000","last_undegraded":"2023-07-09T21:52:17.917352+0000","last_fullsized":"2023-07-09T21:52:17.917352+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:39.110613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.928099+0000","last_change":"2023-07-09T21:52:18.926116+0000","last_active":"2023-07-09T21:52:18.928099+0000","last_peered":"2023-07-09T21:52:18.928099+0000","last_clean":"2023-07-09T21:52:18.928099+0000","last_became_active":"2023-07-09T21:52:18.925663+0000","last_became_peered":"2023-07-09T21:52:18.925663+0000","last_unstale":"2023-07-09T21:52:18.928099+0000","last_undegraded":"2023-07-09T21:52:18.928099+0000","last_fullsized":"2023-07-09T21:52:18.928099+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:03:51.789345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.913725+0000","last_change":"2023-07-09T21:52:17.908662+0000","last_active":"2023-07-09T21:52:17.913725+0000","last_peered":"2023-07-09T21:52:17.913725+0000","last_clean":"2023-07-09T21:52:17.913725+0000","last_became_active":"2023-07-09T21:52:17.908390+0000","last_became_peered":"2023-07-09T21:52:17.908390+0000","last_unstale":"2023-07-09T21:52:17.913725+0000","last_undegraded":"2023-07-09T21:52:17.913725+0000","last_fullsized":"2023-07-09T21:52:17.913725+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:43:58.667439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.928389+0000","last_change":"2023-07-09T21:52:18.925491+0000","last_active":"2023-07-09T21:52:18.928389+0000","last_peered":"2023-07-09T21:52:18.928389+0000","last_clean":"2023-07-09T21:52:18.928389+0000","last_became_active":"2023-07-09T21:52:18.925165+0000","last_became_peered":"2023-07-09T21:52:18.925165+0000","last_unstale":"2023-07-09T21:52:18.928389+0000","last_undegraded":"2023-07-09T21:52:18.928389+0000","last_fullsized":"2023-07-09T21:52:18.928389+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:35:19.222250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912643+0000","last_change":"2023-07-09T21:52:17.905001+0000","last_active":"2023-07-09T21:52:17.912643+0000","last_peered":"2023-07-09T21:52:17.912643+0000","last_clean":"2023-07-09T21:52:17.912643+0000","last_became_active":"2023-07-09T21:52:17.904624+0000","last_became_peered":"2023-07-09T21:52:17.904624+0000","last_unstale":"2023-07-09T21:52:17.912643+0000","last_undegraded":"2023-07-09T21:52:17.912643+0000","last_fullsized":"2023-07-09T21:52:17.912643+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:54:30.292420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.896519+0000","last_change":"2023-07-09T21:52:18.894463+0000","last_active":"2023-07-09T21:52:18.896519+0000","last_peered":"2023-07-09T21:52:18.896519+0000","last_clean":"2023-07-09T21:52:18.896519+0000","last_became_active":"2023-07-09T21:52:18.894175+0000","last_became_peered":"2023-07-09T21:52:18.894175+0000","last_unstale":"2023-07-09T21:52:18.896519+0000","last_undegraded":"2023-07-09T21:52:18.896519+0000","last_fullsized":"2023-07-09T21:52:18.896519+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:10:51.118899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912588+0000","last_change":"2023-07-09T21:52:17.904083+0000","last_active":"2023-07-09T21:52:17.912588+0000","last_peered":"2023-07-09T21:52:17.912588+0000","last_clean":"2023-07-09T21:52:17.912588+0000","last_became_active":"2023-07-09T21:52:17.903804+0000","last_became_peered":"2023-07-09T21:52:17.903804+0000","last_unstale":"2023-07-09T21:52:17.912588+0000","last_undegraded":"2023-07-09T21:52:17.912588+0000","last_fullsized":"2023-07-09T21:52:17.912588+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:41.123866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893003+0000","last_change":"2023-07-09T21:52:17.893003+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893003+0000","last_undegraded":"2023-07-09T21:52:17.893003+0000","last_fullsized":"2023-07-09T21:52:17.893003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.927982+0000","last_change":"2023-07-09T21:52:17.901130+0000","last_active":"2023-07-09T21:52:18.927982+0000","last_peered":"2023-07-09T21:52:18.927982+0000","last_clean":"2023-07-09T21:52:18.927982+0000","last_became_active":"2023-07-09T21:52:17.900760+0000","last_became_peered":"2023-07-09T21:52:17.900760+0000","last_unstale":"2023-07-09T21:52:18.927982+0000","last_undegraded":"2023-07-09T21:52:18.927982+0000","last_fullsized":"2023-07-09T21:52:18.927982+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:25:10.181482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897055+0000","last_change":"2023-07-09T21:52:17.897055+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897055+0000","last_undegraded":"2023-07-09T21:52:17.897055+0000","last_fullsized":"2023-07-09T21:52:17.897055+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.914799+0000","last_change":"2023-07-09T21:52:17.903707+0000","last_active":"2023-07-09T21:52:17.914799+0000","last_peered":"2023-07-09T21:52:17.914799+0000","last_clean":"2023-07-09T21:52:17.914799+0000","last_became_active":"2023-07-09T21:52:17.903434+0000","last_became_peered":"2023-07-09T21:52:17.903434+0000","last_unstale":"2023-07-09T21:52:17.914799+0000","last_undegraded":"2023-07-09T21:52:17.914799+0000","last_fullsized":"2023-07-09T21:52:17.914799+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:11.148078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896838+0000","last_change":"2023-07-09T21:52:17.896838+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896838+0000","last_undegraded":"2023-07-09T21:52:17.896838+0000","last_fullsized":"2023-07-09T21:52:17.896838+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.917373+0000","last_change":"2023-07-09T21:52:17.916113+0000","last_active":"2023-07-09T21:52:17.917373+0000","last_peered":"2023-07-09T21:52:17.917373+0000","last_clean":"2023-07-09T21:52:17.917373+0000","last_became_active":"2023-07-09T21:52:17.915785+0000","last_became_peered":"2023-07-09T21:52:17.915785+0000","last_unstale":"2023-07-09T21:52:17.917373+0000","last_undegraded":"2023-07-09T21:52:17.917373+0000","last_fullsized":"2023-07-09T21:52:17.917373+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:39.204660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.923015+0000","last_change":"2023-07-09T21:52:18.920034+0000","last_active":"2023-07-09T21:52:18.923015+0000","last_peered":"2023-07-09T21:52:18.923015+0000","last_clean":"2023-07-09T21:52:18.923015+0000","last_became_active":"2023-07-09T21:52:18.919780+0000","last_became_peered":"2023-07-09T21:52:18.919780+0000","last_unstale":"2023-07-09T21:52:18.923015+0000","last_undegraded":"2023-07-09T21:52:18.923015+0000","last_fullsized":"2023-07-09T21:52:18.923015+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:12:09.611456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.913861+0000","last_change":"2023-07-09T21:52:17.906386+0000","last_active":"2023-07-09T21:52:17.913861+0000","last_peered":"2023-07-09T21:52:17.913861+0000","last_clean":"2023-07-09T21:52:17.913861+0000","last_became_active":"2023-07-09T21:52:17.906124+0000","last_became_peered":"2023-07-09T21:52:17.906124+0000","last_unstale":"2023-07-09T21:52:17.913861+0000","last_undegraded":"2023-07-09T21:52:17.913861+0000","last_fullsized":"2023-07-09T21:52:17.913861+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:07:31.780909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897337+0000","last_change":"2023-07-09T21:52:17.897337+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897337+0000","last_undegraded":"2023-07-09T21:52:17.897337+0000","last_fullsized":"2023-07-09T21:52:17.897337+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.895309+0000","last_change":"2023-07-09T21:52:17.900770+0000","last_active":"2023-07-09T21:52:18.895309+0000","last_peered":"2023-07-09T21:52:18.895309+0000","last_clean":"2023-07-09T21:52:18.895309+0000","last_became_active":"2023-07-09T21:52:17.900421+0000","last_became_peered":"2023-07-09T21:52:17.900421+0000","last_unstale":"2023-07-09T21:52:18.895309+0000","last_undegraded":"2023-07-09T21:52:18.895309+0000","last_fullsized":"2023-07-09T21:52:18.895309+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:25:21.334696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.889045+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:52:18.889045+0000","last_peered":"2023-07-09T21:52:18.889045+0000","last_clean":"2023-07-09T21:52:18.889045+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:52:18.889045+0000","last_undegraded":"2023-07-09T21:52:18.889045+0000","last_fullsized":"2023-07-09T21:52:18.889045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:10:16.058227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892399+0000","last_change":"2023-07-09T21:52:17.892399+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892399+0000","last_undegraded":"2023-07-09T21:52:17.892399+0000","last_fullsized":"2023-07-09T21:52:17.892399+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.913545+0000","last_change":"2023-07-09T21:52:17.907945+0000","last_active":"2023-07-09T21:52:17.913545+0000","last_peered":"2023-07-09T21:52:17.913545+0000","last_clean":"2023-07-09T21:52:17.913545+0000","last_became_active":"2023-07-09T21:52:17.907687+0000","last_became_peered":"2023-07-09T21:52:17.907687+0000","last_unstale":"2023-07-09T21:52:17.913545+0000","last_undegraded":"2023-07-09T21:52:17.913545+0000","last_fullsized":"2023-07-09T21:52:17.913545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:52.181586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.890975+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:52:17.890975+0000","last_peered":"2023-07-09T21:52:17.890975+0000","last_clean":"2023-07-09T21:52:17.890975+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:52:17.890975+0000","last_undegraded":"2023-07-09T21:52:17.890975+0000","last_fullsized":"2023-07-09T21:52:17.890975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:21:31.603089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892416+0000","last_change":"2023-07-09T21:52:17.892416+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892416+0000","last_undegraded":"2023-07-09T21:52:17.892416+0000","last_fullsized":"2023-07-09T21:52:17.892416+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912936+0000","last_change":"2023-07-09T21:52:17.909086+0000","last_active":"2023-07-09T21:52:17.912936+0000","last_peered":"2023-07-09T21:52:17.912936+0000","last_clean":"2023-07-09T21:52:17.912936+0000","last_became_active":"2023-07-09T21:52:17.907325+0000","last_became_peered":"2023-07-09T21:52:17.907325+0000","last_unstale":"2023-07-09T21:52:17.912936+0000","last_undegraded":"2023-07-09T21:52:17.912936+0000","last_fullsized":"2023-07-09T21:52:17.912936+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:43:42.844895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.902085+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:52:17.902085+0000","last_peered":"2023-07-09T21:52:17.902085+0000","last_clean":"2023-07-09T21:52:17.902085+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:52:17.902085+0000","last_undegraded":"2023-07-09T21:52:17.902085+0000","last_fullsized":"2023-07-09T21:52:17.902085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:55:01.994943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894408+0000","last_change":"2023-07-09T21:52:17.894408+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894408+0000","last_undegraded":"2023-07-09T21:52:17.894408+0000","last_fullsized":"2023-07-09T21:52:17.894408+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912914+0000","last_change":"2023-07-09T21:52:17.908857+0000","last_active":"2023-07-09T21:52:17.912914+0000","last_peered":"2023-07-09T21:52:17.912914+0000","last_clean":"2023-07-09T21:52:17.912914+0000","last_became_active":"2023-07-09T21:52:17.907842+0000","last_became_peered":"2023-07-09T21:52:17.907842+0000","last_unstale":"2023-07-09T21:52:17.912914+0000","last_undegraded":"2023-07-09T21:52:17.912914+0000","last_fullsized":"2023-07-09T21:52:17.912914+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:38:46.077337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.891884+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:52:17.891884+0000","last_peered":"2023-07-09T21:52:17.891884+0000","last_clean":"2023-07-09T21:52:17.891884+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:52:17.891884+0000","last_undegraded":"2023-07-09T21:52:17.891884+0000","last_fullsized":"2023-07-09T21:52:17.891884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:38:31.353644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.897496+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:52:17.897496+0000","last_peered":"2023-07-09T21:52:17.897496+0000","last_clean":"2023-07-09T21:52:17.897496+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:52:17.897496+0000","last_undegraded":"2023-07-09T21:52:17.897496+0000","last_fullsized":"2023-07-09T21:52:17.897496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:48.827423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.925030+0000","last_change":"2023-07-09T21:52:18.921385+0000","last_active":"2023-07-09T21:52:18.925030+0000","last_peered":"2023-07-09T21:52:18.925030+0000","last_clean":"2023-07-09T21:52:18.925030+0000","last_became_active":"2023-07-09T21:52:18.911170+0000","last_became_peered":"2023-07-09T21:52:18.911170+0000","last_unstale":"2023-07-09T21:52:18.925030+0000","last_undegraded":"2023-07-09T21:52:18.925030+0000","last_fullsized":"2023-07-09T21:52:18.925030+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:31:12.671286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.916623+0000","last_change":"2023-07-09T21:52:17.913375+0000","last_active":"2023-07-09T21:52:17.916623+0000","last_peered":"2023-07-09T21:52:17.916623+0000","last_clean":"2023-07-09T21:52:17.916623+0000","last_became_active":"2023-07-09T21:52:17.913062+0000","last_became_peered":"2023-07-09T21:52:17.913062+0000","last_unstale":"2023-07-09T21:52:17.916623+0000","last_undegraded":"2023-07-09T21:52:17.916623+0000","last_fullsized":"2023-07-09T21:52:17.916623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:29:19.233060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.897684+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:52:17.897684+0000","last_peered":"2023-07-09T21:52:17.897684+0000","last_clean":"2023-07-09T21:52:17.897684+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:52:17.897684+0000","last_undegraded":"2023-07-09T21:52:17.897684+0000","last_fullsized":"2023-07-09T21:52:17.897684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:47:08.444583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891841+0000","last_change":"2023-07-09T21:52:17.891841+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891841+0000","last_undegraded":"2023-07-09T21:52:17.891841+0000","last_fullsized":"2023-07-09T21:52:17.891841+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.909928+0000","last_change":"2023-07-09T21:52:17.905141+0000","last_active":"2023-07-09T21:52:17.909928+0000","last_peered":"2023-07-09T21:52:17.909928+0000","last_clean":"2023-07-09T21:52:17.909928+0000","last_became_active":"2023-07-09T21:52:17.904855+0000","last_became_peered":"2023-07-09T21:52:17.904855+0000","last_unstale":"2023-07-09T21:52:17.909928+0000","last_undegraded":"2023-07-09T21:52:17.909928+0000","last_fullsized":"2023-07-09T21:52:17.909928+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:49:08.791384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.898354+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:52:17.898354+0000","last_peered":"2023-07-09T21:52:17.898354+0000","last_clean":"2023-07-09T21:52:17.898354+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:52:17.898354+0000","last_undegraded":"2023-07-09T21:52:17.898354+0000","last_fullsized":"2023-07-09T21:52:17.898354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:07:42.879585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.900222+0000","last_change":"2023-07-09T21:52:17.900222+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.900222+0000","last_undegraded":"2023-07-09T21:52:17.900222+0000","last_fullsized":"2023-07-09T21:52:17.900222+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.914898+0000","last_change":"2023-07-09T21:52:17.908430+0000","last_active":"2023-07-09T21:52:17.914898+0000","last_peered":"2023-07-09T21:52:17.914898+0000","last_clean":"2023-07-09T21:52:17.914898+0000","last_became_active":"2023-07-09T21:52:17.908191+0000","last_became_peered":"2023-07-09T21:52:17.908191+0000","last_unstale":"2023-07-09T21:52:17.914898+0000","last_undegraded":"2023-07-09T21:52:17.914898+0000","last_fullsized":"2023-07-09T21:52:17.914898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:00:29.609406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.889868+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:52:18.889868+0000","last_peered":"2023-07-09T21:52:18.889868+0000","last_clean":"2023-07-09T21:52:18.889868+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:52:18.889868+0000","last_undegraded":"2023-07-09T21:52:18.889868+0000","last_fullsized":"2023-07-09T21:52:18.889868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:30.415219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891448+0000","last_change":"2023-07-09T21:52:17.891448+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891448+0000","last_undegraded":"2023-07-09T21:52:17.891448+0000","last_fullsized":"2023-07-09T21:52:17.891448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.915523+0000","last_change":"2023-07-09T21:52:17.913781+0000","last_active":"2023-07-09T21:52:17.915523+0000","last_peered":"2023-07-09T21:52:17.915523+0000","last_clean":"2023-07-09T21:52:17.915523+0000","last_became_active":"2023-07-09T21:52:17.913487+0000","last_became_peered":"2023-07-09T21:52:17.913487+0000","last_unstale":"2023-07-09T21:52:17.915523+0000","last_undegraded":"2023-07-09T21:52:17.915523+0000","last_fullsized":"2023-07-09T21:52:17.915523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:55:53.352569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.896521+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:52:17.896521+0000","last_peered":"2023-07-09T21:52:17.896521+0000","last_clean":"2023-07-09T21:52:17.896521+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:52:17.896521+0000","last_undegraded":"2023-07-09T21:52:17.896521+0000","last_fullsized":"2023-07-09T21:52:17.896521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:52:10.511336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":243201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95099999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.45900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81999999999999995,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.67400000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.79000000000000004,"15min":0.82099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78700000000000003,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97099999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.60399999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92900000000000005,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.503},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89200000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.622}]},{"osd":6,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":1.214,"15min":1.214},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.68700000000000006}]}]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":569344,"data_stored":243201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52000000000000002,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55500000000000005,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.53700000000000003,"15min":0.55600000000000005},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56699999999999995,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.60599999999999998,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.63300000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.42299999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.68100000000000005,"15min":0.70899999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63400000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60399999999999998,"5min":3.129,"15min":3.129},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94499999999999995,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.749},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.998,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91200000000000003,"5min":1.929,"15min":1.929},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.85099999999999998,"15min":0.86399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97599999999999998,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.86599999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93500000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.95199999999999996,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":2.766,"15min":2.766},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.93400000000000005,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.93200000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":557056,"data_stored":236573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":1.232,"15min":1.3700000000000001},"min":{"1min":0.28899999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":16.946000000000002,"15min":16.946000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.93200000000000005,"15min":1.0089999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":9.5449999999999999,"15min":9.5449999999999999},"last":0.52700000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.92100000000000004,"15min":0.99399999999999999},"min":{"1min":0.38200000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65200000000000002,"5min":9.6950000000000003,"15min":9.6950000000000003},"last":0.435},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.95099999999999996,"15min":1.0329999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63200000000000001,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.995,"15min":1.077},"min":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69199999999999995,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.327,"15min":1.4630000000000001},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73599999999999999,"5min":17.004000000000001,"15min":17.004000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.048,"15min":1.1000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.081,"5min":6.2510000000000003,"15min":6.2510000000000003},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.2849999999999999,"15min":1.3680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2050000000000001,"5min":9.6630000000000003,"15min":9.6630000000000003},"last":0.97099999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":1.091,"15min":1.139},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2370000000000001,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.2849999999999999,"15min":1.369},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.1619999999999999,"5min":9.5879999999999992,"15min":9.5879999999999992},"last":0.93100000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":1.2849999999999999,"15min":1.371},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.048,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":1.266,"15min":1.349},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0529999999999999,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":0.91200000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.2250000000000001,"15min":1.2969999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.103,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.1160000000000001,"15min":1.1659999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.163,"5min":6.2169999999999996,"15min":6.2169999999999996},"last":0.89900000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1150976,"data_stored":826941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.92200000000000004,"15min":1.01},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55000000000000004,"5min":11.949999999999999,"15min":11.949999999999999},"last":3.4849999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60199999999999998,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73899999999999999,"5min":1.212,"15min":1.212},"last":3.0819999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":1.488}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":1.4179999999999999,"15min":1.5720000000000001},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":23.010999999999999,"15min":23.010999999999999},"last":3.9569999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90900000000000003,"15min":0.97499999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65100000000000002,"5min":10.952,"15min":10.952},"last":4.226}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":1.696,"15min":1.859},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":22.974,"15min":22.974},"last":3.1349999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":1.264,"15min":1.3520000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":3.2109999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52300000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":1.589,"15min":1.589},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.748,"5min":1.6890000000000001,"15min":1.8460000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":22.933,"15min":22.933},"last":3.2450000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93100000000000005,"5min":1.623,"15min":1.623},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.6830000000000001,"15min":1.8400000000000001},"min":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98199999999999998,"5min":22.867999999999999,"15min":22.867999999999999},"last":3.1749999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.1639999999999999,"15min":1.23},"min":{"1min":0.57499999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.93300000000000005,"5min":10.907999999999999,"15min":10.907999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83299999999999996,"15min":0.83999999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.99299999999999999,"5min":1.546,"15min":1.546},"last":0.63400000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1150976,"data_stored":826941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.61399999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85799999999999998,"5min":1.464,"15min":1.464},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94999999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89100000000000001,"5min":1.121,"15min":1.121},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.78600000000000003,"15min":0.80400000000000005},"min":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70799999999999996,"15min":0.71699999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.091,"15min":1.091},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96599999999999997,"5min":1.405,"15min":1.405},"last":0.67200000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.95399999999999996,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.443},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70399999999999996,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82799999999999996,"5min":1.341,"15min":1.341},"last":0.497}]},{"osd":5,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.443,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.871,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.52400000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88100000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.68700000000000006}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":557056,"data_stored":236573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57599999999999996,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68200000000000005,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.53800000000000003,"5min":1.21,"15min":1.21},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.54900000000000004,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.433}]},{"osd":2,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60699999999999998,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.56100000000000005,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.44900000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.016,"5min":1.258,"15min":1.258},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0049999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95599999999999996,"5min":1.486,"15min":1.486},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98999999999999999,"5min":1.327,"15min":1.327},"last":0.71799999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":1.302,"15min":1.302},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.86199999999999999,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":0.78300000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.04,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.008,"5min":1.349,"15min":1.349},"last":0.68000000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":557056,"data_stored":236573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.74199999999999999,"15min":0.69999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":7.9779999999999998,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.78700000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":7.8650000000000002,"5min":7.8650000000000002,"15min":7.8650000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.421,"15min":1.421},"last":0.83399999999999996}]},{"osd":2,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.73199999999999998,"15min":0.68200000000000005},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":7.9390000000000001,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88300000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1799999999999999,"5min":1.597,"15min":1.597},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.93700000000000006,"5min":1.216,"15min":1.216},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91200000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0609999999999999,"5min":1.069,"15min":1.069},"last":0.62}]},{"osd":6,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":1.093,"15min":1.093},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.81799999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.038,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76800000000000002,"15min":0.76300000000000001},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.054,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.86299999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":557056,"data_stored":236573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.54400000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84799999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54700000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.86399999999999999,"5min":1.113,"15min":1.113},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84199999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.59699999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85599999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.46800000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63400000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93400000000000005,"5min":1.018,"15min":1.018},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95099999999999996,"5min":1.171,"15min":1.171},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98199999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.754,"15min":0.749},"min":{"1min":0.56699999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96399999999999997,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76400000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.999,"5min":1.133,"15min":1.133},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.022,"5min":1.123,"15min":1.123},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:52:23.839 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:52:24.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.071+0000 7f743edff700 1 Processor -- start 2023-07-09T21:52:24.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.071+0000 7f743edff700 1 -- start start 2023-07-09T21:52:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.072+0000 7f743edff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f74380b1e00 0x7f74380b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.072+0000 7f743edff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74380d1220 0x7f74380afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.072+0000 7f743edff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74380d2ce0 con 0x7f74380b2350 2023-07-09T21:52:24.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.072+0000 7f743edff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74380b3350 con 0x7f74380b1e00 2023-07-09T21:52:24.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.072+0000 7f743edff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74380b3630 con 0x7f74380d1220 2023-07-09T21:52:24.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.073+0000 7f7437fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f74380b2350 0x7f74380d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46440/0 (socket says 172.21.15.53:46440) 2023-07-09T21:52:24.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.073+0000 7f7437fff700 1 -- 172.21.15.53:0/140620604 learned_addr learned my addr 172.21.15.53:0/140620604 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:24.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.073+0000 7f743cb9b700 1 --2- 172.21.15.53:0/140620604 >> v2:172.21.15.184:3300/0 conn(0x7f74380b1e00 0x7f74380b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:24.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.073+0000 7f743d39c700 1 --2- 172.21.15.53:0/140620604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74380d1220 0x7f74380afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:24.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.073+0000 7f74377fe700 1 -- 172.21.15.53:0/140620604 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041566032 0 0) 0x7f74380d2ce0 con 0x7f74380b2350 2023-07-09T21:52:24.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.073+0000 7f74377fe700 1 -- 172.21.15.53:0/140620604 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74280035b0 con 0x7f74380b2350 2023-07-09T21:52:24.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.073+0000 7f743d39c700 1 -- 172.21.15.53:0/140620604 >> v2:172.21.15.184:3300/0 conn(0x7f74380b1e00 msgr2=0x7f74380b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:24.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.073+0000 7f743d39c700 1 --2- 172.21.15.53:0/140620604 >> v2:172.21.15.184:3300/0 conn(0x7f74380b1e00 0x7f74380b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.073+0000 7f743d39c700 1 -- 172.21.15.53:0/140620604 >> v1:172.21.15.53:6789/0 conn(0x7f74380b2350 legacy=0x7f74380d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:24.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.073+0000 7f743d39c700 1 -- 172.21.15.53:0/140620604 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380b3910 con 0x7f74380d1220 2023-07-09T21:52:24.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.074+0000 7f743d39c700 1 --2- 172.21.15.53:0/140620604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74380d1220 0x7f74380afac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7430009d90 tx=0x7f743000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f88a29010aef2e5d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:24.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.074+0000 7f74377fe700 1 -- 172.21.15.53:0/140620604 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743000e070 con 0x7f74380d1220 2023-07-09T21:52:24.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.074+0000 7f74377fe700 1 -- 172.21.15.53:0/140620604 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743000bb20 con 0x7f74380d1220 2023-07-09T21:52:24.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.074+0000 7f74377fe700 1 -- 172.21.15.53:0/140620604 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430012430 con 0x7f74380d1220 2023-07-09T21:52:24.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.074+0000 7f743edff700 1 -- 172.21.15.53:0/140620604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74380d1220 msgr2=0x7f74380afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:24.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.074+0000 7f743edff700 1 --2- 172.21.15.53:0/140620604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74380d1220 0x7f74380afac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7430009d90 tx=0x7f743000b330 comp rx=0 tx=0).stop 2023-07-09T21:52:24.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.074+0000 7f743edff700 1 -- 172.21.15.53:0/140620604 shutdown_connections 2023-07-09T21:52:24.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.074+0000 7f743edff700 1 --2- 172.21.15.53:0/140620604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74380d1220 0x7f74380afac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.074+0000 7f743edff700 1 --2- 172.21.15.53:0/140620604 >> v2:172.21.15.184:3300/0 conn(0x7f74380b1e00 0x7f74380b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.074+0000 7f743edff700 1 -- 172.21.15.53:0/140620604 >> 172.21.15.53:0/140620604 conn(0x7f743809c1d0 msgr2=0x7f74380d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:24.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.075+0000 7f743edff700 1 -- 172.21.15.53:0/140620604 shutdown_connections 2023-07-09T21:52:24.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.075+0000 7f743edff700 1 -- 172.21.15.53:0/140620604 wait complete. 2023-07-09T21:52:24.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.076+0000 7f743edff700 1 Processor -- start 2023-07-09T21:52:24.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.077+0000 7f743edff700 1 -- start start 2023-07-09T21:52:24.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.077+0000 7f743edff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74380b1e00 0x7f7438156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:24.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.077+0000 7f743edff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74380b2350 0x7f74380d0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:24.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.077+0000 7f743edff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74380d1220 0x7f74380cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:24.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f743edff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7438157f10 con 0x7f74380b1e00 2023-07-09T21:52:24.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f743edff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7438157300 con 0x7f74380d1220 2023-07-09T21:52:24.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f743edff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74381575e0 con 0x7f74380b2350 2023-07-09T21:52:24.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f743cb9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74380b1e00 0x7f7438156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:24.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f743cb9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74380b1e00 0x7f7438156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34738/0 (socket says 172.21.15.53:34738) 2023-07-09T21:52:24.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f743cb9b700 1 -- 172.21.15.53:0/460003182 learned_addr learned my addr 172.21.15.53:0/460003182 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:24.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f7437fff700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74380b2350 0x7f74380d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:24.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f743d39c700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74380d1220 0x7f74380cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:24.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f743cb9b700 1 -- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74380b2350 msgr2=0x7f74380d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:24.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f743cb9b700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74380b2350 0x7f74380d0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f743cb9b700 1 -- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74380d1220 msgr2=0x7f74380cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:24.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f743cb9b700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74380d1220 0x7f74380cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f743cb9b700 1 -- 172.21.15.53:0/460003182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430009a70 con 0x7f74380b1e00 2023-07-09T21:52:24.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.078+0000 7f743cb9b700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74380b1e00 0x7f7438156d20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f742c00e990 tx=0x7f742c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:24.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.079+0000 7f74357fa700 1 -- 172.21.15.53:0/460003182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c0096f0 con 0x7f74380b1e00 2023-07-09T21:52:24.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.079+0000 7f74357fa700 1 -- 172.21.15.53:0/460003182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c00c690 con 0x7f74380b1e00 2023-07-09T21:52:24.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.079+0000 7f74357fa700 1 -- 172.21.15.53:0/460003182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00ca00 con 0x7f74380b1e00 2023-07-09T21:52:24.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.079+0000 7f743edff700 1 -- 172.21.15.53:0/460003182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74381578c0 con 0x7f74380b1e00 2023-07-09T21:52:24.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.079+0000 7f743edff700 1 -- 172.21.15.53:0/460003182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7438153b00 con 0x7f74380b1e00 2023-07-09T21:52:24.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.080+0000 7f743edff700 1 -- 172.21.15.53:0/460003182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743804e280 con 0x7f74380b1e00 2023-07-09T21:52:24.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.081+0000 7f74357fa700 1 -- 172.21.15.53:0/460003182 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f742c00cb60 con 0x7f74380b1e00 2023-07-09T21:52:24.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.082+0000 7f74357fa700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f741c06ada0 0x7f741c06d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:24.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.082+0000 7f74357fa700 1 -- 172.21.15.53:0/460003182 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f742c089920 con 0x7f74380b1e00 2023-07-09T21:52:24.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.083+0000 7f7437fff700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f741c06ada0 0x7f741c06d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:24.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.083+0000 7f7437fff700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f741c06ada0 0x7f741c06d250 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f74380b8d40 tx=0x7f7424007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:24.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.086+0000 7f74357fa700 1 -- 172.21.15.53:0/460003182 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f742c054850 con 0x7f74380b1e00 2023-07-09T21:52:24.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.289+0000 7f743edff700 1 -- 172.21.15.53:0/460003182 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74380b3ed0 con 0x7f741c06ada0 2023-07-09T21:52:24.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.299+0000 7f74357fa700 1 -- 172.21.15.53:0/460003182 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307485 (secure 0 0 0) 0x7f74240058e0 con 0x7f741c06ada0 2023-07-09T21:52:24.304 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:24.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.303+0000 7f743edff700 1 -- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f741c06ada0 msgr2=0x7f741c06d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:24.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.303+0000 7f743edff700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f741c06ada0 0x7f741c06d250 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f74380b8d40 tx=0x7f7424007dc0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.303+0000 7f743edff700 1 -- 172.21.15.53:0/460003182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74380b1e00 msgr2=0x7f7438156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:24.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.303+0000 7f743edff700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74380b1e00 0x7f7438156d20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f742c00e990 tx=0x7f742c00eca0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.303+0000 7f743edff700 1 -- 172.21.15.53:0/460003182 shutdown_connections 2023-07-09T21:52:24.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.303+0000 7f743edff700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f741c06ada0 0x7f741c06d250 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.303+0000 7f743edff700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74380d1220 0x7f74380cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.303+0000 7f743edff700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74380b1e00 0x7f7438156d20 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.303+0000 7f743edff700 1 --2- 172.21.15.53:0/460003182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74380b2350 0x7f74380d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.303+0000 7f743edff700 1 -- 172.21.15.53:0/460003182 >> 172.21.15.53:0/460003182 conn(0x7f743809c1d0 msgr2=0x7f74380d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:24.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.303+0000 7f743edff700 1 -- 172.21.15.53:0/460003182 shutdown_connections 2023-07-09T21:52:24.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.303+0000 7f743edff700 1 -- 172.21.15.53:0/460003182 wait complete. 2023-07-09T21:52:24.308 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:52:24.323 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-07-09T21:52:22.879902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225248,"kb_used_data":5536,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754749472,"statfs":{"total":773094113280,"available":772863459328,"internally_reserved":0,"allocated":5668864,"data_stored":3086576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001308"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.903687+0000","last_change":"2023-07-09T21:52:18.896951+0000","last_active":"2023-07-09T21:52:18.903687+0000","last_peered":"2023-07-09T21:52:18.903687+0000","last_clean":"2023-07-09T21:52:18.903687+0000","last_became_active":"2023-07-09T21:52:18.896617+0000","last_became_peered":"2023-07-09T21:52:18.896617+0000","last_unstale":"2023-07-09T21:52:18.903687+0000","last_undegraded":"2023-07-09T21:52:18.903687+0000","last_fullsized":"2023-07-09T21:52:18.903687+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:06:54.804905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894881+0000","last_change":"2023-07-09T21:52:17.894881+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894881+0000","last_undegraded":"2023-07-09T21:52:17.894881+0000","last_fullsized":"2023-07-09T21:52:17.894881+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897443+0000","last_change":"2023-07-09T21:52:17.897443+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897443+0000","last_undegraded":"2023-07-09T21:52:17.897443+0000","last_fullsized":"2023-07-09T21:52:17.897443+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893933+0000","last_change":"2023-07-09T21:52:17.893933+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893933+0000","last_undegraded":"2023-07-09T21:52:17.893933+0000","last_fullsized":"2023-07-09T21:52:17.893933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.909927+0000","last_change":"2023-07-09T21:52:18.906085+0000","last_active":"2023-07-09T21:52:18.909927+0000","last_peered":"2023-07-09T21:52:18.909927+0000","last_clean":"2023-07-09T21:52:18.909927+0000","last_became_active":"2023-07-09T21:52:18.905771+0000","last_became_peered":"2023-07-09T21:52:18.905771+0000","last_unstale":"2023-07-09T21:52:18.909927+0000","last_undegraded":"2023-07-09T21:52:18.909927+0000","last_fullsized":"2023-07-09T21:52:18.909927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:26:23.107762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.921492+0000","last_change":"2023-07-09T21:52:18.909739+0000","last_active":"2023-07-09T21:52:18.921492+0000","last_peered":"2023-07-09T21:52:18.921492+0000","last_clean":"2023-07-09T21:52:18.921492+0000","last_became_active":"2023-07-09T21:52:18.906431+0000","last_became_peered":"2023-07-09T21:52:18.906431+0000","last_unstale":"2023-07-09T21:52:18.921492+0000","last_undegraded":"2023-07-09T21:52:18.921492+0000","last_fullsized":"2023-07-09T21:52:18.921492+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:38:10.323423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.899030+0000","last_change":"2023-07-09T21:52:17.899030+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.899030+0000","last_undegraded":"2023-07-09T21:52:17.899030+0000","last_fullsized":"2023-07-09T21:52:17.899030+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892045+0000","last_change":"2023-07-09T21:52:17.892045+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892045+0000","last_undegraded":"2023-07-09T21:52:17.892045+0000","last_fullsized":"2023-07-09T21:52:17.892045+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894172+0000","last_change":"2023-07-09T21:52:17.894172+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894172+0000","last_undegraded":"2023-07-09T21:52:17.894172+0000","last_fullsized":"2023-07-09T21:52:17.894172+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.913102+0000","last_change":"2023-07-09T21:52:18.905734+0000","last_active":"2023-07-09T21:52:18.913102+0000","last_peered":"2023-07-09T21:52:18.913102+0000","last_clean":"2023-07-09T21:52:18.913102+0000","last_became_active":"2023-07-09T21:52:18.905379+0000","last_became_peered":"2023-07-09T21:52:18.905379+0000","last_unstale":"2023-07-09T21:52:18.913102+0000","last_undegraded":"2023-07-09T21:52:18.913102+0000","last_fullsized":"2023-07-09T21:52:18.913102+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:54.518646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897343+0000","last_change":"2023-07-09T21:52:17.897343+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897343+0000","last_undegraded":"2023-07-09T21:52:17.897343+0000","last_fullsized":"2023-07-09T21:52:17.897343+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891282+0000","last_change":"2023-07-09T21:52:17.891282+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891282+0000","last_undegraded":"2023-07-09T21:52:17.891282+0000","last_fullsized":"2023-07-09T21:52:17.891282+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.921153+0000","last_change":"2023-07-09T21:52:18.906003+0000","last_active":"2023-07-09T21:52:18.921153+0000","last_peered":"2023-07-09T21:52:18.921153+0000","last_clean":"2023-07-09T21:52:18.921153+0000","last_became_active":"2023-07-09T21:52:18.905760+0000","last_became_peered":"2023-07-09T21:52:18.905760+0000","last_unstale":"2023-07-09T21:52:18.921153+0000","last_undegraded":"2023-07-09T21:52:18.921153+0000","last_fullsized":"2023-07-09T21:52:18.921153+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:48:19.857604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897968+0000","last_change":"2023-07-09T21:52:17.897968+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897968+0000","last_undegraded":"2023-07-09T21:52:17.897968+0000","last_fullsized":"2023-07-09T21:52:17.897968+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893772+0000","last_change":"2023-07-09T21:52:17.893772+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893772+0000","last_undegraded":"2023-07-09T21:52:17.893772+0000","last_fullsized":"2023-07-09T21:52:17.893772+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.916614+0000","last_change":"2023-07-09T21:52:18.906627+0000","last_active":"2023-07-09T21:52:18.916614+0000","last_peered":"2023-07-09T21:52:18.916614+0000","last_clean":"2023-07-09T21:52:18.916614+0000","last_became_active":"2023-07-09T21:52:18.906352+0000","last_became_peered":"2023-07-09T21:52:18.906352+0000","last_unstale":"2023-07-09T21:52:18.916614+0000","last_undegraded":"2023-07-09T21:52:18.916614+0000","last_fullsized":"2023-07-09T21:52:18.916614+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:56:25.759336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.901501+0000","last_change":"2023-07-09T21:52:17.901501+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.901501+0000","last_undegraded":"2023-07-09T21:52:17.901501+0000","last_fullsized":"2023-07-09T21:52:17.901501+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894401+0000","last_change":"2023-07-09T21:52:17.894401+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894401+0000","last_undegraded":"2023-07-09T21:52:17.894401+0000","last_fullsized":"2023-07-09T21:52:17.894401+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896966+0000","last_change":"2023-07-09T21:52:17.896966+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896966+0000","last_undegraded":"2023-07-09T21:52:17.896966+0000","last_fullsized":"2023-07-09T21:52:17.896966+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895814+0000","last_change":"2023-07-09T21:52:17.895814+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895814+0000","last_undegraded":"2023-07-09T21:52:17.895814+0000","last_fullsized":"2023-07-09T21:52:17.895814+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894824+0000","last_change":"2023-07-09T21:52:17.894824+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894824+0000","last_undegraded":"2023-07-09T21:52:17.894824+0000","last_fullsized":"2023-07-09T21:52:17.894824+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892776+0000","last_change":"2023-07-09T21:52:17.892776+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892776+0000","last_undegraded":"2023-07-09T21:52:17.892776+0000","last_fullsized":"2023-07-09T21:52:17.892776+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897885+0000","last_change":"2023-07-09T21:52:17.897885+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897885+0000","last_undegraded":"2023-07-09T21:52:17.897885+0000","last_fullsized":"2023-07-09T21:52:17.897885+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.898974+0000","last_change":"2023-07-09T21:52:17.898974+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.898974+0000","last_undegraded":"2023-07-09T21:52:17.898974+0000","last_fullsized":"2023-07-09T21:52:17.898974+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897689+0000","last_change":"2023-07-09T21:52:17.897689+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897689+0000","last_undegraded":"2023-07-09T21:52:17.897689+0000","last_fullsized":"2023-07-09T21:52:17.897689+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893441+0000","last_change":"2023-07-09T21:52:17.893441+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893441+0000","last_undegraded":"2023-07-09T21:52:17.893441+0000","last_fullsized":"2023-07-09T21:52:17.893441+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.928117+0000","last_change":"2023-07-09T21:52:18.926059+0000","last_active":"2023-07-09T21:52:18.928117+0000","last_peered":"2023-07-09T21:52:18.928117+0000","last_clean":"2023-07-09T21:52:18.928117+0000","last_became_active":"2023-07-09T21:52:18.925784+0000","last_became_peered":"2023-07-09T21:52:18.925784+0000","last_unstale":"2023-07-09T21:52:18.928117+0000","last_undegraded":"2023-07-09T21:52:18.928117+0000","last_fullsized":"2023-07-09T21:52:18.928117+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:54:22.307888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895023+0000","last_change":"2023-07-09T21:52:17.895023+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895023+0000","last_undegraded":"2023-07-09T21:52:17.895023+0000","last_fullsized":"2023-07-09T21:52:17.895023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896082+0000","last_change":"2023-07-09T21:52:17.896082+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896082+0000","last_undegraded":"2023-07-09T21:52:17.896082+0000","last_fullsized":"2023-07-09T21:52:17.896082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896237+0000","last_change":"2023-07-09T21:52:17.896237+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896237+0000","last_undegraded":"2023-07-09T21:52:17.896237+0000","last_fullsized":"2023-07-09T21:52:17.896237+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.898105+0000","last_change":"2023-07-09T21:52:17.898105+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.898105+0000","last_undegraded":"2023-07-09T21:52:17.898105+0000","last_fullsized":"2023-07-09T21:52:17.898105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892847+0000","last_change":"2023-07-09T21:52:17.892847+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892847+0000","last_undegraded":"2023-07-09T21:52:17.892847+0000","last_fullsized":"2023-07-09T21:52:17.892847+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893853+0000","last_change":"2023-07-09T21:52:17.893853+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893853+0000","last_undegraded":"2023-07-09T21:52:17.893853+0000","last_fullsized":"2023-07-09T21:52:17.893853+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912675+0000","last_change":"2023-07-09T21:52:17.905074+0000","last_active":"2023-07-09T21:52:17.912675+0000","last_peered":"2023-07-09T21:52:17.912675+0000","last_clean":"2023-07-09T21:52:17.912675+0000","last_became_active":"2023-07-09T21:52:17.904791+0000","last_became_peered":"2023-07-09T21:52:17.904791+0000","last_unstale":"2023-07-09T21:52:17.912675+0000","last_undegraded":"2023-07-09T21:52:17.912675+0000","last_fullsized":"2023-07-09T21:52:17.912675+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:42:18.230865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891253+0000","last_change":"2023-07-09T21:52:17.891253+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891253+0000","last_undegraded":"2023-07-09T21:52:17.891253+0000","last_fullsized":"2023-07-09T21:52:17.891253+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.926314+0000","last_change":"2023-07-09T21:52:17.903525+0000","last_active":"2023-07-09T21:52:18.926314+0000","last_peered":"2023-07-09T21:52:18.926314+0000","last_clean":"2023-07-09T21:52:18.926314+0000","last_became_active":"2023-07-09T21:52:17.900909+0000","last_became_peered":"2023-07-09T21:52:17.900909+0000","last_unstale":"2023-07-09T21:52:18.926314+0000","last_undegraded":"2023-07-09T21:52:18.926314+0000","last_fullsized":"2023-07-09T21:52:18.926314+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:21:52.052315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895397+0000","last_change":"2023-07-09T21:52:17.895397+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895397+0000","last_undegraded":"2023-07-09T21:52:17.895397+0000","last_fullsized":"2023-07-09T21:52:17.895397+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.925131+0000","last_change":"2023-07-09T21:52:17.909999+0000","last_active":"2023-07-09T21:52:18.925131+0000","last_peered":"2023-07-09T21:52:18.925131+0000","last_clean":"2023-07-09T21:52:18.925131+0000","last_became_active":"2023-07-09T21:52:17.909580+0000","last_became_peered":"2023-07-09T21:52:17.909580+0000","last_unstale":"2023-07-09T21:52:18.925131+0000","last_undegraded":"2023-07-09T21:52:18.925131+0000","last_fullsized":"2023-07-09T21:52:18.925131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:25.952731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892858+0000","last_change":"2023-07-09T21:52:17.892858+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892858+0000","last_undegraded":"2023-07-09T21:52:17.892858+0000","last_fullsized":"2023-07-09T21:52:17.892858+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.907556+0000","last_change":"2023-07-09T21:52:17.903946+0000","last_active":"2023-07-09T21:52:17.907556+0000","last_peered":"2023-07-09T21:52:17.907556+0000","last_clean":"2023-07-09T21:52:17.907556+0000","last_became_active":"2023-07-09T21:52:17.903690+0000","last_became_peered":"2023-07-09T21:52:17.903690+0000","last_unstale":"2023-07-09T21:52:17.907556+0000","last_undegraded":"2023-07-09T21:52:17.907556+0000","last_fullsized":"2023-07-09T21:52:17.907556+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:10:56.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.928388+0000","last_change":"2023-07-09T21:52:18.925285+0000","last_active":"2023-07-09T21:52:18.928388+0000","last_peered":"2023-07-09T21:52:18.928388+0000","last_clean":"2023-07-09T21:52:18.928388+0000","last_became_active":"2023-07-09T21:52:18.924973+0000","last_became_peered":"2023-07-09T21:52:18.924973+0000","last_unstale":"2023-07-09T21:52:18.928388+0000","last_undegraded":"2023-07-09T21:52:18.928388+0000","last_fullsized":"2023-07-09T21:52:18.928388+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:09:17.629077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.915950+0000","last_change":"2023-07-09T21:52:17.914742+0000","last_active":"2023-07-09T21:52:17.915950+0000","last_peered":"2023-07-09T21:52:17.915950+0000","last_clean":"2023-07-09T21:52:17.915950+0000","last_became_active":"2023-07-09T21:52:17.914452+0000","last_became_peered":"2023-07-09T21:52:17.914452+0000","last_unstale":"2023-07-09T21:52:17.915950+0000","last_undegraded":"2023-07-09T21:52:17.915950+0000","last_fullsized":"2023-07-09T21:52:17.915950+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:00.889871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895429+0000","last_change":"2023-07-09T21:52:17.895429+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895429+0000","last_undegraded":"2023-07-09T21:52:17.895429+0000","last_fullsized":"2023-07-09T21:52:17.895429+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.916522+0000","last_change":"2023-07-09T21:52:17.901241+0000","last_active":"2023-07-09T21:52:18.916522+0000","last_peered":"2023-07-09T21:52:18.916522+0000","last_clean":"2023-07-09T21:52:18.916522+0000","last_became_active":"2023-07-09T21:52:17.900934+0000","last_became_peered":"2023-07-09T21:52:17.900934+0000","last_unstale":"2023-07-09T21:52:18.916522+0000","last_undegraded":"2023-07-09T21:52:18.916522+0000","last_fullsized":"2023-07-09T21:52:18.916522+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:10:39.535148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896760+0000","last_change":"2023-07-09T21:52:17.896760+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896760+0000","last_undegraded":"2023-07-09T21:52:17.896760+0000","last_fullsized":"2023-07-09T21:52:17.896760+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912702+0000","last_change":"2023-07-09T21:52:17.905888+0000","last_active":"2023-07-09T21:52:17.912702+0000","last_peered":"2023-07-09T21:52:17.912702+0000","last_clean":"2023-07-09T21:52:17.912702+0000","last_became_active":"2023-07-09T21:52:17.905601+0000","last_became_peered":"2023-07-09T21:52:17.905601+0000","last_unstale":"2023-07-09T21:52:17.912702+0000","last_undegraded":"2023-07-09T21:52:17.912702+0000","last_fullsized":"2023-07-09T21:52:17.912702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:11.342048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894467+0000","last_change":"2023-07-09T21:52:17.894467+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894467+0000","last_undegraded":"2023-07-09T21:52:17.894467+0000","last_fullsized":"2023-07-09T21:52:17.894467+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912774+0000","last_change":"2023-07-09T21:52:17.908242+0000","last_active":"2023-07-09T21:52:17.912774+0000","last_peered":"2023-07-09T21:52:17.912774+0000","last_clean":"2023-07-09T21:52:17.912774+0000","last_became_active":"2023-07-09T21:52:17.907897+0000","last_became_peered":"2023-07-09T21:52:17.907897+0000","last_unstale":"2023-07-09T21:52:17.912774+0000","last_undegraded":"2023-07-09T21:52:17.912774+0000","last_fullsized":"2023-07-09T21:52:17.912774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:39:54.273358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.919811+0000","last_change":"2023-07-09T21:52:18.916918+0000","last_active":"2023-07-09T21:52:18.919811+0000","last_peered":"2023-07-09T21:52:18.919811+0000","last_clean":"2023-07-09T21:52:18.919811+0000","last_became_active":"2023-07-09T21:52:18.916633+0000","last_became_peered":"2023-07-09T21:52:18.916633+0000","last_unstale":"2023-07-09T21:52:18.919811+0000","last_undegraded":"2023-07-09T21:52:18.919811+0000","last_fullsized":"2023-07-09T21:52:18.919811+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:49.611360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.905628+0000","last_change":"2023-07-09T21:52:17.902773+0000","last_active":"2023-07-09T21:52:17.905628+0000","last_peered":"2023-07-09T21:52:17.905628+0000","last_clean":"2023-07-09T21:52:17.905628+0000","last_became_active":"2023-07-09T21:52:17.902245+0000","last_became_peered":"2023-07-09T21:52:17.902245+0000","last_unstale":"2023-07-09T21:52:17.905628+0000","last_undegraded":"2023-07-09T21:52:17.905628+0000","last_fullsized":"2023-07-09T21:52:17.905628+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:23:31.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891996+0000","last_change":"2023-07-09T21:52:17.891996+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891996+0000","last_undegraded":"2023-07-09T21:52:17.891996+0000","last_fullsized":"2023-07-09T21:52:17.891996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.897292+0000","last_change":"2023-07-09T21:52:17.907414+0000","last_active":"2023-07-09T21:52:18.897292+0000","last_peered":"2023-07-09T21:52:18.897292+0000","last_clean":"2023-07-09T21:52:18.897292+0000","last_became_active":"2023-07-09T21:52:17.906862+0000","last_became_peered":"2023-07-09T21:52:17.906862+0000","last_unstale":"2023-07-09T21:52:18.897292+0000","last_undegraded":"2023-07-09T21:52:18.897292+0000","last_fullsized":"2023-07-09T21:52:18.897292+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:12:51.306577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.895637+0000","last_change":"2023-07-09T21:52:17.895637+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.895637+0000","last_undegraded":"2023-07-09T21:52:17.895637+0000","last_fullsized":"2023-07-09T21:52:17.895637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.919431+0000","last_change":"2023-07-09T21:52:17.916134+0000","last_active":"2023-07-09T21:52:17.919431+0000","last_peered":"2023-07-09T21:52:17.919431+0000","last_clean":"2023-07-09T21:52:17.919431+0000","last_became_active":"2023-07-09T21:52:17.915830+0000","last_became_peered":"2023-07-09T21:52:17.915830+0000","last_unstale":"2023-07-09T21:52:17.919431+0000","last_undegraded":"2023-07-09T21:52:17.919431+0000","last_fullsized":"2023-07-09T21:52:17.919431+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:40:31.700445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.917698+0000","last_change":"2023-07-09T21:52:18.913106+0000","last_active":"2023-07-09T21:52:18.917698+0000","last_peered":"2023-07-09T21:52:18.917698+0000","last_clean":"2023-07-09T21:52:18.917698+0000","last_became_active":"2023-07-09T21:52:18.912827+0000","last_became_peered":"2023-07-09T21:52:18.912827+0000","last_unstale":"2023-07-09T21:52:18.917698+0000","last_undegraded":"2023-07-09T21:52:18.917698+0000","last_fullsized":"2023-07-09T21:52:18.917698+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:39.589410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.915152+0000","last_change":"2023-07-09T21:52:17.906739+0000","last_active":"2023-07-09T21:52:17.915152+0000","last_peered":"2023-07-09T21:52:17.915152+0000","last_clean":"2023-07-09T21:52:17.915152+0000","last_became_active":"2023-07-09T21:52:17.906459+0000","last_became_peered":"2023-07-09T21:52:17.906459+0000","last_unstale":"2023-07-09T21:52:17.915152+0000","last_undegraded":"2023-07-09T21:52:17.915152+0000","last_fullsized":"2023-07-09T21:52:17.915152+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:07:25.576893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891845+0000","last_change":"2023-07-09T21:52:17.891845+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891845+0000","last_undegraded":"2023-07-09T21:52:17.891845+0000","last_fullsized":"2023-07-09T21:52:17.891845+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912909+0000","last_change":"2023-07-09T21:52:17.908750+0000","last_active":"2023-07-09T21:52:17.912909+0000","last_peered":"2023-07-09T21:52:17.912909+0000","last_clean":"2023-07-09T21:52:17.912909+0000","last_became_active":"2023-07-09T21:52:17.908498+0000","last_became_peered":"2023-07-09T21:52:17.908498+0000","last_unstale":"2023-07-09T21:52:17.912909+0000","last_undegraded":"2023-07-09T21:52:17.912909+0000","last_fullsized":"2023-07-09T21:52:17.912909+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:37:35.072028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896492+0000","last_change":"2023-07-09T21:52:17.896492+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896492+0000","last_undegraded":"2023-07-09T21:52:17.896492+0000","last_fullsized":"2023-07-09T21:52:17.896492+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.916580+0000","last_change":"2023-07-09T21:52:17.913662+0000","last_active":"2023-07-09T21:52:17.916580+0000","last_peered":"2023-07-09T21:52:17.916580+0000","last_clean":"2023-07-09T21:52:17.916580+0000","last_became_active":"2023-07-09T21:52:17.913376+0000","last_became_peered":"2023-07-09T21:52:17.913376+0000","last_unstale":"2023-07-09T21:52:17.916580+0000","last_undegraded":"2023-07-09T21:52:17.916580+0000","last_fullsized":"2023-07-09T21:52:17.916580+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:16:51.455702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897182+0000","last_change":"2023-07-09T21:52:17.897182+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897182+0000","last_undegraded":"2023-07-09T21:52:17.897182+0000","last_fullsized":"2023-07-09T21:52:17.897182+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912824+0000","last_change":"2023-07-09T21:52:17.906064+0000","last_active":"2023-07-09T21:52:17.912824+0000","last_peered":"2023-07-09T21:52:17.912824+0000","last_clean":"2023-07-09T21:52:17.912824+0000","last_became_active":"2023-07-09T21:52:17.905765+0000","last_became_peered":"2023-07-09T21:52:17.905765+0000","last_unstale":"2023-07-09T21:52:17.912824+0000","last_undegraded":"2023-07-09T21:52:17.912824+0000","last_fullsized":"2023-07-09T21:52:17.912824+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:15:03.562144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897286+0000","last_change":"2023-07-09T21:52:17.897286+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897286+0000","last_undegraded":"2023-07-09T21:52:17.897286+0000","last_fullsized":"2023-07-09T21:52:17.897286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.914788+0000","last_change":"2023-07-09T21:52:17.906688+0000","last_active":"2023-07-09T21:52:17.914788+0000","last_peered":"2023-07-09T21:52:17.914788+0000","last_clean":"2023-07-09T21:52:17.914788+0000","last_became_active":"2023-07-09T21:52:17.906355+0000","last_became_peered":"2023-07-09T21:52:17.906355+0000","last_unstale":"2023-07-09T21:52:17.914788+0000","last_undegraded":"2023-07-09T21:52:17.914788+0000","last_fullsized":"2023-07-09T21:52:17.914788+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:37:30.965031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891413+0000","last_change":"2023-07-09T21:52:17.891413+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891413+0000","last_undegraded":"2023-07-09T21:52:17.891413+0000","last_fullsized":"2023-07-09T21:52:17.891413+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.917352+0000","last_change":"2023-07-09T21:52:17.915757+0000","last_active":"2023-07-09T21:52:17.917352+0000","last_peered":"2023-07-09T21:52:17.917352+0000","last_clean":"2023-07-09T21:52:17.917352+0000","last_became_active":"2023-07-09T21:52:17.915396+0000","last_became_peered":"2023-07-09T21:52:17.915396+0000","last_unstale":"2023-07-09T21:52:17.917352+0000","last_undegraded":"2023-07-09T21:52:17.917352+0000","last_fullsized":"2023-07-09T21:52:17.917352+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:39.110613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.928099+0000","last_change":"2023-07-09T21:52:18.926116+0000","last_active":"2023-07-09T21:52:18.928099+0000","last_peered":"2023-07-09T21:52:18.928099+0000","last_clean":"2023-07-09T21:52:18.928099+0000","last_became_active":"2023-07-09T21:52:18.925663+0000","last_became_peered":"2023-07-09T21:52:18.925663+0000","last_unstale":"2023-07-09T21:52:18.928099+0000","last_undegraded":"2023-07-09T21:52:18.928099+0000","last_fullsized":"2023-07-09T21:52:18.928099+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:03:51.789345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.913725+0000","last_change":"2023-07-09T21:52:17.908662+0000","last_active":"2023-07-09T21:52:17.913725+0000","last_peered":"2023-07-09T21:52:17.913725+0000","last_clean":"2023-07-09T21:52:17.913725+0000","last_became_active":"2023-07-09T21:52:17.908390+0000","last_became_peered":"2023-07-09T21:52:17.908390+0000","last_unstale":"2023-07-09T21:52:17.913725+0000","last_undegraded":"2023-07-09T21:52:17.913725+0000","last_fullsized":"2023-07-09T21:52:17.913725+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:43:58.667439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.928389+0000","last_change":"2023-07-09T21:52:18.925491+0000","last_active":"2023-07-09T21:52:18.928389+0000","last_peered":"2023-07-09T21:52:18.928389+0000","last_clean":"2023-07-09T21:52:18.928389+0000","last_became_active":"2023-07-09T21:52:18.925165+0000","last_became_peered":"2023-07-09T21:52:18.925165+0000","last_unstale":"2023-07-09T21:52:18.928389+0000","last_undegraded":"2023-07-09T21:52:18.928389+0000","last_fullsized":"2023-07-09T21:52:18.928389+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:35:19.222250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912643+0000","last_change":"2023-07-09T21:52:17.905001+0000","last_active":"2023-07-09T21:52:17.912643+0000","last_peered":"2023-07-09T21:52:17.912643+0000","last_clean":"2023-07-09T21:52:17.912643+0000","last_became_active":"2023-07-09T21:52:17.904624+0000","last_became_peered":"2023-07-09T21:52:17.904624+0000","last_unstale":"2023-07-09T21:52:17.912643+0000","last_undegraded":"2023-07-09T21:52:17.912643+0000","last_fullsized":"2023-07-09T21:52:17.912643+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:54:30.292420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.896519+0000","last_change":"2023-07-09T21:52:18.894463+0000","last_active":"2023-07-09T21:52:18.896519+0000","last_peered":"2023-07-09T21:52:18.896519+0000","last_clean":"2023-07-09T21:52:18.896519+0000","last_became_active":"2023-07-09T21:52:18.894175+0000","last_became_peered":"2023-07-09T21:52:18.894175+0000","last_unstale":"2023-07-09T21:52:18.896519+0000","last_undegraded":"2023-07-09T21:52:18.896519+0000","last_fullsized":"2023-07-09T21:52:18.896519+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:10:51.118899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912588+0000","last_change":"2023-07-09T21:52:17.904083+0000","last_active":"2023-07-09T21:52:17.912588+0000","last_peered":"2023-07-09T21:52:17.912588+0000","last_clean":"2023-07-09T21:52:17.912588+0000","last_became_active":"2023-07-09T21:52:17.903804+0000","last_became_peered":"2023-07-09T21:52:17.903804+0000","last_unstale":"2023-07-09T21:52:17.912588+0000","last_undegraded":"2023-07-09T21:52:17.912588+0000","last_fullsized":"2023-07-09T21:52:17.912588+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:41.123866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.893003+0000","last_change":"2023-07-09T21:52:17.893003+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.893003+0000","last_undegraded":"2023-07-09T21:52:17.893003+0000","last_fullsized":"2023-07-09T21:52:17.893003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.927982+0000","last_change":"2023-07-09T21:52:17.901130+0000","last_active":"2023-07-09T21:52:18.927982+0000","last_peered":"2023-07-09T21:52:18.927982+0000","last_clean":"2023-07-09T21:52:18.927982+0000","last_became_active":"2023-07-09T21:52:17.900760+0000","last_became_peered":"2023-07-09T21:52:17.900760+0000","last_unstale":"2023-07-09T21:52:18.927982+0000","last_undegraded":"2023-07-09T21:52:18.927982+0000","last_fullsized":"2023-07-09T21:52:18.927982+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:25:10.181482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897055+0000","last_change":"2023-07-09T21:52:17.897055+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897055+0000","last_undegraded":"2023-07-09T21:52:17.897055+0000","last_fullsized":"2023-07-09T21:52:17.897055+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.914799+0000","last_change":"2023-07-09T21:52:17.903707+0000","last_active":"2023-07-09T21:52:17.914799+0000","last_peered":"2023-07-09T21:52:17.914799+0000","last_clean":"2023-07-09T21:52:17.914799+0000","last_became_active":"2023-07-09T21:52:17.903434+0000","last_became_peered":"2023-07-09T21:52:17.903434+0000","last_unstale":"2023-07-09T21:52:17.914799+0000","last_undegraded":"2023-07-09T21:52:17.914799+0000","last_fullsized":"2023-07-09T21:52:17.914799+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:11.148078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.896838+0000","last_change":"2023-07-09T21:52:17.896838+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.896838+0000","last_undegraded":"2023-07-09T21:52:17.896838+0000","last_fullsized":"2023-07-09T21:52:17.896838+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.917373+0000","last_change":"2023-07-09T21:52:17.916113+0000","last_active":"2023-07-09T21:52:17.917373+0000","last_peered":"2023-07-09T21:52:17.917373+0000","last_clean":"2023-07-09T21:52:17.917373+0000","last_became_active":"2023-07-09T21:52:17.915785+0000","last_became_peered":"2023-07-09T21:52:17.915785+0000","last_unstale":"2023-07-09T21:52:17.917373+0000","last_undegraded":"2023-07-09T21:52:17.917373+0000","last_fullsized":"2023-07-09T21:52:17.917373+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:39.204660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.923015+0000","last_change":"2023-07-09T21:52:18.920034+0000","last_active":"2023-07-09T21:52:18.923015+0000","last_peered":"2023-07-09T21:52:18.923015+0000","last_clean":"2023-07-09T21:52:18.923015+0000","last_became_active":"2023-07-09T21:52:18.919780+0000","last_became_peered":"2023-07-09T21:52:18.919780+0000","last_unstale":"2023-07-09T21:52:18.923015+0000","last_undegraded":"2023-07-09T21:52:18.923015+0000","last_fullsized":"2023-07-09T21:52:18.923015+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:12:09.611456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.913861+0000","last_change":"2023-07-09T21:52:17.906386+0000","last_active":"2023-07-09T21:52:17.913861+0000","last_peered":"2023-07-09T21:52:17.913861+0000","last_clean":"2023-07-09T21:52:17.913861+0000","last_became_active":"2023-07-09T21:52:17.906124+0000","last_became_peered":"2023-07-09T21:52:17.906124+0000","last_unstale":"2023-07-09T21:52:17.913861+0000","last_undegraded":"2023-07-09T21:52:17.913861+0000","last_fullsized":"2023-07-09T21:52:17.913861+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:07:31.780909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.897337+0000","last_change":"2023-07-09T21:52:17.897337+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.897337+0000","last_undegraded":"2023-07-09T21:52:17.897337+0000","last_fullsized":"2023-07-09T21:52:17.897337+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.895309+0000","last_change":"2023-07-09T21:52:17.900770+0000","last_active":"2023-07-09T21:52:18.895309+0000","last_peered":"2023-07-09T21:52:18.895309+0000","last_clean":"2023-07-09T21:52:18.895309+0000","last_became_active":"2023-07-09T21:52:17.900421+0000","last_became_peered":"2023-07-09T21:52:17.900421+0000","last_unstale":"2023-07-09T21:52:18.895309+0000","last_undegraded":"2023-07-09T21:52:18.895309+0000","last_fullsized":"2023-07-09T21:52:18.895309+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:25:21.334696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.889045+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:52:18.889045+0000","last_peered":"2023-07-09T21:52:18.889045+0000","last_clean":"2023-07-09T21:52:18.889045+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:52:18.889045+0000","last_undegraded":"2023-07-09T21:52:18.889045+0000","last_fullsized":"2023-07-09T21:52:18.889045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:10:16.058227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892399+0000","last_change":"2023-07-09T21:52:17.892399+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892399+0000","last_undegraded":"2023-07-09T21:52:17.892399+0000","last_fullsized":"2023-07-09T21:52:17.892399+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.913545+0000","last_change":"2023-07-09T21:52:17.907945+0000","last_active":"2023-07-09T21:52:17.913545+0000","last_peered":"2023-07-09T21:52:17.913545+0000","last_clean":"2023-07-09T21:52:17.913545+0000","last_became_active":"2023-07-09T21:52:17.907687+0000","last_became_peered":"2023-07-09T21:52:17.907687+0000","last_unstale":"2023-07-09T21:52:17.913545+0000","last_undegraded":"2023-07-09T21:52:17.913545+0000","last_fullsized":"2023-07-09T21:52:17.913545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:52.181586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.890975+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:52:17.890975+0000","last_peered":"2023-07-09T21:52:17.890975+0000","last_clean":"2023-07-09T21:52:17.890975+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:52:17.890975+0000","last_undegraded":"2023-07-09T21:52:17.890975+0000","last_fullsized":"2023-07-09T21:52:17.890975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:21:31.603089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.892416+0000","last_change":"2023-07-09T21:52:17.892416+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.892416+0000","last_undegraded":"2023-07-09T21:52:17.892416+0000","last_fullsized":"2023-07-09T21:52:17.892416+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912936+0000","last_change":"2023-07-09T21:52:17.909086+0000","last_active":"2023-07-09T21:52:17.912936+0000","last_peered":"2023-07-09T21:52:17.912936+0000","last_clean":"2023-07-09T21:52:17.912936+0000","last_became_active":"2023-07-09T21:52:17.907325+0000","last_became_peered":"2023-07-09T21:52:17.907325+0000","last_unstale":"2023-07-09T21:52:17.912936+0000","last_undegraded":"2023-07-09T21:52:17.912936+0000","last_fullsized":"2023-07-09T21:52:17.912936+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:43:42.844895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.902085+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:52:17.902085+0000","last_peered":"2023-07-09T21:52:17.902085+0000","last_clean":"2023-07-09T21:52:17.902085+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:52:17.902085+0000","last_undegraded":"2023-07-09T21:52:17.902085+0000","last_fullsized":"2023-07-09T21:52:17.902085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:55:01.994943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.894408+0000","last_change":"2023-07-09T21:52:17.894408+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.894408+0000","last_undegraded":"2023-07-09T21:52:17.894408+0000","last_fullsized":"2023-07-09T21:52:17.894408+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.912914+0000","last_change":"2023-07-09T21:52:17.908857+0000","last_active":"2023-07-09T21:52:17.912914+0000","last_peered":"2023-07-09T21:52:17.912914+0000","last_clean":"2023-07-09T21:52:17.912914+0000","last_became_active":"2023-07-09T21:52:17.907842+0000","last_became_peered":"2023-07-09T21:52:17.907842+0000","last_unstale":"2023-07-09T21:52:17.912914+0000","last_undegraded":"2023-07-09T21:52:17.912914+0000","last_fullsized":"2023-07-09T21:52:17.912914+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:38:46.077337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.891884+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:52:17.891884+0000","last_peered":"2023-07-09T21:52:17.891884+0000","last_clean":"2023-07-09T21:52:17.891884+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:52:17.891884+0000","last_undegraded":"2023-07-09T21:52:17.891884+0000","last_fullsized":"2023-07-09T21:52:17.891884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:38:31.353644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.897496+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:52:17.897496+0000","last_peered":"2023-07-09T21:52:17.897496+0000","last_clean":"2023-07-09T21:52:17.897496+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:52:17.897496+0000","last_undegraded":"2023-07-09T21:52:17.897496+0000","last_fullsized":"2023-07-09T21:52:17.897496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:48.827423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.925030+0000","last_change":"2023-07-09T21:52:18.921385+0000","last_active":"2023-07-09T21:52:18.925030+0000","last_peered":"2023-07-09T21:52:18.925030+0000","last_clean":"2023-07-09T21:52:18.925030+0000","last_became_active":"2023-07-09T21:52:18.911170+0000","last_became_peered":"2023-07-09T21:52:18.911170+0000","last_unstale":"2023-07-09T21:52:18.925030+0000","last_undegraded":"2023-07-09T21:52:18.925030+0000","last_fullsized":"2023-07-09T21:52:18.925030+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:31:12.671286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.916623+0000","last_change":"2023-07-09T21:52:17.913375+0000","last_active":"2023-07-09T21:52:17.916623+0000","last_peered":"2023-07-09T21:52:17.916623+0000","last_clean":"2023-07-09T21:52:17.916623+0000","last_became_active":"2023-07-09T21:52:17.913062+0000","last_became_peered":"2023-07-09T21:52:17.913062+0000","last_unstale":"2023-07-09T21:52:17.916623+0000","last_undegraded":"2023-07-09T21:52:17.916623+0000","last_fullsized":"2023-07-09T21:52:17.916623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:29:19.233060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.897684+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:52:17.897684+0000","last_peered":"2023-07-09T21:52:17.897684+0000","last_clean":"2023-07-09T21:52:17.897684+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:52:17.897684+0000","last_undegraded":"2023-07-09T21:52:17.897684+0000","last_fullsized":"2023-07-09T21:52:17.897684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:47:08.444583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891841+0000","last_change":"2023-07-09T21:52:17.891841+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891841+0000","last_undegraded":"2023-07-09T21:52:17.891841+0000","last_fullsized":"2023-07-09T21:52:17.891841+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.909928+0000","last_change":"2023-07-09T21:52:17.905141+0000","last_active":"2023-07-09T21:52:17.909928+0000","last_peered":"2023-07-09T21:52:17.909928+0000","last_clean":"2023-07-09T21:52:17.909928+0000","last_became_active":"2023-07-09T21:52:17.904855+0000","last_became_peered":"2023-07-09T21:52:17.904855+0000","last_unstale":"2023-07-09T21:52:17.909928+0000","last_undegraded":"2023-07-09T21:52:17.909928+0000","last_fullsized":"2023-07-09T21:52:17.909928+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:49:08.791384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.898354+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:52:17.898354+0000","last_peered":"2023-07-09T21:52:17.898354+0000","last_clean":"2023-07-09T21:52:17.898354+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:52:17.898354+0000","last_undegraded":"2023-07-09T21:52:17.898354+0000","last_fullsized":"2023-07-09T21:52:17.898354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:07:42.879585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.900222+0000","last_change":"2023-07-09T21:52:17.900222+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.900222+0000","last_undegraded":"2023-07-09T21:52:17.900222+0000","last_fullsized":"2023-07-09T21:52:17.900222+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.914898+0000","last_change":"2023-07-09T21:52:17.908430+0000","last_active":"2023-07-09T21:52:17.914898+0000","last_peered":"2023-07-09T21:52:17.914898+0000","last_clean":"2023-07-09T21:52:17.914898+0000","last_became_active":"2023-07-09T21:52:17.908191+0000","last_became_peered":"2023-07-09T21:52:17.908191+0000","last_unstale":"2023-07-09T21:52:17.914898+0000","last_undegraded":"2023-07-09T21:52:17.914898+0000","last_fullsized":"2023-07-09T21:52:17.914898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:00:29.609406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-09T21:52:18.889868+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:52:18.889868+0000","last_peered":"2023-07-09T21:52:18.889868+0000","last_clean":"2023-07-09T21:52:18.889868+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:52:18.889868+0000","last_undegraded":"2023-07-09T21:52:18.889868+0000","last_fullsized":"2023-07-09T21:52:18.889868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:30.415219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-07-09T21:52:17.891448+0000","last_change":"2023-07-09T21:52:17.891448+0000","last_active":"2023-07-09T21:52:17.878522+0000","last_peered":"2023-07-09T21:52:17.878522+0000","last_clean":"2023-07-09T21:52:17.878522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:52:17.891448+0000","last_undegraded":"2023-07-09T21:52:17.891448+0000","last_fullsized":"2023-07-09T21:52:17.891448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.915523+0000","last_change":"2023-07-09T21:52:17.913781+0000","last_active":"2023-07-09T21:52:17.915523+0000","last_peered":"2023-07-09T21:52:17.915523+0000","last_clean":"2023-07-09T21:52:17.915523+0000","last_became_active":"2023-07-09T21:52:17.913487+0000","last_became_peered":"2023-07-09T21:52:17.913487+0000","last_unstale":"2023-07-09T21:52:17.915523+0000","last_undegraded":"2023-07-09T21:52:17.915523+0000","last_fullsized":"2023-07-09T21:52:17.915523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:55:53.352569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-09T21:52:17.896521+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:52:17.896521+0000","last_peered":"2023-07-09T21:52:17.896521+0000","last_clean":"2023-07-09T21:52:17.896521+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:52:17.896521+0000","last_undegraded":"2023-07-09T21:52:17.896521+0000","last_fullsized":"2023-07-09T21:52:17.896521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:52:10.511336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":243201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95099999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.45900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81999999999999995,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.67400000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.79000000000000004,"15min":0.82099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78700000000000003,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97099999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.60399999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92900000000000005,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.503},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89200000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.622}]},{"osd":6,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":1.214,"15min":1.214},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.68700000000000006}]}]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":569344,"data_stored":243201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52000000000000002,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55500000000000005,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.53700000000000003,"15min":0.55600000000000005},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56699999999999995,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.60599999999999998,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.63300000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.42299999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.68100000000000005,"15min":0.70899999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63400000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60399999999999998,"5min":3.129,"15min":3.129},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94499999999999995,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.749},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.998,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91200000000000003,"5min":1.929,"15min":1.929},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.85099999999999998,"15min":0.86399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97599999999999998,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.86599999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93500000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.95199999999999996,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":2.766,"15min":2.766},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.93400000000000005,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.93200000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":557056,"data_stored":236573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":1.232,"15min":1.3700000000000001},"min":{"1min":0.28899999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":16.946000000000002,"15min":16.946000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.93200000000000005,"15min":1.0089999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":9.5449999999999999,"15min":9.5449999999999999},"last":0.52700000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.92100000000000004,"15min":0.99399999999999999},"min":{"1min":0.38200000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65200000000000002,"5min":9.6950000000000003,"15min":9.6950000000000003},"last":0.435},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.95099999999999996,"15min":1.0329999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63200000000000001,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.995,"15min":1.077},"min":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69199999999999995,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.327,"15min":1.4630000000000001},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73599999999999999,"5min":17.004000000000001,"15min":17.004000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.048,"15min":1.1000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.081,"5min":6.2510000000000003,"15min":6.2510000000000003},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.2849999999999999,"15min":1.3680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2050000000000001,"5min":9.6630000000000003,"15min":9.6630000000000003},"last":0.97099999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":1.091,"15min":1.139},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2370000000000001,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.2849999999999999,"15min":1.369},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.1619999999999999,"5min":9.5879999999999992,"15min":9.5879999999999992},"last":0.93100000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":1.2849999999999999,"15min":1.371},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.048,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":1.266,"15min":1.349},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0529999999999999,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":0.91200000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.2250000000000001,"15min":1.2969999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.103,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.1160000000000001,"15min":1.1659999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.163,"5min":6.2169999999999996,"15min":6.2169999999999996},"last":0.89900000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1150976,"data_stored":826941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.92200000000000004,"15min":1.01},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55000000000000004,"5min":11.949999999999999,"15min":11.949999999999999},"last":3.4849999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60199999999999998,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73899999999999999,"5min":1.212,"15min":1.212},"last":3.0819999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":1.488}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":1.4179999999999999,"15min":1.5720000000000001},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":23.010999999999999,"15min":23.010999999999999},"last":3.9569999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90900000000000003,"15min":0.97499999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65100000000000002,"5min":10.952,"15min":10.952},"last":4.226}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":1.696,"15min":1.859},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":22.974,"15min":22.974},"last":3.1349999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":1.264,"15min":1.3520000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":3.2109999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52300000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":1.589,"15min":1.589},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.748,"5min":1.6890000000000001,"15min":1.8460000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":22.933,"15min":22.933},"last":3.2450000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93100000000000005,"5min":1.623,"15min":1.623},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.6830000000000001,"15min":1.8400000000000001},"min":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98199999999999998,"5min":22.867999999999999,"15min":22.867999999999999},"last":3.1749999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.1639999999999999,"15min":1.23},"min":{"1min":0.57499999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.93300000000000005,"5min":10.907999999999999,"15min":10.907999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83299999999999996,"15min":0.83999999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.99299999999999999,"5min":1.546,"15min":1.546},"last":0.63400000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1150976,"data_stored":826941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.61399999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85799999999999998,"5min":1.464,"15min":1.464},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94999999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89100000000000001,"5min":1.121,"15min":1.121},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.78600000000000003,"15min":0.80400000000000005},"min":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70799999999999996,"15min":0.71699999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.091,"15min":1.091},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96599999999999997,"5min":1.405,"15min":1.405},"last":0.67200000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.95399999999999996,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.443},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70399999999999996,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82799999999999996,"5min":1.341,"15min":1.341},"last":0.497}]},{"osd":5,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.443,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.871,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.52400000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88100000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.68700000000000006}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":557056,"data_stored":236573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57599999999999996,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68200000000000005,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.53800000000000003,"5min":1.21,"15min":1.21},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.54900000000000004,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.433}]},{"osd":2,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60699999999999998,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.56100000000000005,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.44900000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.016,"5min":1.258,"15min":1.258},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0049999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95599999999999996,"5min":1.486,"15min":1.486},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98999999999999999,"5min":1.327,"15min":1.327},"last":0.71799999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":1.302,"15min":1.302},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.86199999999999999,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":0.78300000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.04,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.008,"5min":1.349,"15min":1.349},"last":0.68000000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":557056,"data_stored":236573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.74199999999999999,"15min":0.69999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":7.9779999999999998,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.78700000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":7.8650000000000002,"5min":7.8650000000000002,"15min":7.8650000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.421,"15min":1.421},"last":0.83399999999999996}]},{"osd":2,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.73199999999999998,"15min":0.68200000000000005},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":7.9390000000000001,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88300000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1799999999999999,"5min":1.597,"15min":1.597},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.93700000000000006,"5min":1.216,"15min":1.216},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91200000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0609999999999999,"5min":1.069,"15min":1.069},"last":0.62}]},{"osd":6,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":1.093,"15min":1.093},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.81799999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.038,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76800000000000002,"15min":0.76300000000000001},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.054,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.86299999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":557056,"data_stored":236573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.54400000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84799999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54700000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.86399999999999999,"5min":1.113,"15min":1.113},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84199999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.59699999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85599999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.46800000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63400000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93400000000000005,"5min":1.018,"15min":1.018},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95099999999999996,"5min":1.171,"15min":1.171},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98199999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.754,"15min":0.749},"min":{"1min":0.56699999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96399999999999997,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76400000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.999,"5min":1.133,"15min":1.133},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.022,"5min":1.123,"15min":1.123},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:52:24.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-07-09T21:52:24.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.894881+0000', 'last_change': '2023-07-09T21:52:17.894881+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.894881+0000', 'last_undegraded': '2023-07-09T21:52:17.894881+0000', 'last_fullsized': '2023-07-09T21:52:17.894881+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:52:24.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-07-09T21:52:24.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.897443+0000', 'last_change': '2023-07-09T21:52:17.897443+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.897443+0000', 'last_undegraded': '2023-07-09T21:52:17.897443+0000', 'last_fullsized': '2023-07-09T21:52:17.897443+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-07-09T21:52:24.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.893933+0000', 'last_change': '2023-07-09T21:52:17.893933+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.893933+0000', 'last_undegraded': '2023-07-09T21:52:17.893933+0000', 'last_fullsized': '2023-07-09T21:52:17.893933+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:52:24.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-07-09T21:52:24.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.899030+0000', 'last_change': '2023-07-09T21:52:17.899030+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.899030+0000', 'last_undegraded': '2023-07-09T21:52:17.899030+0000', 'last_fullsized': '2023-07-09T21:52:17.899030+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-07-09T21:52:24.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.892045+0000', 'last_change': '2023-07-09T21:52:17.892045+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.892045+0000', 'last_undegraded': '2023-07-09T21:52:17.892045+0000', 'last_fullsized': '2023-07-09T21:52:17.892045+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:52:24.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-07-09T21:52:24.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.894172+0000', 'last_change': '2023-07-09T21:52:17.894172+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.894172+0000', 'last_undegraded': '2023-07-09T21:52:17.894172+0000', 'last_fullsized': '2023-07-09T21:52:17.894172+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:52:24.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-07-09T21:52:24.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.897343+0000', 'last_change': '2023-07-09T21:52:17.897343+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.897343+0000', 'last_undegraded': '2023-07-09T21:52:17.897343+0000', 'last_fullsized': '2023-07-09T21:52:17.897343+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:52:24.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-07-09T21:52:24.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.891282+0000', 'last_change': '2023-07-09T21:52:17.891282+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.891282+0000', 'last_undegraded': '2023-07-09T21:52:17.891282+0000', 'last_fullsized': '2023-07-09T21:52:17.891282+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:52:24.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-07-09T21:52:24.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.897968+0000', 'last_change': '2023-07-09T21:52:17.897968+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.897968+0000', 'last_undegraded': '2023-07-09T21:52:17.897968+0000', 'last_fullsized': '2023-07-09T21:52:17.897968+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-07-09T21:52:24.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.893772+0000', 'last_change': '2023-07-09T21:52:17.893772+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.893772+0000', 'last_undegraded': '2023-07-09T21:52:17.893772+0000', 'last_fullsized': '2023-07-09T21:52:17.893772+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:52:24.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-07-09T21:52:24.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.901501+0000', 'last_change': '2023-07-09T21:52:17.901501+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.901501+0000', 'last_undegraded': '2023-07-09T21:52:17.901501+0000', 'last_fullsized': '2023-07-09T21:52:17.901501+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-07-09T21:52:24.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.894401+0000', 'last_change': '2023-07-09T21:52:17.894401+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.894401+0000', 'last_undegraded': '2023-07-09T21:52:17.894401+0000', 'last_fullsized': '2023-07-09T21:52:17.894401+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:52:24.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-07-09T21:52:24.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.896966+0000', 'last_change': '2023-07-09T21:52:17.896966+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.896966+0000', 'last_undegraded': '2023-07-09T21:52:17.896966+0000', 'last_fullsized': '2023-07-09T21:52:17.896966+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-07-09T21:52:24.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.895814+0000', 'last_change': '2023-07-09T21:52:17.895814+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.895814+0000', 'last_undegraded': '2023-07-09T21:52:17.895814+0000', 'last_fullsized': '2023-07-09T21:52:17.895814+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:52:24.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-07-09T21:52:24.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.894824+0000', 'last_change': '2023-07-09T21:52:17.894824+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.894824+0000', 'last_undegraded': '2023-07-09T21:52:17.894824+0000', 'last_fullsized': '2023-07-09T21:52:17.894824+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:52:24.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-07-09T21:52:24.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.892776+0000', 'last_change': '2023-07-09T21:52:17.892776+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.892776+0000', 'last_undegraded': '2023-07-09T21:52:17.892776+0000', 'last_fullsized': '2023-07-09T21:52:17.892776+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:52:24.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-07-09T21:52:24.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.897885+0000', 'last_change': '2023-07-09T21:52:17.897885+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.897885+0000', 'last_undegraded': '2023-07-09T21:52:17.897885+0000', 'last_fullsized': '2023-07-09T21:52:17.897885+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:52:24.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-07-09T21:52:24.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.898974+0000', 'last_change': '2023-07-09T21:52:17.898974+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.898974+0000', 'last_undegraded': '2023-07-09T21:52:17.898974+0000', 'last_fullsized': '2023-07-09T21:52:17.898974+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-07-09T21:52:24.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.897689+0000', 'last_change': '2023-07-09T21:52:17.897689+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.897689+0000', 'last_undegraded': '2023-07-09T21:52:17.897689+0000', 'last_fullsized': '2023-07-09T21:52:17.897689+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-07-09T21:52:24.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.893441+0000', 'last_change': '2023-07-09T21:52:17.893441+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.893441+0000', 'last_undegraded': '2023-07-09T21:52:17.893441+0000', 'last_fullsized': '2023-07-09T21:52:17.893441+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:52:24.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-07-09T21:52:24.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.895023+0000', 'last_change': '2023-07-09T21:52:17.895023+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.895023+0000', 'last_undegraded': '2023-07-09T21:52:17.895023+0000', 'last_fullsized': '2023-07-09T21:52:17.895023+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:52:24.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-07-09T21:52:24.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.896082+0000', 'last_change': '2023-07-09T21:52:17.896082+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.896082+0000', 'last_undegraded': '2023-07-09T21:52:17.896082+0000', 'last_fullsized': '2023-07-09T21:52:17.896082+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-07-09T21:52:24.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.896237+0000', 'last_change': '2023-07-09T21:52:17.896237+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.896237+0000', 'last_undegraded': '2023-07-09T21:52:17.896237+0000', 'last_fullsized': '2023-07-09T21:52:17.896237+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:52:24.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-07-09T21:52:24.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.898105+0000', 'last_change': '2023-07-09T21:52:17.898105+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.898105+0000', 'last_undegraded': '2023-07-09T21:52:17.898105+0000', 'last_fullsized': '2023-07-09T21:52:17.898105+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-07-09T21:52:24.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.892847+0000', 'last_change': '2023-07-09T21:52:17.892847+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.892847+0000', 'last_undegraded': '2023-07-09T21:52:17.892847+0000', 'last_fullsized': '2023-07-09T21:52:17.892847+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:52:24.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-07-09T21:52:24.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.893853+0000', 'last_change': '2023-07-09T21:52:17.893853+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.893853+0000', 'last_undegraded': '2023-07-09T21:52:17.893853+0000', 'last_fullsized': '2023-07-09T21:52:17.893853+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:52:24.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-07-09T21:52:24.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.891253+0000', 'last_change': '2023-07-09T21:52:17.891253+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.891253+0000', 'last_undegraded': '2023-07-09T21:52:17.891253+0000', 'last_fullsized': '2023-07-09T21:52:17.891253+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:52:24.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-07-09T21:52:24.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.895397+0000', 'last_change': '2023-07-09T21:52:17.895397+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.895397+0000', 'last_undegraded': '2023-07-09T21:52:17.895397+0000', 'last_fullsized': '2023-07-09T21:52:17.895397+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:52:24.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-07-09T21:52:24.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.892858+0000', 'last_change': '2023-07-09T21:52:17.892858+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.892858+0000', 'last_undegraded': '2023-07-09T21:52:17.892858+0000', 'last_fullsized': '2023-07-09T21:52:17.892858+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:52:24.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-07-09T21:52:24.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.895429+0000', 'last_change': '2023-07-09T21:52:17.895429+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.895429+0000', 'last_undegraded': '2023-07-09T21:52:17.895429+0000', 'last_fullsized': '2023-07-09T21:52:17.895429+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:52:24.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-07-09T21:52:24.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.896760+0000', 'last_change': '2023-07-09T21:52:17.896760+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.896760+0000', 'last_undegraded': '2023-07-09T21:52:17.896760+0000', 'last_fullsized': '2023-07-09T21:52:17.896760+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:52:24.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-07-09T21:52:24.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.894467+0000', 'last_change': '2023-07-09T21:52:17.894467+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.894467+0000', 'last_undegraded': '2023-07-09T21:52:17.894467+0000', 'last_fullsized': '2023-07-09T21:52:17.894467+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:52:24.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-07-09T21:52:24.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.891996+0000', 'last_change': '2023-07-09T21:52:17.891996+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.891996+0000', 'last_undegraded': '2023-07-09T21:52:17.891996+0000', 'last_fullsized': '2023-07-09T21:52:17.891996+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:52:24.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-07-09T21:52:24.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.895637+0000', 'last_change': '2023-07-09T21:52:17.895637+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.895637+0000', 'last_undegraded': '2023-07-09T21:52:17.895637+0000', 'last_fullsized': '2023-07-09T21:52:17.895637+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-07-09T21:52:24.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.891845+0000', 'last_change': '2023-07-09T21:52:17.891845+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.891845+0000', 'last_undegraded': '2023-07-09T21:52:17.891845+0000', 'last_fullsized': '2023-07-09T21:52:17.891845+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:52:24.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-07-09T21:52:24.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.896492+0000', 'last_change': '2023-07-09T21:52:17.896492+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.896492+0000', 'last_undegraded': '2023-07-09T21:52:17.896492+0000', 'last_fullsized': '2023-07-09T21:52:17.896492+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-07-09T21:52:24.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.897182+0000', 'last_change': '2023-07-09T21:52:17.897182+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.897182+0000', 'last_undegraded': '2023-07-09T21:52:17.897182+0000', 'last_fullsized': '2023-07-09T21:52:17.897182+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:52:24.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-07-09T21:52:24.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.897286+0000', 'last_change': '2023-07-09T21:52:17.897286+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.897286+0000', 'last_undegraded': '2023-07-09T21:52:17.897286+0000', 'last_fullsized': '2023-07-09T21:52:17.897286+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-07-09T21:52:24.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.891413+0000', 'last_change': '2023-07-09T21:52:17.891413+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.891413+0000', 'last_undegraded': '2023-07-09T21:52:17.891413+0000', 'last_fullsized': '2023-07-09T21:52:17.891413+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:52:24.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-07-09T21:52:24.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.893003+0000', 'last_change': '2023-07-09T21:52:17.893003+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.893003+0000', 'last_undegraded': '2023-07-09T21:52:17.893003+0000', 'last_fullsized': '2023-07-09T21:52:17.893003+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:52:24.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-07-09T21:52:24.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.897055+0000', 'last_change': '2023-07-09T21:52:17.897055+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.897055+0000', 'last_undegraded': '2023-07-09T21:52:17.897055+0000', 'last_fullsized': '2023-07-09T21:52:17.897055+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:52:24.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-07-09T21:52:24.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.896838+0000', 'last_change': '2023-07-09T21:52:17.896838+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.896838+0000', 'last_undegraded': '2023-07-09T21:52:17.896838+0000', 'last_fullsized': '2023-07-09T21:52:17.896838+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-07-09T21:52:24.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.897337+0000', 'last_change': '2023-07-09T21:52:17.897337+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.897337+0000', 'last_undegraded': '2023-07-09T21:52:17.897337+0000', 'last_fullsized': '2023-07-09T21:52:17.897337+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-07-09T21:52:24.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.892399+0000', 'last_change': '2023-07-09T21:52:17.892399+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.892399+0000', 'last_undegraded': '2023-07-09T21:52:17.892399+0000', 'last_fullsized': '2023-07-09T21:52:17.892399+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:52:24.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-07-09T21:52:24.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.892416+0000', 'last_change': '2023-07-09T21:52:17.892416+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.892416+0000', 'last_undegraded': '2023-07-09T21:52:17.892416+0000', 'last_fullsized': '2023-07-09T21:52:17.892416+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:52:24.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-07-09T21:52:24.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.894408+0000', 'last_change': '2023-07-09T21:52:17.894408+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.894408+0000', 'last_undegraded': '2023-07-09T21:52:17.894408+0000', 'last_fullsized': '2023-07-09T21:52:17.894408+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:52:24.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-07-09T21:52:24.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.891841+0000', 'last_change': '2023-07-09T21:52:17.891841+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.891841+0000', 'last_undegraded': '2023-07-09T21:52:17.891841+0000', 'last_fullsized': '2023-07-09T21:52:17.891841+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:52:24.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-07-09T21:52:24.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.900222+0000', 'last_change': '2023-07-09T21:52:17.900222+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.900222+0000', 'last_undegraded': '2023-07-09T21:52:17.900222+0000', 'last_fullsized': '2023-07-09T21:52:17.900222+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:52:24.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-07-09T21:52:24.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:52:17.891448+0000', 'last_change': '2023-07-09T21:52:17.891448+0000', 'last_active': '2023-07-09T21:52:17.878522+0000', 'last_peered': '2023-07-09T21:52:17.878522+0000', 'last_clean': '2023-07-09T21:52:17.878522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:52:17.891448+0000', 'last_undegraded': '2023-07-09T21:52:17.891448+0000', 'last_fullsized': '2023-07-09T21:52:17.891448+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'last_clean_scrub_stamp': '2023-07-09T21:52:17.878522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:52:24.379 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-09T21:52:24.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.577+0000 7f6e16fff700 1 Processor -- start 2023-07-09T21:52:24.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.577+0000 7f6e16fff700 1 -- start start 2023-07-09T21:52:24.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e16fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6e100b4510 0x7f6e100b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:24.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e16fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e100d1220 0x7f6e100b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:24.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e16fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e100b7f50 con 0x7f6e100cd590 2023-07-09T21:52:24.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e16fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e100b48e0 con 0x7f6e100b4510 2023-07-09T21:52:24.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e16fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100b7340 con 0x7f6e100d1220 2023-07-09T21:52:24.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e14d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6e100b4510 0x7f6e100b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:24.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e0ffff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6e100cd590 0x7f6e100d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46456/0 (socket says 172.21.15.53:46456) 2023-07-09T21:52:24.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e14d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6e100b4510 0x7f6e100b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34750/0 (socket says 172.21.15.53:34750) 2023-07-09T21:52:24.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e0ffff700 1 -- 172.21.15.53:0/2469726190 learned_addr learned my addr 172.21.15.53:0/2469726190 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:24.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e1559c700 1 --2- 172.21.15.53:0/2469726190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e100d1220 0x7f6e100b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:24.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e14d9b700 1 -- 172.21.15.53:0/2469726190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e100d1220 msgr2=0x7f6e100b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:24.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e14d9b700 1 --2- 172.21.15.53:0/2469726190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e100d1220 0x7f6e100b83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e14d9b700 1 -- 172.21.15.53:0/2469726190 >> v1:172.21.15.53:6789/0 conn(0x7f6e100cd590 legacy=0x7f6e100d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:24.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e14d9b700 1 -- 172.21.15.53:0/2469726190 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100b7620 con 0x7f6e100b4510 2023-07-09T21:52:24.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.579+0000 7f6e1559c700 1 --2- 172.21.15.53:0/2469726190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e100d1220 0x7f6e100b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:24.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.580+0000 7f6e14d9b700 1 --2- 172.21.15.53:0/2469726190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100b4510 0x7f6e100b6c80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009820 tx=0x7f6e04009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2aaa04d355d677c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:24.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.580+0000 7f6e0f7fe700 1 -- 172.21.15.53:0/2469726190 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04005e30 con 0x7f6e100b4510 2023-07-09T21:52:24.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.580+0000 7f6e0f7fe700 1 -- 172.21.15.53:0/2469726190 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e04006030 con 0x7f6e100b4510 2023-07-09T21:52:24.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.580+0000 7f6e0f7fe700 1 -- 172.21.15.53:0/2469726190 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e040063e0 con 0x7f6e100b4510 2023-07-09T21:52:24.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.580+0000 7f6e16fff700 1 -- 172.21.15.53:0/2469726190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100b4510 msgr2=0x7f6e100b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:24.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.580+0000 7f6e16fff700 1 --2- 172.21.15.53:0/2469726190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100b4510 0x7f6e100b6c80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009820 tx=0x7f6e04009b30 comp rx=0 tx=0).stop 2023-07-09T21:52:24.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.581+0000 7f6e16fff700 1 -- 172.21.15.53:0/2469726190 shutdown_connections 2023-07-09T21:52:24.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.581+0000 7f6e16fff700 1 --2- 172.21.15.53:0/2469726190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e100d1220 0x7f6e100b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.581+0000 7f6e16fff700 1 --2- 172.21.15.53:0/2469726190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100b4510 0x7f6e100b6c80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.581+0000 7f6e16fff700 1 -- 172.21.15.53:0/2469726190 >> 172.21.15.53:0/2469726190 conn(0x7f6e1009c1d0 msgr2=0x7f6e100d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:24.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.581+0000 7f6e16fff700 1 -- 172.21.15.53:0/2469726190 shutdown_connections 2023-07-09T21:52:24.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.581+0000 7f6e16fff700 1 -- 172.21.15.53:0/2469726190 wait complete. 2023-07-09T21:52:24.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.583+0000 7f6e16fff700 1 Processor -- start 2023-07-09T21:52:24.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.583+0000 7f6e16fff700 1 -- start start 2023-07-09T21:52:24.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e16fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e100b4510 0x7f6e101425a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:24.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e16fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd590 0x7f6e10156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:24.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e16fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e100d1220 0x7f6e101f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:24.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e16fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100ca010 con 0x7f6e100cd590 2023-07-09T21:52:24.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e16fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100ca220 con 0x7f6e100d1220 2023-07-09T21:52:24.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e16fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100ca500 con 0x7f6e100b4510 2023-07-09T21:52:24.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e0ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd590 0x7f6e10156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:24.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e0ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd590 0x7f6e10156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34752/0 (socket says 172.21.15.53:34752) 2023-07-09T21:52:24.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e0ffff700 1 -- 172.21.15.53:0/459945317 learned_addr learned my addr 172.21.15.53:0/459945317 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:24.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e14d9b700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e100b4510 0x7f6e101425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:24.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e1559c700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e100d1220 0x7f6e101f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:24.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e0ffff700 1 -- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e100b4510 msgr2=0x7f6e101425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:24.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e0ffff700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e100b4510 0x7f6e101425a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e0ffff700 1 -- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e100d1220 msgr2=0x7f6e101f1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:24.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e0ffff700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e100d1220 0x7f6e101f1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e0ffff700 1 -- 172.21.15.53:0/459945317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e04009430 con 0x7f6e100cd590 2023-07-09T21:52:24.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.585+0000 7f6e1559c700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e100d1220 0x7f6e101f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:24.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.586+0000 7f6e0ffff700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd590 0x7f6e10156fd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00c520 tx=0x7f6dfc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:24.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.586+0000 7f6e0d7fa700 1 -- 172.21.15.53:0/459945317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc005d70 con 0x7f6e100cd590 2023-07-09T21:52:24.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.586+0000 7f6e0d7fa700 1 -- 172.21.15.53:0/459945317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc0070d0 con 0x7f6e100cd590 2023-07-09T21:52:24.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.586+0000 7f6e0d7fa700 1 -- 172.21.15.53:0/459945317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc007440 con 0x7f6e100cd590 2023-07-09T21:52:24.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.586+0000 7f6e16fff700 1 -- 172.21.15.53:0/459945317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e100cbed0 con 0x7f6e100cd590 2023-07-09T21:52:24.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.586+0000 7f6e16fff700 1 -- 172.21.15.53:0/459945317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e10157510 con 0x7f6e100cd590 2023-07-09T21:52:24.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.587+0000 7f6e16fff700 1 -- 172.21.15.53:0/459945317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e100cbd30 con 0x7f6e100cd590 2023-07-09T21:52:24.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.588+0000 7f6e0d7fa700 1 -- 172.21.15.53:0/459945317 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f6dfc0075a0 con 0x7f6e100cd590 2023-07-09T21:52:24.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.589+0000 7f6e0d7fa700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6df406ad70 0x7f6df406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:24.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.589+0000 7f6e0d7fa700 1 -- 172.21.15.53:0/459945317 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6dfc088880 con 0x7f6e100cd590 2023-07-09T21:52:24.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.590+0000 7f6e14d9b700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6df406ad70 0x7f6df406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:24.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.590+0000 7f6e14d9b700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6df406ad70 0x7f6df406d220 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6e04013040 tx=0x7f6e04008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:24.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.593+0000 7f6e0d7fa700 1 -- 172.21.15.53:0/459945317 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6e100cbd30 con 0x7f6e100cd590 2023-07-09T21:52:24.865 INFO:tasks.ceph.mds.a.smithi053.stderr:2023-07-09T21:52:24.864+0000 7f4abbff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:52:24.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.887+0000 7f6e16fff700 1 -- 172.21.15.53:0/459945317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6e100cbd30 con 0x7f6e100cd590 2023-07-09T21:52:24.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.887+0000 7f6e0d7fa700 1 -- 172.21.15.53:0/459945317 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1514 (secure 0 0 0) 0x7f6e100cbd30 con 0x7f6e100cd590 2023-07-09T21:52:24.889 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:24.889 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":149,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1688939408,"num_in_osds":8,"osd_in_since":1688939399,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":56},{"state_name":"creating+peering","count":49}],"num_pgs":105,"num_pools":4,"num_objects":4,"data_bytes":590368,"bytes_used":230653952,"bytes_avail":772863459328,"bytes_total":773094113280,"inactive_pgs_ratio":0.46666666865348816,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":27,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5619}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-07-09T21:52:06.877036+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-09T21:52:24.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.890+0000 7f6e16fff700 1 -- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6df406ad70 msgr2=0x7f6df406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:24.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.890+0000 7f6e16fff700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6df406ad70 0x7f6df406d220 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6e04013040 tx=0x7f6e04008070 comp rx=0 tx=0).stop 2023-07-09T21:52:24.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.890+0000 7f6e16fff700 1 -- 172.21.15.53:0/459945317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd590 msgr2=0x7f6e10156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.890+0000 7f6e16fff700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd590 0x7f6e10156fd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00c520 tx=0x7f6dfc00c830 comp rx=0 tx=0).stop 2023-07-09T21:52:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.890+0000 7f6e16fff700 1 -- 172.21.15.53:0/459945317 shutdown_connections 2023-07-09T21:52:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.890+0000 7f6e16fff700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6df406ad70 0x7f6df406d220 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.890+0000 7f6e16fff700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e100d1220 0x7f6e101f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.890+0000 7f6e16fff700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e100b4510 0x7f6e101425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.890+0000 7f6e16fff700 1 --2- 172.21.15.53:0/459945317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd590 0x7f6e10156fd0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.890+0000 7f6e16fff700 1 -- 172.21.15.53:0/459945317 >> 172.21.15.53:0/459945317 conn(0x7f6e1009c1d0 msgr2=0x7f6e100ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:24.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.890+0000 7f6e16fff700 1 -- 172.21.15.53:0/459945317 shutdown_connections 2023-07-09T21:52:24.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:24.890+0000 7f6e16fff700 1 -- 172.21.15.53:0/459945317 wait complete. 2023-07-09T21:52:24.909 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-09T21:52:24.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:52:25.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.108+0000 7f62823ff700 1 Processor -- start 2023-07-09T21:52:25.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.108+0000 7f62823ff700 1 -- start start 2023-07-09T21:52:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.109+0000 7f62823ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f627c0b1e00 0x7f627c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.109+0000 7f62823ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c0b2350 0x7f627c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.110+0000 7f62823ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c0d14a0 con 0x7f627c0d1050 2023-07-09T21:52:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.110+0000 7f62823ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627c0d2ce0 con 0x7f627c0b1e00 2023-07-09T21:52:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.110+0000 7f62823ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0b3350 con 0x7f627c0b2350 2023-07-09T21:52:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.110+0000 7f627bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f627c0b1e00 0x7f627c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:25.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.110+0000 7f627bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f627c0b1e00 0x7f627c0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34766/0 (socket says 172.21.15.53:34766) 2023-07-09T21:52:25.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.110+0000 7f627bfff700 1 -- 172.21.15.53:0/931666049 learned_addr learned my addr 172.21.15.53:0/931666049 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:25.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.110+0000 7f628099c700 1 --1- 172.21.15.53:0/931666049 >> v1:172.21.15.53:6789/0 conn(0x7f627c0d1050 0x7f627c0afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46470/0 (socket says 172.21.15.53:46470) 2023-07-09T21:52:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.110+0000 7f627b7fe700 1 --2- 172.21.15.53:0/931666049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c0b2350 0x7f627c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.110+0000 7f627bfff700 1 -- 172.21.15.53:0/931666049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c0b2350 msgr2=0x7f627c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.110+0000 7f627bfff700 1 --2- 172.21.15.53:0/931666049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c0b2350 0x7f627c0d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.110+0000 7f627bfff700 1 -- 172.21.15.53:0/931666049 >> v1:172.21.15.53:6789/0 conn(0x7f627c0d1050 legacy=0x7f627c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:25.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.110+0000 7f627bfff700 1 -- 172.21.15.53:0/931666049 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0b3630 con 0x7f627c0b1e00 2023-07-09T21:52:25.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.110+0000 7f627affd700 1 -- 172.21.15.53:0/931666049 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775642842 0 0) 0x7f6274001490 con 0x7f627c0d1050 2023-07-09T21:52:25.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.111+0000 7f627bfff700 1 --2- 172.21.15.53:0/931666049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f627c0b1e00 0x7f627c0b43f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f626c006fd0 tx=0x7f626c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288a9bdc25d34e7a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:25.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.111+0000 7f627affd700 1 -- 172.21.15.53:0/931666049 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c005e30 con 0x7f627c0b1e00 2023-07-09T21:52:25.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.111+0000 7f627affd700 1 -- 172.21.15.53:0/931666049 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c004030 con 0x7f627c0b1e00 2023-07-09T21:52:25.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.111+0000 7f627affd700 1 -- 172.21.15.53:0/931666049 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c0043e0 con 0x7f627c0b1e00 2023-07-09T21:52:25.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.111+0000 7f62823ff700 1 -- 172.21.15.53:0/931666049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f627c0b1e00 msgr2=0x7f627c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:25.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.111+0000 7f62823ff700 1 --2- 172.21.15.53:0/931666049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f627c0b1e00 0x7f627c0b43f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f626c006fd0 tx=0x7f626c009bd0 comp rx=0 tx=0).stop 2023-07-09T21:52:25.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.111+0000 7f62823ff700 1 -- 172.21.15.53:0/931666049 shutdown_connections 2023-07-09T21:52:25.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.111+0000 7f62823ff700 1 --2- 172.21.15.53:0/931666049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f627c0b1e00 0x7f627c0b43f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:25.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.112+0000 7f62823ff700 1 --2- 172.21.15.53:0/931666049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c0b2350 0x7f627c0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:25.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.112+0000 7f62823ff700 1 -- 172.21.15.53:0/931666049 >> 172.21.15.53:0/931666049 conn(0x7f627c09c1d0 msgr2=0x7f627c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:25.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.112+0000 7f62823ff700 1 -- 172.21.15.53:0/931666049 shutdown_connections 2023-07-09T21:52:25.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.112+0000 7f62823ff700 1 -- 172.21.15.53:0/931666049 wait complete. 2023-07-09T21:52:25.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.113+0000 7f62823ff700 1 Processor -- start 2023-07-09T21:52:25.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.114+0000 7f62823ff700 1 -- start start 2023-07-09T21:52:25.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.114+0000 7f62823ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c0b1e00 0x7f627c0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:25.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.114+0000 7f62823ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f627c0b2350 0x7f627c0cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:25.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f62823ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f627c0d1050 0x7f627c0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:25.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f62823ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0c8570 con 0x7f627c0b2350 2023-07-09T21:52:25.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f62823ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0c8850 con 0x7f627c0d1050 2023-07-09T21:52:25.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f62823ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0c8b30 con 0x7f627c0b1e00 2023-07-09T21:52:25.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f627b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f627c0b2350 0x7f627c0cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:25.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f627b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f627c0b2350 0x7f627c0cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34770/0 (socket says 172.21.15.53:34770) 2023-07-09T21:52:25.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f627b7fe700 1 -- 172.21.15.53:0/1715278477 learned_addr learned my addr 172.21.15.53:0/1715278477 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:25.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f627bfff700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c0b1e00 0x7f627c0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:25.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f628099c700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f627c0d1050 0x7f627c0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:25.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f627b7fe700 1 -- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c0b1e00 msgr2=0x7f627c0ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:25.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f627b7fe700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c0b1e00 0x7f627c0ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:25.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f627b7fe700 1 -- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f627c0d1050 msgr2=0x7f627c0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:25.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f627b7fe700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f627c0d1050 0x7f627c0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:25.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f627b7fe700 1 -- 172.21.15.53:0/1715278477 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c009500 con 0x7f627c0b2350 2023-07-09T21:52:25.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f628099c700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f627c0d1050 0x7f627c0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:25.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.115+0000 7f627b7fe700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f627c0b2350 0x7f627c0cfaf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f627000d800 tx=0x7f627000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:25.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.116+0000 7f6278ff9700 1 -- 172.21.15.53:0/1715278477 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62700125f0 con 0x7f627c0b2350 2023-07-09T21:52:25.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.116+0000 7f6278ff9700 1 -- 172.21.15.53:0/1715278477 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6270012750 con 0x7f627c0b2350 2023-07-09T21:52:25.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.116+0000 7f6278ff9700 1 -- 172.21.15.53:0/1715278477 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270012b00 con 0x7f627c0b2350 2023-07-09T21:52:25.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.116+0000 7f62823ff700 1 -- 172.21.15.53:0/1715278477 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c0c8e10 con 0x7f627c0b2350 2023-07-09T21:52:25.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.116+0000 7f62823ff700 1 -- 172.21.15.53:0/1715278477 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c0ca710 con 0x7f627c0b2350 2023-07-09T21:52:25.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.117+0000 7f62823ff700 1 -- 172.21.15.53:0/1715278477 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c0ca8d0 con 0x7f627c0b2350 2023-07-09T21:52:25.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.118+0000 7f6278ff9700 1 -- 172.21.15.53:0/1715278477 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f6270012c60 con 0x7f627c0b2350 2023-07-09T21:52:25.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.119+0000 7f6278ff9700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f626806ad70 0x7f626806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:25.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.119+0000 7f6278ff9700 1 -- 172.21.15.53:0/1715278477 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6270089880 con 0x7f627c0b2350 2023-07-09T21:52:25.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.119+0000 7f627bfff700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f626806ad70 0x7f626806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:25.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.120+0000 7f627bfff700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f626806ad70 0x7f626806d220 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f626c009c10 tx=0x7f626c008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:25.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.123+0000 7f6278ff9700 1 -- 172.21.15.53:0/1715278477 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f627c0ca8d0 con 0x7f627c0b2350 2023-07-09T21:52:25.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.329+0000 7f62823ff700 1 -- 172.21.15.53:0/1715278477 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f627c0b3bf0 con 0x7f626806ad70 2023-07-09T21:52:25.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.338+0000 7f6278ff9700 1 -- 172.21.15.53:0/1715278477 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311507 (secure 0 0 0) 0x7f626c021070 con 0x7f626806ad70 2023-07-09T21:52:25.343 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:25.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.342+0000 7f62823ff700 1 -- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f626806ad70 msgr2=0x7f626806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:25.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.342+0000 7f62823ff700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f626806ad70 0x7f626806d220 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f626c009c10 tx=0x7f626c008070 comp rx=0 tx=0).stop 2023-07-09T21:52:25.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.343+0000 7f62823ff700 1 -- 172.21.15.53:0/1715278477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f627c0b2350 msgr2=0x7f627c0cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:25.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.343+0000 7f62823ff700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f627c0b2350 0x7f627c0cfaf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f627000d800 tx=0x7f627000db10 comp rx=0 tx=0).stop 2023-07-09T21:52:25.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.343+0000 7f62823ff700 1 -- 172.21.15.53:0/1715278477 shutdown_connections 2023-07-09T21:52:25.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.343+0000 7f62823ff700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f626806ad70 0x7f626806d220 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:25.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.343+0000 7f62823ff700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f627c0d1050 0x7f627c0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:25.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.343+0000 7f62823ff700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c0b1e00 0x7f627c0ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:25.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.343+0000 7f62823ff700 1 --2- 172.21.15.53:0/1715278477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f627c0b2350 0x7f627c0cfaf0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:25.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.343+0000 7f62823ff700 1 -- 172.21.15.53:0/1715278477 >> 172.21.15.53:0/1715278477 conn(0x7f627c09c1d0 msgr2=0x7f627c0b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:25.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.343+0000 7f62823ff700 1 -- 172.21.15.53:0/1715278477 shutdown_connections 2023-07-09T21:52:25.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:25.343+0000 7f62823ff700 1 -- 172.21.15.53:0/1715278477 wait complete. 2023-07-09T21:52:25.347 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:52:25.362 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-07-09T21:52:24.880284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225576,"kb_used_data":5864,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754749144,"statfs":{"total":773094113280,"available":772863123456,"internally_reserved":0,"allocated":6004736,"data_stored":3241316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.995198"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595013+0000","last_change":"2023-07-09T21:52:18.896951+0000","last_active":"2023-07-09T21:52:20.595013+0000","last_peered":"2023-07-09T21:52:20.595013+0000","last_clean":"2023-07-09T21:52:20.595013+0000","last_became_active":"2023-07-09T21:52:18.896617+0000","last_became_peered":"2023-07-09T21:52:18.896617+0000","last_unstale":"2023-07-09T21:52:20.595013+0000","last_undegraded":"2023-07-09T21:52:20.595013+0000","last_fullsized":"2023-07-09T21:52:20.595013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:34.965091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.513082+0000","last_change":"2023-07-09T21:52:18.906798+0000","last_active":"2023-07-09T21:52:20.513082+0000","last_peered":"2023-07-09T21:52:20.513082+0000","last_clean":"2023-07-09T21:52:20.513082+0000","last_became_active":"2023-07-09T21:52:18.906499+0000","last_became_peered":"2023-07-09T21:52:18.906499+0000","last_unstale":"2023-07-09T21:52:20.513082+0000","last_undegraded":"2023-07-09T21:52:20.513082+0000","last_fullsized":"2023-07-09T21:52:20.513082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:59:44.973975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595781+0000","last_change":"2023-07-09T21:52:18.923034+0000","last_active":"2023-07-09T21:52:20.595781+0000","last_peered":"2023-07-09T21:52:20.595781+0000","last_clean":"2023-07-09T21:52:20.595781+0000","last_became_active":"2023-07-09T21:52:18.922368+0000","last_became_peered":"2023-07-09T21:52:18.922368+0000","last_unstale":"2023-07-09T21:52:20.595781+0000","last_undegraded":"2023-07-09T21:52:20.595781+0000","last_fullsized":"2023-07-09T21:52:20.595781+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:31:20.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512805+0000","last_change":"2023-07-09T21:52:18.932684+0000","last_active":"2023-07-09T21:52:20.512805+0000","last_peered":"2023-07-09T21:52:20.512805+0000","last_clean":"2023-07-09T21:52:20.512805+0000","last_became_active":"2023-07-09T21:52:18.932291+0000","last_became_peered":"2023-07-09T21:52:18.932291+0000","last_unstale":"2023-07-09T21:52:20.512805+0000","last_undegraded":"2023-07-09T21:52:20.512805+0000","last_fullsized":"2023-07-09T21:52:20.512805+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:18:31.547364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595378+0000","last_change":"2023-07-09T21:52:18.906085+0000","last_active":"2023-07-09T21:52:20.595378+0000","last_peered":"2023-07-09T21:52:20.595378+0000","last_clean":"2023-07-09T21:52:20.595378+0000","last_became_active":"2023-07-09T21:52:18.905771+0000","last_became_peered":"2023-07-09T21:52:18.905771+0000","last_unstale":"2023-07-09T21:52:20.595378+0000","last_undegraded":"2023-07-09T21:52:20.595378+0000","last_fullsized":"2023-07-09T21:52:20.595378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:14.102629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594906+0000","last_change":"2023-07-09T21:52:18.909739+0000","last_active":"2023-07-09T21:52:20.594906+0000","last_peered":"2023-07-09T21:52:20.594906+0000","last_clean":"2023-07-09T21:52:20.594906+0000","last_became_active":"2023-07-09T21:52:18.906431+0000","last_became_peered":"2023-07-09T21:52:18.906431+0000","last_unstale":"2023-07-09T21:52:20.594906+0000","last_undegraded":"2023-07-09T21:52:20.594906+0000","last_fullsized":"2023-07-09T21:52:20.594906+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:39:50.084070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595369+0000","last_change":"2023-07-09T21:52:18.919260+0000","last_active":"2023-07-09T21:52:20.595369+0000","last_peered":"2023-07-09T21:52:20.595369+0000","last_clean":"2023-07-09T21:52:20.595369+0000","last_became_active":"2023-07-09T21:52:18.918787+0000","last_became_peered":"2023-07-09T21:52:18.918787+0000","last_unstale":"2023-07-09T21:52:20.595369+0000","last_undegraded":"2023-07-09T21:52:20.595369+0000","last_fullsized":"2023-07-09T21:52:20.595369+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:56:23.980518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902201+0000","last_change":"2023-07-09T21:52:18.928885+0000","last_active":"2023-07-09T21:52:19.902201+0000","last_peered":"2023-07-09T21:52:19.902201+0000","last_clean":"2023-07-09T21:52:19.902201+0000","last_became_active":"2023-07-09T21:52:18.928503+0000","last_became_peered":"2023-07-09T21:52:18.928503+0000","last_unstale":"2023-07-09T21:52:19.902201+0000","last_undegraded":"2023-07-09T21:52:19.902201+0000","last_fullsized":"2023-07-09T21:52:19.902201+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:40:03.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902722+0000","last_change":"2023-07-09T21:52:18.929505+0000","last_active":"2023-07-09T21:52:19.902722+0000","last_peered":"2023-07-09T21:52:19.902722+0000","last_clean":"2023-07-09T21:52:19.902722+0000","last_became_active":"2023-07-09T21:52:18.929040+0000","last_became_peered":"2023-07-09T21:52:18.929040+0000","last_unstale":"2023-07-09T21:52:19.902722+0000","last_undegraded":"2023-07-09T21:52:19.902722+0000","last_fullsized":"2023-07-09T21:52:19.902722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:17:36.841569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594980+0000","last_change":"2023-07-09T21:52:18.905734+0000","last_active":"2023-07-09T21:52:20.594980+0000","last_peered":"2023-07-09T21:52:20.594980+0000","last_clean":"2023-07-09T21:52:20.594980+0000","last_became_active":"2023-07-09T21:52:18.905379+0000","last_became_peered":"2023-07-09T21:52:18.905379+0000","last_unstale":"2023-07-09T21:52:20.594980+0000","last_undegraded":"2023-07-09T21:52:20.594980+0000","last_fullsized":"2023-07-09T21:52:20.594980+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:43:53.191291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903567+0000","last_change":"2023-07-09T21:52:18.910192+0000","last_active":"2023-07-09T21:52:19.903567+0000","last_peered":"2023-07-09T21:52:19.903567+0000","last_clean":"2023-07-09T21:52:19.903567+0000","last_became_active":"2023-07-09T21:52:18.909553+0000","last_became_peered":"2023-07-09T21:52:18.909553+0000","last_unstale":"2023-07-09T21:52:19.903567+0000","last_undegraded":"2023-07-09T21:52:19.903567+0000","last_fullsized":"2023-07-09T21:52:19.903567+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:02:06.366605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903545+0000","last_change":"2023-07-09T21:52:18.917117+0000","last_active":"2023-07-09T21:52:19.903545+0000","last_peered":"2023-07-09T21:52:19.903545+0000","last_clean":"2023-07-09T21:52:19.903545+0000","last_became_active":"2023-07-09T21:52:18.916709+0000","last_became_peered":"2023-07-09T21:52:18.916709+0000","last_unstale":"2023-07-09T21:52:19.903545+0000","last_undegraded":"2023-07-09T21:52:19.903545+0000","last_fullsized":"2023-07-09T21:52:19.903545+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:45:21.380456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594883+0000","last_change":"2023-07-09T21:52:18.906003+0000","last_active":"2023-07-09T21:52:20.594883+0000","last_peered":"2023-07-09T21:52:20.594883+0000","last_clean":"2023-07-09T21:52:20.594883+0000","last_became_active":"2023-07-09T21:52:18.905760+0000","last_became_peered":"2023-07-09T21:52:18.905760+0000","last_unstale":"2023-07-09T21:52:20.594883+0000","last_undegraded":"2023-07-09T21:52:20.594883+0000","last_fullsized":"2023-07-09T21:52:20.594883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:00:24.204053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595592+0000","last_change":"2023-07-09T21:52:18.924277+0000","last_active":"2023-07-09T21:52:20.595592+0000","last_peered":"2023-07-09T21:52:20.595592+0000","last_clean":"2023-07-09T21:52:20.595592+0000","last_became_active":"2023-07-09T21:52:18.923822+0000","last_became_peered":"2023-07-09T21:52:18.923822+0000","last_unstale":"2023-07-09T21:52:20.595592+0000","last_undegraded":"2023-07-09T21:52:20.595592+0000","last_fullsized":"2023-07-09T21:52:20.595592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:14.102629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512617+0000","last_change":"2023-07-09T21:52:18.913608+0000","last_active":"2023-07-09T21:52:20.512617+0000","last_peered":"2023-07-09T21:52:20.512617+0000","last_clean":"2023-07-09T21:52:20.512617+0000","last_became_active":"2023-07-09T21:52:18.913309+0000","last_became_peered":"2023-07-09T21:52:18.913309+0000","last_unstale":"2023-07-09T21:52:20.512617+0000","last_undegraded":"2023-07-09T21:52:20.512617+0000","last_fullsized":"2023-07-09T21:52:20.512617+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:47:16.469049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594753+0000","last_change":"2023-07-09T21:52:18.906627+0000","last_active":"2023-07-09T21:52:20.594753+0000","last_peered":"2023-07-09T21:52:20.594753+0000","last_clean":"2023-07-09T21:52:20.594753+0000","last_became_active":"2023-07-09T21:52:18.906352+0000","last_became_peered":"2023-07-09T21:52:18.906352+0000","last_unstale":"2023-07-09T21:52:20.594753+0000","last_undegraded":"2023-07-09T21:52:20.594753+0000","last_fullsized":"2023-07-09T21:52:20.594753+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:07.549932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.596101+0000","last_change":"2023-07-09T21:52:18.909088+0000","last_active":"2023-07-09T21:52:20.596101+0000","last_peered":"2023-07-09T21:52:20.596101+0000","last_clean":"2023-07-09T21:52:20.596101+0000","last_became_active":"2023-07-09T21:52:18.908791+0000","last_became_peered":"2023-07-09T21:52:18.908791+0000","last_unstale":"2023-07-09T21:52:20.596101+0000","last_undegraded":"2023-07-09T21:52:20.596101+0000","last_fullsized":"2023-07-09T21:52:20.596101+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:45:21.380456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.513119+0000","last_change":"2023-07-09T21:52:18.913993+0000","last_active":"2023-07-09T21:52:20.513119+0000","last_peered":"2023-07-09T21:52:20.513119+0000","last_clean":"2023-07-09T21:52:20.513119+0000","last_became_active":"2023-07-09T21:52:18.913556+0000","last_became_peered":"2023-07-09T21:52:18.913556+0000","last_unstale":"2023-07-09T21:52:20.513119+0000","last_undegraded":"2023-07-09T21:52:20.513119+0000","last_fullsized":"2023-07-09T21:52:20.513119+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:22:40.394416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595930+0000","last_change":"2023-07-09T21:52:18.923195+0000","last_active":"2023-07-09T21:52:20.595930+0000","last_peered":"2023-07-09T21:52:20.595930+0000","last_clean":"2023-07-09T21:52:20.595930+0000","last_became_active":"2023-07-09T21:52:18.922764+0000","last_became_peered":"2023-07-09T21:52:18.922764+0000","last_unstale":"2023-07-09T21:52:20.595930+0000","last_undegraded":"2023-07-09T21:52:20.595930+0000","last_fullsized":"2023-07-09T21:52:20.595930+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:19:47.253311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.556005+0000","last_change":"2023-07-09T21:52:18.909470+0000","last_active":"2023-07-09T21:52:20.556005+0000","last_peered":"2023-07-09T21:52:20.556005+0000","last_clean":"2023-07-09T21:52:20.556005+0000","last_became_active":"2023-07-09T21:52:18.909176+0000","last_became_peered":"2023-07-09T21:52:18.909176+0000","last_unstale":"2023-07-09T21:52:20.556005+0000","last_undegraded":"2023-07-09T21:52:20.556005+0000","last_fullsized":"2023-07-09T21:52:20.556005+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:10:40.266061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555912+0000","last_change":"2023-07-09T21:52:18.908718+0000","last_active":"2023-07-09T21:52:20.555912+0000","last_peered":"2023-07-09T21:52:20.555912+0000","last_clean":"2023-07-09T21:52:20.555912+0000","last_became_active":"2023-07-09T21:52:18.908409+0000","last_became_peered":"2023-07-09T21:52:18.908409+0000","last_unstale":"2023-07-09T21:52:20.555912+0000","last_undegraded":"2023-07-09T21:52:20.555912+0000","last_fullsized":"2023-07-09T21:52:20.555912+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:01:34.153114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902304+0000","last_change":"2023-07-09T21:52:18.929332+0000","last_active":"2023-07-09T21:52:19.902304+0000","last_peered":"2023-07-09T21:52:19.902304+0000","last_clean":"2023-07-09T21:52:19.902304+0000","last_became_active":"2023-07-09T21:52:18.928979+0000","last_became_peered":"2023-07-09T21:52:18.928979+0000","last_unstale":"2023-07-09T21:52:19.902304+0000","last_undegraded":"2023-07-09T21:52:19.902304+0000","last_fullsized":"2023-07-09T21:52:19.902304+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:29.682846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902921+0000","last_change":"2023-07-09T21:52:18.898859+0000","last_active":"2023-07-09T21:52:19.902921+0000","last_peered":"2023-07-09T21:52:19.902921+0000","last_clean":"2023-07-09T21:52:19.902921+0000","last_became_active":"2023-07-09T21:52:18.898644+0000","last_became_peered":"2023-07-09T21:52:18.898644+0000","last_unstale":"2023-07-09T21:52:19.902921+0000","last_undegraded":"2023-07-09T21:52:19.902921+0000","last_fullsized":"2023-07-09T21:52:19.902921+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:22:37.253358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594793+0000","last_change":"2023-07-09T21:52:18.922310+0000","last_active":"2023-07-09T21:52:20.594793+0000","last_peered":"2023-07-09T21:52:20.594793+0000","last_clean":"2023-07-09T21:52:20.594793+0000","last_became_active":"2023-07-09T21:52:18.921979+0000","last_became_peered":"2023-07-09T21:52:18.921979+0000","last_unstale":"2023-07-09T21:52:20.594793+0000","last_undegraded":"2023-07-09T21:52:20.594793+0000","last_fullsized":"2023-07-09T21:52:20.594793+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:12:52.313544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.596020+0000","last_change":"2023-07-09T21:52:18.923872+0000","last_active":"2023-07-09T21:52:20.596020+0000","last_peered":"2023-07-09T21:52:20.596020+0000","last_clean":"2023-07-09T21:52:20.596020+0000","last_became_active":"2023-07-09T21:52:18.923384+0000","last_became_peered":"2023-07-09T21:52:18.923384+0000","last_unstale":"2023-07-09T21:52:20.596020+0000","last_undegraded":"2023-07-09T21:52:20.596020+0000","last_fullsized":"2023-07-09T21:52:20.596020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:21:13.322563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902746+0000","last_change":"2023-07-09T21:52:18.912520+0000","last_active":"2023-07-09T21:52:19.902746+0000","last_peered":"2023-07-09T21:52:19.902746+0000","last_clean":"2023-07-09T21:52:19.902746+0000","last_became_active":"2023-07-09T21:52:18.911959+0000","last_became_peered":"2023-07-09T21:52:18.911959+0000","last_unstale":"2023-07-09T21:52:19.902746+0000","last_undegraded":"2023-07-09T21:52:19.902746+0000","last_fullsized":"2023-07-09T21:52:19.902746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:46:29.694801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595330+0000","last_change":"2023-07-09T21:52:18.926059+0000","last_active":"2023-07-09T21:52:20.595330+0000","last_peered":"2023-07-09T21:52:20.595330+0000","last_clean":"2023-07-09T21:52:20.595330+0000","last_became_active":"2023-07-09T21:52:18.925784+0000","last_became_peered":"2023-07-09T21:52:18.925784+0000","last_unstale":"2023-07-09T21:52:20.595330+0000","last_undegraded":"2023-07-09T21:52:20.595330+0000","last_fullsized":"2023-07-09T21:52:20.595330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:28:16.208382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.556051+0000","last_change":"2023-07-09T21:52:18.912969+0000","last_active":"2023-07-09T21:52:20.556051+0000","last_peered":"2023-07-09T21:52:20.556051+0000","last_clean":"2023-07-09T21:52:20.556051+0000","last_became_active":"2023-07-09T21:52:18.912699+0000","last_became_peered":"2023-07-09T21:52:18.912699+0000","last_unstale":"2023-07-09T21:52:20.556051+0000","last_undegraded":"2023-07-09T21:52:20.556051+0000","last_fullsized":"2023-07-09T21:52:20.556051+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:44.039781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595463+0000","last_change":"2023-07-09T21:52:18.922844+0000","last_active":"2023-07-09T21:52:20.595463+0000","last_peered":"2023-07-09T21:52:20.595463+0000","last_clean":"2023-07-09T21:52:20.595463+0000","last_became_active":"2023-07-09T21:52:18.922541+0000","last_became_peered":"2023-07-09T21:52:18.922541+0000","last_unstale":"2023-07-09T21:52:20.595463+0000","last_undegraded":"2023-07-09T21:52:20.595463+0000","last_fullsized":"2023-07-09T21:52:20.595463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:29:28.754474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512570+0000","last_change":"2023-07-09T21:52:18.925934+0000","last_active":"2023-07-09T21:52:20.512570+0000","last_peered":"2023-07-09T21:52:20.512570+0000","last_clean":"2023-07-09T21:52:20.512570+0000","last_became_active":"2023-07-09T21:52:18.925687+0000","last_became_peered":"2023-07-09T21:52:18.925687+0000","last_unstale":"2023-07-09T21:52:20.512570+0000","last_undegraded":"2023-07-09T21:52:20.512570+0000","last_fullsized":"2023-07-09T21:52:20.512570+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:55:00.079307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595564+0000","last_change":"2023-07-09T21:52:18.919066+0000","last_active":"2023-07-09T21:52:20.595564+0000","last_peered":"2023-07-09T21:52:20.595564+0000","last_clean":"2023-07-09T21:52:20.595564+0000","last_became_active":"2023-07-09T21:52:18.918418+0000","last_became_peered":"2023-07-09T21:52:18.918418+0000","last_unstale":"2023-07-09T21:52:20.595564+0000","last_undegraded":"2023-07-09T21:52:20.595564+0000","last_fullsized":"2023-07-09T21:52:20.595564+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:02:23.061639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903980+0000","last_change":"2023-07-09T21:52:18.917337+0000","last_active":"2023-07-09T21:52:19.903980+0000","last_peered":"2023-07-09T21:52:19.903980+0000","last_clean":"2023-07-09T21:52:19.903980+0000","last_became_active":"2023-07-09T21:52:18.916997+0000","last_became_peered":"2023-07-09T21:52:18.916997+0000","last_unstale":"2023-07-09T21:52:19.903980+0000","last_undegraded":"2023-07-09T21:52:19.903980+0000","last_fullsized":"2023-07-09T21:52:19.903980+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:40:58.939980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512418+0000","last_change":"2023-07-09T21:52:18.906661+0000","last_active":"2023-07-09T21:52:20.512418+0000","last_peered":"2023-07-09T21:52:20.512418+0000","last_clean":"2023-07-09T21:52:20.512418+0000","last_became_active":"2023-07-09T21:52:18.906392+0000","last_became_peered":"2023-07-09T21:52:18.906392+0000","last_unstale":"2023-07-09T21:52:20.512418+0000","last_undegraded":"2023-07-09T21:52:20.512418+0000","last_fullsized":"2023-07-09T21:52:20.512418+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:52:23.101621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555794+0000","last_change":"2023-07-09T21:52:17.905074+0000","last_active":"2023-07-09T21:52:20.555794+0000","last_peered":"2023-07-09T21:52:20.555794+0000","last_clean":"2023-07-09T21:52:20.555794+0000","last_became_active":"2023-07-09T21:52:17.904791+0000","last_became_peered":"2023-07-09T21:52:17.904791+0000","last_unstale":"2023-07-09T21:52:20.555794+0000","last_undegraded":"2023-07-09T21:52:20.555794+0000","last_fullsized":"2023-07-09T21:52:20.555794+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:02:05.359638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904364+0000","last_change":"2023-07-09T21:52:18.898797+0000","last_active":"2023-07-09T21:52:19.904364+0000","last_peered":"2023-07-09T21:52:19.904364+0000","last_clean":"2023-07-09T21:52:19.904364+0000","last_became_active":"2023-07-09T21:52:18.898476+0000","last_became_peered":"2023-07-09T21:52:18.898476+0000","last_unstale":"2023-07-09T21:52:19.904364+0000","last_undegraded":"2023-07-09T21:52:19.904364+0000","last_fullsized":"2023-07-09T21:52:19.904364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:18:35.836151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595123+0000","last_change":"2023-07-09T21:52:17.903525+0000","last_active":"2023-07-09T21:52:20.595123+0000","last_peered":"2023-07-09T21:52:20.595123+0000","last_clean":"2023-07-09T21:52:20.595123+0000","last_became_active":"2023-07-09T21:52:17.900909+0000","last_became_peered":"2023-07-09T21:52:17.900909+0000","last_unstale":"2023-07-09T21:52:20.595123+0000","last_undegraded":"2023-07-09T21:52:20.595123+0000","last_fullsized":"2023-07-09T21:52:20.595123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:51.390709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555603+0000","last_change":"2023-07-09T21:52:18.909934+0000","last_active":"2023-07-09T21:52:20.555603+0000","last_peered":"2023-07-09T21:52:20.555603+0000","last_clean":"2023-07-09T21:52:20.555603+0000","last_became_active":"2023-07-09T21:52:18.909657+0000","last_became_peered":"2023-07-09T21:52:18.909657+0000","last_unstale":"2023-07-09T21:52:20.555603+0000","last_undegraded":"2023-07-09T21:52:20.555603+0000","last_fullsized":"2023-07-09T21:52:20.555603+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:22:37.253358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595468+0000","last_change":"2023-07-09T21:52:17.909999+0000","last_active":"2023-07-09T21:52:20.595468+0000","last_peered":"2023-07-09T21:52:20.595468+0000","last_clean":"2023-07-09T21:52:20.595468+0000","last_became_active":"2023-07-09T21:52:17.909580+0000","last_became_peered":"2023-07-09T21:52:17.909580+0000","last_unstale":"2023-07-09T21:52:20.595468+0000","last_undegraded":"2023-07-09T21:52:20.595468+0000","last_fullsized":"2023-07-09T21:52:20.595468+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:51.857256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902463+0000","last_change":"2023-07-09T21:52:18.911614+0000","last_active":"2023-07-09T21:52:19.902463+0000","last_peered":"2023-07-09T21:52:19.902463+0000","last_clean":"2023-07-09T21:52:19.902463+0000","last_became_active":"2023-07-09T21:52:18.911314+0000","last_became_peered":"2023-07-09T21:52:18.911314+0000","last_unstale":"2023-07-09T21:52:19.902463+0000","last_undegraded":"2023-07-09T21:52:19.902463+0000","last_fullsized":"2023-07-09T21:52:19.902463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:12.665376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904394+0000","last_change":"2023-07-09T21:52:17.903946+0000","last_active":"2023-07-09T21:52:19.904394+0000","last_peered":"2023-07-09T21:52:19.904394+0000","last_clean":"2023-07-09T21:52:19.904394+0000","last_became_active":"2023-07-09T21:52:17.903690+0000","last_became_peered":"2023-07-09T21:52:17.903690+0000","last_unstale":"2023-07-09T21:52:19.904394+0000","last_undegraded":"2023-07-09T21:52:19.904394+0000","last_fullsized":"2023-07-09T21:52:19.904394+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:59.072340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595504+0000","last_change":"2023-07-09T21:52:18.925285+0000","last_active":"2023-07-09T21:52:20.595504+0000","last_peered":"2023-07-09T21:52:20.595504+0000","last_clean":"2023-07-09T21:52:20.595504+0000","last_became_active":"2023-07-09T21:52:18.924973+0000","last_became_peered":"2023-07-09T21:52:18.924973+0000","last_unstale":"2023-07-09T21:52:20.595504+0000","last_undegraded":"2023-07-09T21:52:20.595504+0000","last_fullsized":"2023-07-09T21:52:20.595504+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:22:47.938868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595628+0000","last_change":"2023-07-09T21:52:17.914742+0000","last_active":"2023-07-09T21:52:20.595628+0000","last_peered":"2023-07-09T21:52:20.595628+0000","last_clean":"2023-07-09T21:52:20.595628+0000","last_became_active":"2023-07-09T21:52:17.914452+0000","last_became_peered":"2023-07-09T21:52:17.914452+0000","last_unstale":"2023-07-09T21:52:20.595628+0000","last_undegraded":"2023-07-09T21:52:20.595628+0000","last_fullsized":"2023-07-09T21:52:20.595628+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:28.675879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512819+0000","last_change":"2023-07-09T21:52:18.921844+0000","last_active":"2023-07-09T21:52:20.512819+0000","last_peered":"2023-07-09T21:52:20.512819+0000","last_clean":"2023-07-09T21:52:20.512819+0000","last_became_active":"2023-07-09T21:52:18.921381+0000","last_became_peered":"2023-07-09T21:52:18.921381+0000","last_unstale":"2023-07-09T21:52:20.512819+0000","last_undegraded":"2023-07-09T21:52:20.512819+0000","last_fullsized":"2023-07-09T21:52:20.512819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:22:50.768814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595185+0000","last_change":"2023-07-09T21:52:17.901241+0000","last_active":"2023-07-09T21:52:20.595185+0000","last_peered":"2023-07-09T21:52:20.595185+0000","last_clean":"2023-07-09T21:52:20.595185+0000","last_became_active":"2023-07-09T21:52:17.900934+0000","last_became_peered":"2023-07-09T21:52:17.900934+0000","last_unstale":"2023-07-09T21:52:20.595185+0000","last_undegraded":"2023-07-09T21:52:20.595185+0000","last_fullsized":"2023-07-09T21:52:20.595185+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:40:02.015596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902622+0000","last_change":"2023-07-09T21:52:18.917563+0000","last_active":"2023-07-09T21:52:19.902622+0000","last_peered":"2023-07-09T21:52:19.902622+0000","last_clean":"2023-07-09T21:52:19.902622+0000","last_became_active":"2023-07-09T21:52:18.917229+0000","last_became_peered":"2023-07-09T21:52:18.917229+0000","last_unstale":"2023-07-09T21:52:19.902622+0000","last_undegraded":"2023-07-09T21:52:19.902622+0000","last_fullsized":"2023-07-09T21:52:19.902622+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:31:20.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555576+0000","last_change":"2023-07-09T21:52:17.905888+0000","last_active":"2023-07-09T21:52:20.555576+0000","last_peered":"2023-07-09T21:52:20.555576+0000","last_clean":"2023-07-09T21:52:20.555576+0000","last_became_active":"2023-07-09T21:52:17.905601+0000","last_became_peered":"2023-07-09T21:52:17.905601+0000","last_unstale":"2023-07-09T21:52:20.555576+0000","last_undegraded":"2023-07-09T21:52:20.555576+0000","last_fullsized":"2023-07-09T21:52:20.555576+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:36:33.580515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512998+0000","last_change":"2023-07-09T21:52:18.927211+0000","last_active":"2023-07-09T21:52:20.512998+0000","last_peered":"2023-07-09T21:52:20.512998+0000","last_clean":"2023-07-09T21:52:20.512998+0000","last_became_active":"2023-07-09T21:52:18.926919+0000","last_became_peered":"2023-07-09T21:52:18.926919+0000","last_unstale":"2023-07-09T21:52:20.512998+0000","last_undegraded":"2023-07-09T21:52:20.512998+0000","last_fullsized":"2023-07-09T21:52:20.512998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:06:46.376234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594947+0000","last_change":"2023-07-09T21:52:17.908242+0000","last_active":"2023-07-09T21:52:20.594947+0000","last_peered":"2023-07-09T21:52:20.594947+0000","last_clean":"2023-07-09T21:52:20.594947+0000","last_became_active":"2023-07-09T21:52:17.907897+0000","last_became_peered":"2023-07-09T21:52:17.907897+0000","last_unstale":"2023-07-09T21:52:20.594947+0000","last_undegraded":"2023-07-09T21:52:20.594947+0000","last_fullsized":"2023-07-09T21:52:20.594947+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:57:00.640426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595130+0000","last_change":"2023-07-09T21:52:18.916918+0000","last_active":"2023-07-09T21:52:20.595130+0000","last_peered":"2023-07-09T21:52:20.595130+0000","last_clean":"2023-07-09T21:52:20.595130+0000","last_became_active":"2023-07-09T21:52:18.916633+0000","last_became_peered":"2023-07-09T21:52:18.916633+0000","last_unstale":"2023-07-09T21:52:20.595130+0000","last_undegraded":"2023-07-09T21:52:20.595130+0000","last_fullsized":"2023-07-09T21:52:20.595130+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:02:23.061639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512964+0000","last_change":"2023-07-09T21:52:17.902773+0000","last_active":"2023-07-09T21:52:20.512964+0000","last_peered":"2023-07-09T21:52:20.512964+0000","last_clean":"2023-07-09T21:52:20.512964+0000","last_became_active":"2023-07-09T21:52:17.902245+0000","last_became_peered":"2023-07-09T21:52:17.902245+0000","last_unstale":"2023-07-09T21:52:20.512964+0000","last_undegraded":"2023-07-09T21:52:20.512964+0000","last_fullsized":"2023-07-09T21:52:20.512964+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:14:37.682718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904034+0000","last_change":"2023-07-09T21:52:18.901889+0000","last_active":"2023-07-09T21:52:19.904034+0000","last_peered":"2023-07-09T21:52:19.904034+0000","last_clean":"2023-07-09T21:52:19.904034+0000","last_became_active":"2023-07-09T21:52:18.901597+0000","last_became_peered":"2023-07-09T21:52:18.901597+0000","last_unstale":"2023-07-09T21:52:19.904034+0000","last_undegraded":"2023-07-09T21:52:19.904034+0000","last_fullsized":"2023-07-09T21:52:19.904034+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:19:08.639665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595459+0000","last_change":"2023-07-09T21:52:17.907414+0000","last_active":"2023-07-09T21:52:20.595459+0000","last_peered":"2023-07-09T21:52:20.595459+0000","last_clean":"2023-07-09T21:52:20.595459+0000","last_became_active":"2023-07-09T21:52:17.906862+0000","last_became_peered":"2023-07-09T21:52:17.906862+0000","last_unstale":"2023-07-09T21:52:20.595459+0000","last_undegraded":"2023-07-09T21:52:20.595459+0000","last_fullsized":"2023-07-09T21:52:20.595459+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:28.675879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595765+0000","last_change":"2023-07-09T21:52:18.924175+0000","last_active":"2023-07-09T21:52:20.595765+0000","last_peered":"2023-07-09T21:52:20.595765+0000","last_clean":"2023-07-09T21:52:20.595765+0000","last_became_active":"2023-07-09T21:52:18.923516+0000","last_became_peered":"2023-07-09T21:52:18.923516+0000","last_unstale":"2023-07-09T21:52:20.595765+0000","last_undegraded":"2023-07-09T21:52:20.595765+0000","last_fullsized":"2023-07-09T21:52:20.595765+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:11:34.515460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.513036+0000","last_change":"2023-07-09T21:52:17.916134+0000","last_active":"2023-07-09T21:52:20.513036+0000","last_peered":"2023-07-09T21:52:20.513036+0000","last_clean":"2023-07-09T21:52:20.513036+0000","last_became_active":"2023-07-09T21:52:17.915830+0000","last_became_peered":"2023-07-09T21:52:17.915830+0000","last_unstale":"2023-07-09T21:52:20.513036+0000","last_undegraded":"2023-07-09T21:52:20.513036+0000","last_fullsized":"2023-07-09T21:52:20.513036+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:59:52.123332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595474+0000","last_change":"2023-07-09T21:52:18.913106+0000","last_active":"2023-07-09T21:52:20.595474+0000","last_peered":"2023-07-09T21:52:20.595474+0000","last_clean":"2023-07-09T21:52:20.595474+0000","last_became_active":"2023-07-09T21:52:18.912827+0000","last_became_peered":"2023-07-09T21:52:18.912827+0000","last_unstale":"2023-07-09T21:52:20.595474+0000","last_undegraded":"2023-07-09T21:52:20.595474+0000","last_fullsized":"2023-07-09T21:52:20.595474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:01:03.868728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903644+0000","last_change":"2023-07-09T21:52:17.906739+0000","last_active":"2023-07-09T21:52:19.903644+0000","last_peered":"2023-07-09T21:52:19.903644+0000","last_clean":"2023-07-09T21:52:19.903644+0000","last_became_active":"2023-07-09T21:52:17.906459+0000","last_became_peered":"2023-07-09T21:52:17.906459+0000","last_unstale":"2023-07-09T21:52:19.903644+0000","last_undegraded":"2023-07-09T21:52:19.903644+0000","last_fullsized":"2023-07-09T21:52:19.903644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:32:02.218437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904420+0000","last_change":"2023-07-09T21:52:18.898730+0000","last_active":"2023-07-09T21:52:19.904420+0000","last_peered":"2023-07-09T21:52:19.904420+0000","last_clean":"2023-07-09T21:52:19.904420+0000","last_became_active":"2023-07-09T21:52:18.898426+0000","last_became_peered":"2023-07-09T21:52:18.898426+0000","last_unstale":"2023-07-09T21:52:19.904420+0000","last_undegraded":"2023-07-09T21:52:19.904420+0000","last_fullsized":"2023-07-09T21:52:19.904420+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:47:16.469049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595738+0000","last_change":"2023-07-09T21:52:17.908750+0000","last_active":"2023-07-09T21:52:20.595738+0000","last_peered":"2023-07-09T21:52:20.595738+0000","last_clean":"2023-07-09T21:52:20.595738+0000","last_became_active":"2023-07-09T21:52:17.908498+0000","last_became_peered":"2023-07-09T21:52:17.908498+0000","last_unstale":"2023-07-09T21:52:20.595738+0000","last_undegraded":"2023-07-09T21:52:20.595738+0000","last_fullsized":"2023-07-09T21:52:20.595738+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:22:46.931900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.596021+0000","last_change":"2023-07-09T21:52:18.922130+0000","last_active":"2023-07-09T21:52:20.596021+0000","last_peered":"2023-07-09T21:52:20.596021+0000","last_clean":"2023-07-09T21:52:20.596021+0000","last_became_active":"2023-07-09T21:52:18.921840+0000","last_became_peered":"2023-07-09T21:52:18.921840+0000","last_unstale":"2023-07-09T21:52:20.596021+0000","last_undegraded":"2023-07-09T21:52:20.596021+0000","last_fullsized":"2023-07-09T21:52:20.596021+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:12.665376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555783+0000","last_change":"2023-07-09T21:52:17.913662+0000","last_active":"2023-07-09T21:52:20.555783+0000","last_peered":"2023-07-09T21:52:20.555783+0000","last_clean":"2023-07-09T21:52:20.555783+0000","last_became_active":"2023-07-09T21:52:17.913376+0000","last_became_peered":"2023-07-09T21:52:17.913376+0000","last_unstale":"2023-07-09T21:52:20.555783+0000","last_undegraded":"2023-07-09T21:52:20.555783+0000","last_fullsized":"2023-07-09T21:52:20.555783+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:29:38.675674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902469+0000","last_change":"2023-07-09T21:52:18.912743+0000","last_active":"2023-07-09T21:52:19.902469+0000","last_peered":"2023-07-09T21:52:19.902469+0000","last_clean":"2023-07-09T21:52:19.902469+0000","last_became_active":"2023-07-09T21:52:18.912257+0000","last_became_peered":"2023-07-09T21:52:18.912257+0000","last_unstale":"2023-07-09T21:52:19.902469+0000","last_undegraded":"2023-07-09T21:52:19.902469+0000","last_fullsized":"2023-07-09T21:52:19.902469+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:22:47.938868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512677+0000","last_change":"2023-07-09T21:52:17.906064+0000","last_active":"2023-07-09T21:52:20.512677+0000","last_peered":"2023-07-09T21:52:20.512677+0000","last_clean":"2023-07-09T21:52:20.512677+0000","last_became_active":"2023-07-09T21:52:17.905765+0000","last_became_peered":"2023-07-09T21:52:17.905765+0000","last_unstale":"2023-07-09T21:52:20.512677+0000","last_undegraded":"2023-07-09T21:52:20.512677+0000","last_fullsized":"2023-07-09T21:52:20.512677+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:17:45.762909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.596031+0000","last_change":"2023-07-09T21:52:18.922888+0000","last_active":"2023-07-09T21:52:20.596031+0000","last_peered":"2023-07-09T21:52:20.596031+0000","last_clean":"2023-07-09T21:52:20.596031+0000","last_became_active":"2023-07-09T21:52:18.922489+0000","last_became_peered":"2023-07-09T21:52:18.922489+0000","last_unstale":"2023-07-09T21:52:20.596031+0000","last_undegraded":"2023-07-09T21:52:20.596031+0000","last_fullsized":"2023-07-09T21:52:20.596031+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:48:23.971303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902446+0000","last_change":"2023-07-09T21:52:17.906688+0000","last_active":"2023-07-09T21:52:19.902446+0000","last_peered":"2023-07-09T21:52:19.902446+0000","last_clean":"2023-07-09T21:52:19.902446+0000","last_became_active":"2023-07-09T21:52:17.906355+0000","last_became_peered":"2023-07-09T21:52:17.906355+0000","last_unstale":"2023-07-09T21:52:19.902446+0000","last_undegraded":"2023-07-09T21:52:19.902446+0000","last_fullsized":"2023-07-09T21:52:19.902446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:01:02.861760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902201+0000","last_change":"2023-07-09T21:52:18.914307+0000","last_active":"2023-07-09T21:52:19.902201+0000","last_peered":"2023-07-09T21:52:19.902201+0000","last_clean":"2023-07-09T21:52:19.902201+0000","last_became_active":"2023-07-09T21:52:18.914040+0000","last_became_peered":"2023-07-09T21:52:18.914040+0000","last_unstale":"2023-07-09T21:52:19.902201+0000","last_undegraded":"2023-07-09T21:52:19.902201+0000","last_fullsized":"2023-07-09T21:52:19.902201+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:14.102629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595913+0000","last_change":"2023-07-09T21:52:17.915757+0000","last_active":"2023-07-09T21:52:20.595913+0000","last_peered":"2023-07-09T21:52:20.595913+0000","last_clean":"2023-07-09T21:52:20.595913+0000","last_became_active":"2023-07-09T21:52:17.915396+0000","last_became_peered":"2023-07-09T21:52:17.915396+0000","last_unstale":"2023-07-09T21:52:20.595913+0000","last_undegraded":"2023-07-09T21:52:20.595913+0000","last_fullsized":"2023-07-09T21:52:20.595913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:46:28.687834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594759+0000","last_change":"2023-07-09T21:52:18.926116+0000","last_active":"2023-07-09T21:52:20.594759+0000","last_peered":"2023-07-09T21:52:20.594759+0000","last_clean":"2023-07-09T21:52:20.594759+0000","last_became_active":"2023-07-09T21:52:18.925663+0000","last_became_peered":"2023-07-09T21:52:18.925663+0000","last_unstale":"2023-07-09T21:52:20.594759+0000","last_undegraded":"2023-07-09T21:52:20.594759+0000","last_fullsized":"2023-07-09T21:52:20.594759+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:19:09.676297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903125+0000","last_change":"2023-07-09T21:52:17.908662+0000","last_active":"2023-07-09T21:52:19.903125+0000","last_peered":"2023-07-09T21:52:19.903125+0000","last_clean":"2023-07-09T21:52:19.903125+0000","last_became_active":"2023-07-09T21:52:17.908390+0000","last_became_peered":"2023-07-09T21:52:17.908390+0000","last_unstale":"2023-07-09T21:52:19.903125+0000","last_undegraded":"2023-07-09T21:52:19.903125+0000","last_fullsized":"2023-07-09T21:52:19.903125+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:29:38.675674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595136+0000","last_change":"2023-07-09T21:52:18.925491+0000","last_active":"2023-07-09T21:52:20.595136+0000","last_peered":"2023-07-09T21:52:20.595136+0000","last_clean":"2023-07-09T21:52:20.595136+0000","last_became_active":"2023-07-09T21:52:18.925165+0000","last_became_peered":"2023-07-09T21:52:18.925165+0000","last_unstale":"2023-07-09T21:52:20.595136+0000","last_undegraded":"2023-07-09T21:52:20.595136+0000","last_fullsized":"2023-07-09T21:52:20.595136+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:29:28.754474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.556187+0000","last_change":"2023-07-09T21:52:17.905001+0000","last_active":"2023-07-09T21:52:20.556187+0000","last_peered":"2023-07-09T21:52:20.556187+0000","last_clean":"2023-07-09T21:52:20.556187+0000","last_became_active":"2023-07-09T21:52:17.904624+0000","last_became_peered":"2023-07-09T21:52:17.904624+0000","last_unstale":"2023-07-09T21:52:20.556187+0000","last_undegraded":"2023-07-09T21:52:20.556187+0000","last_fullsized":"2023-07-09T21:52:20.556187+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:39:02.442720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595045+0000","last_change":"2023-07-09T21:52:18.894463+0000","last_active":"2023-07-09T21:52:20.595045+0000","last_peered":"2023-07-09T21:52:20.595045+0000","last_clean":"2023-07-09T21:52:20.595045+0000","last_became_active":"2023-07-09T21:52:18.894175+0000","last_became_peered":"2023-07-09T21:52:18.894175+0000","last_unstale":"2023-07-09T21:52:20.595045+0000","last_undegraded":"2023-07-09T21:52:20.595045+0000","last_fullsized":"2023-07-09T21:52:20.595045+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:32:06.281504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555855+0000","last_change":"2023-07-09T21:52:17.904083+0000","last_active":"2023-07-09T21:52:20.555855+0000","last_peered":"2023-07-09T21:52:20.555855+0000","last_clean":"2023-07-09T21:52:20.555855+0000","last_became_active":"2023-07-09T21:52:17.903804+0000","last_became_peered":"2023-07-09T21:52:17.903804+0000","last_unstale":"2023-07-09T21:52:20.555855+0000","last_undegraded":"2023-07-09T21:52:20.555855+0000","last_fullsized":"2023-07-09T21:52:20.555855+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:56:03.315636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904142+0000","last_change":"2023-07-09T21:52:18.902562+0000","last_active":"2023-07-09T21:52:19.904142+0000","last_peered":"2023-07-09T21:52:19.904142+0000","last_clean":"2023-07-09T21:52:19.904142+0000","last_became_active":"2023-07-09T21:52:18.902303+0000","last_became_peered":"2023-07-09T21:52:18.902303+0000","last_unstale":"2023-07-09T21:52:19.904142+0000","last_undegraded":"2023-07-09T21:52:19.904142+0000","last_fullsized":"2023-07-09T21:52:19.904142+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:08:28.314748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594966+0000","last_change":"2023-07-09T21:52:17.901130+0000","last_active":"2023-07-09T21:52:20.594966+0000","last_peered":"2023-07-09T21:52:20.594966+0000","last_clean":"2023-07-09T21:52:20.594966+0000","last_became_active":"2023-07-09T21:52:17.900760+0000","last_became_peered":"2023-07-09T21:52:17.900760+0000","last_unstale":"2023-07-09T21:52:20.594966+0000","last_undegraded":"2023-07-09T21:52:20.594966+0000","last_fullsized":"2023-07-09T21:52:20.594966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:29:58.763717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555956+0000","last_change":"2023-07-09T21:52:18.912184+0000","last_active":"2023-07-09T21:52:20.555956+0000","last_peered":"2023-07-09T21:52:20.555956+0000","last_clean":"2023-07-09T21:52:20.555956+0000","last_became_active":"2023-07-09T21:52:18.911938+0000","last_became_peered":"2023-07-09T21:52:18.911938+0000","last_unstale":"2023-07-09T21:52:20.555956+0000","last_undegraded":"2023-07-09T21:52:20.555956+0000","last_fullsized":"2023-07-09T21:52:20.555956+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:09:30.618896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902888+0000","last_change":"2023-07-09T21:52:17.903707+0000","last_active":"2023-07-09T21:52:19.902888+0000","last_peered":"2023-07-09T21:52:19.902888+0000","last_clean":"2023-07-09T21:52:19.902888+0000","last_became_active":"2023-07-09T21:52:17.903434+0000","last_became_peered":"2023-07-09T21:52:17.903434+0000","last_unstale":"2023-07-09T21:52:19.902888+0000","last_undegraded":"2023-07-09T21:52:19.902888+0000","last_fullsized":"2023-07-09T21:52:19.902888+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:19:46.246344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595731+0000","last_change":"2023-07-09T21:52:18.923992+0000","last_active":"2023-07-09T21:52:20.595731+0000","last_peered":"2023-07-09T21:52:20.595731+0000","last_clean":"2023-07-09T21:52:20.595731+0000","last_became_active":"2023-07-09T21:52:18.923404+0000","last_became_peered":"2023-07-09T21:52:18.923404+0000","last_unstale":"2023-07-09T21:52:20.595731+0000","last_undegraded":"2023-07-09T21:52:20.595731+0000","last_fullsized":"2023-07-09T21:52:20.595731+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:01:03.868728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595367+0000","last_change":"2023-07-09T21:52:17.916113+0000","last_active":"2023-07-09T21:52:20.595367+0000","last_peered":"2023-07-09T21:52:20.595367+0000","last_clean":"2023-07-09T21:52:20.595367+0000","last_became_active":"2023-07-09T21:52:17.915785+0000","last_became_peered":"2023-07-09T21:52:17.915785+0000","last_unstale":"2023-07-09T21:52:20.595367+0000","last_undegraded":"2023-07-09T21:52:20.595367+0000","last_fullsized":"2023-07-09T21:52:20.595367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:00:28.708380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595303+0000","last_change":"2023-07-09T21:52:18.920034+0000","last_active":"2023-07-09T21:52:20.595303+0000","last_peered":"2023-07-09T21:52:20.595303+0000","last_clean":"2023-07-09T21:52:20.595303+0000","last_became_active":"2023-07-09T21:52:18.919780+0000","last_became_peered":"2023-07-09T21:52:18.919780+0000","last_unstale":"2023-07-09T21:52:20.595303+0000","last_undegraded":"2023-07-09T21:52:20.595303+0000","last_fullsized":"2023-07-09T21:52:20.595303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:37:44.395177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902603+0000","last_change":"2023-07-09T21:52:17.906386+0000","last_active":"2023-07-09T21:52:19.902603+0000","last_peered":"2023-07-09T21:52:19.902603+0000","last_clean":"2023-07-09T21:52:19.902603+0000","last_became_active":"2023-07-09T21:52:17.906124+0000","last_became_peered":"2023-07-09T21:52:17.906124+0000","last_unstale":"2023-07-09T21:52:19.902603+0000","last_undegraded":"2023-07-09T21:52:19.902603+0000","last_fullsized":"2023-07-09T21:52:19.902603+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:36:33.580515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595354+0000","last_change":"2023-07-09T21:52:18.924061+0000","last_active":"2023-07-09T21:52:20.595354+0000","last_peered":"2023-07-09T21:52:20.595354+0000","last_clean":"2023-07-09T21:52:20.595354+0000","last_became_active":"2023-07-09T21:52:18.923764+0000","last_became_peered":"2023-07-09T21:52:18.923764+0000","last_unstale":"2023-07-09T21:52:20.595354+0000","last_undegraded":"2023-07-09T21:52:20.595354+0000","last_fullsized":"2023-07-09T21:52:20.595354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:02.781153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595617+0000","last_change":"2023-07-09T21:52:17.900770+0000","last_active":"2023-07-09T21:52:20.595617+0000","last_peered":"2023-07-09T21:52:20.595617+0000","last_clean":"2023-07-09T21:52:20.595617+0000","last_became_active":"2023-07-09T21:52:17.900421+0000","last_became_peered":"2023-07-09T21:52:17.900421+0000","last_unstale":"2023-07-09T21:52:20.595617+0000","last_undegraded":"2023-07-09T21:52:20.595617+0000","last_fullsized":"2023-07-09T21:52:20.595617+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:21.741126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595542+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:52:20.595542+0000","last_peered":"2023-07-09T21:52:20.595542+0000","last_clean":"2023-07-09T21:52:20.595542+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:52:20.595542+0000","last_undegraded":"2023-07-09T21:52:20.595542+0000","last_fullsized":"2023-07-09T21:52:20.595542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:02:53.224740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904231+0000","last_change":"2023-07-09T21:52:18.916659+0000","last_active":"2023-07-09T21:52:19.904231+0000","last_peered":"2023-07-09T21:52:19.904231+0000","last_clean":"2023-07-09T21:52:19.904231+0000","last_became_active":"2023-07-09T21:52:18.916033+0000","last_became_peered":"2023-07-09T21:52:18.916033+0000","last_unstale":"2023-07-09T21:52:19.904231+0000","last_undegraded":"2023-07-09T21:52:19.904231+0000","last_fullsized":"2023-07-09T21:52:19.904231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:15:14.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.556003+0000","last_change":"2023-07-09T21:52:17.907945+0000","last_active":"2023-07-09T21:52:20.556003+0000","last_peered":"2023-07-09T21:52:20.556003+0000","last_clean":"2023-07-09T21:52:20.556003+0000","last_became_active":"2023-07-09T21:52:17.907687+0000","last_became_peered":"2023-07-09T21:52:17.907687+0000","last_unstale":"2023-07-09T21:52:20.556003+0000","last_undegraded":"2023-07-09T21:52:20.556003+0000","last_fullsized":"2023-07-09T21:52:20.556003+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:20:37.899763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903983+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:52:19.903983+0000","last_peered":"2023-07-09T21:52:19.903983+0000","last_clean":"2023-07-09T21:52:19.903983+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:52:19.903983+0000","last_undegraded":"2023-07-09T21:52:19.903983+0000","last_fullsized":"2023-07-09T21:52:19.903983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:22:55.469638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902582+0000","last_change":"2023-07-09T21:52:18.910698+0000","last_active":"2023-07-09T21:52:19.902582+0000","last_peered":"2023-07-09T21:52:19.902582+0000","last_clean":"2023-07-09T21:52:19.902582+0000","last_became_active":"2023-07-09T21:52:18.910455+0000","last_became_peered":"2023-07-09T21:52:18.910455+0000","last_unstale":"2023-07-09T21:52:19.902582+0000","last_undegraded":"2023-07-09T21:52:19.902582+0000","last_fullsized":"2023-07-09T21:52:19.902582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:22.748093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595760+0000","last_change":"2023-07-09T21:52:17.909086+0000","last_active":"2023-07-09T21:52:20.595760+0000","last_peered":"2023-07-09T21:52:20.595760+0000","last_clean":"2023-07-09T21:52:20.595760+0000","last_became_active":"2023-07-09T21:52:17.907325+0000","last_became_peered":"2023-07-09T21:52:17.907325+0000","last_unstale":"2023-07-09T21:52:20.595760+0000","last_undegraded":"2023-07-09T21:52:20.595760+0000","last_fullsized":"2023-07-09T21:52:20.595760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:21.741126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903077+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:52:19.903077+0000","last_peered":"2023-07-09T21:52:19.903077+0000","last_clean":"2023-07-09T21:52:19.903077+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:52:19.903077+0000","last_undegraded":"2023-07-09T21:52:19.903077+0000","last_fullsized":"2023-07-09T21:52:19.903077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:01:29.799648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555685+0000","last_change":"2023-07-09T21:52:18.914520+0000","last_active":"2023-07-09T21:52:20.555685+0000","last_peered":"2023-07-09T21:52:20.555685+0000","last_clean":"2023-07-09T21:52:20.555685+0000","last_became_active":"2023-07-09T21:52:18.913949+0000","last_became_peered":"2023-07-09T21:52:18.913949+0000","last_unstale":"2023-07-09T21:52:20.555685+0000","last_undegraded":"2023-07-09T21:52:20.555685+0000","last_fullsized":"2023-07-09T21:52:20.555685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:03:31.153416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595858+0000","last_change":"2023-07-09T21:52:17.908857+0000","last_active":"2023-07-09T21:52:20.595858+0000","last_peered":"2023-07-09T21:52:20.595858+0000","last_clean":"2023-07-09T21:52:20.595858+0000","last_became_active":"2023-07-09T21:52:17.907842+0000","last_became_peered":"2023-07-09T21:52:17.907842+0000","last_unstale":"2023-07-09T21:52:20.595858+0000","last_undegraded":"2023-07-09T21:52:20.595858+0000","last_fullsized":"2023-07-09T21:52:20.595858+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:17:35.834602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904281+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:52:19.904281+0000","last_peered":"2023-07-09T21:52:19.904281+0000","last_clean":"2023-07-09T21:52:19.904281+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:52:19.904281+0000","last_undegraded":"2023-07-09T21:52:19.904281+0000","last_fullsized":"2023-07-09T21:52:19.904281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:23:30.980449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":218,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512474+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:52:20.512474+0000","last_peered":"2023-07-09T21:52:20.512474+0000","last_clean":"2023-07-09T21:52:20.512474+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:52:20.512474+0000","last_undegraded":"2023-07-09T21:52:20.512474+0000","last_fullsized":"2023-07-09T21:52:20.512474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:16:27.087160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595087+0000","last_change":"2023-07-09T21:52:18.921385+0000","last_active":"2023-07-09T21:52:20.595087+0000","last_peered":"2023-07-09T21:52:20.595087+0000","last_clean":"2023-07-09T21:52:20.595087+0000","last_became_active":"2023-07-09T21:52:18.911170+0000","last_became_peered":"2023-07-09T21:52:18.911170+0000","last_unstale":"2023-07-09T21:52:20.595087+0000","last_undegraded":"2023-07-09T21:52:20.595087+0000","last_fullsized":"2023-07-09T21:52:20.595087+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:10:52.133057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.513046+0000","last_change":"2023-07-09T21:52:17.913375+0000","last_active":"2023-07-09T21:52:20.513046+0000","last_peered":"2023-07-09T21:52:20.513046+0000","last_clean":"2023-07-09T21:52:20.513046+0000","last_became_active":"2023-07-09T21:52:17.913062+0000","last_became_peered":"2023-07-09T21:52:17.913062+0000","last_unstale":"2023-07-09T21:52:20.513046+0000","last_undegraded":"2023-07-09T21:52:20.513046+0000","last_fullsized":"2023-07-09T21:52:20.513046+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:32:04.037549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512670+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:52:20.512670+0000","last_peered":"2023-07-09T21:52:20.512670+0000","last_clean":"2023-07-09T21:52:20.512670+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:52:20.512670+0000","last_undegraded":"2023-07-09T21:52:20.512670+0000","last_fullsized":"2023-07-09T21:52:20.512670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:02:09.717154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903127+0000","last_change":"2023-07-09T21:52:18.914591+0000","last_active":"2023-07-09T21:52:19.903127+0000","last_peered":"2023-07-09T21:52:19.903127+0000","last_clean":"2023-07-09T21:52:19.903127+0000","last_became_active":"2023-07-09T21:52:18.913500+0000","last_became_peered":"2023-07-09T21:52:18.913500+0000","last_unstale":"2023-07-09T21:52:19.903127+0000","last_undegraded":"2023-07-09T21:52:19.903127+0000","last_fullsized":"2023-07-09T21:52:19.903127+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:48:23.971303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904218+0000","last_change":"2023-07-09T21:52:17.905141+0000","last_active":"2023-07-09T21:52:19.904218+0000","last_peered":"2023-07-09T21:52:19.904218+0000","last_clean":"2023-07-09T21:52:19.904218+0000","last_became_active":"2023-07-09T21:52:17.904855+0000","last_became_peered":"2023-07-09T21:52:17.904855+0000","last_unstale":"2023-07-09T21:52:19.904218+0000","last_undegraded":"2023-07-09T21:52:19.904218+0000","last_fullsized":"2023-07-09T21:52:19.904218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:52:22.094654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.513214+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:52:20.513214+0000","last_peered":"2023-07-09T21:52:20.513214+0000","last_clean":"2023-07-09T21:52:20.513214+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:52:20.513214+0000","last_undegraded":"2023-07-09T21:52:20.513214+0000","last_fullsized":"2023-07-09T21:52:20.513214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:55:41.882384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595583+0000","last_change":"2023-07-09T21:52:18.926700+0000","last_active":"2023-07-09T21:52:20.595583+0000","last_peered":"2023-07-09T21:52:20.595583+0000","last_clean":"2023-07-09T21:52:20.595583+0000","last_became_active":"2023-07-09T21:52:18.926311+0000","last_became_peered":"2023-07-09T21:52:18.926311+0000","last_unstale":"2023-07-09T21:52:20.595583+0000","last_undegraded":"2023-07-09T21:52:20.595583+0000","last_fullsized":"2023-07-09T21:52:20.595583+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:40:03.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902711+0000","last_change":"2023-07-09T21:52:17.908430+0000","last_active":"2023-07-09T21:52:19.902711+0000","last_peered":"2023-07-09T21:52:19.902711+0000","last_clean":"2023-07-09T21:52:19.902711+0000","last_became_active":"2023-07-09T21:52:17.908191+0000","last_became_peered":"2023-07-09T21:52:17.908191+0000","last_unstale":"2023-07-09T21:52:19.902711+0000","last_undegraded":"2023-07-09T21:52:19.902711+0000","last_fullsized":"2023-07-09T21:52:19.902711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:11:33.508493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595146+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:52:20.595146+0000","last_peered":"2023-07-09T21:52:20.595146+0000","last_clean":"2023-07-09T21:52:20.595146+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:52:20.595146+0000","last_undegraded":"2023-07-09T21:52:20.595146+0000","last_fullsized":"2023-07-09T21:52:20.595146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:58.615194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904013+0000","last_change":"2023-07-09T21:52:18.902936+0000","last_active":"2023-07-09T21:52:19.904013+0000","last_peered":"2023-07-09T21:52:19.904013+0000","last_clean":"2023-07-09T21:52:19.904013+0000","last_became_active":"2023-07-09T21:52:18.902636+0000","last_became_peered":"2023-07-09T21:52:18.902636+0000","last_unstale":"2023-07-09T21:52:19.904013+0000","last_undegraded":"2023-07-09T21:52:19.904013+0000","last_fullsized":"2023-07-09T21:52:19.904013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:56:36.890197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903004+0000","last_change":"2023-07-09T21:52:17.913781+0000","last_active":"2023-07-09T21:52:19.903004+0000","last_peered":"2023-07-09T21:52:19.903004+0000","last_clean":"2023-07-09T21:52:19.903004+0000","last_became_active":"2023-07-09T21:52:17.913487+0000","last_became_peered":"2023-07-09T21:52:17.913487+0000","last_unstale":"2023-07-09T21:52:19.903004+0000","last_undegraded":"2023-07-09T21:52:19.903004+0000","last_fullsized":"2023-07-09T21:52:19.903004+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:21:12.315596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555995+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:52:20.555995+0000","last_peered":"2023-07-09T21:52:20.555995+0000","last_clean":"2023-07-09T21:52:20.555995+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:52:20.555995+0000","last_undegraded":"2023-07-09T21:52:20.555995+0000","last_fullsized":"2023-07-09T21:52:20.555995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:35:08.109356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":257564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95099999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.54400000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.45900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81999999999999995,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.72399999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.79000000000000004,"15min":0.82099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78700000000000003,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.624},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97099999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.61599999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92900000000000005,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89200000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.68600000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":1.214,"15min":1.214},"last":0.76900000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.754}]}]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":602112,"data_stored":257142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52000000000000002,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55500000000000005,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.443},{"interface":"front","average":{"1min":0.438,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.53700000000000003,"15min":0.55600000000000005},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56699999999999995,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.60599999999999998,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.63300000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.49399999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.68100000000000005,"15min":0.70899999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63400000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60399999999999998,"5min":3.129,"15min":3.129},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94499999999999995,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.998,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.71699999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91200000000000003,"5min":1.929,"15min":1.929},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.85099999999999998,"15min":0.86399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97599999999999998,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93500000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.95199999999999996,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.68200000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":2.766,"15min":2.766},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.93400000000000005,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.623}]}]},{"osd":2,"up_from":14,"seq":60129542173,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":606208,"data_stored":258546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":1.232,"15min":1.3700000000000001},"min":{"1min":0.28899999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":16.946000000000002,"15min":16.946000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.93200000000000005,"15min":1.0089999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":9.5449999999999999,"15min":9.5449999999999999},"last":0.504}]},{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.92100000000000004,"15min":0.99399999999999999},"min":{"1min":0.38200000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65200000000000002,"5min":9.6950000000000003,"15min":9.6950000000000003},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.95099999999999996,"15min":1.0329999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63200000000000001,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.33700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.995,"15min":1.077},"min":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69199999999999995,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.327,"15min":1.4630000000000001},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73599999999999999,"5min":17.004000000000001,"15min":17.004000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.048,"15min":1.1000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.081,"5min":6.2510000000000003,"15min":6.2510000000000003},"last":0.748},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.2849999999999999,"15min":1.3680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2050000000000001,"5min":9.6630000000000003,"15min":9.6630000000000003},"last":0.77900000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":1.091,"15min":1.139},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2370000000000001,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.2849999999999999,"15min":1.369},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.1619999999999999,"5min":9.5879999999999992,"15min":9.5879999999999992},"last":0.82599999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":1.2849999999999999,"15min":1.371},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.048,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":1.266,"15min":1.349},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0529999999999999,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":0.79500000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.2250000000000001,"15min":1.2969999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.103,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.1160000000000001,"15min":1.1659999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.163,"5min":6.2169999999999996,"15min":6.2169999999999996},"last":0.84699999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542173,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1196032,"data_stored":847406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.92200000000000004,"15min":1.01},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55000000000000004,"5min":11.949999999999999,"15min":11.949999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60199999999999998,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73899999999999999,"5min":1.212,"15min":1.212},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":1.4179999999999999,"15min":1.5720000000000001},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90900000000000003,"15min":0.97499999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65100000000000002,"5min":10.952,"15min":10.952},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":1.696,"15min":1.859},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":22.974,"15min":22.974},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":1.264,"15min":1.3520000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.96999999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52300000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":1.589,"15min":1.589},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.748,"5min":1.6890000000000001,"15min":1.8460000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":22.933,"15min":22.933},"last":0.94299999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93100000000000005,"5min":1.623,"15min":1.623},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.6830000000000001,"15min":1.8400000000000001},"min":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98199999999999998,"5min":22.867999999999999,"15min":22.867999999999999},"last":1.01}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.1639999999999999,"15min":1.23},"min":{"1min":0.57499999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.93300000000000005,"5min":10.907999999999999,"15min":10.907999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83299999999999996,"15min":0.83999999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.99299999999999999,"5min":1.546,"15min":1.546},"last":0.95299999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542174,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1196032,"data_stored":847474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.71999999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85799999999999998,"5min":1.464,"15min":1.464},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94999999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.93799999999999994}]},{"osd":2,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89100000000000001,"5min":1.121,"15min":1.121},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.78600000000000003,"15min":0.80400000000000005},"min":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70799999999999996,"15min":0.71699999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.091,"15min":1.091},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96599999999999997,"5min":1.405,"15min":1.405},"last":0.88}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.95399999999999996,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70399999999999996,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82799999999999996,"5min":1.341,"15min":1.341},"last":0.81100000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.443,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.871,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.96299999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88100000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.0149999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":258568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57599999999999996,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.37},{"interface":"front","average":{"1min":0.435,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68200000000000005,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.53800000000000003,"5min":1.21,"15min":1.21},"last":0.438},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.54900000000000004,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.496}]},{"osd":2,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60699999999999998,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.56100000000000005,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.016,"5min":1.258,"15min":1.258},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0049999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.92200000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95599999999999996,"5min":1.486,"15min":1.486},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98999999999999999,"5min":1.327,"15min":1.327},"last":0.89400000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":1.302,"15min":1.302},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.86199999999999999,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":0.86799999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.04,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.008,"5min":1.349,"15min":1.349},"last":0.748}]}]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":593920,"data_stored":256982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.74199999999999999,"15min":0.69999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":7.9779999999999998,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":7.8650000000000002,"5min":7.8650000000000002,"15min":7.8650000000000002},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.421,"15min":1.421},"last":0.68300000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.73199999999999998,"15min":0.68200000000000005},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":7.9390000000000001,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88300000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81200000000000006}]},{"osd":3,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1799999999999999,"5min":1.597,"15min":1.597},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.93700000000000006,"5min":1.216,"15min":1.216},"last":0.65200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91200000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0609999999999999,"5min":1.069,"15min":1.069},"last":0.79200000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":1.093,"15min":1.093},"last":0.63},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.038,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76800000000000002,"15min":0.76300000000000001},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.054,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.77800000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":602112,"data_stored":257634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.54400000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84799999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.48399999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.86399999999999999,"5min":1.113,"15min":1.113},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84199999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.97499999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85599999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.46800000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.871}]},{"osd":3,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.746}]},{"osd":4,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93400000000000005,"5min":1.018,"15min":1.018},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95099999999999996,"5min":1.171,"15min":1.171},"last":0.60999999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98199999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.754,"15min":0.749},"min":{"1min":0.56699999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96399999999999997,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.1020000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.999,"5min":1.133,"15min":1.133},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.022,"5min":1.123,"15min":1.123},"last":0.88900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:52:28.374 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:52:28.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.584+0000 7fa83e7ff700 1 Processor -- start 2023-07-09T21:52:28.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.585+0000 7fa83e7ff700 1 -- start start 2023-07-09T21:52:28.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.586+0000 7fa83e7ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8380b1e00 0x7fa8380b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:28.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.586+0000 7fa83e7ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa8380b2350 0x7fa8380d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:28.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.586+0000 7fa83e7ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8380d2ce0 con 0x7fa8380d1050 2023-07-09T21:52:28.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.586+0000 7fa83e7ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8380d14d0 con 0x7fa8380b1e00 2023-07-09T21:52:28.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.586+0000 7fa83e7ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8380b3350 con 0x7fa8380b2350 2023-07-09T21:52:28.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.586+0000 7fa837fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8380b1e00 0x7fa8380b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:28.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.586+0000 7fa837fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8380b1e00 0x7fa8380b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34784/0 (socket says 172.21.15.53:34784) 2023-07-09T21:52:28.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.586+0000 7fa837fff700 1 -- 172.21.15.53:0/496033216 learned_addr learned my addr 172.21.15.53:0/496033216 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:28.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.586+0000 7fa83cd9c700 1 --1- 172.21.15.53:0/496033216 >> v1:172.21.15.53:6789/0 conn(0x7fa8380d1050 0x7fa8380afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46478/0 (socket says 172.21.15.53:46478) 2023-07-09T21:52:28.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.586+0000 7fa8377fe700 1 --2- 172.21.15.53:0/496033216 >> v2:172.21.15.184:3300/0 conn(0x7fa8380b2350 0x7fa8380d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:28.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.587+0000 7fa837fff700 1 -- 172.21.15.53:0/496033216 >> v2:172.21.15.184:3300/0 conn(0x7fa8380b2350 msgr2=0x7fa8380d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:28.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.587+0000 7fa837fff700 1 --2- 172.21.15.53:0/496033216 >> v2:172.21.15.184:3300/0 conn(0x7fa8380b2350 0x7fa8380d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:28.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.587+0000 7fa837fff700 1 -- 172.21.15.53:0/496033216 >> v1:172.21.15.53:6789/0 conn(0x7fa8380d1050 legacy=0x7fa8380afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:28.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.587+0000 7fa837fff700 1 -- 172.21.15.53:0/496033216 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8380b3630 con 0x7fa8380b1e00 2023-07-09T21:52:28.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.587+0000 7fa837fff700 1 --2- 172.21.15.53:0/496033216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8380b1e00 0x7fa8380b43f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa838072140 tx=0x7fa828009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600b17bb705b37d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:28.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.587+0000 7fa836ffd700 1 -- 172.21.15.53:0/496033216 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828005e30 con 0x7fa8380b1e00 2023-07-09T21:52:28.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.587+0000 7fa836ffd700 1 -- 172.21.15.53:0/496033216 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa828004030 con 0x7fa8380b1e00 2023-07-09T21:52:28.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.587+0000 7fa836ffd700 1 -- 172.21.15.53:0/496033216 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8280043e0 con 0x7fa8380b1e00 2023-07-09T21:52:28.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.588+0000 7fa83e7ff700 1 -- 172.21.15.53:0/496033216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8380b1e00 msgr2=0x7fa8380b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:28.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.588+0000 7fa83e7ff700 1 --2- 172.21.15.53:0/496033216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8380b1e00 0x7fa8380b43f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa838072140 tx=0x7fa828009bd0 comp rx=0 tx=0).stop 2023-07-09T21:52:28.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.588+0000 7fa83e7ff700 1 -- 172.21.15.53:0/496033216 shutdown_connections 2023-07-09T21:52:28.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.588+0000 7fa83e7ff700 1 --2- 172.21.15.53:0/496033216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8380b1e00 0x7fa8380b43f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:28.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.588+0000 7fa83e7ff700 1 --2- 172.21.15.53:0/496033216 >> v2:172.21.15.184:3300/0 conn(0x7fa8380b2350 0x7fa8380d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:28.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.588+0000 7fa83e7ff700 1 -- 172.21.15.53:0/496033216 >> 172.21.15.53:0/496033216 conn(0x7fa83809c1d0 msgr2=0x7fa8380d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:28.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.588+0000 7fa83e7ff700 1 -- 172.21.15.53:0/496033216 shutdown_connections 2023-07-09T21:52:28.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.588+0000 7fa83e7ff700 1 -- 172.21.15.53:0/496033216 wait complete. 2023-07-09T21:52:28.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.590+0000 7fa83e7ff700 1 Processor -- start 2023-07-09T21:52:28.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.591+0000 7fa83e7ff700 1 -- start start 2023-07-09T21:52:28.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83e7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8380b1e00 0x7fa8380c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:28.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83e7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8380b2350 0x7fa83815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:28.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83e7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8380d1050 0x7fa8380b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:28.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83e7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380c89e0 con 0x7fa8380d1050 2023-07-09T21:52:28.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83e7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83815bc20 con 0x7fa8380b1e00 2023-07-09T21:52:28.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83e7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380c7b30 con 0x7fa8380b2350 2023-07-09T21:52:28.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83cd9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8380d1050 0x7fa8380b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:28.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83cd9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8380d1050 0x7fa8380b6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34800/0 (socket says 172.21.15.53:34800) 2023-07-09T21:52:28.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83cd9c700 1 -- 172.21.15.53:0/3567053408 learned_addr learned my addr 172.21.15.53:0/3567053408 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:28.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa837fff700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8380b1e00 0x7fa8380c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:28.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa8377fe700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8380b2350 0x7fa83815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:28.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83cd9c700 1 -- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8380b2350 msgr2=0x7fa83815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:28.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83cd9c700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8380b2350 0x7fa83815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:28.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83cd9c700 1 -- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8380b1e00 msgr2=0x7fa8380c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:28.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83cd9c700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8380b1e00 0x7fa8380c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:28.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.592+0000 7fa83cd9c700 1 -- 172.21.15.53:0/3567053408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa828009500 con 0x7fa8380d1050 2023-07-09T21:52:28.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.593+0000 7fa83cd9c700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8380d1050 0x7fa8380b6dc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa83000cbc0 tx=0x7fa83000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:28.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.593+0000 7fa834ff9700 1 -- 172.21.15.53:0/3567053408 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83000a9e0 con 0x7fa8380d1050 2023-07-09T21:52:28.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.593+0000 7fa834ff9700 1 -- 172.21.15.53:0/3567053408 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83000ab40 con 0x7fa8380d1050 2023-07-09T21:52:28.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.593+0000 7fa83e7ff700 1 -- 172.21.15.53:0/3567053408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8380c7dd0 con 0x7fa8380d1050 2023-07-09T21:52:28.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.593+0000 7fa834ff9700 1 -- 172.21.15.53:0/3567053408 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830007070 con 0x7fa8380d1050 2023-07-09T21:52:28.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.593+0000 7fa83e7ff700 1 -- 172.21.15.53:0/3567053408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8380c8390 con 0x7fa8380d1050 2023-07-09T21:52:28.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.594+0000 7fa83e7ff700 1 -- 172.21.15.53:0/3567053408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8380b3eb0 con 0x7fa8380d1050 2023-07-09T21:52:28.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.595+0000 7fa834ff9700 1 -- 172.21.15.53:0/3567053408 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fa8300071d0 con 0x7fa8380d1050 2023-07-09T21:52:28.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.596+0000 7fa834ff9700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa82406ad70 0x7fa82406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:28.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.596+0000 7fa834ff9700 1 -- 172.21.15.53:0/3567053408 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa830089160 con 0x7fa8380d1050 2023-07-09T21:52:28.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.597+0000 7fa837fff700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa82406ad70 0x7fa82406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:28.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.597+0000 7fa837fff700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa82406ad70 0x7fa82406d220 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa838072140 tx=0x7fa828008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:28.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.601+0000 7fa834ff9700 1 -- 172.21.15.53:0/3567053408 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa8380b3eb0 con 0x7fa8380d1050 2023-07-09T21:52:28.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.805+0000 7fa83e7ff700 1 -- 172.21.15.53:0/3567053408 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8380b3bf0 con 0x7fa82406ad70 2023-07-09T21:52:28.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.815+0000 7fa834ff9700 1 -- 172.21.15.53:0/3567053408 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311507 (secure 0 0 0) 0x7fa828022070 con 0x7fa82406ad70 2023-07-09T21:52:28.820 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:28.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.819+0000 7fa83e7ff700 1 -- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa82406ad70 msgr2=0x7fa82406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:28.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.819+0000 7fa83e7ff700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa82406ad70 0x7fa82406d220 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa838072140 tx=0x7fa828008070 comp rx=0 tx=0).stop 2023-07-09T21:52:28.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.819+0000 7fa83e7ff700 1 -- 172.21.15.53:0/3567053408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8380d1050 msgr2=0x7fa8380b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:28.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.819+0000 7fa83e7ff700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8380d1050 0x7fa8380b6dc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa83000cbc0 tx=0x7fa83000ced0 comp rx=0 tx=0).stop 2023-07-09T21:52:28.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.819+0000 7fa83e7ff700 1 -- 172.21.15.53:0/3567053408 shutdown_connections 2023-07-09T21:52:28.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.819+0000 7fa83e7ff700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa82406ad70 0x7fa82406d220 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:28.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.819+0000 7fa83e7ff700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8380d1050 0x7fa8380b6dc0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:28.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.819+0000 7fa83e7ff700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8380b1e00 0x7fa8380c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:28.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.819+0000 7fa83e7ff700 1 --2- 172.21.15.53:0/3567053408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8380b2350 0x7fa83815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:28.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.819+0000 7fa83e7ff700 1 -- 172.21.15.53:0/3567053408 >> 172.21.15.53:0/3567053408 conn(0x7fa83809c1d0 msgr2=0x7fa838158530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:28.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.820+0000 7fa83e7ff700 1 -- 172.21.15.53:0/3567053408 shutdown_connections 2023-07-09T21:52:28.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:28.820+0000 7fa83e7ff700 1 -- 172.21.15.53:0/3567053408 wait complete. 2023-07-09T21:52:28.823 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:52:28.839 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-07-09T21:52:26.881076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225576,"kb_used_data":5864,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754749144,"statfs":{"total":773094113280,"available":772863123456,"internally_reserved":0,"allocated":6004736,"data_stored":3241316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002129"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595013+0000","last_change":"2023-07-09T21:52:18.896951+0000","last_active":"2023-07-09T21:52:20.595013+0000","last_peered":"2023-07-09T21:52:20.595013+0000","last_clean":"2023-07-09T21:52:20.595013+0000","last_became_active":"2023-07-09T21:52:18.896617+0000","last_became_peered":"2023-07-09T21:52:18.896617+0000","last_unstale":"2023-07-09T21:52:20.595013+0000","last_undegraded":"2023-07-09T21:52:20.595013+0000","last_fullsized":"2023-07-09T21:52:20.595013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:34.965091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.513082+0000","last_change":"2023-07-09T21:52:18.906798+0000","last_active":"2023-07-09T21:52:20.513082+0000","last_peered":"2023-07-09T21:52:20.513082+0000","last_clean":"2023-07-09T21:52:20.513082+0000","last_became_active":"2023-07-09T21:52:18.906499+0000","last_became_peered":"2023-07-09T21:52:18.906499+0000","last_unstale":"2023-07-09T21:52:20.513082+0000","last_undegraded":"2023-07-09T21:52:20.513082+0000","last_fullsized":"2023-07-09T21:52:20.513082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:59:44.973975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595781+0000","last_change":"2023-07-09T21:52:18.923034+0000","last_active":"2023-07-09T21:52:20.595781+0000","last_peered":"2023-07-09T21:52:20.595781+0000","last_clean":"2023-07-09T21:52:20.595781+0000","last_became_active":"2023-07-09T21:52:18.922368+0000","last_became_peered":"2023-07-09T21:52:18.922368+0000","last_unstale":"2023-07-09T21:52:20.595781+0000","last_undegraded":"2023-07-09T21:52:20.595781+0000","last_fullsized":"2023-07-09T21:52:20.595781+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:31:20.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512805+0000","last_change":"2023-07-09T21:52:18.932684+0000","last_active":"2023-07-09T21:52:20.512805+0000","last_peered":"2023-07-09T21:52:20.512805+0000","last_clean":"2023-07-09T21:52:20.512805+0000","last_became_active":"2023-07-09T21:52:18.932291+0000","last_became_peered":"2023-07-09T21:52:18.932291+0000","last_unstale":"2023-07-09T21:52:20.512805+0000","last_undegraded":"2023-07-09T21:52:20.512805+0000","last_fullsized":"2023-07-09T21:52:20.512805+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:18:31.547364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595378+0000","last_change":"2023-07-09T21:52:18.906085+0000","last_active":"2023-07-09T21:52:20.595378+0000","last_peered":"2023-07-09T21:52:20.595378+0000","last_clean":"2023-07-09T21:52:20.595378+0000","last_became_active":"2023-07-09T21:52:18.905771+0000","last_became_peered":"2023-07-09T21:52:18.905771+0000","last_unstale":"2023-07-09T21:52:20.595378+0000","last_undegraded":"2023-07-09T21:52:20.595378+0000","last_fullsized":"2023-07-09T21:52:20.595378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:14.102629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594906+0000","last_change":"2023-07-09T21:52:18.909739+0000","last_active":"2023-07-09T21:52:20.594906+0000","last_peered":"2023-07-09T21:52:20.594906+0000","last_clean":"2023-07-09T21:52:20.594906+0000","last_became_active":"2023-07-09T21:52:18.906431+0000","last_became_peered":"2023-07-09T21:52:18.906431+0000","last_unstale":"2023-07-09T21:52:20.594906+0000","last_undegraded":"2023-07-09T21:52:20.594906+0000","last_fullsized":"2023-07-09T21:52:20.594906+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:39:50.084070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595369+0000","last_change":"2023-07-09T21:52:18.919260+0000","last_active":"2023-07-09T21:52:20.595369+0000","last_peered":"2023-07-09T21:52:20.595369+0000","last_clean":"2023-07-09T21:52:20.595369+0000","last_became_active":"2023-07-09T21:52:18.918787+0000","last_became_peered":"2023-07-09T21:52:18.918787+0000","last_unstale":"2023-07-09T21:52:20.595369+0000","last_undegraded":"2023-07-09T21:52:20.595369+0000","last_fullsized":"2023-07-09T21:52:20.595369+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:56:23.980518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902201+0000","last_change":"2023-07-09T21:52:18.928885+0000","last_active":"2023-07-09T21:52:19.902201+0000","last_peered":"2023-07-09T21:52:19.902201+0000","last_clean":"2023-07-09T21:52:19.902201+0000","last_became_active":"2023-07-09T21:52:18.928503+0000","last_became_peered":"2023-07-09T21:52:18.928503+0000","last_unstale":"2023-07-09T21:52:19.902201+0000","last_undegraded":"2023-07-09T21:52:19.902201+0000","last_fullsized":"2023-07-09T21:52:19.902201+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:40:03.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902722+0000","last_change":"2023-07-09T21:52:18.929505+0000","last_active":"2023-07-09T21:52:19.902722+0000","last_peered":"2023-07-09T21:52:19.902722+0000","last_clean":"2023-07-09T21:52:19.902722+0000","last_became_active":"2023-07-09T21:52:18.929040+0000","last_became_peered":"2023-07-09T21:52:18.929040+0000","last_unstale":"2023-07-09T21:52:19.902722+0000","last_undegraded":"2023-07-09T21:52:19.902722+0000","last_fullsized":"2023-07-09T21:52:19.902722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:17:36.841569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594980+0000","last_change":"2023-07-09T21:52:18.905734+0000","last_active":"2023-07-09T21:52:20.594980+0000","last_peered":"2023-07-09T21:52:20.594980+0000","last_clean":"2023-07-09T21:52:20.594980+0000","last_became_active":"2023-07-09T21:52:18.905379+0000","last_became_peered":"2023-07-09T21:52:18.905379+0000","last_unstale":"2023-07-09T21:52:20.594980+0000","last_undegraded":"2023-07-09T21:52:20.594980+0000","last_fullsized":"2023-07-09T21:52:20.594980+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:43:53.191291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903567+0000","last_change":"2023-07-09T21:52:18.910192+0000","last_active":"2023-07-09T21:52:19.903567+0000","last_peered":"2023-07-09T21:52:19.903567+0000","last_clean":"2023-07-09T21:52:19.903567+0000","last_became_active":"2023-07-09T21:52:18.909553+0000","last_became_peered":"2023-07-09T21:52:18.909553+0000","last_unstale":"2023-07-09T21:52:19.903567+0000","last_undegraded":"2023-07-09T21:52:19.903567+0000","last_fullsized":"2023-07-09T21:52:19.903567+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:02:06.366605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903545+0000","last_change":"2023-07-09T21:52:18.917117+0000","last_active":"2023-07-09T21:52:19.903545+0000","last_peered":"2023-07-09T21:52:19.903545+0000","last_clean":"2023-07-09T21:52:19.903545+0000","last_became_active":"2023-07-09T21:52:18.916709+0000","last_became_peered":"2023-07-09T21:52:18.916709+0000","last_unstale":"2023-07-09T21:52:19.903545+0000","last_undegraded":"2023-07-09T21:52:19.903545+0000","last_fullsized":"2023-07-09T21:52:19.903545+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:45:21.380456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594883+0000","last_change":"2023-07-09T21:52:18.906003+0000","last_active":"2023-07-09T21:52:20.594883+0000","last_peered":"2023-07-09T21:52:20.594883+0000","last_clean":"2023-07-09T21:52:20.594883+0000","last_became_active":"2023-07-09T21:52:18.905760+0000","last_became_peered":"2023-07-09T21:52:18.905760+0000","last_unstale":"2023-07-09T21:52:20.594883+0000","last_undegraded":"2023-07-09T21:52:20.594883+0000","last_fullsized":"2023-07-09T21:52:20.594883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:00:24.204053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595592+0000","last_change":"2023-07-09T21:52:18.924277+0000","last_active":"2023-07-09T21:52:20.595592+0000","last_peered":"2023-07-09T21:52:20.595592+0000","last_clean":"2023-07-09T21:52:20.595592+0000","last_became_active":"2023-07-09T21:52:18.923822+0000","last_became_peered":"2023-07-09T21:52:18.923822+0000","last_unstale":"2023-07-09T21:52:20.595592+0000","last_undegraded":"2023-07-09T21:52:20.595592+0000","last_fullsized":"2023-07-09T21:52:20.595592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:14.102629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512617+0000","last_change":"2023-07-09T21:52:18.913608+0000","last_active":"2023-07-09T21:52:20.512617+0000","last_peered":"2023-07-09T21:52:20.512617+0000","last_clean":"2023-07-09T21:52:20.512617+0000","last_became_active":"2023-07-09T21:52:18.913309+0000","last_became_peered":"2023-07-09T21:52:18.913309+0000","last_unstale":"2023-07-09T21:52:20.512617+0000","last_undegraded":"2023-07-09T21:52:20.512617+0000","last_fullsized":"2023-07-09T21:52:20.512617+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:47:16.469049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594753+0000","last_change":"2023-07-09T21:52:18.906627+0000","last_active":"2023-07-09T21:52:20.594753+0000","last_peered":"2023-07-09T21:52:20.594753+0000","last_clean":"2023-07-09T21:52:20.594753+0000","last_became_active":"2023-07-09T21:52:18.906352+0000","last_became_peered":"2023-07-09T21:52:18.906352+0000","last_unstale":"2023-07-09T21:52:20.594753+0000","last_undegraded":"2023-07-09T21:52:20.594753+0000","last_fullsized":"2023-07-09T21:52:20.594753+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:07.549932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.596101+0000","last_change":"2023-07-09T21:52:18.909088+0000","last_active":"2023-07-09T21:52:20.596101+0000","last_peered":"2023-07-09T21:52:20.596101+0000","last_clean":"2023-07-09T21:52:20.596101+0000","last_became_active":"2023-07-09T21:52:18.908791+0000","last_became_peered":"2023-07-09T21:52:18.908791+0000","last_unstale":"2023-07-09T21:52:20.596101+0000","last_undegraded":"2023-07-09T21:52:20.596101+0000","last_fullsized":"2023-07-09T21:52:20.596101+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:45:21.380456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.513119+0000","last_change":"2023-07-09T21:52:18.913993+0000","last_active":"2023-07-09T21:52:20.513119+0000","last_peered":"2023-07-09T21:52:20.513119+0000","last_clean":"2023-07-09T21:52:20.513119+0000","last_became_active":"2023-07-09T21:52:18.913556+0000","last_became_peered":"2023-07-09T21:52:18.913556+0000","last_unstale":"2023-07-09T21:52:20.513119+0000","last_undegraded":"2023-07-09T21:52:20.513119+0000","last_fullsized":"2023-07-09T21:52:20.513119+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:22:40.394416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595930+0000","last_change":"2023-07-09T21:52:18.923195+0000","last_active":"2023-07-09T21:52:20.595930+0000","last_peered":"2023-07-09T21:52:20.595930+0000","last_clean":"2023-07-09T21:52:20.595930+0000","last_became_active":"2023-07-09T21:52:18.922764+0000","last_became_peered":"2023-07-09T21:52:18.922764+0000","last_unstale":"2023-07-09T21:52:20.595930+0000","last_undegraded":"2023-07-09T21:52:20.595930+0000","last_fullsized":"2023-07-09T21:52:20.595930+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:19:47.253311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.556005+0000","last_change":"2023-07-09T21:52:18.909470+0000","last_active":"2023-07-09T21:52:20.556005+0000","last_peered":"2023-07-09T21:52:20.556005+0000","last_clean":"2023-07-09T21:52:20.556005+0000","last_became_active":"2023-07-09T21:52:18.909176+0000","last_became_peered":"2023-07-09T21:52:18.909176+0000","last_unstale":"2023-07-09T21:52:20.556005+0000","last_undegraded":"2023-07-09T21:52:20.556005+0000","last_fullsized":"2023-07-09T21:52:20.556005+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:10:40.266061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555912+0000","last_change":"2023-07-09T21:52:18.908718+0000","last_active":"2023-07-09T21:52:20.555912+0000","last_peered":"2023-07-09T21:52:20.555912+0000","last_clean":"2023-07-09T21:52:20.555912+0000","last_became_active":"2023-07-09T21:52:18.908409+0000","last_became_peered":"2023-07-09T21:52:18.908409+0000","last_unstale":"2023-07-09T21:52:20.555912+0000","last_undegraded":"2023-07-09T21:52:20.555912+0000","last_fullsized":"2023-07-09T21:52:20.555912+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:01:34.153114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902304+0000","last_change":"2023-07-09T21:52:18.929332+0000","last_active":"2023-07-09T21:52:19.902304+0000","last_peered":"2023-07-09T21:52:19.902304+0000","last_clean":"2023-07-09T21:52:19.902304+0000","last_became_active":"2023-07-09T21:52:18.928979+0000","last_became_peered":"2023-07-09T21:52:18.928979+0000","last_unstale":"2023-07-09T21:52:19.902304+0000","last_undegraded":"2023-07-09T21:52:19.902304+0000","last_fullsized":"2023-07-09T21:52:19.902304+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:29.682846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902921+0000","last_change":"2023-07-09T21:52:18.898859+0000","last_active":"2023-07-09T21:52:19.902921+0000","last_peered":"2023-07-09T21:52:19.902921+0000","last_clean":"2023-07-09T21:52:19.902921+0000","last_became_active":"2023-07-09T21:52:18.898644+0000","last_became_peered":"2023-07-09T21:52:18.898644+0000","last_unstale":"2023-07-09T21:52:19.902921+0000","last_undegraded":"2023-07-09T21:52:19.902921+0000","last_fullsized":"2023-07-09T21:52:19.902921+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:22:37.253358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594793+0000","last_change":"2023-07-09T21:52:18.922310+0000","last_active":"2023-07-09T21:52:20.594793+0000","last_peered":"2023-07-09T21:52:20.594793+0000","last_clean":"2023-07-09T21:52:20.594793+0000","last_became_active":"2023-07-09T21:52:18.921979+0000","last_became_peered":"2023-07-09T21:52:18.921979+0000","last_unstale":"2023-07-09T21:52:20.594793+0000","last_undegraded":"2023-07-09T21:52:20.594793+0000","last_fullsized":"2023-07-09T21:52:20.594793+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:12:52.313544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.596020+0000","last_change":"2023-07-09T21:52:18.923872+0000","last_active":"2023-07-09T21:52:20.596020+0000","last_peered":"2023-07-09T21:52:20.596020+0000","last_clean":"2023-07-09T21:52:20.596020+0000","last_became_active":"2023-07-09T21:52:18.923384+0000","last_became_peered":"2023-07-09T21:52:18.923384+0000","last_unstale":"2023-07-09T21:52:20.596020+0000","last_undegraded":"2023-07-09T21:52:20.596020+0000","last_fullsized":"2023-07-09T21:52:20.596020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:21:13.322563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902746+0000","last_change":"2023-07-09T21:52:18.912520+0000","last_active":"2023-07-09T21:52:19.902746+0000","last_peered":"2023-07-09T21:52:19.902746+0000","last_clean":"2023-07-09T21:52:19.902746+0000","last_became_active":"2023-07-09T21:52:18.911959+0000","last_became_peered":"2023-07-09T21:52:18.911959+0000","last_unstale":"2023-07-09T21:52:19.902746+0000","last_undegraded":"2023-07-09T21:52:19.902746+0000","last_fullsized":"2023-07-09T21:52:19.902746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:46:29.694801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595330+0000","last_change":"2023-07-09T21:52:18.926059+0000","last_active":"2023-07-09T21:52:20.595330+0000","last_peered":"2023-07-09T21:52:20.595330+0000","last_clean":"2023-07-09T21:52:20.595330+0000","last_became_active":"2023-07-09T21:52:18.925784+0000","last_became_peered":"2023-07-09T21:52:18.925784+0000","last_unstale":"2023-07-09T21:52:20.595330+0000","last_undegraded":"2023-07-09T21:52:20.595330+0000","last_fullsized":"2023-07-09T21:52:20.595330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:28:16.208382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.556051+0000","last_change":"2023-07-09T21:52:18.912969+0000","last_active":"2023-07-09T21:52:20.556051+0000","last_peered":"2023-07-09T21:52:20.556051+0000","last_clean":"2023-07-09T21:52:20.556051+0000","last_became_active":"2023-07-09T21:52:18.912699+0000","last_became_peered":"2023-07-09T21:52:18.912699+0000","last_unstale":"2023-07-09T21:52:20.556051+0000","last_undegraded":"2023-07-09T21:52:20.556051+0000","last_fullsized":"2023-07-09T21:52:20.556051+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:44.039781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595463+0000","last_change":"2023-07-09T21:52:18.922844+0000","last_active":"2023-07-09T21:52:20.595463+0000","last_peered":"2023-07-09T21:52:20.595463+0000","last_clean":"2023-07-09T21:52:20.595463+0000","last_became_active":"2023-07-09T21:52:18.922541+0000","last_became_peered":"2023-07-09T21:52:18.922541+0000","last_unstale":"2023-07-09T21:52:20.595463+0000","last_undegraded":"2023-07-09T21:52:20.595463+0000","last_fullsized":"2023-07-09T21:52:20.595463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:29:28.754474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512570+0000","last_change":"2023-07-09T21:52:18.925934+0000","last_active":"2023-07-09T21:52:20.512570+0000","last_peered":"2023-07-09T21:52:20.512570+0000","last_clean":"2023-07-09T21:52:20.512570+0000","last_became_active":"2023-07-09T21:52:18.925687+0000","last_became_peered":"2023-07-09T21:52:18.925687+0000","last_unstale":"2023-07-09T21:52:20.512570+0000","last_undegraded":"2023-07-09T21:52:20.512570+0000","last_fullsized":"2023-07-09T21:52:20.512570+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:55:00.079307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595564+0000","last_change":"2023-07-09T21:52:18.919066+0000","last_active":"2023-07-09T21:52:20.595564+0000","last_peered":"2023-07-09T21:52:20.595564+0000","last_clean":"2023-07-09T21:52:20.595564+0000","last_became_active":"2023-07-09T21:52:18.918418+0000","last_became_peered":"2023-07-09T21:52:18.918418+0000","last_unstale":"2023-07-09T21:52:20.595564+0000","last_undegraded":"2023-07-09T21:52:20.595564+0000","last_fullsized":"2023-07-09T21:52:20.595564+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:02:23.061639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903980+0000","last_change":"2023-07-09T21:52:18.917337+0000","last_active":"2023-07-09T21:52:19.903980+0000","last_peered":"2023-07-09T21:52:19.903980+0000","last_clean":"2023-07-09T21:52:19.903980+0000","last_became_active":"2023-07-09T21:52:18.916997+0000","last_became_peered":"2023-07-09T21:52:18.916997+0000","last_unstale":"2023-07-09T21:52:19.903980+0000","last_undegraded":"2023-07-09T21:52:19.903980+0000","last_fullsized":"2023-07-09T21:52:19.903980+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:40:58.939980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512418+0000","last_change":"2023-07-09T21:52:18.906661+0000","last_active":"2023-07-09T21:52:20.512418+0000","last_peered":"2023-07-09T21:52:20.512418+0000","last_clean":"2023-07-09T21:52:20.512418+0000","last_became_active":"2023-07-09T21:52:18.906392+0000","last_became_peered":"2023-07-09T21:52:18.906392+0000","last_unstale":"2023-07-09T21:52:20.512418+0000","last_undegraded":"2023-07-09T21:52:20.512418+0000","last_fullsized":"2023-07-09T21:52:20.512418+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:52:23.101621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555794+0000","last_change":"2023-07-09T21:52:17.905074+0000","last_active":"2023-07-09T21:52:20.555794+0000","last_peered":"2023-07-09T21:52:20.555794+0000","last_clean":"2023-07-09T21:52:20.555794+0000","last_became_active":"2023-07-09T21:52:17.904791+0000","last_became_peered":"2023-07-09T21:52:17.904791+0000","last_unstale":"2023-07-09T21:52:20.555794+0000","last_undegraded":"2023-07-09T21:52:20.555794+0000","last_fullsized":"2023-07-09T21:52:20.555794+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:02:05.359638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904364+0000","last_change":"2023-07-09T21:52:18.898797+0000","last_active":"2023-07-09T21:52:19.904364+0000","last_peered":"2023-07-09T21:52:19.904364+0000","last_clean":"2023-07-09T21:52:19.904364+0000","last_became_active":"2023-07-09T21:52:18.898476+0000","last_became_peered":"2023-07-09T21:52:18.898476+0000","last_unstale":"2023-07-09T21:52:19.904364+0000","last_undegraded":"2023-07-09T21:52:19.904364+0000","last_fullsized":"2023-07-09T21:52:19.904364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:18:35.836151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595123+0000","last_change":"2023-07-09T21:52:17.903525+0000","last_active":"2023-07-09T21:52:20.595123+0000","last_peered":"2023-07-09T21:52:20.595123+0000","last_clean":"2023-07-09T21:52:20.595123+0000","last_became_active":"2023-07-09T21:52:17.900909+0000","last_became_peered":"2023-07-09T21:52:17.900909+0000","last_unstale":"2023-07-09T21:52:20.595123+0000","last_undegraded":"2023-07-09T21:52:20.595123+0000","last_fullsized":"2023-07-09T21:52:20.595123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:51.390709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555603+0000","last_change":"2023-07-09T21:52:18.909934+0000","last_active":"2023-07-09T21:52:20.555603+0000","last_peered":"2023-07-09T21:52:20.555603+0000","last_clean":"2023-07-09T21:52:20.555603+0000","last_became_active":"2023-07-09T21:52:18.909657+0000","last_became_peered":"2023-07-09T21:52:18.909657+0000","last_unstale":"2023-07-09T21:52:20.555603+0000","last_undegraded":"2023-07-09T21:52:20.555603+0000","last_fullsized":"2023-07-09T21:52:20.555603+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:22:37.253358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595468+0000","last_change":"2023-07-09T21:52:17.909999+0000","last_active":"2023-07-09T21:52:20.595468+0000","last_peered":"2023-07-09T21:52:20.595468+0000","last_clean":"2023-07-09T21:52:20.595468+0000","last_became_active":"2023-07-09T21:52:17.909580+0000","last_became_peered":"2023-07-09T21:52:17.909580+0000","last_unstale":"2023-07-09T21:52:20.595468+0000","last_undegraded":"2023-07-09T21:52:20.595468+0000","last_fullsized":"2023-07-09T21:52:20.595468+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:51.857256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902463+0000","last_change":"2023-07-09T21:52:18.911614+0000","last_active":"2023-07-09T21:52:19.902463+0000","last_peered":"2023-07-09T21:52:19.902463+0000","last_clean":"2023-07-09T21:52:19.902463+0000","last_became_active":"2023-07-09T21:52:18.911314+0000","last_became_peered":"2023-07-09T21:52:18.911314+0000","last_unstale":"2023-07-09T21:52:19.902463+0000","last_undegraded":"2023-07-09T21:52:19.902463+0000","last_fullsized":"2023-07-09T21:52:19.902463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:12.665376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904394+0000","last_change":"2023-07-09T21:52:17.903946+0000","last_active":"2023-07-09T21:52:19.904394+0000","last_peered":"2023-07-09T21:52:19.904394+0000","last_clean":"2023-07-09T21:52:19.904394+0000","last_became_active":"2023-07-09T21:52:17.903690+0000","last_became_peered":"2023-07-09T21:52:17.903690+0000","last_unstale":"2023-07-09T21:52:19.904394+0000","last_undegraded":"2023-07-09T21:52:19.904394+0000","last_fullsized":"2023-07-09T21:52:19.904394+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:54:59.072340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595504+0000","last_change":"2023-07-09T21:52:18.925285+0000","last_active":"2023-07-09T21:52:20.595504+0000","last_peered":"2023-07-09T21:52:20.595504+0000","last_clean":"2023-07-09T21:52:20.595504+0000","last_became_active":"2023-07-09T21:52:18.924973+0000","last_became_peered":"2023-07-09T21:52:18.924973+0000","last_unstale":"2023-07-09T21:52:20.595504+0000","last_undegraded":"2023-07-09T21:52:20.595504+0000","last_fullsized":"2023-07-09T21:52:20.595504+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:22:47.938868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595628+0000","last_change":"2023-07-09T21:52:17.914742+0000","last_active":"2023-07-09T21:52:20.595628+0000","last_peered":"2023-07-09T21:52:20.595628+0000","last_clean":"2023-07-09T21:52:20.595628+0000","last_became_active":"2023-07-09T21:52:17.914452+0000","last_became_peered":"2023-07-09T21:52:17.914452+0000","last_unstale":"2023-07-09T21:52:20.595628+0000","last_undegraded":"2023-07-09T21:52:20.595628+0000","last_fullsized":"2023-07-09T21:52:20.595628+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:28.675879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512819+0000","last_change":"2023-07-09T21:52:18.921844+0000","last_active":"2023-07-09T21:52:20.512819+0000","last_peered":"2023-07-09T21:52:20.512819+0000","last_clean":"2023-07-09T21:52:20.512819+0000","last_became_active":"2023-07-09T21:52:18.921381+0000","last_became_peered":"2023-07-09T21:52:18.921381+0000","last_unstale":"2023-07-09T21:52:20.512819+0000","last_undegraded":"2023-07-09T21:52:20.512819+0000","last_fullsized":"2023-07-09T21:52:20.512819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:22:50.768814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595185+0000","last_change":"2023-07-09T21:52:17.901241+0000","last_active":"2023-07-09T21:52:20.595185+0000","last_peered":"2023-07-09T21:52:20.595185+0000","last_clean":"2023-07-09T21:52:20.595185+0000","last_became_active":"2023-07-09T21:52:17.900934+0000","last_became_peered":"2023-07-09T21:52:17.900934+0000","last_unstale":"2023-07-09T21:52:20.595185+0000","last_undegraded":"2023-07-09T21:52:20.595185+0000","last_fullsized":"2023-07-09T21:52:20.595185+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:40:02.015596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902622+0000","last_change":"2023-07-09T21:52:18.917563+0000","last_active":"2023-07-09T21:52:19.902622+0000","last_peered":"2023-07-09T21:52:19.902622+0000","last_clean":"2023-07-09T21:52:19.902622+0000","last_became_active":"2023-07-09T21:52:18.917229+0000","last_became_peered":"2023-07-09T21:52:18.917229+0000","last_unstale":"2023-07-09T21:52:19.902622+0000","last_undegraded":"2023-07-09T21:52:19.902622+0000","last_fullsized":"2023-07-09T21:52:19.902622+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:31:20.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555576+0000","last_change":"2023-07-09T21:52:17.905888+0000","last_active":"2023-07-09T21:52:20.555576+0000","last_peered":"2023-07-09T21:52:20.555576+0000","last_clean":"2023-07-09T21:52:20.555576+0000","last_became_active":"2023-07-09T21:52:17.905601+0000","last_became_peered":"2023-07-09T21:52:17.905601+0000","last_unstale":"2023-07-09T21:52:20.555576+0000","last_undegraded":"2023-07-09T21:52:20.555576+0000","last_fullsized":"2023-07-09T21:52:20.555576+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:36:33.580515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512998+0000","last_change":"2023-07-09T21:52:18.927211+0000","last_active":"2023-07-09T21:52:20.512998+0000","last_peered":"2023-07-09T21:52:20.512998+0000","last_clean":"2023-07-09T21:52:20.512998+0000","last_became_active":"2023-07-09T21:52:18.926919+0000","last_became_peered":"2023-07-09T21:52:18.926919+0000","last_unstale":"2023-07-09T21:52:20.512998+0000","last_undegraded":"2023-07-09T21:52:20.512998+0000","last_fullsized":"2023-07-09T21:52:20.512998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:06:46.376234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594947+0000","last_change":"2023-07-09T21:52:17.908242+0000","last_active":"2023-07-09T21:52:20.594947+0000","last_peered":"2023-07-09T21:52:20.594947+0000","last_clean":"2023-07-09T21:52:20.594947+0000","last_became_active":"2023-07-09T21:52:17.907897+0000","last_became_peered":"2023-07-09T21:52:17.907897+0000","last_unstale":"2023-07-09T21:52:20.594947+0000","last_undegraded":"2023-07-09T21:52:20.594947+0000","last_fullsized":"2023-07-09T21:52:20.594947+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:57:00.640426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595130+0000","last_change":"2023-07-09T21:52:18.916918+0000","last_active":"2023-07-09T21:52:20.595130+0000","last_peered":"2023-07-09T21:52:20.595130+0000","last_clean":"2023-07-09T21:52:20.595130+0000","last_became_active":"2023-07-09T21:52:18.916633+0000","last_became_peered":"2023-07-09T21:52:18.916633+0000","last_unstale":"2023-07-09T21:52:20.595130+0000","last_undegraded":"2023-07-09T21:52:20.595130+0000","last_fullsized":"2023-07-09T21:52:20.595130+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:02:23.061639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512964+0000","last_change":"2023-07-09T21:52:17.902773+0000","last_active":"2023-07-09T21:52:20.512964+0000","last_peered":"2023-07-09T21:52:20.512964+0000","last_clean":"2023-07-09T21:52:20.512964+0000","last_became_active":"2023-07-09T21:52:17.902245+0000","last_became_peered":"2023-07-09T21:52:17.902245+0000","last_unstale":"2023-07-09T21:52:20.512964+0000","last_undegraded":"2023-07-09T21:52:20.512964+0000","last_fullsized":"2023-07-09T21:52:20.512964+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:14:37.682718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904034+0000","last_change":"2023-07-09T21:52:18.901889+0000","last_active":"2023-07-09T21:52:19.904034+0000","last_peered":"2023-07-09T21:52:19.904034+0000","last_clean":"2023-07-09T21:52:19.904034+0000","last_became_active":"2023-07-09T21:52:18.901597+0000","last_became_peered":"2023-07-09T21:52:18.901597+0000","last_unstale":"2023-07-09T21:52:19.904034+0000","last_undegraded":"2023-07-09T21:52:19.904034+0000","last_fullsized":"2023-07-09T21:52:19.904034+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:19:08.639665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595459+0000","last_change":"2023-07-09T21:52:17.907414+0000","last_active":"2023-07-09T21:52:20.595459+0000","last_peered":"2023-07-09T21:52:20.595459+0000","last_clean":"2023-07-09T21:52:20.595459+0000","last_became_active":"2023-07-09T21:52:17.906862+0000","last_became_peered":"2023-07-09T21:52:17.906862+0000","last_unstale":"2023-07-09T21:52:20.595459+0000","last_undegraded":"2023-07-09T21:52:20.595459+0000","last_fullsized":"2023-07-09T21:52:20.595459+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:28.675879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595765+0000","last_change":"2023-07-09T21:52:18.924175+0000","last_active":"2023-07-09T21:52:20.595765+0000","last_peered":"2023-07-09T21:52:20.595765+0000","last_clean":"2023-07-09T21:52:20.595765+0000","last_became_active":"2023-07-09T21:52:18.923516+0000","last_became_peered":"2023-07-09T21:52:18.923516+0000","last_unstale":"2023-07-09T21:52:20.595765+0000","last_undegraded":"2023-07-09T21:52:20.595765+0000","last_fullsized":"2023-07-09T21:52:20.595765+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:11:34.515460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.513036+0000","last_change":"2023-07-09T21:52:17.916134+0000","last_active":"2023-07-09T21:52:20.513036+0000","last_peered":"2023-07-09T21:52:20.513036+0000","last_clean":"2023-07-09T21:52:20.513036+0000","last_became_active":"2023-07-09T21:52:17.915830+0000","last_became_peered":"2023-07-09T21:52:17.915830+0000","last_unstale":"2023-07-09T21:52:20.513036+0000","last_undegraded":"2023-07-09T21:52:20.513036+0000","last_fullsized":"2023-07-09T21:52:20.513036+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:59:52.123332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595474+0000","last_change":"2023-07-09T21:52:18.913106+0000","last_active":"2023-07-09T21:52:20.595474+0000","last_peered":"2023-07-09T21:52:20.595474+0000","last_clean":"2023-07-09T21:52:20.595474+0000","last_became_active":"2023-07-09T21:52:18.912827+0000","last_became_peered":"2023-07-09T21:52:18.912827+0000","last_unstale":"2023-07-09T21:52:20.595474+0000","last_undegraded":"2023-07-09T21:52:20.595474+0000","last_fullsized":"2023-07-09T21:52:20.595474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:01:03.868728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903644+0000","last_change":"2023-07-09T21:52:17.906739+0000","last_active":"2023-07-09T21:52:19.903644+0000","last_peered":"2023-07-09T21:52:19.903644+0000","last_clean":"2023-07-09T21:52:19.903644+0000","last_became_active":"2023-07-09T21:52:17.906459+0000","last_became_peered":"2023-07-09T21:52:17.906459+0000","last_unstale":"2023-07-09T21:52:19.903644+0000","last_undegraded":"2023-07-09T21:52:19.903644+0000","last_fullsized":"2023-07-09T21:52:19.903644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:32:02.218437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904420+0000","last_change":"2023-07-09T21:52:18.898730+0000","last_active":"2023-07-09T21:52:19.904420+0000","last_peered":"2023-07-09T21:52:19.904420+0000","last_clean":"2023-07-09T21:52:19.904420+0000","last_became_active":"2023-07-09T21:52:18.898426+0000","last_became_peered":"2023-07-09T21:52:18.898426+0000","last_unstale":"2023-07-09T21:52:19.904420+0000","last_undegraded":"2023-07-09T21:52:19.904420+0000","last_fullsized":"2023-07-09T21:52:19.904420+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:47:16.469049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595738+0000","last_change":"2023-07-09T21:52:17.908750+0000","last_active":"2023-07-09T21:52:20.595738+0000","last_peered":"2023-07-09T21:52:20.595738+0000","last_clean":"2023-07-09T21:52:20.595738+0000","last_became_active":"2023-07-09T21:52:17.908498+0000","last_became_peered":"2023-07-09T21:52:17.908498+0000","last_unstale":"2023-07-09T21:52:20.595738+0000","last_undegraded":"2023-07-09T21:52:20.595738+0000","last_fullsized":"2023-07-09T21:52:20.595738+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:22:46.931900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.596021+0000","last_change":"2023-07-09T21:52:18.922130+0000","last_active":"2023-07-09T21:52:20.596021+0000","last_peered":"2023-07-09T21:52:20.596021+0000","last_clean":"2023-07-09T21:52:20.596021+0000","last_became_active":"2023-07-09T21:52:18.921840+0000","last_became_peered":"2023-07-09T21:52:18.921840+0000","last_unstale":"2023-07-09T21:52:20.596021+0000","last_undegraded":"2023-07-09T21:52:20.596021+0000","last_fullsized":"2023-07-09T21:52:20.596021+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:12.665376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555783+0000","last_change":"2023-07-09T21:52:17.913662+0000","last_active":"2023-07-09T21:52:20.555783+0000","last_peered":"2023-07-09T21:52:20.555783+0000","last_clean":"2023-07-09T21:52:20.555783+0000","last_became_active":"2023-07-09T21:52:17.913376+0000","last_became_peered":"2023-07-09T21:52:17.913376+0000","last_unstale":"2023-07-09T21:52:20.555783+0000","last_undegraded":"2023-07-09T21:52:20.555783+0000","last_fullsized":"2023-07-09T21:52:20.555783+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:29:38.675674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902469+0000","last_change":"2023-07-09T21:52:18.912743+0000","last_active":"2023-07-09T21:52:19.902469+0000","last_peered":"2023-07-09T21:52:19.902469+0000","last_clean":"2023-07-09T21:52:19.902469+0000","last_became_active":"2023-07-09T21:52:18.912257+0000","last_became_peered":"2023-07-09T21:52:18.912257+0000","last_unstale":"2023-07-09T21:52:19.902469+0000","last_undegraded":"2023-07-09T21:52:19.902469+0000","last_fullsized":"2023-07-09T21:52:19.902469+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:22:47.938868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512677+0000","last_change":"2023-07-09T21:52:17.906064+0000","last_active":"2023-07-09T21:52:20.512677+0000","last_peered":"2023-07-09T21:52:20.512677+0000","last_clean":"2023-07-09T21:52:20.512677+0000","last_became_active":"2023-07-09T21:52:17.905765+0000","last_became_peered":"2023-07-09T21:52:17.905765+0000","last_unstale":"2023-07-09T21:52:20.512677+0000","last_undegraded":"2023-07-09T21:52:20.512677+0000","last_fullsized":"2023-07-09T21:52:20.512677+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:17:45.762909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.596031+0000","last_change":"2023-07-09T21:52:18.922888+0000","last_active":"2023-07-09T21:52:20.596031+0000","last_peered":"2023-07-09T21:52:20.596031+0000","last_clean":"2023-07-09T21:52:20.596031+0000","last_became_active":"2023-07-09T21:52:18.922489+0000","last_became_peered":"2023-07-09T21:52:18.922489+0000","last_unstale":"2023-07-09T21:52:20.596031+0000","last_undegraded":"2023-07-09T21:52:20.596031+0000","last_fullsized":"2023-07-09T21:52:20.596031+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:48:23.971303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902446+0000","last_change":"2023-07-09T21:52:17.906688+0000","last_active":"2023-07-09T21:52:19.902446+0000","last_peered":"2023-07-09T21:52:19.902446+0000","last_clean":"2023-07-09T21:52:19.902446+0000","last_became_active":"2023-07-09T21:52:17.906355+0000","last_became_peered":"2023-07-09T21:52:17.906355+0000","last_unstale":"2023-07-09T21:52:19.902446+0000","last_undegraded":"2023-07-09T21:52:19.902446+0000","last_fullsized":"2023-07-09T21:52:19.902446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:01:02.861760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902201+0000","last_change":"2023-07-09T21:52:18.914307+0000","last_active":"2023-07-09T21:52:19.902201+0000","last_peered":"2023-07-09T21:52:19.902201+0000","last_clean":"2023-07-09T21:52:19.902201+0000","last_became_active":"2023-07-09T21:52:18.914040+0000","last_became_peered":"2023-07-09T21:52:18.914040+0000","last_unstale":"2023-07-09T21:52:19.902201+0000","last_undegraded":"2023-07-09T21:52:19.902201+0000","last_fullsized":"2023-07-09T21:52:19.902201+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:14.102629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595913+0000","last_change":"2023-07-09T21:52:17.915757+0000","last_active":"2023-07-09T21:52:20.595913+0000","last_peered":"2023-07-09T21:52:20.595913+0000","last_clean":"2023-07-09T21:52:20.595913+0000","last_became_active":"2023-07-09T21:52:17.915396+0000","last_became_peered":"2023-07-09T21:52:17.915396+0000","last_unstale":"2023-07-09T21:52:20.595913+0000","last_undegraded":"2023-07-09T21:52:20.595913+0000","last_fullsized":"2023-07-09T21:52:20.595913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:46:28.687834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594759+0000","last_change":"2023-07-09T21:52:18.926116+0000","last_active":"2023-07-09T21:52:20.594759+0000","last_peered":"2023-07-09T21:52:20.594759+0000","last_clean":"2023-07-09T21:52:20.594759+0000","last_became_active":"2023-07-09T21:52:18.925663+0000","last_became_peered":"2023-07-09T21:52:18.925663+0000","last_unstale":"2023-07-09T21:52:20.594759+0000","last_undegraded":"2023-07-09T21:52:20.594759+0000","last_fullsized":"2023-07-09T21:52:20.594759+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:19:09.676297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903125+0000","last_change":"2023-07-09T21:52:17.908662+0000","last_active":"2023-07-09T21:52:19.903125+0000","last_peered":"2023-07-09T21:52:19.903125+0000","last_clean":"2023-07-09T21:52:19.903125+0000","last_became_active":"2023-07-09T21:52:17.908390+0000","last_became_peered":"2023-07-09T21:52:17.908390+0000","last_unstale":"2023-07-09T21:52:19.903125+0000","last_undegraded":"2023-07-09T21:52:19.903125+0000","last_fullsized":"2023-07-09T21:52:19.903125+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:29:38.675674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595136+0000","last_change":"2023-07-09T21:52:18.925491+0000","last_active":"2023-07-09T21:52:20.595136+0000","last_peered":"2023-07-09T21:52:20.595136+0000","last_clean":"2023-07-09T21:52:20.595136+0000","last_became_active":"2023-07-09T21:52:18.925165+0000","last_became_peered":"2023-07-09T21:52:18.925165+0000","last_unstale":"2023-07-09T21:52:20.595136+0000","last_undegraded":"2023-07-09T21:52:20.595136+0000","last_fullsized":"2023-07-09T21:52:20.595136+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:29:28.754474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.556187+0000","last_change":"2023-07-09T21:52:17.905001+0000","last_active":"2023-07-09T21:52:20.556187+0000","last_peered":"2023-07-09T21:52:20.556187+0000","last_clean":"2023-07-09T21:52:20.556187+0000","last_became_active":"2023-07-09T21:52:17.904624+0000","last_became_peered":"2023-07-09T21:52:17.904624+0000","last_unstale":"2023-07-09T21:52:20.556187+0000","last_undegraded":"2023-07-09T21:52:20.556187+0000","last_fullsized":"2023-07-09T21:52:20.556187+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:39:02.442720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595045+0000","last_change":"2023-07-09T21:52:18.894463+0000","last_active":"2023-07-09T21:52:20.595045+0000","last_peered":"2023-07-09T21:52:20.595045+0000","last_clean":"2023-07-09T21:52:20.595045+0000","last_became_active":"2023-07-09T21:52:18.894175+0000","last_became_peered":"2023-07-09T21:52:18.894175+0000","last_unstale":"2023-07-09T21:52:20.595045+0000","last_undegraded":"2023-07-09T21:52:20.595045+0000","last_fullsized":"2023-07-09T21:52:20.595045+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:32:06.281504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555855+0000","last_change":"2023-07-09T21:52:17.904083+0000","last_active":"2023-07-09T21:52:20.555855+0000","last_peered":"2023-07-09T21:52:20.555855+0000","last_clean":"2023-07-09T21:52:20.555855+0000","last_became_active":"2023-07-09T21:52:17.903804+0000","last_became_peered":"2023-07-09T21:52:17.903804+0000","last_unstale":"2023-07-09T21:52:20.555855+0000","last_undegraded":"2023-07-09T21:52:20.555855+0000","last_fullsized":"2023-07-09T21:52:20.555855+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:56:03.315636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904142+0000","last_change":"2023-07-09T21:52:18.902562+0000","last_active":"2023-07-09T21:52:19.904142+0000","last_peered":"2023-07-09T21:52:19.904142+0000","last_clean":"2023-07-09T21:52:19.904142+0000","last_became_active":"2023-07-09T21:52:18.902303+0000","last_became_peered":"2023-07-09T21:52:18.902303+0000","last_unstale":"2023-07-09T21:52:19.904142+0000","last_undegraded":"2023-07-09T21:52:19.904142+0000","last_fullsized":"2023-07-09T21:52:19.904142+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:08:28.314748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.594966+0000","last_change":"2023-07-09T21:52:17.901130+0000","last_active":"2023-07-09T21:52:20.594966+0000","last_peered":"2023-07-09T21:52:20.594966+0000","last_clean":"2023-07-09T21:52:20.594966+0000","last_became_active":"2023-07-09T21:52:17.900760+0000","last_became_peered":"2023-07-09T21:52:17.900760+0000","last_unstale":"2023-07-09T21:52:20.594966+0000","last_undegraded":"2023-07-09T21:52:20.594966+0000","last_fullsized":"2023-07-09T21:52:20.594966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:29:58.763717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555956+0000","last_change":"2023-07-09T21:52:18.912184+0000","last_active":"2023-07-09T21:52:20.555956+0000","last_peered":"2023-07-09T21:52:20.555956+0000","last_clean":"2023-07-09T21:52:20.555956+0000","last_became_active":"2023-07-09T21:52:18.911938+0000","last_became_peered":"2023-07-09T21:52:18.911938+0000","last_unstale":"2023-07-09T21:52:20.555956+0000","last_undegraded":"2023-07-09T21:52:20.555956+0000","last_fullsized":"2023-07-09T21:52:20.555956+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:09:30.618896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902888+0000","last_change":"2023-07-09T21:52:17.903707+0000","last_active":"2023-07-09T21:52:19.902888+0000","last_peered":"2023-07-09T21:52:19.902888+0000","last_clean":"2023-07-09T21:52:19.902888+0000","last_became_active":"2023-07-09T21:52:17.903434+0000","last_became_peered":"2023-07-09T21:52:17.903434+0000","last_unstale":"2023-07-09T21:52:19.902888+0000","last_undegraded":"2023-07-09T21:52:19.902888+0000","last_fullsized":"2023-07-09T21:52:19.902888+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:19:46.246344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595731+0000","last_change":"2023-07-09T21:52:18.923992+0000","last_active":"2023-07-09T21:52:20.595731+0000","last_peered":"2023-07-09T21:52:20.595731+0000","last_clean":"2023-07-09T21:52:20.595731+0000","last_became_active":"2023-07-09T21:52:18.923404+0000","last_became_peered":"2023-07-09T21:52:18.923404+0000","last_unstale":"2023-07-09T21:52:20.595731+0000","last_undegraded":"2023-07-09T21:52:20.595731+0000","last_fullsized":"2023-07-09T21:52:20.595731+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:01:03.868728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595367+0000","last_change":"2023-07-09T21:52:17.916113+0000","last_active":"2023-07-09T21:52:20.595367+0000","last_peered":"2023-07-09T21:52:20.595367+0000","last_clean":"2023-07-09T21:52:20.595367+0000","last_became_active":"2023-07-09T21:52:17.915785+0000","last_became_peered":"2023-07-09T21:52:17.915785+0000","last_unstale":"2023-07-09T21:52:20.595367+0000","last_undegraded":"2023-07-09T21:52:20.595367+0000","last_fullsized":"2023-07-09T21:52:20.595367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:00:28.708380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595303+0000","last_change":"2023-07-09T21:52:18.920034+0000","last_active":"2023-07-09T21:52:20.595303+0000","last_peered":"2023-07-09T21:52:20.595303+0000","last_clean":"2023-07-09T21:52:20.595303+0000","last_became_active":"2023-07-09T21:52:18.919780+0000","last_became_peered":"2023-07-09T21:52:18.919780+0000","last_unstale":"2023-07-09T21:52:20.595303+0000","last_undegraded":"2023-07-09T21:52:20.595303+0000","last_fullsized":"2023-07-09T21:52:20.595303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:37:44.395177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902603+0000","last_change":"2023-07-09T21:52:17.906386+0000","last_active":"2023-07-09T21:52:19.902603+0000","last_peered":"2023-07-09T21:52:19.902603+0000","last_clean":"2023-07-09T21:52:19.902603+0000","last_became_active":"2023-07-09T21:52:17.906124+0000","last_became_peered":"2023-07-09T21:52:17.906124+0000","last_unstale":"2023-07-09T21:52:19.902603+0000","last_undegraded":"2023-07-09T21:52:19.902603+0000","last_fullsized":"2023-07-09T21:52:19.902603+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:36:33.580515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595354+0000","last_change":"2023-07-09T21:52:18.924061+0000","last_active":"2023-07-09T21:52:20.595354+0000","last_peered":"2023-07-09T21:52:20.595354+0000","last_clean":"2023-07-09T21:52:20.595354+0000","last_became_active":"2023-07-09T21:52:18.923764+0000","last_became_peered":"2023-07-09T21:52:18.923764+0000","last_unstale":"2023-07-09T21:52:20.595354+0000","last_undegraded":"2023-07-09T21:52:20.595354+0000","last_fullsized":"2023-07-09T21:52:20.595354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:02.781153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595617+0000","last_change":"2023-07-09T21:52:17.900770+0000","last_active":"2023-07-09T21:52:20.595617+0000","last_peered":"2023-07-09T21:52:20.595617+0000","last_clean":"2023-07-09T21:52:20.595617+0000","last_became_active":"2023-07-09T21:52:17.900421+0000","last_became_peered":"2023-07-09T21:52:17.900421+0000","last_unstale":"2023-07-09T21:52:20.595617+0000","last_undegraded":"2023-07-09T21:52:20.595617+0000","last_fullsized":"2023-07-09T21:52:20.595617+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:21.741126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595542+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:52:20.595542+0000","last_peered":"2023-07-09T21:52:20.595542+0000","last_clean":"2023-07-09T21:52:20.595542+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:52:20.595542+0000","last_undegraded":"2023-07-09T21:52:20.595542+0000","last_fullsized":"2023-07-09T21:52:20.595542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:02:53.224740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904231+0000","last_change":"2023-07-09T21:52:18.916659+0000","last_active":"2023-07-09T21:52:19.904231+0000","last_peered":"2023-07-09T21:52:19.904231+0000","last_clean":"2023-07-09T21:52:19.904231+0000","last_became_active":"2023-07-09T21:52:18.916033+0000","last_became_peered":"2023-07-09T21:52:18.916033+0000","last_unstale":"2023-07-09T21:52:19.904231+0000","last_undegraded":"2023-07-09T21:52:19.904231+0000","last_fullsized":"2023-07-09T21:52:19.904231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:15:14.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.556003+0000","last_change":"2023-07-09T21:52:17.907945+0000","last_active":"2023-07-09T21:52:20.556003+0000","last_peered":"2023-07-09T21:52:20.556003+0000","last_clean":"2023-07-09T21:52:20.556003+0000","last_became_active":"2023-07-09T21:52:17.907687+0000","last_became_peered":"2023-07-09T21:52:17.907687+0000","last_unstale":"2023-07-09T21:52:20.556003+0000","last_undegraded":"2023-07-09T21:52:20.556003+0000","last_fullsized":"2023-07-09T21:52:20.556003+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:20:37.899763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903983+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:52:19.903983+0000","last_peered":"2023-07-09T21:52:19.903983+0000","last_clean":"2023-07-09T21:52:19.903983+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:52:19.903983+0000","last_undegraded":"2023-07-09T21:52:19.903983+0000","last_fullsized":"2023-07-09T21:52:19.903983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:22:55.469638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902582+0000","last_change":"2023-07-09T21:52:18.910698+0000","last_active":"2023-07-09T21:52:19.902582+0000","last_peered":"2023-07-09T21:52:19.902582+0000","last_clean":"2023-07-09T21:52:19.902582+0000","last_became_active":"2023-07-09T21:52:18.910455+0000","last_became_peered":"2023-07-09T21:52:18.910455+0000","last_unstale":"2023-07-09T21:52:19.902582+0000","last_undegraded":"2023-07-09T21:52:19.902582+0000","last_fullsized":"2023-07-09T21:52:19.902582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:22.748093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595760+0000","last_change":"2023-07-09T21:52:17.909086+0000","last_active":"2023-07-09T21:52:20.595760+0000","last_peered":"2023-07-09T21:52:20.595760+0000","last_clean":"2023-07-09T21:52:20.595760+0000","last_became_active":"2023-07-09T21:52:17.907325+0000","last_became_peered":"2023-07-09T21:52:17.907325+0000","last_unstale":"2023-07-09T21:52:20.595760+0000","last_undegraded":"2023-07-09T21:52:20.595760+0000","last_fullsized":"2023-07-09T21:52:20.595760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:21.741126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903077+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:52:19.903077+0000","last_peered":"2023-07-09T21:52:19.903077+0000","last_clean":"2023-07-09T21:52:19.903077+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:52:19.903077+0000","last_undegraded":"2023-07-09T21:52:19.903077+0000","last_fullsized":"2023-07-09T21:52:19.903077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:01:29.799648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555685+0000","last_change":"2023-07-09T21:52:18.914520+0000","last_active":"2023-07-09T21:52:20.555685+0000","last_peered":"2023-07-09T21:52:20.555685+0000","last_clean":"2023-07-09T21:52:20.555685+0000","last_became_active":"2023-07-09T21:52:18.913949+0000","last_became_peered":"2023-07-09T21:52:18.913949+0000","last_unstale":"2023-07-09T21:52:20.555685+0000","last_undegraded":"2023-07-09T21:52:20.555685+0000","last_fullsized":"2023-07-09T21:52:20.555685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:03:31.153416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595858+0000","last_change":"2023-07-09T21:52:17.908857+0000","last_active":"2023-07-09T21:52:20.595858+0000","last_peered":"2023-07-09T21:52:20.595858+0000","last_clean":"2023-07-09T21:52:20.595858+0000","last_became_active":"2023-07-09T21:52:17.907842+0000","last_became_peered":"2023-07-09T21:52:17.907842+0000","last_unstale":"2023-07-09T21:52:20.595858+0000","last_undegraded":"2023-07-09T21:52:20.595858+0000","last_fullsized":"2023-07-09T21:52:20.595858+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:17:35.834602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904281+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:52:19.904281+0000","last_peered":"2023-07-09T21:52:19.904281+0000","last_clean":"2023-07-09T21:52:19.904281+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:52:19.904281+0000","last_undegraded":"2023-07-09T21:52:19.904281+0000","last_fullsized":"2023-07-09T21:52:19.904281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:23:30.980449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":218,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512474+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:52:20.512474+0000","last_peered":"2023-07-09T21:52:20.512474+0000","last_clean":"2023-07-09T21:52:20.512474+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:52:20.512474+0000","last_undegraded":"2023-07-09T21:52:20.512474+0000","last_fullsized":"2023-07-09T21:52:20.512474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:16:27.087160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595087+0000","last_change":"2023-07-09T21:52:18.921385+0000","last_active":"2023-07-09T21:52:20.595087+0000","last_peered":"2023-07-09T21:52:20.595087+0000","last_clean":"2023-07-09T21:52:20.595087+0000","last_became_active":"2023-07-09T21:52:18.911170+0000","last_became_peered":"2023-07-09T21:52:18.911170+0000","last_unstale":"2023-07-09T21:52:20.595087+0000","last_undegraded":"2023-07-09T21:52:20.595087+0000","last_fullsized":"2023-07-09T21:52:20.595087+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:10:52.133057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.513046+0000","last_change":"2023-07-09T21:52:17.913375+0000","last_active":"2023-07-09T21:52:20.513046+0000","last_peered":"2023-07-09T21:52:20.513046+0000","last_clean":"2023-07-09T21:52:20.513046+0000","last_became_active":"2023-07-09T21:52:17.913062+0000","last_became_peered":"2023-07-09T21:52:17.913062+0000","last_unstale":"2023-07-09T21:52:20.513046+0000","last_undegraded":"2023-07-09T21:52:20.513046+0000","last_fullsized":"2023-07-09T21:52:20.513046+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:32:04.037549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.512670+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:52:20.512670+0000","last_peered":"2023-07-09T21:52:20.512670+0000","last_clean":"2023-07-09T21:52:20.512670+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:52:20.512670+0000","last_undegraded":"2023-07-09T21:52:20.512670+0000","last_fullsized":"2023-07-09T21:52:20.512670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:02:09.717154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903127+0000","last_change":"2023-07-09T21:52:18.914591+0000","last_active":"2023-07-09T21:52:19.903127+0000","last_peered":"2023-07-09T21:52:19.903127+0000","last_clean":"2023-07-09T21:52:19.903127+0000","last_became_active":"2023-07-09T21:52:18.913500+0000","last_became_peered":"2023-07-09T21:52:18.913500+0000","last_unstale":"2023-07-09T21:52:19.903127+0000","last_undegraded":"2023-07-09T21:52:19.903127+0000","last_fullsized":"2023-07-09T21:52:19.903127+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:48:23.971303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904218+0000","last_change":"2023-07-09T21:52:17.905141+0000","last_active":"2023-07-09T21:52:19.904218+0000","last_peered":"2023-07-09T21:52:19.904218+0000","last_clean":"2023-07-09T21:52:19.904218+0000","last_became_active":"2023-07-09T21:52:17.904855+0000","last_became_peered":"2023-07-09T21:52:17.904855+0000","last_unstale":"2023-07-09T21:52:19.904218+0000","last_undegraded":"2023-07-09T21:52:19.904218+0000","last_fullsized":"2023-07-09T21:52:19.904218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:52:22.094654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.513214+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:52:20.513214+0000","last_peered":"2023-07-09T21:52:20.513214+0000","last_clean":"2023-07-09T21:52:20.513214+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:52:20.513214+0000","last_undegraded":"2023-07-09T21:52:20.513214+0000","last_fullsized":"2023-07-09T21:52:20.513214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:55:41.882384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595583+0000","last_change":"2023-07-09T21:52:18.926700+0000","last_active":"2023-07-09T21:52:20.595583+0000","last_peered":"2023-07-09T21:52:20.595583+0000","last_clean":"2023-07-09T21:52:20.595583+0000","last_became_active":"2023-07-09T21:52:18.926311+0000","last_became_peered":"2023-07-09T21:52:18.926311+0000","last_unstale":"2023-07-09T21:52:20.595583+0000","last_undegraded":"2023-07-09T21:52:20.595583+0000","last_fullsized":"2023-07-09T21:52:20.595583+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:40:03.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.902711+0000","last_change":"2023-07-09T21:52:17.908430+0000","last_active":"2023-07-09T21:52:19.902711+0000","last_peered":"2023-07-09T21:52:19.902711+0000","last_clean":"2023-07-09T21:52:19.902711+0000","last_became_active":"2023-07-09T21:52:17.908191+0000","last_became_peered":"2023-07-09T21:52:17.908191+0000","last_unstale":"2023-07-09T21:52:19.902711+0000","last_undegraded":"2023-07-09T21:52:19.902711+0000","last_fullsized":"2023-07-09T21:52:19.902711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:11:33.508493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.595146+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:52:20.595146+0000","last_peered":"2023-07-09T21:52:20.595146+0000","last_clean":"2023-07-09T21:52:20.595146+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:52:20.595146+0000","last_undegraded":"2023-07-09T21:52:20.595146+0000","last_fullsized":"2023-07-09T21:52:20.595146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:58.615194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.904013+0000","last_change":"2023-07-09T21:52:18.902936+0000","last_active":"2023-07-09T21:52:19.904013+0000","last_peered":"2023-07-09T21:52:19.904013+0000","last_clean":"2023-07-09T21:52:19.904013+0000","last_became_active":"2023-07-09T21:52:18.902636+0000","last_became_peered":"2023-07-09T21:52:18.902636+0000","last_unstale":"2023-07-09T21:52:19.904013+0000","last_undegraded":"2023-07-09T21:52:19.904013+0000","last_fullsized":"2023-07-09T21:52:19.904013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:17.878522+0000","last_clean_scrub_stamp":"2023-07-09T21:52:17.878522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:56:36.890197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:19.903004+0000","last_change":"2023-07-09T21:52:17.913781+0000","last_active":"2023-07-09T21:52:19.903004+0000","last_peered":"2023-07-09T21:52:19.903004+0000","last_clean":"2023-07-09T21:52:19.903004+0000","last_became_active":"2023-07-09T21:52:17.913487+0000","last_became_peered":"2023-07-09T21:52:17.913487+0000","last_unstale":"2023-07-09T21:52:19.903004+0000","last_undegraded":"2023-07-09T21:52:19.903004+0000","last_fullsized":"2023-07-09T21:52:19.903004+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:52:16.871555+0000","last_clean_scrub_stamp":"2023-07-09T21:52:16.871555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:21:12.315596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-09T21:52:20.555995+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:52:20.555995+0000","last_peered":"2023-07-09T21:52:20.555995+0000","last_clean":"2023-07-09T21:52:20.555995+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:52:20.555995+0000","last_undegraded":"2023-07-09T21:52:20.555995+0000","last_fullsized":"2023-07-09T21:52:20.555995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:35:08.109356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":257564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95099999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.54400000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.45900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81999999999999995,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.72399999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.79000000000000004,"15min":0.82099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78700000000000003,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.624},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97099999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.61599999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92900000000000005,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89200000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.68600000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":1.214,"15min":1.214},"last":0.76900000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.754}]}]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":602112,"data_stored":257142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52000000000000002,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55500000000000005,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.443},{"interface":"front","average":{"1min":0.438,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.53700000000000003,"15min":0.55600000000000005},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56699999999999995,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.60599999999999998,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.63300000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.49399999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.68100000000000005,"15min":0.70899999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63400000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60399999999999998,"5min":3.129,"15min":3.129},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94499999999999995,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.998,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.71699999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91200000000000003,"5min":1.929,"15min":1.929},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.85099999999999998,"15min":0.86399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97599999999999998,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93500000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.95199999999999996,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.68200000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":2.766,"15min":2.766},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.93400000000000005,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.623}]}]},{"osd":2,"up_from":14,"seq":60129542173,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":606208,"data_stored":258546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":1.232,"15min":1.3700000000000001},"min":{"1min":0.28899999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":16.946000000000002,"15min":16.946000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.93200000000000005,"15min":1.0089999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":9.5449999999999999,"15min":9.5449999999999999},"last":0.504}]},{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.92100000000000004,"15min":0.99399999999999999},"min":{"1min":0.38200000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65200000000000002,"5min":9.6950000000000003,"15min":9.6950000000000003},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.95099999999999996,"15min":1.0329999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63200000000000001,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.33700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.995,"15min":1.077},"min":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69199999999999995,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.327,"15min":1.4630000000000001},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73599999999999999,"5min":17.004000000000001,"15min":17.004000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.048,"15min":1.1000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.081,"5min":6.2510000000000003,"15min":6.2510000000000003},"last":0.748},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.2849999999999999,"15min":1.3680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2050000000000001,"5min":9.6630000000000003,"15min":9.6630000000000003},"last":0.77900000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":1.091,"15min":1.139},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2370000000000001,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.2849999999999999,"15min":1.369},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.1619999999999999,"5min":9.5879999999999992,"15min":9.5879999999999992},"last":0.82599999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":1.2849999999999999,"15min":1.371},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.048,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":1.266,"15min":1.349},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0529999999999999,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":0.79500000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.2250000000000001,"15min":1.2969999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.103,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.1160000000000001,"15min":1.1659999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.163,"5min":6.2169999999999996,"15min":6.2169999999999996},"last":0.84699999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542173,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1196032,"data_stored":847406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.92200000000000004,"15min":1.01},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55000000000000004,"5min":11.949999999999999,"15min":11.949999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60199999999999998,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73899999999999999,"5min":1.212,"15min":1.212},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":1.4179999999999999,"15min":1.5720000000000001},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90900000000000003,"15min":0.97499999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65100000000000002,"5min":10.952,"15min":10.952},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":1.696,"15min":1.859},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":22.974,"15min":22.974},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":1.264,"15min":1.3520000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.96999999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52300000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":1.589,"15min":1.589},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.748,"5min":1.6890000000000001,"15min":1.8460000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":22.933,"15min":22.933},"last":0.94299999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93100000000000005,"5min":1.623,"15min":1.623},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.6830000000000001,"15min":1.8400000000000001},"min":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98199999999999998,"5min":22.867999999999999,"15min":22.867999999999999},"last":1.01}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.1639999999999999,"15min":1.23},"min":{"1min":0.57499999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.93300000000000005,"5min":10.907999999999999,"15min":10.907999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83299999999999996,"15min":0.83999999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.99299999999999999,"5min":1.546,"15min":1.546},"last":0.95299999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542174,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1196032,"data_stored":847474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.71999999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85799999999999998,"5min":1.464,"15min":1.464},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94999999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.93799999999999994}]},{"osd":2,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89100000000000001,"5min":1.121,"15min":1.121},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.78600000000000003,"15min":0.80400000000000005},"min":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70799999999999996,"15min":0.71699999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.091,"15min":1.091},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96599999999999997,"5min":1.405,"15min":1.405},"last":0.88}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.95399999999999996,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70399999999999996,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82799999999999996,"5min":1.341,"15min":1.341},"last":0.81100000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.443,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.871,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.96299999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88100000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.0149999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":258568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57599999999999996,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.37},{"interface":"front","average":{"1min":0.435,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68200000000000005,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.53800000000000003,"5min":1.21,"15min":1.21},"last":0.438},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.54900000000000004,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.496}]},{"osd":2,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60699999999999998,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.56100000000000005,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.016,"5min":1.258,"15min":1.258},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0049999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.92200000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95599999999999996,"5min":1.486,"15min":1.486},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98999999999999999,"5min":1.327,"15min":1.327},"last":0.89400000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":1.302,"15min":1.302},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.86199999999999999,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":0.86799999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.04,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.008,"5min":1.349,"15min":1.349},"last":0.748}]}]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":593920,"data_stored":256982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.74199999999999999,"15min":0.69999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":7.9779999999999998,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":7.8650000000000002,"5min":7.8650000000000002,"15min":7.8650000000000002},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.421,"15min":1.421},"last":0.68300000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.73199999999999998,"15min":0.68200000000000005},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":7.9390000000000001,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88300000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81200000000000006}]},{"osd":3,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1799999999999999,"5min":1.597,"15min":1.597},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.93700000000000006,"5min":1.216,"15min":1.216},"last":0.65200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91200000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0609999999999999,"5min":1.069,"15min":1.069},"last":0.79200000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":1.093,"15min":1.093},"last":0.63},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.038,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76800000000000002,"15min":0.76300000000000001},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.054,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.77800000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":602112,"data_stored":257634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.54400000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84799999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.48399999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.86399999999999999,"5min":1.113,"15min":1.113},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84199999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.97499999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85599999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.46800000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.871}]},{"osd":3,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.746}]},{"osd":4,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93400000000000005,"5min":1.018,"15min":1.018},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95099999999999996,"5min":1.171,"15min":1.171},"last":0.60999999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98199999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.754,"15min":0.749},"min":{"1min":0.56699999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96399999999999997,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.1020000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.999,"5min":1.133,"15min":1.133},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.022,"5min":1.123,"15min":1.123},"last":0.88900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:52:28.846 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T21:52:28.847 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T21:52:29.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.084+0000 7f36133ff700 1 Processor -- start 2023-07-09T21:52:29.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.084+0000 7f36133ff700 1 -- start start 2023-07-09T21:52:29.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.085+0000 7f36133ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f360c15c860 0x7f360c0c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:29.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.085+0000 7f36133ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f360c0b49d0 0x7f360c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:29.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.085+0000 7f36133ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360c0d2260 con 0x7f360c0cf2a0 2023-07-09T21:52:29.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.085+0000 7f36133ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360c146740 con 0x7f360c0b49d0 2023-07-09T21:52:29.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.085+0000 7f36133ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360c0cd5a0 con 0x7f360c15c860 2023-07-09T21:52:29.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.086+0000 7f361119b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f360c0cf2a0 0x7f360c0c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46492/0 (socket says 172.21.15.53:46492) 2023-07-09T21:52:29.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.086+0000 7f361119b700 1 -- 172.21.15.53:0/900397296 learned_addr learned my addr 172.21.15.53:0/900397296 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:29.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.086+0000 7f361199c700 1 --2- 172.21.15.53:0/900397296 >> v2:172.21.15.53:3300/0 conn(0x7f360c0b49d0 0x7f360c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:29.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.086+0000 7f361099a700 1 --2- 172.21.15.53:0/900397296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f360c15c860 0x7f360c0c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:29.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.086+0000 7f361199c700 1 -- 172.21.15.53:0/900397296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f360c15c860 msgr2=0x7f360c0c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:29.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.086+0000 7f361199c700 1 --2- 172.21.15.53:0/900397296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f360c15c860 0x7f360c0c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.086+0000 7f361199c700 1 -- 172.21.15.53:0/900397296 >> v1:172.21.15.53:6789/0 conn(0x7f360c0cf2a0 legacy=0x7f360c0c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:29.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.086+0000 7f361199c700 1 -- 172.21.15.53:0/900397296 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c15ccd0 con 0x7f360c0b49d0 2023-07-09T21:52:29.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.086+0000 7f3603fff700 1 -- 172.21.15.53:0/900397296 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071058228 0 0) 0x7f360c0d2260 con 0x7f360c0cf2a0 2023-07-09T21:52:29.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.087+0000 7f361199c700 1 --2- 172.21.15.53:0/900397296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f360c0b49d0 0x7f360c0b4e50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3604009d90 tx=0x7f360400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f696bfa5eba9270f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:29.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.087+0000 7f3603fff700 1 -- 172.21.15.53:0/900397296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360400e070 con 0x7f360c0b49d0 2023-07-09T21:52:29.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.087+0000 7f3603fff700 1 -- 172.21.15.53:0/900397296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360400bb20 con 0x7f360c0b49d0 2023-07-09T21:52:29.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.087+0000 7f3603fff700 1 -- 172.21.15.53:0/900397296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604012430 con 0x7f360c0b49d0 2023-07-09T21:52:29.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.087+0000 7f36133ff700 1 -- 172.21.15.53:0/900397296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f360c0b49d0 msgr2=0x7f360c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:29.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.087+0000 7f36133ff700 1 --2- 172.21.15.53:0/900397296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f360c0b49d0 0x7f360c0b4e50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3604009d90 tx=0x7f360400b330 comp rx=0 tx=0).stop 2023-07-09T21:52:29.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.087+0000 7f36133ff700 1 -- 172.21.15.53:0/900397296 shutdown_connections 2023-07-09T21:52:29.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.087+0000 7f36133ff700 1 --2- 172.21.15.53:0/900397296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f360c0b49d0 0x7f360c0b4e50 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.087+0000 7f36133ff700 1 --2- 172.21.15.53:0/900397296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f360c15c860 0x7f360c0c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.087+0000 7f36133ff700 1 -- 172.21.15.53:0/900397296 >> 172.21.15.53:0/900397296 conn(0x7f360c065bd0 msgr2=0x7f360c065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:29.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.087+0000 7f36133ff700 1 -- 172.21.15.53:0/900397296 shutdown_connections 2023-07-09T21:52:29.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.087+0000 7f36133ff700 1 -- 172.21.15.53:0/900397296 wait complete. 2023-07-09T21:52:29.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.089+0000 7f36133ff700 1 Processor -- start 2023-07-09T21:52:29.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.089+0000 7f36133ff700 1 -- start start 2023-07-09T21:52:29.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.090+0000 7f36133ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f360c0b49d0 0x7f360c1f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:29.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.090+0000 7f36133ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f360c0cf2a0 0x7f360c157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:29.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.090+0000 7f36133ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f360c15c860 0x7f360c158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:29.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.090+0000 7f36133ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c0cc5f0 con 0x7f360c15c860 2023-07-09T21:52:29.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.090+0000 7f36133ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c0cc8d0 con 0x7f360c0cf2a0 2023-07-09T21:52:29.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.090+0000 7f36133ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360c0ccbb0 con 0x7f360c0b49d0 2023-07-09T21:52:29.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.090+0000 7f361199c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f360c15c860 0x7f360c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:29.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.091+0000 7f361199c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f360c15c860 0x7f360c158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34830/0 (socket says 172.21.15.53:34830) 2023-07-09T21:52:29.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.091+0000 7f361199c700 1 -- 172.21.15.53:0/412341302 learned_addr learned my addr 172.21.15.53:0/412341302 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:29.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.091+0000 7f361119b700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f360c0b49d0 0x7f360c1f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:29.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.091+0000 7f361099a700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f360c0cf2a0 0x7f360c157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:29.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.091+0000 7f361199c700 1 -- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f360c0b49d0 msgr2=0x7f360c1f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:29.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.091+0000 7f361199c700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f360c0b49d0 0x7f360c1f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.091+0000 7f361199c700 1 -- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f360c0cf2a0 msgr2=0x7f360c157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:29.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.091+0000 7f361199c700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f360c0cf2a0 0x7f360c157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.091+0000 7f361199c700 1 -- 172.21.15.53:0/412341302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3604009a70 con 0x7f360c15c860 2023-07-09T21:52:29.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.091+0000 7f361199c700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f360c15c860 0x7f360c158000 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f360c0672c0 tx=0x7f3604004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:29.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.091+0000 7f3601ffb700 1 -- 172.21.15.53:0/412341302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604012430 con 0x7f360c15c860 2023-07-09T21:52:29.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.092+0000 7f3601ffb700 1 -- 172.21.15.53:0/412341302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3604020070 con 0x7f360c15c860 2023-07-09T21:52:29.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.092+0000 7f36133ff700 1 -- 172.21.15.53:0/412341302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360c0cce90 con 0x7f360c15c860 2023-07-09T21:52:29.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.092+0000 7f3601ffb700 1 -- 172.21.15.53:0/412341302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604004280 con 0x7f360c15c860 2023-07-09T21:52:29.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.092+0000 7f36133ff700 1 -- 172.21.15.53:0/412341302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360c1f5430 con 0x7f360c15c860 2023-07-09T21:52:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.093+0000 7f36133ff700 1 -- 172.21.15.53:0/412341302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360c0cf670 con 0x7f360c15c860 2023-07-09T21:52:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.093+0000 7f3601ffb700 1 -- 172.21.15.53:0/412341302 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f36040043e0 con 0x7f360c15c860 2023-07-09T21:52:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.094+0000 7f3601ffb700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f35f006ad70 0x7f35f006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.095+0000 7f3601ffb700 1 -- 172.21.15.53:0/412341302 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3604022070 con 0x7f360c15c860 2023-07-09T21:52:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.095+0000 7f361119b700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f35f006ad70 0x7f35f006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.095+0000 7f361119b700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f35f006ad70 0x7f35f006d220 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3608000f60 tx=0x7f3608007be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:29.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.099+0000 7f3601ffb700 1 -- 172.21.15.53:0/412341302 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3604056320 con 0x7f360c15c860 2023-07-09T21:52:29.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.388+0000 7f36133ff700 1 -- 172.21.15.53:0/412341302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f360c0b8f10 con 0x7f360c15c860 2023-07-09T21:52:29.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.392+0000 7f3601ffb700 1 -- 172.21.15.53:0/412341302 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7f3604059940 con 0x7f360c15c860 2023-07-09T21:52:29.394 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2023-07-09T21:52:29.394 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBbK6tkVu19ABAApbFrRRJdrT0qBJ/fG9bEVA== 2023-07-09T21:52:29.394 INFO:teuthology.orchestra.run.smithi053.stdout: caps mds = "allow" 2023-07-09T21:52:29.395 INFO:teuthology.orchestra.run.smithi053.stdout: caps mon = "allow r" 2023-07-09T21:52:29.395 INFO:teuthology.orchestra.run.smithi053.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T21:52:29.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.394+0000 7f36133ff700 1 -- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f35f006ad70 msgr2=0x7f35f006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:29.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.394+0000 7f36133ff700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f35f006ad70 0x7f35f006d220 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3608000f60 tx=0x7f3608007be0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.395+0000 7f36133ff700 1 -- 172.21.15.53:0/412341302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f360c15c860 msgr2=0x7f360c158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:29.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.395+0000 7f36133ff700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f360c15c860 0x7f360c158000 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f360c0672c0 tx=0x7f3604004ad0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.395+0000 7f36133ff700 1 -- 172.21.15.53:0/412341302 shutdown_connections 2023-07-09T21:52:29.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.395+0000 7f36133ff700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f35f006ad70 0x7f35f006d220 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.395+0000 7f36133ff700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f360c15c860 0x7f360c158000 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.395+0000 7f36133ff700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f360c0b49d0 0x7f360c1f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.395+0000 7f36133ff700 1 --2- 172.21.15.53:0/412341302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f360c0cf2a0 0x7f360c157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.395+0000 7f36133ff700 1 -- 172.21.15.53:0/412341302 >> 172.21.15.53:0/412341302 conn(0x7f360c065bd0 msgr2=0x7f360c0d3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:29.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.395+0000 7f36133ff700 1 -- 172.21.15.53:0/412341302 shutdown_connections 2023-07-09T21:52:29.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.395+0000 7f36133ff700 1 -- 172.21.15.53:0/412341302 wait complete. 2023-07-09T21:52:29.398 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2023-07-09T21:52:29.414 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:52:29.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.613+0000 7f8d38fff700 1 Processor -- start 2023-07-09T21:52:29.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.613+0000 7f8d38fff700 1 -- start start 2023-07-09T21:52:29.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.614+0000 7f8d38fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8d340d1220 0x7f8d340b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:29.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.614+0000 7f8d38fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8d340b2350 0x7f8d340afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:29.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.614+0000 7f8d38fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d340d2ce0 con 0x7f8d340b1e00 2023-07-09T21:52:29.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.614+0000 7f8d38fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d340b3350 con 0x7f8d340b2350 2023-07-09T21:52:29.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.614+0000 7f8d38fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d340b3630 con 0x7f8d340d1220 2023-07-09T21:52:29.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.615+0000 7f8d32d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8d340b2350 0x7f8d340afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:29.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.615+0000 7f8d3259c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8d340b1e00 0x7f8d340d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46506/0 (socket says 172.21.15.53:46506) 2023-07-09T21:52:29.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.615+0000 7f8d32d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8d340b2350 0x7f8d340afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34838/0 (socket says 172.21.15.53:34838) 2023-07-09T21:52:29.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.615+0000 7f8d3259c700 1 -- 172.21.15.53:0/60661698 learned_addr learned my addr 172.21.15.53:0/60661698 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:29.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.615+0000 7f8d31d9b700 1 --2- 172.21.15.53:0/60661698 >> v2:172.21.15.184:3300/0 conn(0x7f8d340d1220 0x7f8d340b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:29.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.615+0000 7f8d32d9d700 1 -- 172.21.15.53:0/60661698 >> v2:172.21.15.184:3300/0 conn(0x7f8d340d1220 msgr2=0x7f8d340b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:29.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.615+0000 7f8d32d9d700 1 --2- 172.21.15.53:0/60661698 >> v2:172.21.15.184:3300/0 conn(0x7f8d340d1220 0x7f8d340b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.615+0000 7f8d32d9d700 1 -- 172.21.15.53:0/60661698 >> v1:172.21.15.53:6789/0 conn(0x7f8d340b1e00 legacy=0x7f8d340d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:29.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.615+0000 7f8d32d9d700 1 -- 172.21.15.53:0/60661698 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d340b3910 con 0x7f8d340b2350 2023-07-09T21:52:29.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.615+0000 7f8d3159a700 1 -- 172.21.15.53:0/60661698 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146259217 0 0) 0x7f8d340d2ce0 con 0x7f8d340b1e00 2023-07-09T21:52:29.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.615+0000 7f8d32d9d700 1 --2- 172.21.15.53:0/60661698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d340b2350 0x7f8d340afac0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8d34072140 tx=0x7f8d2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94b0531935b33c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:29.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.616+0000 7f8d3159a700 1 -- 172.21.15.53:0/60661698 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c00e070 con 0x7f8d340b2350 2023-07-09T21:52:29.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.616+0000 7f8d3159a700 1 -- 172.21.15.53:0/60661698 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c00bbd0 con 0x7f8d340b2350 2023-07-09T21:52:29.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.616+0000 7f8d3159a700 1 -- 172.21.15.53:0/60661698 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c012430 con 0x7f8d340b2350 2023-07-09T21:52:29.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.616+0000 7f8d38fff700 1 -- 172.21.15.53:0/60661698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d340b2350 msgr2=0x7f8d340afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:29.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.616+0000 7f8d38fff700 1 --2- 172.21.15.53:0/60661698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d340b2350 0x7f8d340afac0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8d34072140 tx=0x7f8d2c00b330 comp rx=0 tx=0).stop 2023-07-09T21:52:29.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.616+0000 7f8d38fff700 1 -- 172.21.15.53:0/60661698 shutdown_connections 2023-07-09T21:52:29.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.616+0000 7f8d38fff700 1 --2- 172.21.15.53:0/60661698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d340b2350 0x7f8d340afac0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.616+0000 7f8d38fff700 1 --2- 172.21.15.53:0/60661698 >> v2:172.21.15.184:3300/0 conn(0x7f8d340d1220 0x7f8d340b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.616+0000 7f8d38fff700 1 -- 172.21.15.53:0/60661698 >> 172.21.15.53:0/60661698 conn(0x7f8d3409c1d0 msgr2=0x7f8d340d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:29.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.616+0000 7f8d38fff700 1 -- 172.21.15.53:0/60661698 shutdown_connections 2023-07-09T21:52:29.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.616+0000 7f8d38fff700 1 -- 172.21.15.53:0/60661698 wait complete. 2023-07-09T21:52:29.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.618+0000 7f8d38fff700 1 Processor -- start 2023-07-09T21:52:29.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.618+0000 7f8d38fff700 1 -- start start 2023-07-09T21:52:29.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.619+0000 7f8d38fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d340b1e00 0x7f8d340cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:29.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.619+0000 7f8d38fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d340b2350 0x7f8d3414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:29.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.619+0000 7f8d38fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d340d1220 0x7f8d34155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:29.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.619+0000 7f8d38fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d340d0480 con 0x7f8d340b1e00 2023-07-09T21:52:29.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.619+0000 7f8d38fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d340ca4a0 con 0x7f8d340b2350 2023-07-09T21:52:29.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.619+0000 7f8d38fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d340ca780 con 0x7f8d340d1220 2023-07-09T21:52:29.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.620+0000 7f8d3259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d340b1e00 0x7f8d340cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:29.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.620+0000 7f8d3259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d340b1e00 0x7f8d340cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34854/0 (socket says 172.21.15.53:34854) 2023-07-09T21:52:29.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.620+0000 7f8d3259c700 1 -- 172.21.15.53:0/2231919735 learned_addr learned my addr 172.21.15.53:0/2231919735 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:29.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.620+0000 7f8d32d9d700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d340d1220 0x7f8d34155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:29.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.620+0000 7f8d31d9b700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d340b2350 0x7f8d3414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:29.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.620+0000 7f8d3259c700 1 -- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d340d1220 msgr2=0x7f8d34155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:29.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.620+0000 7f8d3259c700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d340d1220 0x7f8d34155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.620+0000 7f8d3259c700 1 -- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d340b2350 msgr2=0x7f8d3414ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:29.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.620+0000 7f8d3259c700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d340b2350 0x7f8d3414ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.620+0000 7f8d3259c700 1 -- 172.21.15.53:0/2231919735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c009a70 con 0x7f8d340b1e00 2023-07-09T21:52:29.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.620+0000 7f8d31d9b700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d340b2350 0x7f8d3414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:29.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.620+0000 7f8d3259c700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d340b1e00 0x7f8d340cd780 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8d240010e0 tx=0x7f8d2400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:29.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.621+0000 7f8d22ffd700 1 -- 172.21.15.53:0/2231919735 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d240074e0 con 0x7f8d340b1e00 2023-07-09T21:52:29.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.621+0000 7f8d22ffd700 1 -- 172.21.15.53:0/2231919735 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d24007640 con 0x7f8d340b1e00 2023-07-09T21:52:29.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.621+0000 7f8d22ffd700 1 -- 172.21.15.53:0/2231919735 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24005a70 con 0x7f8d340b1e00 2023-07-09T21:52:29.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.621+0000 7f8d38fff700 1 -- 172.21.15.53:0/2231919735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d340caa60 con 0x7f8d340b1e00 2023-07-09T21:52:29.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.621+0000 7f8d38fff700 1 -- 172.21.15.53:0/2231919735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d34150480 con 0x7f8d340b1e00 2023-07-09T21:52:29.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.622+0000 7f8d38fff700 1 -- 172.21.15.53:0/2231919735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3404e280 con 0x7f8d340b1e00 2023-07-09T21:52:29.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.623+0000 7f8d22ffd700 1 -- 172.21.15.53:0/2231919735 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f8d24005bd0 con 0x7f8d340b1e00 2023-07-09T21:52:29.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.624+0000 7f8d22ffd700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8d1406ad70 0x7f8d1406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:29.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.624+0000 7f8d22ffd700 1 -- 172.21.15.53:0/2231919735 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d24088a20 con 0x7f8d340b1e00 2023-07-09T21:52:29.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.624+0000 7f8d31d9b700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8d1406ad70 0x7f8d1406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:29.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.625+0000 7f8d31d9b700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8d1406ad70 0x7f8d1406d220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d340d4060 tx=0x7f8d28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:29.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.628+0000 7f8d22ffd700 1 -- 172.21.15.53:0/2231919735 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8d24053a70 con 0x7f8d340b1e00 2023-07-09T21:52:29.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.884+0000 7f8d38fff700 1 -- 172.21.15.53:0/2231919735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d3408c5a0 con 0x7f8d340b1e00 2023-07-09T21:52:29.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.885+0000 7f8d22ffd700 1 -- 172.21.15.53:0/2231919735 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f8d24007e60 con 0x7f8d340b1e00 2023-07-09T21:52:29.886 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:29.886 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2286885595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2286885595},{"type":"v1","addr":"172.21.15.184:6837","nonce":2286885595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2019231045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2019231045},{"type":"v1","addr":"172.21.15.53:6834","nonce":2019231045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/1440999283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1440999283},{"type":"v1","addr":"172.21.15.184:6836","nonce":1440999283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:52:18.405674+0000","modified":"2023-07-09T21:52:21.909106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3167613257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3167613257},{"type":"v1","addr":"172.21.15.53:6835","nonce":3167613257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T21:52:29.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.887+0000 7f8d38fff700 1 -- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8d1406ad70 msgr2=0x7f8d1406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:29.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.887+0000 7f8d38fff700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8d1406ad70 0x7f8d1406d220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d340d4060 tx=0x7f8d28008040 comp rx=0 tx=0).stop 2023-07-09T21:52:29.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.887+0000 7f8d38fff700 1 -- 172.21.15.53:0/2231919735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d340b1e00 msgr2=0x7f8d340cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:29.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.887+0000 7f8d38fff700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d340b1e00 0x7f8d340cd780 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8d240010e0 tx=0x7f8d2400ca30 comp rx=0 tx=0).stop 2023-07-09T21:52:29.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.887+0000 7f8d38fff700 1 -- 172.21.15.53:0/2231919735 shutdown_connections 2023-07-09T21:52:29.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.887+0000 7f8d38fff700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8d1406ad70 0x7f8d1406d220 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.887+0000 7f8d38fff700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d340d1220 0x7f8d34155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.887+0000 7f8d38fff700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d340b1e00 0x7f8d340cd780 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.887+0000 7f8d38fff700 1 --2- 172.21.15.53:0/2231919735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d340b2350 0x7f8d3414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:29.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.887+0000 7f8d38fff700 1 -- 172.21.15.53:0/2231919735 >> 172.21.15.53:0/2231919735 conn(0x7f8d3409c1d0 msgr2=0x7f8d34159530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:29.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.887+0000 7f8d38fff700 1 -- 172.21.15.53:0/2231919735 shutdown_connections 2023-07-09T21:52:29.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:29.887+0000 7f8d38fff700 1 -- 172.21.15.53:0/2231919735 wait complete. 2023-07-09T21:52:29.890 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 27 2023-07-09T21:52:30.308 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T21:52:18.405674+0000', 'modified': '2023-07-09T21:52:21.909106+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5619}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5619': {'gid': 5619, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/3167613257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6833', 'nonce': 3167613257}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 3167613257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T21:52:30.309 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T21:52:30.309 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-09T21:52:30.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.510+0000 7f9c843ff700 1 Processor -- start 2023-07-09T21:52:30.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.510+0000 7f9c843ff700 1 -- start start 2023-07-09T21:52:30.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.511+0000 7f9c843ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9c7c069f30 0x7f9c7c06a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.511+0000 7f9c843ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9c7c1601d0 0x7f9c7c160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.511+0000 7f9c843ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7c0cdba0 con 0x7f9c7c071650 2023-07-09T21:52:30.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.511+0000 7f9c843ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7c06a910 con 0x7f9c7c1601d0 2023-07-09T21:52:30.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.511+0000 7f9c843ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7c0cf370 con 0x7f9c7c069f30 2023-07-09T21:52:30.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.512+0000 7f9c8299c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9c7c1601d0 0x7f9c7c160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.512+0000 7f9c8299c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9c7c1601d0 0x7f9c7c160650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34866/0 (socket says 172.21.15.53:34866) 2023-07-09T21:52:30.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.512+0000 7f9c8299c700 1 -- 172.21.15.53:0/2023282383 learned_addr learned my addr 172.21.15.53:0/2023282383 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:30.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.512+0000 7f9c8219b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9c7c071650 0x7f9c7c0ce030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46518/0 (socket says 172.21.15.53:46518) 2023-07-09T21:52:30.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.512+0000 7f9c8199a700 1 --2- 172.21.15.53:0/2023282383 >> v2:172.21.15.184:3300/0 conn(0x7f9c7c069f30 0x7f9c7c06a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.512+0000 7f9c8299c700 1 -- 172.21.15.53:0/2023282383 >> v2:172.21.15.184:3300/0 conn(0x7f9c7c069f30 msgr2=0x7f9c7c06a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:30.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.512+0000 7f9c8299c700 1 --2- 172.21.15.53:0/2023282383 >> v2:172.21.15.184:3300/0 conn(0x7f9c7c069f30 0x7f9c7c06a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.512+0000 7f9c8299c700 1 -- 172.21.15.53:0/2023282383 >> v1:172.21.15.53:6789/0 conn(0x7f9c7c071650 legacy=0x7f9c7c0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:30.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.512+0000 7f9c8299c700 1 -- 172.21.15.53:0/2023282383 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c0cf650 con 0x7f9c7c1601d0 2023-07-09T21:52:30.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.512+0000 7f9c81199700 1 -- 172.21.15.53:0/2023282383 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689389664 0 0) 0x7f9c7c0cdba0 con 0x7f9c7c071650 2023-07-09T21:52:30.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.512+0000 7f9c8299c700 1 --2- 172.21.15.53:0/2023282383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c7c1601d0 0x7f9c7c160650 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0cb410 tx=0x7f9c7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbe6bb0602a377f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:30.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.513+0000 7f9c81199700 1 -- 172.21.15.53:0/2023282383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400e070 con 0x7f9c7c1601d0 2023-07-09T21:52:30.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.513+0000 7f9c81199700 1 -- 172.21.15.53:0/2023282383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7400b910 con 0x7f9c7c1601d0 2023-07-09T21:52:30.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.513+0000 7f9c81199700 1 -- 172.21.15.53:0/2023282383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400bcc0 con 0x7f9c7c1601d0 2023-07-09T21:52:30.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.513+0000 7f9c843ff700 1 -- 172.21.15.53:0/2023282383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c7c1601d0 msgr2=0x7f9c7c160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:30.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.513+0000 7f9c843ff700 1 --2- 172.21.15.53:0/2023282383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c7c1601d0 0x7f9c7c160650 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0cb410 tx=0x7f9c7400b330 comp rx=0 tx=0).stop 2023-07-09T21:52:30.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.513+0000 7f9c843ff700 1 -- 172.21.15.53:0/2023282383 shutdown_connections 2023-07-09T21:52:30.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.513+0000 7f9c843ff700 1 --2- 172.21.15.53:0/2023282383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c7c1601d0 0x7f9c7c160650 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.513+0000 7f9c843ff700 1 --2- 172.21.15.53:0/2023282383 >> v2:172.21.15.184:3300/0 conn(0x7f9c7c069f30 0x7f9c7c06a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.513+0000 7f9c843ff700 1 -- 172.21.15.53:0/2023282383 >> 172.21.15.53:0/2023282383 conn(0x7f9c7c0cc640 msgr2=0x7f9c7c0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:30.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.513+0000 7f9c843ff700 1 -- 172.21.15.53:0/2023282383 shutdown_connections 2023-07-09T21:52:30.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.514+0000 7f9c843ff700 1 -- 172.21.15.53:0/2023282383 wait complete. 2023-07-09T21:52:30.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.516+0000 7f9c843ff700 1 Processor -- start 2023-07-09T21:52:30.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.516+0000 7f9c843ff700 1 -- start start 2023-07-09T21:52:30.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.517+0000 7f9c843ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c7c069f30 0x7f9c7c0af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.517+0000 7f9c843ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c7c071650 0x7f9c7c0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.517+0000 7f9c843ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c7c1601d0 0x7f9c7c1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.517+0000 7f9c843ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c15df10 con 0x7f9c7c071650 2023-07-09T21:52:30.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.517+0000 7f9c843ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0b4b30 con 0x7f9c7c1601d0 2023-07-09T21:52:30.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.517+0000 7f9c843ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0b4290 con 0x7f9c7c069f30 2023-07-09T21:52:30.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.518+0000 7f9c8199a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c7c071650 0x7f9c7c0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.518+0000 7f9c8199a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c7c071650 0x7f9c7c0b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34872/0 (socket says 172.21.15.53:34872) 2023-07-09T21:52:30.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.518+0000 7f9c8199a700 1 -- 172.21.15.53:0/3359029042 learned_addr learned my addr 172.21.15.53:0/3359029042 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:30.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.518+0000 7f9c8219b700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c7c069f30 0x7f9c7c0af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.518+0000 7f9c8299c700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c7c1601d0 0x7f9c7c1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.518+0000 7f9c8199a700 1 -- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c7c069f30 msgr2=0x7f9c7c0af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:30.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.518+0000 7f9c8199a700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c7c069f30 0x7f9c7c0af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.518+0000 7f9c8199a700 1 -- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c7c1601d0 msgr2=0x7f9c7c1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:30.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.518+0000 7f9c8199a700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c7c1601d0 0x7f9c7c1553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.518+0000 7f9c8199a700 1 -- 172.21.15.53:0/3359029042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74009b30 con 0x7f9c7c071650 2023-07-09T21:52:30.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.518+0000 7f9c8299c700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c7c1601d0 0x7f9c7c1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:30.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.518+0000 7f9c8199a700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c7c071650 0x7f9c7c0b3a40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00e870 tx=0x7f9c6c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:30.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.518+0000 7f9c72ffd700 1 -- 172.21.15.53:0/3359029042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c009590 con 0x7f9c7c071650 2023-07-09T21:52:30.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.519+0000 7f9c72ffd700 1 -- 172.21.15.53:0/3359029042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c013680 con 0x7f9c7c071650 2023-07-09T21:52:30.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.519+0000 7f9c843ff700 1 -- 172.21.15.53:0/3359029042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c0b4570 con 0x7f9c7c071650 2023-07-09T21:52:30.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.519+0000 7f9c72ffd700 1 -- 172.21.15.53:0/3359029042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0139f0 con 0x7f9c7c071650 2023-07-09T21:52:30.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.519+0000 7f9c843ff700 1 -- 172.21.15.53:0/3359029042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c15e140 con 0x7f9c7c071650 2023-07-09T21:52:30.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.521+0000 7f9c72ffd700 1 -- 172.21.15.53:0/3359029042 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f9c6c013b50 con 0x7f9c7c071650 2023-07-09T21:52:30.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.522+0000 7f9c72ffd700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9c6006ad70 0x7f9c6006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.522+0000 7f9c72ffd700 1 -- 172.21.15.53:0/3359029042 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c6c089370 con 0x7f9c7c071650 2023-07-09T21:52:30.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.522+0000 7f9c8219b700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9c6006ad70 0x7f9c6006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.523+0000 7f9c8219b700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9c6006ad70 0x7f9c6006d220 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9c78007fd0 tx=0x7f9c78007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:30.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.524+0000 7f9c97d91b80 1 Processor -- start 2023-07-09T21:52:30.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.524+0000 7f9c97d91b80 1 -- start start 2023-07-09T21:52:30.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c97d91b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fab060 0x55fa09fab430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c97d91b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fae390 0x55fa09fae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c97d91b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 0x55fa09f82560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c97d91b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa09e88c60 con 0x55fa09fae390 2023-07-09T21:52:30.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c97d91b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa09edb9f0 con 0x55fa09fab060 2023-07-09T21:52:30.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c97d91b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa09ed4e80 con 0x55fa09faee20 2023-07-09T21:52:30.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c8199a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fae390 0x55fa09fae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c8199a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fae390 0x55fa09fae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34888/0 (socket says 172.21.15.53:34888) 2023-07-09T21:52:30.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c8199a700 1 -- 172.21.15.53:0/576379292 learned_addr learned my addr 172.21.15.53:0/576379292 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:30.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c8199a700 1 -- 172.21.15.53:0/576379292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 msgr2=0x55fa09f82560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:30.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c8199a700 1 --2- 172.21.15.53:0/576379292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 0x55fa09f82560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c8199a700 1 -- 172.21.15.53:0/576379292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fab060 msgr2=0x55fa09fab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:30.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c8199a700 1 --2- 172.21.15.53:0/576379292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fab060 0x55fa09fab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.525+0000 7f9c8199a700 1 -- 172.21.15.53:0/576379292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa09d02d90 con 0x55fa09fae390 2023-07-09T21:52:30.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.526+0000 7f9c8199a700 1 --2- 172.21.15.53:0/576379292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fae390 0x55fa09fae8e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c087700 tx=0x7f9c6c05c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e85e593d736a7f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:30.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.526+0000 7f9c5ffff700 1 -- 172.21.15.53:0/576379292 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c089070 con 0x55fa09fae390 2023-07-09T21:52:30.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.526+0000 7f9c5ffff700 1 -- 172.21.15.53:0/576379292 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c0891d0 con 0x55fa09fae390 2023-07-09T21:52:30.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.526+0000 7f9c5ffff700 1 -- 172.21.15.53:0/576379292 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0577e0 con 0x55fa09fae390 2023-07-09T21:52:30.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.527+0000 7f9c97d91b80 1 -- 172.21.15.53:0/576379292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fae390 msgr2=0x55fa09fae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:30.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.527+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/576379292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fae390 0x55fa09fae8e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c087700 tx=0x7f9c6c05c230 comp rx=0 tx=0).stop 2023-07-09T21:52:30.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.527+0000 7f9c97d91b80 1 -- 172.21.15.53:0/576379292 shutdown_connections 2023-07-09T21:52:30.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.527+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/576379292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 0x55fa09f82560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.527+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/576379292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fab060 0x55fa09fab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.527+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/576379292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fae390 0x55fa09fae8e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.527+0000 7f9c97d91b80 1 -- 172.21.15.53:0/576379292 >> 172.21.15.53:0/576379292 conn(0x55fa09f78a90 msgr2=0x55fa09f7e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:30.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.527+0000 7f9c97d91b80 1 -- 172.21.15.53:0/576379292 shutdown_connections 2023-07-09T21:52:30.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.527+0000 7f9c97d91b80 1 -- 172.21.15.53:0/576379292 wait complete. 2023-07-09T21:52:30.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.527+0000 7f9c97d91b80 1 -- start start 2023-07-09T21:52:30.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.528+0000 7f9c97d91b80 1 Processor -- start 2023-07-09T21:52:30.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.529+0000 7f9c97d91b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fab060 0x55fa09fac650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.529+0000 7f9c97d91b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09fae390 0x55fa09f802d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.529+0000 7f9c97d91b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09faee20 0x55fa09fb19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.529+0000 7f9c97d91b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa09e74a70 con 0x55fa09faee20 2023-07-09T21:52:30.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.529+0000 7f9c97d91b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa09e74770 con 0x55fa09fab060 2023-07-09T21:52:30.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.529+0000 7f9c97d91b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa09d588d0 con 0x55fa09fae390 2023-07-09T21:52:30.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.529+0000 7f9c97d91b80 10 client.0 _ll_register_callbacks cb 0x55fa09e72710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:52:30.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.529+0000 7f9c8299c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09faee20 0x55fa09fb19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.529+0000 7f9c8299c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09faee20 0x55fa09fb19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34894/0 (socket says 172.21.15.53:34894) 2023-07-09T21:52:30.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.529+0000 7f9c8299c700 1 -- 172.21.15.53:0/3898404272 learned_addr learned my addr 172.21.15.53:0/3898404272 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:30.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.529+0000 7f9c8199a700 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09fae390 0x55fa09f802d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.529+0000 7f9c8219b700 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fab060 0x55fa09fac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c8299c700 1 -- 172.21.15.53:0/3898404272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09fae390 msgr2=0x55fa09f802d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c8299c700 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09fae390 0x55fa09f802d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c8299c700 1 -- 172.21.15.53:0/3898404272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fab060 msgr2=0x55fa09fac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c8299c700 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fab060 0x55fa09fac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c8299c700 1 -- 172.21.15.53:0/3898404272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c15e140 con 0x55fa09faee20 2023-07-09T21:52:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c8199a700 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09fae390 0x55fa09f802d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:52:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c8299c700 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09faee20 0x55fa09fb19e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9c74012000 tx=0x7f9c74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e97775199d83735 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c5d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-07-09T21:52:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c5d7fa700 1 -- 172.21.15.53:0/3898404272 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74004240 con 0x55fa09faee20 2023-07-09T21:52:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3898404272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa09ecde60 con 0x55fa09faee20 2023-07-09T21:52:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c5d7fa700 1 -- 172.21.15.53:0/3898404272 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c740043a0 con 0x55fa09faee20 2023-07-09T21:52:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c5d7fa700 1 -- 172.21.15.53:0/3898404272 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c74004560 con 0x55fa09faee20 2023-07-09T21:52:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c97d91b80 10 client.5799 fetch_fsmap learned FSMap version 27 2023-07-09T21:52:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.530+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3898404272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x55fa09cebc10 con 0x55fa09faee20 2023-07-09T21:52:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.531+0000 7f9c5d7fa700 1 -- 172.21.15.53:0/3898404272 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa09ecde60 con 0x55fa09faee20 2023-07-09T21:52:30.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.531+0000 7f9c5d7fa700 1 -- 172.21.15.53:0/3898404272 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f9c74023020 con 0x55fa09faee20 2023-07-09T21:52:30.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.531+0000 7f9c97d91b80 10 client.5799 fetch_fsmap finished waiting for FSMap version 27 2023-07-09T21:52:30.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.531+0000 7f9c97d91b80 10 client.5799 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T21:52:30.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.531+0000 7f9c97d91b80 20 client.5799 populate_metadata read hostname 'smithi053' 2023-07-09T21:52:30.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.531+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.53:6833/3167613257,v1:172.21.15.53:6835/3167613257] conn(0x55fa09fca9a0 0x55fa09fcad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.531+0000 7f9c97d91b80 4 client.5799 mds_command: new command op to 5619 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T21:52:30.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.531+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3898404272 --> [v2:172.21.15.53:6833/3167613257,v1:172.21.15.53:6835/3167613257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa09e90000 con 0x55fa09fca9a0 2023-07-09T21:52:30.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.531+0000 7f9c8219b700 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.53:6833/3167613257,v1:172.21.15.53:6835/3167613257] conn(0x55fa09fca9a0 0x55fa09fcad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.531+0000 7f9c8219b700 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.53:6833/3167613257,v1:172.21.15.53:6835/3167613257] conn(0x55fa09fca9a0 0x55fa09fcad70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=685aa4440c43faf1 server_cookie=4241dca15af17419 in_seq=0 out_seq=0 2023-07-09T21:52:30.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.531+0000 7f9c5d7fa700 10 client.5799 ms_handle_connect on v2:172.21.15.53:6833/3167613257 2023-07-09T21:52:30.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.532+0000 7f9c5d7fa700 1 -- 172.21.15.53:0/3898404272 <== mds.0 v2:172.21.15.53:6833/3167613257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fa09e90000 con 0x55fa09fca9a0 2023-07-09T21:52:30.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.532+0000 7f9c5d7fa700 10 client.5799 handle_command_reply: tid=0 2023-07-09T21:52:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.532+0000 7f9c97d91b80 1 client.5799 shutdown 2023-07-09T21:52:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.533+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3898404272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09faee20 msgr2=0x55fa09fb19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.533+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09faee20 0x55fa09fb19e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9c74012000 tx=0x7f9c74004ad0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.533+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3898404272 shutdown_connections 2023-07-09T21:52:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.533+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.53:6833/3167613257,v1:172.21.15.53:6835/3167613257] conn(0x55fa09fca9a0 0x55fa09fcad70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.533+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09faee20 0x55fa09fb19e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.533+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fab060 0x55fa09fac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.533+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/3898404272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09fae390 0x55fa09f802d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.533+0000 7f9c5d7fa700 0 client.5799 ms_handle_reset on v2:172.21.15.53:6833/3167613257 2023-07-09T21:52:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.533+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3898404272 >> 172.21.15.53:0/3898404272 conn(0x55fa09f78a90 msgr2=0x55fa09f82420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.533+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3898404272 shutdown_connections 2023-07-09T21:52:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.533+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3898404272 wait complete. 2023-07-09T21:52:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.533+0000 7f9c97d91b80 20 client.5799 trim_cache size 0 max 16384 2023-07-09T21:52:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.551+0000 7f9c97d91b80 1 Processor -- start 2023-07-09T21:52:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.551+0000 7f9c97d91b80 1 -- start start 2023-07-09T21:52:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.552+0000 7f9c97d91b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 0x55fa09fc9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.552+0000 7f9c97d91b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fae390 0x55fa09f81530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.552+0000 7f9c97d91b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 0x55fa09fc5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.552+0000 7f9c97d91b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa09fad7e0 con 0x55fa09fab060 2023-07-09T21:52:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.552+0000 7f9c97d91b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa09fac0a0 con 0x55fa09fae390 2023-07-09T21:52:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.552+0000 7f9c97d91b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa09fd7af0 con 0x55fa09faee20 2023-07-09T21:52:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.552+0000 7f9c8219b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 0x55fa09fc9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.553+0000 7f9c8219b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 0x55fa09fc9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34904/0 (socket says 172.21.15.53:34904) 2023-07-09T21:52:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.553+0000 7f9c8219b700 1 -- 172.21.15.53:0/4179457111 learned_addr learned my addr 172.21.15.53:0/4179457111 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.553+0000 7f9c8199a700 1 --2- 172.21.15.53:0/4179457111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fae390 0x55fa09f81530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.553+0000 7f9c8299c700 1 --2- 172.21.15.53:0/4179457111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 0x55fa09fc5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.553+0000 7f9c8219b700 1 -- 172.21.15.53:0/4179457111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 msgr2=0x55fa09fc5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.553+0000 7f9c8219b700 1 --2- 172.21.15.53:0/4179457111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 0x55fa09fc5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.553+0000 7f9c8219b700 1 -- 172.21.15.53:0/4179457111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fae390 msgr2=0x55fa09f81530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.553+0000 7f9c8219b700 1 --2- 172.21.15.53:0/4179457111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fae390 0x55fa09f81530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.553+0000 7f9c8219b700 1 -- 172.21.15.53:0/4179457111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa09d29200 con 0x55fa09fab060 2023-07-09T21:52:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.553+0000 7f9c8299c700 1 --2- 172.21.15.53:0/4179457111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 0x55fa09fc5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.553+0000 7f9c8219b700 1 --2- 172.21.15.53:0/4179457111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 0x55fa09fc9be0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9c780049c0 tx=0x7f9c78013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd34ca99f4f2d1e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.554+0000 7f9c70bff700 1 -- 172.21.15.53:0/4179457111 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78001bd0 con 0x55fa09fab060 2023-07-09T21:52:30.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.554+0000 7f9c70bff700 1 -- 172.21.15.53:0/4179457111 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c78001d30 con 0x55fa09fab060 2023-07-09T21:52:30.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.554+0000 7f9c70bff700 1 -- 172.21.15.53:0/4179457111 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78024420 con 0x55fa09fab060 2023-07-09T21:52:30.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.554+0000 7f9c97d91b80 1 -- 172.21.15.53:0/4179457111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 msgr2=0x55fa09fc9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:30.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.554+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/4179457111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 0x55fa09fc9be0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9c780049c0 tx=0x7f9c78013000 comp rx=0 tx=0).stop 2023-07-09T21:52:30.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.554+0000 7f9c97d91b80 1 -- 172.21.15.53:0/4179457111 shutdown_connections 2023-07-09T21:52:30.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.554+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/4179457111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 0x55fa09fc5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.554+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/4179457111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 0x55fa09fc9be0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.554+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/4179457111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fae390 0x55fa09f81530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.554+0000 7f9c97d91b80 1 -- 172.21.15.53:0/4179457111 >> 172.21.15.53:0/4179457111 conn(0x55fa09f78a90 msgr2=0x55fa09fd7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.554+0000 7f9c97d91b80 1 -- 172.21.15.53:0/4179457111 shutdown_connections 2023-07-09T21:52:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.554+0000 7f9c97d91b80 1 -- 172.21.15.53:0/4179457111 wait complete. 2023-07-09T21:52:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.555+0000 7f9c97d91b80 1 -- start start 2023-07-09T21:52:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.555+0000 7f9c97d91b80 1 Processor -- start 2023-07-09T21:52:30.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.557+0000 7f9c97d91b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 0x55fa0a02ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.557+0000 7f9c97d91b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fae390 0x55fa09fa9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.557+0000 7f9c97d91b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 0x55fa09fa7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.557+0000 7f9c97d91b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa09fa88c0 con 0x55fa09fab060 2023-07-09T21:52:30.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.557+0000 7f9c97d91b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa09f82b10 con 0x55fa09fae390 2023-07-09T21:52:30.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.557+0000 7f9c97d91b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa09f855e0 con 0x55fa09faee20 2023-07-09T21:52:30.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.557+0000 7f9c97d91b80 10 client.0 _ll_register_callbacks cb 0x7f9c6c0090e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:52:30.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.557+0000 7f9c8219b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 0x55fa0a02ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.557+0000 7f9c8219b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 0x55fa0a02ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34906/0 (socket says 172.21.15.53:34906) 2023-07-09T21:52:30.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.557+0000 7f9c8219b700 1 -- 172.21.15.53:0/3486220491 learned_addr learned my addr 172.21.15.53:0/3486220491 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:30.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.558+0000 7f9c8299c700 1 --2- 172.21.15.53:0/3486220491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 0x55fa09fa7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.558+0000 7f9c8199a700 1 --2- 172.21.15.53:0/3486220491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fae390 0x55fa09fa9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.558+0000 7f9c8219b700 1 -- 172.21.15.53:0/3486220491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 msgr2=0x55fa09fa7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:30.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.558+0000 7f9c8219b700 1 --2- 172.21.15.53:0/3486220491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 0x55fa09fa7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.558+0000 7f9c8219b700 1 -- 172.21.15.53:0/3486220491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fae390 msgr2=0x55fa09fa9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:30.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.558+0000 7f9c8219b700 1 --2- 172.21.15.53:0/3486220491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fae390 0x55fa09fa9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.558+0000 7f9c8219b700 1 -- 172.21.15.53:0/3486220491 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c78001890 con 0x55fa09fab060 2023-07-09T21:52:30.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.558+0000 7f9c8219b700 1 --2- 172.21.15.53:0/3486220491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 0x55fa0a02ec30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9c78004fd0 tx=0x7f9c78000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f3171b65181cb8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:30.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.558+0000 7f9c5d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-07-09T21:52:30.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.558+0000 7f9c5d7fa700 1 -- 172.21.15.53:0/3486220491 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78024c70 con 0x55fa09fab060 2023-07-09T21:52:30.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.558+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3486220491 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa09fcd190 con 0x55fa09fab060 2023-07-09T21:52:30.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.558+0000 7f9c5d7fa700 1 -- 172.21.15.53:0/3486220491 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c78024dd0 con 0x55fa09fab060 2023-07-09T21:52:30.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.559+0000 7f9c5d7fa700 1 -- 172.21.15.53:0/3486220491 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c7802f450 con 0x55fa09fab060 2023-07-09T21:52:30.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.559+0000 7f9c97d91b80 10 client.5805 fetch_fsmap learned FSMap version 27 2023-07-09T21:52:30.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.559+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3486220491 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x55fa09d01260 con 0x55fa09fab060 2023-07-09T21:52:30.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.559+0000 7f9c5d7fa700 1 -- 172.21.15.53:0/3486220491 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa09fcd190 con 0x55fa09fab060 2023-07-09T21:52:30.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.559+0000 7f9c5d7fa700 1 -- 172.21.15.53:0/3486220491 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f9c78020070 con 0x55fa09fab060 2023-07-09T21:52:30.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.559+0000 7f9c97d91b80 10 client.5805 fetch_fsmap finished waiting for FSMap version 27 2023-07-09T21:52:30.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.559+0000 7f9c97d91b80 10 client.5805 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T21:52:30.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.559+0000 7f9c97d91b80 20 client.5805 populate_metadata read hostname 'smithi053' 2023-07-09T21:52:30.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.559+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/3486220491 >> [v2:172.21.15.53:6833/3167613257,v1:172.21.15.53:6835/3167613257] conn(0x55fa09fc4d60 0x55fa09fc5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.559+0000 7f9c97d91b80 4 client.5805 mds_command: new command op to 5619 tid=0[{"prefix": "status"}] 2023-07-09T21:52:30.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.559+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3486220491 --> [v2:172.21.15.53:6833/3167613257,v1:172.21.15.53:6835/3167613257] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fa09f760a0 con 0x55fa09fc4d60 2023-07-09T21:52:30.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.559+0000 7f9c8199a700 1 --2- 172.21.15.53:0/3486220491 >> [v2:172.21.15.53:6833/3167613257,v1:172.21.15.53:6835/3167613257] conn(0x55fa09fc4d60 0x55fa09fc5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c8199a700 1 --2- 172.21.15.53:0/3486220491 >> [v2:172.21.15.53:6833/3167613257,v1:172.21.15.53:6835/3167613257] conn(0x55fa09fc4d60 0x55fa09fc5130 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6942e11da6bf3cc server_cookie=24aa492fbcad1f23 in_seq=0 out_seq=0 2023-07-09T21:52:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c5d7fa700 10 client.5805 ms_handle_connect on v2:172.21.15.53:6833/3167613257 2023-07-09T21:52:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c5d7fa700 1 -- 172.21.15.53:0/3486220491 <== mds.0 v2:172.21.15.53:6833/3167613257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55fa09f760a0 con 0x55fa09fc4d60 2023-07-09T21:52:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c5d7fa700 10 client.5805 handle_command_reply: tid=0 2023-07-09T21:52:30.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c97d91b80 1 client.5805 shutdown 2023-07-09T21:52:30.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3486220491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 msgr2=0x55fa0a02ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:30.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/3486220491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 0x55fa0a02ec30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9c78004fd0 tx=0x7f9c78000ed0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3486220491 shutdown_connections 2023-07-09T21:52:30.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/3486220491 >> [v2:172.21.15.53:6833/3167613257,v1:172.21.15.53:6835/3167613257] conn(0x55fa09fc4d60 0x55fa09fc5130 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/3486220491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fa09faee20 0x55fa09fa7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/3486220491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa09fab060 0x55fa0a02ec30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c97d91b80 1 --2- 172.21.15.53:0/3486220491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa09fae390 0x55fa09fa9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c5d7fa700 0 client.5805 ms_handle_reset on v2:172.21.15.53:6833/3167613257 2023-07-09T21:52:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3486220491 >> 172.21.15.53:0/3486220491 conn(0x55fa09f78a90 msgr2=0x55fa09f800e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3486220491 shutdown_connections 2023-07-09T21:52:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.560+0000 7f9c97d91b80 1 -- 172.21.15.53:0/3486220491 wait complete. 2023-07-09T21:52:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.561+0000 7f9c97d91b80 20 client.5805 trim_cache size 0 max 16384 2023-07-09T21:52:30.573 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-07-09T21:52:30.573 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "25d21351-dc09-4310-b56b-79a331e4aa31", 2023-07-09T21:52:30.573 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-07-09T21:52:30.573 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 5619, 2023-07-09T21:52:30.573 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-07-09T21:52:30.573 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-07-09T21:52:30.574 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-07-09T21:52:30.574 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 11.665510109, 2023-07-09T21:52:30.574 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 27, 2023-07-09T21:52:30.574 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 51, 2023-07-09T21:52:30.575 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 51, 2023-07-09T21:52:30.575 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 17.100159442999999 2023-07-09T21:52:30.575 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-07-09T21:52:30.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.561+0000 7f9c843ff700 1 -- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9c6006ad70 msgr2=0x7f9c6006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:30.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.561+0000 7f9c843ff700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9c6006ad70 0x7f9c6006d220 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9c78007fd0 tx=0x7f9c78007de0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.561+0000 7f9c843ff700 1 -- 172.21.15.53:0/3359029042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c7c071650 msgr2=0x7f9c7c0b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:30.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.561+0000 7f9c843ff700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c7c071650 0x7f9c7c0b3a40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00e870 tx=0x7f9c6c00eb80 comp rx=0 tx=0).stop 2023-07-09T21:52:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.561+0000 7f9c843ff700 1 -- 172.21.15.53:0/3359029042 shutdown_connections 2023-07-09T21:52:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.561+0000 7f9c843ff700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f9c6006ad70 0x7f9c6006d220 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.561+0000 7f9c843ff700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c7c1601d0 0x7f9c7c1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.561+0000 7f9c843ff700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c7c069f30 0x7f9c7c0af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.561+0000 7f9c843ff700 1 --2- 172.21.15.53:0/3359029042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c7c071650 0x7f9c7c0b3a40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.561+0000 7f9c843ff700 1 -- 172.21.15.53:0/3359029042 >> 172.21.15.53:0/3359029042 conn(0x7f9c7c0cc640 msgr2=0x7f9c7c1e6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.561+0000 7f9c843ff700 1 -- 172.21.15.53:0/3359029042 shutdown_connections 2023-07-09T21:52:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.561+0000 7f9c843ff700 1 -- 172.21.15.53:0/3359029042 wait complete. 2023-07-09T21:52:30.581 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:52:30.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.782+0000 7f1f9e5ff700 1 Processor -- start 2023-07-09T21:52:30.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.782+0000 7f1f9e5ff700 1 -- start start 2023-07-09T21:52:30.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.784+0000 7f1f9e5ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1f980b6c80 0x7f1f980d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.784+0000 7f1f9e5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1f980d1050 0x7f1f980b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.784+0000 7f1f9e5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f980b7f50 con 0x7f1f980b4510 2023-07-09T21:52:30.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.784+0000 7f1f9e5ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f980b48e0 con 0x7f1f980b6c80 2023-07-09T21:52:30.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.784+0000 7f1f9e5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f980d14d0 con 0x7f1f980d1050 2023-07-09T21:52:30.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.784+0000 7f1f8ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1f980b6c80 0x7f1f980d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.784+0000 7f1f8ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1f980b6c80 0x7f1f980d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34912/0 (socket says 172.21.15.53:34912) 2023-07-09T21:52:30.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.784+0000 7f1f8ffff700 1 -- 172.21.15.53:0/3488103867 learned_addr learned my addr 172.21.15.53:0/3488103867 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:30.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.784+0000 7f1f9cb9c700 1 --2- 172.21.15.53:0/3488103867 >> v2:172.21.15.184:3300/0 conn(0x7f1f980d1050 0x7f1f980b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.784+0000 7f1f8ffff700 1 -- 172.21.15.53:0/3488103867 >> v2:172.21.15.184:3300/0 conn(0x7f1f980d1050 msgr2=0x7f1f980b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:30.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.784+0000 7f1f8ffff700 1 --2- 172.21.15.53:0/3488103867 >> v2:172.21.15.184:3300/0 conn(0x7f1f980d1050 0x7f1f980b83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.784+0000 7f1f8ffff700 1 -- 172.21.15.53:0/3488103867 >> v1:172.21.15.184:6789/0 conn(0x7f1f980b4510 legacy=0x7f1f980cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:30.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.784+0000 7f1f8ffff700 1 -- 172.21.15.53:0/3488103867 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f980b70d0 con 0x7f1f980b6c80 2023-07-09T21:52:30.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.785+0000 7f1f8ffff700 1 --2- 172.21.15.53:0/3488103867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f980b6c80 0x7f1f980d0b10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1f98067390 tx=0x7f1f80009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87423ecbff773e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:30.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.785+0000 7f1f977fe700 1 -- 172.21.15.53:0/3488103867 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8000b870 con 0x7f1f980b6c80 2023-07-09T21:52:30.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.785+0000 7f1f977fe700 1 -- 172.21.15.53:0/3488103867 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8000b9d0 con 0x7f1f980b6c80 2023-07-09T21:52:30.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.785+0000 7f1f977fe700 1 -- 172.21.15.53:0/3488103867 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8000bd60 con 0x7f1f980b6c80 2023-07-09T21:52:30.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.785+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/3488103867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f980b6c80 msgr2=0x7f1f980d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:30.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.785+0000 7f1f9e5ff700 1 --2- 172.21.15.53:0/3488103867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f980b6c80 0x7f1f980d0b10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1f98067390 tx=0x7f1f80009bd0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.786+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/3488103867 shutdown_connections 2023-07-09T21:52:30.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.786+0000 7f1f9e5ff700 1 --2- 172.21.15.53:0/3488103867 >> v2:172.21.15.184:3300/0 conn(0x7f1f980d1050 0x7f1f980b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.786+0000 7f1f9e5ff700 1 --2- 172.21.15.53:0/3488103867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f980b6c80 0x7f1f980d0b10 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.786+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/3488103867 >> 172.21.15.53:0/3488103867 conn(0x7f1f9809c1d0 msgr2=0x7f1f980d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:30.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.786+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/3488103867 shutdown_connections 2023-07-09T21:52:30.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.786+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/3488103867 wait complete. 2023-07-09T21:52:30.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.787+0000 7f1f9e5ff700 1 Processor -- start 2023-07-09T21:52:30.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.787+0000 7f1f9e5ff700 1 -- start start 2023-07-09T21:52:30.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.788+0000 7f1f9e5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f980b4510 0x7f1f980c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.788+0000 7f1f9e5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f980b6c80 0x7f1f980c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.788+0000 7f1f9e5ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f980d1050 0x7f1f98150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.788+0000 7f1f9e5ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980c8bc0 con 0x7f1f980d1050 2023-07-09T21:52:30.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.788+0000 7f1f9e5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f98155420 con 0x7f1f980b6c80 2023-07-09T21:52:30.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.788+0000 7f1f9e5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980c8dd0 con 0x7f1f980b4510 2023-07-09T21:52:30.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.789+0000 7f1f9cb9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f980d1050 0x7f1f98150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.789+0000 7f1f9cb9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f980d1050 0x7f1f98150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34918/0 (socket says 172.21.15.53:34918) 2023-07-09T21:52:30.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.789+0000 7f1f9cb9c700 1 -- 172.21.15.53:0/4214689611 learned_addr learned my addr 172.21.15.53:0/4214689611 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:30.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.789+0000 7f1f8ffff700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f980b6c80 0x7f1f980c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.789+0000 7f1f97fff700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f980b4510 0x7f1f980c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.789+0000 7f1f9cb9c700 1 -- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f980b4510 msgr2=0x7f1f980c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:30.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.789+0000 7f1f9cb9c700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f980b4510 0x7f1f980c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.789+0000 7f1f9cb9c700 1 -- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f980b6c80 msgr2=0x7f1f980c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:30.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.789+0000 7f1f9cb9c700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f980b6c80 0x7f1f980c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:30.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.789+0000 7f1f9cb9c700 1 -- 172.21.15.53:0/4214689611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f80009550 con 0x7f1f980d1050 2023-07-09T21:52:30.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.789+0000 7f1f8ffff700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f980b6c80 0x7f1f980c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:30.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.789+0000 7f1f9cb9c700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f980d1050 0x7f1f98150d20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1f90007e60 tx=0x7f1f9000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:30.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.790+0000 7f1f957fa700 1 -- 172.21.15.53:0/4214689611 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9000ede0 con 0x7f1f980d1050 2023-07-09T21:52:30.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.790+0000 7f1f957fa700 1 -- 172.21.15.53:0/4214689611 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f90014420 con 0x7f1f980d1050 2023-07-09T21:52:30.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.790+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/4214689611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f98155670 con 0x7f1f980d1050 2023-07-09T21:52:30.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.790+0000 7f1f957fa700 1 -- 172.21.15.53:0/4214689611 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900147d0 con 0x7f1f980d1050 2023-07-09T21:52:30.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.790+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/4214689611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f98155c30 con 0x7f1f980d1050 2023-07-09T21:52:30.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.791+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/4214689611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9804e280 con 0x7f1f980d1050 2023-07-09T21:52:30.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.792+0000 7f1f957fa700 1 -- 172.21.15.53:0/4214689611 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f1f90014930 con 0x7f1f980d1050 2023-07-09T21:52:30.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.793+0000 7f1f957fa700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1f7806ad70 0x7f1f7806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:30.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.793+0000 7f1f957fa700 1 -- 172.21.15.53:0/4214689611 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f90089d40 con 0x7f1f980d1050 2023-07-09T21:52:30.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.793+0000 7f1f97fff700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1f7806ad70 0x7f1f7806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:30.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.794+0000 7f1f97fff700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1f7806ad70 0x7f1f7806d220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1f88000fb0 tx=0x7f1f88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:30.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:30.798+0000 7f1f957fa700 1 -- 172.21.15.53:0/4214689611 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f90054db0 con 0x7f1f980d1050 2023-07-09T21:52:31.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.056+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/4214689611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1f98155df0 con 0x7f1f980d1050 2023-07-09T21:52:31.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.056+0000 7f1f957fa700 1 -- 172.21.15.53:0/4214689611 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1f90089030 con 0x7f1f980d1050 2023-07-09T21:52:31.058 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:52:31.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.058+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1f7806ad70 msgr2=0x7f1f7806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:31.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.058+0000 7f1f9e5ff700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1f7806ad70 0x7f1f7806d220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1f88000fb0 tx=0x7f1f88009040 comp rx=0 tx=0).stop 2023-07-09T21:52:31.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.058+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/4214689611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f980d1050 msgr2=0x7f1f98150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:31.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.058+0000 7f1f9e5ff700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f980d1050 0x7f1f98150d20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1f90007e60 tx=0x7f1f9000e3c0 comp rx=0 tx=0).stop 2023-07-09T21:52:31.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.058+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/4214689611 shutdown_connections 2023-07-09T21:52:31.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.058+0000 7f1f9e5ff700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1f7806ad70 0x7f1f7806d220 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:31.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.058+0000 7f1f9e5ff700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f980d1050 0x7f1f98150d20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:31.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.058+0000 7f1f9e5ff700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f980b4510 0x7f1f980c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:31.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.058+0000 7f1f9e5ff700 1 --2- 172.21.15.53:0/4214689611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f980b6c80 0x7f1f980c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:31.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.058+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/4214689611 >> 172.21.15.53:0/4214689611 conn(0x7f1f9809c1d0 msgr2=0x7f1f980ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:31.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.058+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/4214689611 shutdown_connections 2023-07-09T21:52:31.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:31.059+0000 7f1f9e5ff700 1 -- 172.21.15.53:0/4214689611 wait complete. 2023-07-09T21:52:31.077 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T21:52:31.078 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:52:31.078 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-07-09T21:52:31.078 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T21:52:31.079 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:52:31.079 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T21:52:31.079 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T21:52:31.079 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:52:31.080 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:52:31.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:31.080 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-07-09T21:52:31.124 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:52:31.124 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:52:31.125 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:52:31.125 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:31.125 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-07-09T21:52:31.125 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:31.125 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:52:31.125 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-07-09T21:52:31.126 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-07-09T21:52:31.126 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:52:31.126 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-07-09T21:52:31.126 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-07-09T21:52:31.126 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:52:31.127 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:52:31.127 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-07-09T21:52:31.127 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-09T21:52:31.127 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42001sec preferred_lft 42001sec 2023-07-09T21:52:31.127 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-07-09T21:52:31.127 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:31.127 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:52:31.127 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:52:31.128 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-07-09T21:52:31.128 INFO:teuthology.orchestra.run.smithi053.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:52:31.128 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 4e:2d:4a:aa:2a:16 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:52:31.128 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:52:31.128 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:31.129 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::7d:bbff:fed2:eee3/64 scope link 2023-07-09T21:52:31.129 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:31.129 INFO:teuthology.orchestra.run.smithi053.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:52:31.129 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 4e:2d:4a:aa:2a:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:52:31.129 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::4c2d:4aff:feaa:2a16/64 scope link 2023-07-09T21:52:31.129 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:31.129 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:52:31.130 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 7e:34:96:47:0b:ee brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:52:31.130 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::7c34:96ff:fe47:bee/64 scope link 2023-07-09T21:52:31.130 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:31.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:31.131 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:52:31.231 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-07-09T21:52:31.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:31.235 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-07-09T21:52:31.281 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-07-09T21:52:31.282 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:52:31.282 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-09T21:52:31.282 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-09T21:52:31.282 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:52:31.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:31.284 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-07-09T21:52:31.284 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-07-09T21:52:31.284 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:52:31.285 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:52:31.285 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:52:31.286 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-07-09T21:52:31.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:31.494 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-07-09T21:52:31.537 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T21:52:31.538 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:52:31.538 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:52:31.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:31.539 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-07-09T21:52:31.646 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:52:31.646 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T21:52:31.689 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:52:31.690 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:52:31.691 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:52:31.773 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-09T21:52:31.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:31.774 DEBUG:teuthology.orchestra.run.smithi053:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-09T21:52:31.918 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-09T21:52:31.919 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-09T21:52:31.919 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2023-07-09T21:52:31.937 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-09T21:52:31.937 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-09T21:52:31.937 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2023-07-09T21:52:31.938 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:52:31.938 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:52:31.958 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-09T21:52:31.959 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-09T21:52:31.959 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2023-07-09T21:52:31.959 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:52:31.960 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:52:31.960 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-07-09T21:52:31.960 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-07-09T21:52:31.961 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=25d21351-dc09-4310-b56b-79a331e4aa31" will pass to kernel 2023-07-09T21:52:31.964 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T21:52:31.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:31.965 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:52:32.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:32.034 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:52:32.129 INFO:teuthology.orchestra.run.smithi053.stdout:client5814 2023-07-09T21:52:32.130 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:52:32.130 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:32.173 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:52:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.412+0000 7fbd1efff700 1 Processor -- start 2023-07-09T21:52:32.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.412+0000 7fbd1efff700 1 -- start start 2023-07-09T21:52:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.413+0000 7fbd1efff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd180b2350 0x7fbd180b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.413+0000 7fbd1efff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd180d2ce0 con 0x7fbd180b1e00 2023-07-09T21:52:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.413+0000 7fbd1efff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd180b3350 con 0x7fbd180d1220 2023-07-09T21:52:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.413+0000 7fbd1efff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180b3630 con 0x7fbd180b2350 2023-07-09T21:52:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.413+0000 7fbd1cd9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbd180b1e00 0x7fbd180d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46530/0 (socket says 172.21.15.53:46530) 2023-07-09T21:52:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.413+0000 7fbd1cd9b700 1 -- 172.21.15.53:0/679756050 learned_addr learned my addr 172.21.15.53:0/679756050 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd1d59c700 1 --2- 172.21.15.53:0/679756050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd180b2350 0x7fbd180b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611706364 0 0) 0x7fbd180d2ce0 con 0x7fbd180b1e00 2023-07-09T21:52:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd080035b0 con 0x7fbd180b1e00 2023-07-09T21:52:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 483503530 0 0) 0x7fbd080035b0 con 0x7fbd180b1e00 2023-07-09T21:52:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd180b2350 msgr2=0x7fbd180b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 --2- 172.21.15.53:0/679756050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd180b2350 0x7fbd180b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 >> v1:172.21.15.184:6789/0 conn(0x7fbd180d1220 legacy=0x7fbd180afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd180b3910 con 0x7fbd180b1e00 2023-07-09T21:52:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7fbd0c0017f0 con 0x7fbd180b1e00 2023-07-09T21:52:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 >> v1:172.21.15.53:6789/0 conn(0x7fbd180b1e00 legacy=0x7fbd180d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 --2- 172.21.15.53:0/679756050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd08003a30 0x7fbd08003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 --2- 172.21.15.53:0/679756050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd08004850 0x7fbd08004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 --2- 172.21.15.53:0/679756050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd180b2350 0x7fbd080052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180b3630 con 0x7fbd08003a30 2023-07-09T21:52:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0800bbd0 con 0x7fbd08004850 2023-07-09T21:52:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.414+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0800bd90 con 0x7fbd180b2350 2023-07-09T21:52:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.415+0000 7fbd1cd9b700 1 --2- 172.21.15.53:0/679756050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd08003a30 0x7fbd08003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.415+0000 7fbd1d59c700 1 --2- 172.21.15.53:0/679756050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd180b2350 0x7fbd080052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.415+0000 7fbd17fff700 1 --2- 172.21.15.53:0/679756050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd08004850 0x7fbd08004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.415+0000 7fbd1cd9b700 1 -- 172.21.15.53:0/679756050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd180b2350 msgr2=0x7fbd080052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.415+0000 7fbd1cd9b700 1 --2- 172.21.15.53:0/679756050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd180b2350 0x7fbd080052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.415+0000 7fbd1cd9b700 1 -- 172.21.15.53:0/679756050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd08004850 msgr2=0x7fbd08004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.415+0000 7fbd1cd9b700 1 --2- 172.21.15.53:0/679756050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd08004850 0x7fbd08004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.415+0000 7fbd1cd9b700 1 -- 172.21.15.53:0/679756050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd080035b0 con 0x7fbd08003a30 2023-07-09T21:52:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.415+0000 7fbd1cd9b700 1 --2- 172.21.15.53:0/679756050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd08003a30 0x7fbd08003e00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c190 tx=0x7fbd08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4ff2c1a458f2ea server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.415+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00cd30 con 0x7fbd08003a30 2023-07-09T21:52:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.415+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c00ce90 con 0x7fbd08003a30 2023-07-09T21:52:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.415+0000 7fbd177fe700 1 -- 172.21.15.53:0/679756050 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c005a50 con 0x7fbd08003a30 2023-07-09T21:52:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.416+0000 7fbd1efff700 1 -- 172.21.15.53:0/679756050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd08003a30 msgr2=0x7fbd08003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.416+0000 7fbd1efff700 1 --2- 172.21.15.53:0/679756050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd08003a30 0x7fbd08003e00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c190 tx=0x7fbd08005880 comp rx=0 tx=0).stop 2023-07-09T21:52:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.416+0000 7fbd1d59c700 1 -- 172.21.15.53:0/679756050 reap_dead start 2023-07-09T21:52:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.416+0000 7fbd1efff700 1 -- 172.21.15.53:0/679756050 shutdown_connections 2023-07-09T21:52:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.416+0000 7fbd1efff700 1 -- 172.21.15.53:0/679756050 >> 172.21.15.53:0/679756050 conn(0x7fbd1809c1d0 msgr2=0x7fbd180d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:32.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.416+0000 7fbd1efff700 1 -- 172.21.15.53:0/679756050 shutdown_connections 2023-07-09T21:52:32.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.416+0000 7fbd1efff700 1 -- 172.21.15.53:0/679756050 wait complete. 2023-07-09T21:52:32.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.418+0000 7fbd1efff700 1 Processor -- start 2023-07-09T21:52:32.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.418+0000 7fbd1efff700 1 -- start start 2023-07-09T21:52:32.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.419+0000 7fbd1efff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd08003a30 0x7fbd180ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:32.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.419+0000 7fbd1efff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd1814ef50 0x7fbd1815f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:32.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.419+0000 7fbd1efff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd180cba70 0x7fbd18156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:32.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.419+0000 7fbd1efff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1814f6d0 con 0x7fbd08003a30 2023-07-09T21:52:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.419+0000 7fbd1efff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180cbed0 con 0x7fbd1814ef50 2023-07-09T21:52:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.419+0000 7fbd1efff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1815ec40 con 0x7fbd180cba70 2023-07-09T21:52:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.419+0000 7fbd1cd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd08003a30 0x7fbd180ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.419+0000 7fbd1cd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd08003a30 0x7fbd180ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34930/0 (socket says 172.21.15.53:34930) 2023-07-09T21:52:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.419+0000 7fbd1cd9b700 1 -- 172.21.15.53:0/1327617119 learned_addr learned my addr 172.21.15.53:0/1327617119 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.419+0000 7fbd17fff700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd1814ef50 0x7fbd1815f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.419+0000 7fbd1d59c700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd180cba70 0x7fbd18156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.420+0000 7fbd1cd9b700 1 -- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd180cba70 msgr2=0x7fbd18156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.420+0000 7fbd1cd9b700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd180cba70 0x7fbd18156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:32.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.420+0000 7fbd1cd9b700 1 -- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd1814ef50 msgr2=0x7fbd1815f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:32.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.420+0000 7fbd1cd9b700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd1814ef50 0x7fbd1815f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:32.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.420+0000 7fbd1cd9b700 1 -- 172.21.15.53:0/1327617119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1815e090 con 0x7fbd08003a30 2023-07-09T21:52:32.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.420+0000 7fbd1cd9b700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd08003a30 0x7fbd180ccb50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c780 tx=0x7fbd0c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:32.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.420+0000 7fbd157fa700 1 -- 172.21.15.53:0/1327617119 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c005c40 con 0x7fbd08003a30 2023-07-09T21:52:32.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.420+0000 7fbd157fa700 1 -- 172.21.15.53:0/1327617119 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c005da0 con 0x7fbd08003a30 2023-07-09T21:52:32.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.420+0000 7fbd1efff700 1 -- 172.21.15.53:0/1327617119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1815e310 con 0x7fbd08003a30 2023-07-09T21:52:32.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.420+0000 7fbd157fa700 1 -- 172.21.15.53:0/1327617119 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c007310 con 0x7fbd08003a30 2023-07-09T21:52:32.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.420+0000 7fbd1efff700 1 -- 172.21.15.53:0/1327617119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1815e8d0 con 0x7fbd08003a30 2023-07-09T21:52:32.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.421+0000 7fbd1efff700 1 -- 172.21.15.53:0/1327617119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd180b3bd0 con 0x7fbd08003a30 2023-07-09T21:52:32.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.422+0000 7fbd157fa700 1 -- 172.21.15.53:0/1327617119 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fbd0c019070 con 0x7fbd08003a30 2023-07-09T21:52:32.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.424+0000 7fbd157fa700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbcfc06ad70 0x7fbcfc06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:32.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.424+0000 7fbd157fa700 1 -- 172.21.15.53:0/1327617119 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd0c08a020 con 0x7fbd08003a30 2023-07-09T21:52:32.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.425+0000 7fbd17fff700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbcfc06ad70 0x7fbcfc06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:32.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.426+0000 7fbd17fff700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbcfc06ad70 0x7fbcfc06d220 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbd1806c2f0 tx=0x7fbd04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:32.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.429+0000 7fbd157fa700 1 -- 172.21.15.53:0/1327617119 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbd180b3bd0 con 0x7fbd08003a30 2023-07-09T21:52:32.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.685+0000 7fbd1efff700 1 -- 172.21.15.53:0/1327617119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbd180b3bd0 con 0x7fbd08003a30 2023-07-09T21:52:32.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.685+0000 7fbd157fa700 1 -- 172.21.15.53:0/1327617119 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbd0c021060 con 0x7fbd08003a30 2023-07-09T21:52:32.687 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:52:32.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.688+0000 7fbd1efff700 1 -- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbcfc06ad70 msgr2=0x7fbcfc06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:32.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.688+0000 7fbd1efff700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbcfc06ad70 0x7fbcfc06d220 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbd1806c2f0 tx=0x7fbd04009040 comp rx=0 tx=0).stop 2023-07-09T21:52:32.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.688+0000 7fbd1efff700 1 -- 172.21.15.53:0/1327617119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd08003a30 msgr2=0x7fbd180ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:32.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.688+0000 7fbd1efff700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd08003a30 0x7fbd180ccb50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c780 tx=0x7fbd0c001ab0 comp rx=0 tx=0).stop 2023-07-09T21:52:32.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.688+0000 7fbd1efff700 1 -- 172.21.15.53:0/1327617119 shutdown_connections 2023-07-09T21:52:32.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.688+0000 7fbd1efff700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbcfc06ad70 0x7fbcfc06d220 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:32.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.688+0000 7fbd1efff700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd180cba70 0x7fbd18156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:32.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.688+0000 7fbd1efff700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd08003a30 0x7fbd180ccb50 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:32.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.688+0000 7fbd1efff700 1 --2- 172.21.15.53:0/1327617119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd1814ef50 0x7fbd1815f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:32.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.688+0000 7fbd1efff700 1 -- 172.21.15.53:0/1327617119 >> 172.21.15.53:0/1327617119 conn(0x7fbd1809c1d0 msgr2=0x7fbd180b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:32.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.688+0000 7fbd1efff700 1 -- 172.21.15.53:0/1327617119 shutdown_connections 2023-07-09T21:52:32.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:32.688+0000 7fbd1efff700 1 -- 172.21.15.53:0/1327617119 wait complete. 2023-07-09T21:52:32.707 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T21:52:32.708 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:52:32.708 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-07-09T21:52:32.708 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T21:52:32.708 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T21:52:32.709 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T21:52:32.709 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T21:52:32.709 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:52:32.709 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T21:52:32.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:32.710 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-07-09T21:52:32.759 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:52:32.759 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:52:32.760 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:52:32.760 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:32.760 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-07-09T21:52:32.760 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:32.760 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:52:32.760 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:52:32.760 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-07-09T21:52:32.761 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:52:32.761 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:52:32.761 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-07-09T21:52:32.761 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-09T21:52:32.761 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-07-09T21:52:32.761 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:52:32.762 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-07-09T21:52:32.762 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-09T21:52:32.762 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 41999sec preferred_lft 41999sec 2023-07-09T21:52:32.762 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c7b:9bae:bb6f:ebac/64 scope link noprefixroute 2023-07-09T21:52:32.763 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:32.763 INFO:teuthology.orchestra.run.smithi184.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:52:32.763 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether a6:56:97:e0:ed:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:52:32.763 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:52:32.763 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:32.763 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::e4ec:4fff:feff:3b5b/64 scope link 2023-07-09T21:52:32.763 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:32.764 INFO:teuthology.orchestra.run.smithi184.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:52:32.764 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether a6:56:97:e0:ed:a7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T21:52:32.764 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::a456:97ff:fee0:eda7/64 scope link 2023-07-09T21:52:32.764 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:32.764 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:52:32.764 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether d6:7b:16:b8:b8:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T21:52:32.764 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::d47b:16ff:feb8:b80a/64 scope link 2023-07-09T21:52:32.764 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:52:32.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:32.765 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:52:32.832 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-07-09T21:52:32.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:32.836 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-07-09T21:52:32.881 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-07-09T21:52:32.947 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:52:32.948 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T21:52:32.948 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T21:52:32.948 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:52:32.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:32.949 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-09T21:52:32.950 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-09T21:52:32.950 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T21:52:32.950 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T21:52:32.951 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T21:52:32.951 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-09T21:52:33.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:33.157 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-07-09T21:52:33.200 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T21:52:33.200 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T21:52:33.200 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T21:52:33.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:33.201 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-07-09T21:52:33.306 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:52:33.307 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T21:52:33.349 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T21:52:33.349 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:52:33.350 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T21:52:33.430 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-09T21:52:33.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:33.432 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-09T21:52:33.573 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-09T21:52:33.574 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-09T21:52:33.574 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-09T21:52:33.593 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-09T21:52:33.593 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-09T21:52:33.594 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-09T21:52:33.594 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:52:33.594 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:52:33.616 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-09T21:52:33.616 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-09T21:52:33.616 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-09T21:52:33.616 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-09T21:52:33.617 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-09T21:52:33.617 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-07-09T21:52:33.617 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.53:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-07-09T21:52:33.617 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=25d21351-dc09-4310-b56b-79a331e4aa31" will pass to kernel 2023-07-09T21:52:33.622 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T21:52:33.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:33.623 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T21:52:33.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:33.690 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T21:52:33.776 INFO:teuthology.orchestra.run.smithi184.stdout:client5204 2023-07-09T21:52:33.777 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:52:33.777 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:33.820 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-09T21:52:34.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.037+0000 7f0f5e5ff700 1 Processor -- start 2023-07-09T21:52:34.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.037+0000 7f0f5e5ff700 1 -- start start 2023-07-09T21:52:34.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.038+0000 7f0f5e5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0f5815c7b0 0x7f0f580ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:34.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.038+0000 7f0f5e5ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f580d2c70 con 0x7f0f580d28a0 2023-07-09T21:52:34.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.038+0000 7f0f5e5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f580d0190 con 0x7f0f580d1140 2023-07-09T21:52:34.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.038+0000 7f0f5e5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f580d3de0 con 0x7f0f5815c7b0 2023-07-09T21:52:34.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.038+0000 7f0f57fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0f580d28a0 0x7f0f580d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58402/0 (socket says 172.21.15.53:58402) 2023-07-09T21:52:34.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.038+0000 7f0f57fff700 1 -- 172.21.15.53:0/1452639273 learned_addr learned my addr 172.21.15.53:0/1452639273 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:34.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f5cb9c700 1 --2- 172.21.15.53:0/1452639273 >> v2:172.21.15.184:3300/0 conn(0x7f0f5815c7b0 0x7f0f580ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:34.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261478757 0 0) 0x7f0f580d2c70 con 0x7f0f580d28a0 2023-07-09T21:52:34.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f400035b0 con 0x7f0f580d28a0 2023-07-09T21:52:34.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387807772 0 0) 0x7f0f580d0190 con 0x7f0f580d1140 2023-07-09T21:52:34.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f580d2c70 con 0x7f0f580d1140 2023-07-09T21:52:34.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 85538095 0 0) 0x7f0f400035b0 con 0x7f0f580d28a0 2023-07-09T21:52:34.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 >> v2:172.21.15.184:3300/0 conn(0x7f0f5815c7b0 msgr2=0x7f0f580ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:34.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 --2- 172.21.15.53:0/1452639273 >> v2:172.21.15.184:3300/0 conn(0x7f0f5815c7b0 0x7f0f580ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 >> v1:172.21.15.184:6789/0 conn(0x7f0f580d1140 legacy=0x7f0f580ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:34.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f580d0470 con 0x7f0f580d28a0 2023-07-09T21:52:34.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f0f48001670 con 0x7f0f580d28a0 2023-07-09T21:52:34.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 >> v1:172.21.15.53:6789/0 conn(0x7f0f580d28a0 legacy=0x7f0f580d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:34.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 --2- 172.21.15.53:0/1452639273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f40003ca0 0x7f0f40004090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:34.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 --2- 172.21.15.53:0/1452639273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f40004850 0x7f0f40004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 --2- 172.21.15.53:0/1452639273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f40005250 0x7f0f4000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580d3de0 con 0x7f0f40003ca0 2023-07-09T21:52:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4000c160 con 0x7f0f40005250 2023-07-09T21:52:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.039+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4000c320 con 0x7f0f40004850 2023-07-09T21:52:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.040+0000 7f0f57fff700 1 --2- 172.21.15.53:0/1452639273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f40003ca0 0x7f0f40004090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:34.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.040+0000 7f0f577fe700 1 --2- 172.21.15.53:0/1452639273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f40004850 0x7f0f40004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:34.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.040+0000 7f0f5cb9c700 1 --2- 172.21.15.53:0/1452639273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f40005250 0x7f0f4000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:34.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.040+0000 7f0f57fff700 1 -- 172.21.15.53:0/1452639273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f40004850 msgr2=0x7f0f40004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:34.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.040+0000 7f0f57fff700 1 --2- 172.21.15.53:0/1452639273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f40004850 0x7f0f40004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.040+0000 7f0f57fff700 1 -- 172.21.15.53:0/1452639273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f40005250 msgr2=0x7f0f4000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.040+0000 7f0f57fff700 1 --2- 172.21.15.53:0/1452639273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f40005250 0x7f0f4000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.040+0000 7f0f57fff700 1 -- 172.21.15.53:0/1452639273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f400035b0 con 0x7f0f40003ca0 2023-07-09T21:52:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.040+0000 7f0f5cb9c700 1 -- 172.21.15.53:0/1452639273 reap_dead start 2023-07-09T21:52:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.040+0000 7f0f57fff700 1 --2- 172.21.15.53:0/1452639273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f40003ca0 0x7f0f40004090 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800c110 tx=0x7f0f40005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7681e392b9a938 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.041+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4800ccb0 con 0x7f0f40003ca0 2023-07-09T21:52:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.041+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4800ce10 con 0x7f0f40003ca0 2023-07-09T21:52:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.041+0000 7f0f56ffd700 1 -- 172.21.15.53:0/1452639273 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48005ba0 con 0x7f0f40003ca0 2023-07-09T21:52:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.041+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/1452639273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f40003ca0 msgr2=0x7f0f40004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.041+0000 7f0f5e5ff700 1 --2- 172.21.15.53:0/1452639273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f40003ca0 0x7f0f40004090 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800c110 tx=0x7f0f40005880 comp rx=0 tx=0).stop 2023-07-09T21:52:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.041+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/1452639273 shutdown_connections 2023-07-09T21:52:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.041+0000 7f0f5e5ff700 1 --2- 172.21.15.53:0/1452639273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f40003ca0 0x7f0f40004090 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.041+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/1452639273 >> 172.21.15.53:0/1452639273 conn(0x7f0f5809c1b0 msgr2=0x7f0f580d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:34.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.041+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/1452639273 shutdown_connections 2023-07-09T21:52:34.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.041+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/1452639273 wait complete. 2023-07-09T21:52:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.043+0000 7f0f5e5ff700 1 Processor -- start 2023-07-09T21:52:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.043+0000 7f0f5e5ff700 1 -- start start 2023-07-09T21:52:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.044+0000 7f0f5e5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f40003ca0 0x7f0f580c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.044+0000 7f0f5e5ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f581f63a0 0x7f0f581f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.044+0000 7f0f5e5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f580cc680 0x7f0f58154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:34.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.044+0000 7f0f5e5ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5815e480 con 0x7f0f581f63a0 2023-07-09T21:52:34.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.044+0000 7f0f5e5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5815e760 con 0x7f0f580cc680 2023-07-09T21:52:34.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.044+0000 7f0f5e5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5815ea40 con 0x7f0f40003ca0 2023-07-09T21:52:34.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f577fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f581f63a0 0x7f0f581f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:34.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f57fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f40003ca0 0x7f0f580c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:34.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f577fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f581f63a0 0x7f0f581f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54868/0 (socket says 172.21.15.53:54868) 2023-07-09T21:52:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f57fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f40003ca0 0x7f0f580c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:42758/0 (socket says 172.21.15.53:42758) 2023-07-09T21:52:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f577fe700 1 -- 172.21.15.53:0/3525111300 learned_addr learned my addr 172.21.15.53:0/3525111300 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f5cb9c700 1 --2- 172.21.15.53:0/3525111300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f580cc680 0x7f0f58154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f577fe700 1 -- 172.21.15.53:0/3525111300 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f40003ca0 msgr2=0x7f0f580c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f577fe700 1 --2- 172.21.15.53:0/3525111300 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f40003ca0 0x7f0f580c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f577fe700 1 -- 172.21.15.53:0/3525111300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f580cc680 msgr2=0x7f0f58154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f577fe700 1 --2- 172.21.15.53:0/3525111300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f580cc680 0x7f0f58154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f577fe700 1 -- 172.21.15.53:0/3525111300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5815ed20 con 0x7f0f581f63a0 2023-07-09T21:52:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f577fe700 1 --2- 172.21.15.53:0/3525111300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f581f63a0 0x7f0f581f5a70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00f7c0 tx=0x7f0f4c00fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f54ff9700 1 -- 172.21.15.53:0/3525111300 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c005320 con 0x7f0f581f63a0 2023-07-09T21:52:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.045+0000 7f0f54ff9700 1 -- 172.21.15.53:0/3525111300 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c005480 con 0x7f0f581f63a0 2023-07-09T21:52:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.046+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/3525111300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5815f000 con 0x7f0f581f63a0 2023-07-09T21:52:34.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.046+0000 7f0f54ff9700 1 -- 172.21.15.53:0/3525111300 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c006aa0 con 0x7f0f581f63a0 2023-07-09T21:52:34.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.046+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/3525111300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f581f5fb0 con 0x7f0f581f63a0 2023-07-09T21:52:34.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.047+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/3525111300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5815f1f0 con 0x7f0f581f63a0 2023-07-09T21:52:34.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.048+0000 7f0f54ff9700 1 -- 172.21.15.53:0/3525111300 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f0f4c006c00 con 0x7f0f581f63a0 2023-07-09T21:52:34.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.049+0000 7f0f54ff9700 1 --2- 172.21.15.53:0/3525111300 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0f4406ad70 0x7f0f4406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:34.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.049+0000 7f0f54ff9700 1 -- 172.21.15.53:0/3525111300 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f4c088cd0 con 0x7f0f581f63a0 2023-07-09T21:52:34.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.049+0000 7f0f57fff700 1 --2- 172.21.15.53:0/3525111300 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0f4406ad70 0x7f0f4406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:34.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.049+0000 7f0f57fff700 1 --2- 172.21.15.53:0/3525111300 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0f4406ad70 0x7f0f4406d220 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800c110 tx=0x7f0f48007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:34.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.053+0000 7f0f54ff9700 1 -- 172.21.15.53:0/3525111300 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f4c053c90 con 0x7f0f581f63a0 2023-07-09T21:52:34.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.310+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/3525111300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0f58074350 con 0x7f0f581f63a0 2023-07-09T21:52:34.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.585+0000 7f0f54ff9700 1 -- 172.21.15.53:0/3525111300 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 136+0+0 (secure 0 0 0) 0x7f0f4c01a0c0 con 0x7f0f581f63a0 2023-07-09T21:52:34.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.588+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/3525111300 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0f4406ad70 msgr2=0x7f0f4406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:34.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.588+0000 7f0f5e5ff700 1 --2- 172.21.15.53:0/3525111300 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0f4406ad70 0x7f0f4406d220 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800c110 tx=0x7f0f48007000 comp rx=0 tx=0).stop 2023-07-09T21:52:34.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.588+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/3525111300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f581f63a0 msgr2=0x7f0f581f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:34.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.588+0000 7f0f5e5ff700 1 --2- 172.21.15.53:0/3525111300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f581f63a0 0x7f0f581f5a70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00f7c0 tx=0x7f0f4c00fad0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.588+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/3525111300 shutdown_connections 2023-07-09T21:52:34.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.588+0000 7f0f5e5ff700 1 --2- 172.21.15.53:0/3525111300 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f0f4406ad70 0x7f0f4406d220 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.588+0000 7f0f5e5ff700 1 --2- 172.21.15.53:0/3525111300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f580cc680 0x7f0f58154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.588+0000 7f0f5e5ff700 1 --2- 172.21.15.53:0/3525111300 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f40003ca0 0x7f0f580c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.588+0000 7f0f5e5ff700 1 --2- 172.21.15.53:0/3525111300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f581f63a0 0x7f0f581f5a70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.588+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/3525111300 >> 172.21.15.53:0/3525111300 conn(0x7f0f5809c1b0 msgr2=0x7f0f580cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:34.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.588+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/3525111300 shutdown_connections 2023-07-09T21:52:34.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.588+0000 7f0f5e5ff700 1 -- 172.21.15.53:0/3525111300 wait complete. 2023-07-09T21:52:34.608 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-09T21:52:34.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.809+0000 7fecdb1ff700 1 Processor -- start 2023-07-09T21:52:34.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.809+0000 7fecdb1ff700 1 -- start start 2023-07-09T21:52:34.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.810+0000 7fecdb1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fecd40d0430 0x7fecd40b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:34.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.810+0000 7fecdb1ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd415cd60 con 0x7fecd40b6430 2023-07-09T21:52:34.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.810+0000 7fecdb1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd40cf340 con 0x7fecd40b4600 2023-07-09T21:52:34.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.810+0000 7fecdb1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd40d1550 con 0x7fecd40d0430 2023-07-09T21:52:34.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.810+0000 7fecd979c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fecd40b6430 0x7fecd40b6840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58412/0 (socket says 172.21.15.53:58412) 2023-07-09T21:52:34.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.810+0000 7fecd979c700 1 -- 172.21.15.53:0/2448009286 learned_addr learned my addr 172.21.15.53:0/2448009286 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:34.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.811+0000 7fecd3fff700 1 --2- 172.21.15.53:0/2448009286 >> v2:172.21.15.184:3300/0 conn(0x7fecd40d0430 0x7fecd40b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:34.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.811+0000 7fecd37fe700 1 -- 172.21.15.53:0/2448009286 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093160944 0 0) 0x7fecd415cd60 con 0x7fecd40b6430 2023-07-09T21:52:34.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.811+0000 7fecd37fe700 1 -- 172.21.15.53:0/2448009286 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc40035b0 con 0x7fecd40b6430 2023-07-09T21:52:34.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.811+0000 7fecd37fe700 1 -- 172.21.15.53:0/2448009286 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679789742 0 0) 0x7fecd40cf340 con 0x7fecd40b4600 2023-07-09T21:52:34.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.811+0000 7fecd37fe700 1 -- 172.21.15.53:0/2448009286 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecd415cd60 con 0x7fecd40b4600 2023-07-09T21:52:34.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.811+0000 7fecd37fe700 1 -- 172.21.15.53:0/2448009286 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 272584813 0 0) 0x7fecc40035b0 con 0x7fecd40b6430 2023-07-09T21:52:34.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.811+0000 7fecd3fff700 1 -- 172.21.15.53:0/2448009286 >> v1:172.21.15.184:6789/0 conn(0x7fecd40b4600 legacy=0x7fecd40cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:34.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.811+0000 7fecd3fff700 1 -- 172.21.15.53:0/2448009286 >> v1:172.21.15.53:6789/0 conn(0x7fecd40b6430 legacy=0x7fecd40b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:34.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.811+0000 7fecd3fff700 1 -- 172.21.15.53:0/2448009286 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40d0e90 con 0x7fecd40d0430 2023-07-09T21:52:34.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.811+0000 7fecd3fff700 1 --2- 172.21.15.53:0/2448009286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecd40d0430 0x7fecd40b5ef0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009840 tx=0x7fecc0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bbabe0553398540 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:34.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.812+0000 7fecd37fe700 1 -- 172.21.15.53:0/2448009286 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0019f0 con 0x7fecd40d0430 2023-07-09T21:52:34.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.812+0000 7fecd37fe700 1 -- 172.21.15.53:0/2448009286 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc0004030 con 0x7fecd40d0430 2023-07-09T21:52:34.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.812+0000 7fecd37fe700 1 -- 172.21.15.53:0/2448009286 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc00043c0 con 0x7fecd40d0430 2023-07-09T21:52:34.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.812+0000 7fecdb1ff700 1 -- 172.21.15.53:0/2448009286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecd40d0430 msgr2=0x7fecd40b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:34.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.812+0000 7fecdb1ff700 1 --2- 172.21.15.53:0/2448009286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecd40d0430 0x7fecd40b5ef0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009840 tx=0x7fecc0009b50 comp rx=0 tx=0).stop 2023-07-09T21:52:34.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.812+0000 7fecdb1ff700 1 -- 172.21.15.53:0/2448009286 shutdown_connections 2023-07-09T21:52:34.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.812+0000 7fecdb1ff700 1 --2- 172.21.15.53:0/2448009286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecd40d0430 0x7fecd40b5ef0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.812+0000 7fecdb1ff700 1 -- 172.21.15.53:0/2448009286 >> 172.21.15.53:0/2448009286 conn(0x7fecd409c200 msgr2=0x7fecd40d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:34.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.812+0000 7fecdb1ff700 1 -- 172.21.15.53:0/2448009286 shutdown_connections 2023-07-09T21:52:34.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.813+0000 7fecdb1ff700 1 -- 172.21.15.53:0/2448009286 wait complete. 2023-07-09T21:52:34.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.814+0000 7fecdb1ff700 1 Processor -- start 2023-07-09T21:52:34.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.814+0000 7fecdb1ff700 1 -- start start 2023-07-09T21:52:34.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.815+0000 7fecdb1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40b6430 0x7fecd4154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:34.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.815+0000 7fecdb1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecd40d0430 0x7fecd4153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:34.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.815+0000 7fecdb1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecd41565b0 0x7fecd4156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:34.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.815+0000 7fecdb1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4157ed0 con 0x7fecd40b6430 2023-07-09T21:52:34.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.815+0000 7fecdb1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40c9220 con 0x7fecd41565b0 2023-07-09T21:52:34.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.815+0000 7fecdb1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41573f0 con 0x7fecd40d0430 2023-07-09T21:52:34.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.816+0000 7fecd8f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40b6430 0x7fecd4154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:34.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.816+0000 7fecd8f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40b6430 0x7fecd4154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54882/0 (socket says 172.21.15.53:54882) 2023-07-09T21:52:34.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.816+0000 7fecd8f9b700 1 -- 172.21.15.53:0/1516099272 learned_addr learned my addr 172.21.15.53:0/1516099272 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:34.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.816+0000 7fecd979c700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecd41565b0 0x7fecd4156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:34.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.816+0000 7fecd3fff700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecd40d0430 0x7fecd4153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:34.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.816+0000 7fecd8f9b700 1 -- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecd40d0430 msgr2=0x7fecd4153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:34.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.816+0000 7fecd8f9b700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecd40d0430 0x7fecd4153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.816+0000 7fecd8f9b700 1 -- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecd41565b0 msgr2=0x7fecd4156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:34.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.816+0000 7fecd8f9b700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecd41565b0 0x7fecd4156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:34.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.816+0000 7fecd8f9b700 1 -- 172.21.15.53:0/1516099272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc00094a0 con 0x7fecd40b6430 2023-07-09T21:52:34.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.816+0000 7fecd3fff700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecd40d0430 0x7fecd4153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:34.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.816+0000 7fecd8f9b700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40b6430 0x7fecd4154cc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fecc800c500 tx=0x7fecc800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:34.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.817+0000 7fecd17fa700 1 -- 172.21.15.53:0/1516099272 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc80052d0 con 0x7fecd40b6430 2023-07-09T21:52:34.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.817+0000 7fecd17fa700 1 -- 172.21.15.53:0/1516099272 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc8005430 con 0x7fecd40b6430 2023-07-09T21:52:34.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.817+0000 7fecd17fa700 1 -- 172.21.15.53:0/1516099272 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc80038c0 con 0x7fecd40b6430 2023-07-09T21:52:34.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.817+0000 7fecdb1ff700 1 -- 172.21.15.53:0/1516099272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd41576d0 con 0x7fecd40b6430 2023-07-09T21:52:34.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.817+0000 7fecdb1ff700 1 -- 172.21.15.53:0/1516099272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd4153eb0 con 0x7fecd40b6430 2023-07-09T21:52:34.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.818+0000 7fecdb1ff700 1 -- 172.21.15.53:0/1516099272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd4157bf0 con 0x7fecd40b6430 2023-07-09T21:52:34.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.819+0000 7fecd17fa700 1 -- 172.21.15.53:0/1516099272 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fecc8003a20 con 0x7fecd40b6430 2023-07-09T21:52:34.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.820+0000 7fecd17fa700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fecb806ad70 0x7fecb806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:34.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.820+0000 7fecd17fa700 1 -- 172.21.15.53:0/1516099272 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fecc8088af0 con 0x7fecd40b6430 2023-07-09T21:52:34.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.821+0000 7fecd3fff700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fecb806ad70 0x7fecb806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:34.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.821+0000 7fecd3fff700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fecb806ad70 0x7fecb806d220 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fecc00090b0 tx=0x7fecc0013040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:34.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:34.824+0000 7fecd17fa700 1 -- 172.21.15.53:0/1516099272 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fecd4157bf0 con 0x7fecd40b6430 2023-07-09T21:52:35.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.064+0000 7fecdb1ff700 1 -- 172.21.15.53:0/1516099272 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fecd4157560 con 0x7fecb806ad70 2023-07-09T21:52:35.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.066+0000 7fecd17fa700 1 -- 172.21.15.53:0/1516099272 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fecd4157560 con 0x7fecb806ad70 2023-07-09T21:52:35.068 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-07-09T21:52:35.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-07-09T21:52:35.068 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephfs" 2023-07-09T21:52:35.069 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-07-09T21:52:35.069 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-07-09T21:52:35.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.069+0000 7fecdb1ff700 1 -- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fecb806ad70 msgr2=0x7fecb806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:35.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.069+0000 7fecdb1ff700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fecb806ad70 0x7fecb806d220 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fecc00090b0 tx=0x7fecc0013040 comp rx=0 tx=0).stop 2023-07-09T21:52:35.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.069+0000 7fecdb1ff700 1 -- 172.21.15.53:0/1516099272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40b6430 msgr2=0x7fecd4154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:35.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.069+0000 7fecdb1ff700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40b6430 0x7fecd4154cc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fecc800c500 tx=0x7fecc800c8c0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.069+0000 7fecdb1ff700 1 -- 172.21.15.53:0/1516099272 shutdown_connections 2023-07-09T21:52:35.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.069+0000 7fecdb1ff700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fecb806ad70 0x7fecb806d220 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.069+0000 7fecdb1ff700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecd41565b0 0x7fecd4156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.069+0000 7fecdb1ff700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40b6430 0x7fecd4154cc0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.069+0000 7fecdb1ff700 1 --2- 172.21.15.53:0/1516099272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecd40d0430 0x7fecd4153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.069+0000 7fecdb1ff700 1 -- 172.21.15.53:0/1516099272 >> 172.21.15.53:0/1516099272 conn(0x7fecd409c200 msgr2=0x7fecd415f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:35.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.069+0000 7fecdb1ff700 1 -- 172.21.15.53:0/1516099272 shutdown_connections 2023-07-09T21:52:35.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.069+0000 7fecdb1ff700 1 -- 172.21.15.53:0/1516099272 wait complete. 2023-07-09T21:52:35.088 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T21:52:35.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.289+0000 7f6c3b7ff700 1 Processor -- start 2023-07-09T21:52:35.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.289+0000 7f6c3b7ff700 1 -- start start 2023-07-09T21:52:35.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.290+0000 7f6c3b7ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6c340b3ff0 0x7f6c340b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:35.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.290+0000 7f6c3b7ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6c340d0b10 0x7f6c340d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:35.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.290+0000 7f6c3b7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340b8e80 con 0x7f6c340b25d0 2023-07-09T21:52:35.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.290+0000 7f6c3b7ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340d14d0 con 0x7f6c340b3ff0 2023-07-09T21:52:35.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.290+0000 7f6c3b7ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340b1e30 con 0x7f6c340d0b10 2023-07-09T21:52:35.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.291+0000 7f6c3959b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6c340b3ff0 0x7f6c340b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:35.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.291+0000 7f6c3959b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6c340b3ff0 0x7f6c340b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54890/0 (socket says 172.21.15.53:54890) 2023-07-09T21:52:35.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.291+0000 7f6c3959b700 1 -- 172.21.15.53:0/52920576 learned_addr learned my addr 172.21.15.53:0/52920576 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.291+0000 7f6c38d9a700 1 --2- 172.21.15.53:0/52920576 >> v2:172.21.15.184:3300/0 conn(0x7f6c340d0b10 0x7f6c340d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.291+0000 7f6c3959b700 1 -- 172.21.15.53:0/52920576 >> v2:172.21.15.184:3300/0 conn(0x7f6c340d0b10 msgr2=0x7f6c340d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.291+0000 7f6c3959b700 1 --2- 172.21.15.53:0/52920576 >> v2:172.21.15.184:3300/0 conn(0x7f6c340d0b10 0x7f6c340d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.291+0000 7f6c3959b700 1 -- 172.21.15.53:0/52920576 >> v1:172.21.15.184:6789/0 conn(0x7f6c340b25d0 legacy=0x7f6c340b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.291+0000 7f6c3959b700 1 -- 172.21.15.53:0/52920576 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c340afaa0 con 0x7f6c340b3ff0 2023-07-09T21:52:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.291+0000 7f6c3959b700 1 --2- 172.21.15.53:0/52920576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c340b3ff0 0x7f6c340b43c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6c3409c8e0 tx=0x7f6c30009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ff7fe7064f8a88 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:35.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.292+0000 7f6c2bfff700 1 -- 172.21.15.53:0/52920576 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30011830 con 0x7f6c340b3ff0 2023-07-09T21:52:35.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.292+0000 7f6c2bfff700 1 -- 172.21.15.53:0/52920576 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c30011990 con 0x7f6c340b3ff0 2023-07-09T21:52:35.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.292+0000 7f6c2bfff700 1 -- 172.21.15.53:0/52920576 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30011d20 con 0x7f6c340b3ff0 2023-07-09T21:52:35.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.292+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/52920576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c340b3ff0 msgr2=0x7f6c340b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:35.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.292+0000 7f6c3b7ff700 1 --2- 172.21.15.53:0/52920576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c340b3ff0 0x7f6c340b43c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6c3409c8e0 tx=0x7f6c30009bd0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.292+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/52920576 shutdown_connections 2023-07-09T21:52:35.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.292+0000 7f6c3b7ff700 1 --2- 172.21.15.53:0/52920576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c340b3ff0 0x7f6c340b43c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.292+0000 7f6c3b7ff700 1 --2- 172.21.15.53:0/52920576 >> v2:172.21.15.184:3300/0 conn(0x7f6c340d0b10 0x7f6c340d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.292+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/52920576 >> 172.21.15.53:0/52920576 conn(0x7f6c3409c1b0 msgr2=0x7f6c340d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:35.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.292+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/52920576 shutdown_connections 2023-07-09T21:52:35.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.292+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/52920576 wait complete. 2023-07-09T21:52:35.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.294+0000 7f6c3b7ff700 1 Processor -- start 2023-07-09T21:52:35.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.294+0000 7f6c3b7ff700 1 -- start start 2023-07-09T21:52:35.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.295+0000 7f6c3b7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c340b25d0 0x7f6c340ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:35.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.295+0000 7f6c3b7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c340b3ff0 0x7f6c341f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:35.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.295+0000 7f6c3b7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c340d0b10 0x7f6c3414f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:35.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.295+0000 7f6c3b7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340cf610 con 0x7f6c340b3ff0 2023-07-09T21:52:35.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.295+0000 7f6c3b7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341f3110 con 0x7f6c340d0b10 2023-07-09T21:52:35.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.295+0000 7f6c3b7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340cda10 con 0x7f6c340b25d0 2023-07-09T21:52:35.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.296+0000 7f6c38d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c340b3ff0 0x7f6c341f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:35.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.296+0000 7f6c38d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c340b3ff0 0x7f6c341f2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54906/0 (socket says 172.21.15.53:54906) 2023-07-09T21:52:35.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.296+0000 7f6c38d9a700 1 -- 172.21.15.53:0/2889642860 learned_addr learned my addr 172.21.15.53:0/2889642860 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:35.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.296+0000 7f6c39d9c700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c340d0b10 0x7f6c3414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:35.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.296+0000 7f6c3959b700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c340b25d0 0x7f6c340ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:35.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.296+0000 7f6c38d9a700 1 -- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c340b25d0 msgr2=0x7f6c340ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:35.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.296+0000 7f6c38d9a700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c340b25d0 0x7f6c340ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.296+0000 7f6c38d9a700 1 -- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c340d0b10 msgr2=0x7f6c3414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:35.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.296+0000 7f6c38d9a700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c340d0b10 0x7f6c3414f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.296+0000 7f6c38d9a700 1 -- 172.21.15.53:0/2889642860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c30009550 con 0x7f6c340b3ff0 2023-07-09T21:52:35.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.296+0000 7f6c39d9c700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c340d0b10 0x7f6c3414f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:35.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.296+0000 7f6c3959b700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c340b25d0 0x7f6c340ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:35.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.296+0000 7f6c38d9a700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c340b3ff0 0x7f6c341f2bd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400e870 tx=0x7f6c2400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:35.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.297+0000 7f6c29ffb700 1 -- 172.21.15.53:0/2889642860 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24009590 con 0x7f6c340b3ff0 2023-07-09T21:52:35.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.297+0000 7f6c29ffb700 1 -- 172.21.15.53:0/2889642860 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2400ee70 con 0x7f6c340b3ff0 2023-07-09T21:52:35.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.297+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/2889642860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c340cdcf0 con 0x7f6c340b3ff0 2023-07-09T21:52:35.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.297+0000 7f6c29ffb700 1 -- 172.21.15.53:0/2889642860 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400ca50 con 0x7f6c340b3ff0 2023-07-09T21:52:35.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.297+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/2889642860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c340ce2b0 con 0x7f6c340b3ff0 2023-07-09T21:52:35.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.298+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/2889642860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c34074350 con 0x7f6c340b3ff0 2023-07-09T21:52:35.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.299+0000 7f6c29ffb700 1 -- 172.21.15.53:0/2889642860 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f6c2400cbb0 con 0x7f6c340b3ff0 2023-07-09T21:52:35.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.300+0000 7f6c29ffb700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6c1806ad70 0x7f6c1806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:35.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.300+0000 7f6c29ffb700 1 -- 172.21.15.53:0/2889642860 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c24089540 con 0x7f6c340b3ff0 2023-07-09T21:52:35.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.300+0000 7f6c3959b700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6c1806ad70 0x7f6c1806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:35.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.301+0000 7f6c3959b700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6c1806ad70 0x7f6c1806d220 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009c10 tx=0x7f6c30008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:35.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.304+0000 7f6c29ffb700 1 -- 172.21.15.53:0/2889642860 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6c24057f90 con 0x7f6c340b3ff0 2023-07-09T21:52:35.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.513+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/2889642860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6c340b0610 con 0x7f6c340b3ff0 2023-07-09T21:52:35.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.513+0000 7f6c29ffb700 1 -- 172.21.15.53:0/2889642860 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6c2400ce60 con 0x7f6c340b3ff0 2023-07-09T21:52:35.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.515+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6c1806ad70 msgr2=0x7f6c1806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:35.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.515+0000 7f6c3b7ff700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6c1806ad70 0x7f6c1806d220 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009c10 tx=0x7f6c30008030 comp rx=0 tx=0).stop 2023-07-09T21:52:35.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.515+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/2889642860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c340b3ff0 msgr2=0x7f6c341f2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:35.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.515+0000 7f6c3b7ff700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c340b3ff0 0x7f6c341f2bd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400e870 tx=0x7f6c2400ec30 comp rx=0 tx=0).stop 2023-07-09T21:52:35.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.515+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/2889642860 shutdown_connections 2023-07-09T21:52:35.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.516+0000 7f6c3b7ff700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f6c1806ad70 0x7f6c1806d220 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.516+0000 7f6c3b7ff700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c340d0b10 0x7f6c3414f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.516+0000 7f6c3b7ff700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c340b25d0 0x7f6c340ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.516+0000 7f6c3b7ff700 1 --2- 172.21.15.53:0/2889642860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c340b3ff0 0x7f6c341f2bd0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.516+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/2889642860 >> 172.21.15.53:0/2889642860 conn(0x7f6c3409c1b0 msgr2=0x7f6c3406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:35.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.516+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/2889642860 shutdown_connections 2023-07-09T21:52:35.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.516+0000 7f6c3b7ff700 1 -- 172.21.15.53:0/2889642860 wait complete. 2023-07-09T21:52:35.535 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000629258 2023-07-09T21:52:35.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.739+0000 7f30e75ff700 1 Processor -- start 2023-07-09T21:52:35.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.739+0000 7f30e75ff700 1 -- start start 2023-07-09T21:52:35.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.740+0000 7f30e75ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f30e00cd430 0x7f30e00cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.740+0000 7f30e75ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f30e00b4860 0x7f30e00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.740+0000 7f30e75ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e00d02a0 con 0x7f30e01601f0 2023-07-09T21:52:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.740+0000 7f30e75ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e00b5240 con 0x7f30e00cd430 2023-07-09T21:52:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.740+0000 7f30e75ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e00cfce0 con 0x7f30e00b4860 2023-07-09T21:52:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.741+0000 7f30e539b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f30e00cd430 0x7f30e00cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.741+0000 7f30e539b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f30e00cd430 0x7f30e00cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54922/0 (socket says 172.21.15.53:54922) 2023-07-09T21:52:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.741+0000 7f30e539b700 1 -- 172.21.15.53:0/450516028 learned_addr learned my addr 172.21.15.53:0/450516028 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.741+0000 7f30e4b9a700 1 --2- 172.21.15.53:0/450516028 >> v2:172.21.15.184:3300/0 conn(0x7f30e00b4860 0x7f30e00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.741+0000 7f30e539b700 1 -- 172.21.15.53:0/450516028 >> v2:172.21.15.184:3300/0 conn(0x7f30e00b4860 msgr2=0x7f30e00b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.741+0000 7f30e539b700 1 --2- 172.21.15.53:0/450516028 >> v2:172.21.15.184:3300/0 conn(0x7f30e00b4860 0x7f30e00b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.741+0000 7f30e539b700 1 -- 172.21.15.53:0/450516028 >> v1:172.21.15.184:6789/0 conn(0x7f30e01601f0 legacy=0x7f30e0160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.741+0000 7f30e539b700 1 -- 172.21.15.53:0/450516028 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e00cffc0 con 0x7f30e00cd430 2023-07-09T21:52:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.742+0000 7f30e539b700 1 --2- 172.21.15.53:0/450516028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e00cd430 0x7f30e00cd800 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f30e0160130 tx=0x7f30dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567ed532e7c41910 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.742+0000 7f30d7fff700 1 -- 172.21.15.53:0/450516028 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc011830 con 0x7f30e00cd430 2023-07-09T21:52:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.742+0000 7f30d7fff700 1 -- 172.21.15.53:0/450516028 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc011990 con 0x7f30e00cd430 2023-07-09T21:52:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.742+0000 7f30d7fff700 1 -- 172.21.15.53:0/450516028 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc011d20 con 0x7f30e00cd430 2023-07-09T21:52:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.742+0000 7f30e75ff700 1 -- 172.21.15.53:0/450516028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e00cd430 msgr2=0x7f30e00cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.742+0000 7f30e75ff700 1 --2- 172.21.15.53:0/450516028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e00cd430 0x7f30e00cd800 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f30e0160130 tx=0x7f30dc009bd0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.742+0000 7f30e75ff700 1 -- 172.21.15.53:0/450516028 shutdown_connections 2023-07-09T21:52:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.742+0000 7f30e75ff700 1 --2- 172.21.15.53:0/450516028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e00cd430 0x7f30e00cd800 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.742+0000 7f30e75ff700 1 --2- 172.21.15.53:0/450516028 >> v2:172.21.15.184:3300/0 conn(0x7f30e00b4860 0x7f30e00b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.743+0000 7f30e75ff700 1 -- 172.21.15.53:0/450516028 >> 172.21.15.53:0/450516028 conn(0x7f30e0066860 msgr2=0x7f30e006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.743+0000 7f30e75ff700 1 -- 172.21.15.53:0/450516028 shutdown_connections 2023-07-09T21:52:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.743+0000 7f30e75ff700 1 -- 172.21.15.53:0/450516028 wait complete. 2023-07-09T21:52:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.744+0000 7f30e75ff700 1 Processor -- start 2023-07-09T21:52:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.744+0000 7f30e75ff700 1 -- start start 2023-07-09T21:52:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.745+0000 7f30e75ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e00b4860 0x7f30e0151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:35.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.745+0000 7f30e75ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e00cd430 0x7f30e00c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:35.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.745+0000 7f30e75ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e01601f0 0x7f30e00c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:35.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.745+0000 7f30e75ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e015d3b0 con 0x7f30e01601f0 2023-07-09T21:52:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.745+0000 7f30e75ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e015b3e0 con 0x7f30e00b4860 2023-07-09T21:52:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.745+0000 7f30e75ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00c7f00 con 0x7f30e00cd430 2023-07-09T21:52:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.746+0000 7f30e5b9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e01601f0 0x7f30e00c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.746+0000 7f30e5b9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e01601f0 0x7f30e00c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54928/0 (socket says 172.21.15.53:54928) 2023-07-09T21:52:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.746+0000 7f30e5b9c700 1 -- 172.21.15.53:0/1434728299 learned_addr learned my addr 172.21.15.53:0/1434728299 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.746+0000 7f30e539b700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e00b4860 0x7f30e0151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.746+0000 7f30e4b9a700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e00cd430 0x7f30e00c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.746+0000 7f30e5b9c700 1 -- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e00cd430 msgr2=0x7f30e00c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.746+0000 7f30e5b9c700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e00cd430 0x7f30e00c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.746+0000 7f30e5b9c700 1 -- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e00b4860 msgr2=0x7f30e0151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.746+0000 7f30e5b9c700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e00b4860 0x7f30e0151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.746+0000 7f30e5b9c700 1 -- 172.21.15.53:0/1434728299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc009550 con 0x7f30e01601f0 2023-07-09T21:52:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.746+0000 7f30e539b700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e00b4860 0x7f30e0151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.746+0000 7f30e5b9c700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e01601f0 0x7f30e00c9350 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f30d800cc50 tx=0x7f30d800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.747+0000 7f30d5ffb700 1 -- 172.21.15.53:0/1434728299 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800ad80 con 0x7f30e01601f0 2023-07-09T21:52:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.747+0000 7f30d5ffb700 1 -- 172.21.15.53:0/1434728299 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d800ce50 con 0x7f30e01601f0 2023-07-09T21:52:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.747+0000 7f30d5ffb700 1 -- 172.21.15.53:0/1434728299 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8003c40 con 0x7f30e01601f0 2023-07-09T21:52:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.747+0000 7f30e75ff700 1 -- 172.21.15.53:0/1434728299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e00c81e0 con 0x7f30e01601f0 2023-07-09T21:52:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.747+0000 7f30e75ff700 1 -- 172.21.15.53:0/1434728299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e015cfd0 con 0x7f30e01601f0 2023-07-09T21:52:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.748+0000 7f30e75ff700 1 -- 172.21.15.53:0/1434728299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e0074350 con 0x7f30e01601f0 2023-07-09T21:52:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.749+0000 7f30d5ffb700 1 -- 172.21.15.53:0/1434728299 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f30d80050d0 con 0x7f30e01601f0 2023-07-09T21:52:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.750+0000 7f30d5ffb700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f30c406ad70 0x7f30c406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.750+0000 7f30d5ffb700 1 -- 172.21.15.53:0/1434728299 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30d80895d0 con 0x7f30e01601f0 2023-07-09T21:52:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.750+0000 7f30e539b700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f30c406ad70 0x7f30c406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:35.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.751+0000 7f30e539b700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f30c406ad70 0x7f30c406d220 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009c10 tx=0x7f30dc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:35.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.754+0000 7f30d5ffb700 1 -- 172.21.15.53:0/1434728299 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f30d8054620 con 0x7f30e01601f0 2023-07-09T21:52:35.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:35.992+0000 7f30e75ff700 1 -- 172.21.15.53:0/1434728299 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000629258", "target": ["mon-mgr", ""]}) v1 -- 0x7f30e00d0da0 con 0x7f30c406ad70 2023-07-09T21:52:36.002 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:52:36.001+0000 7fa52c43e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:52:36.002 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:52:36.001+0000 7fa52c43e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:52:36.003 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:52:36.001+0000 7fa52c43e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:52:36.003 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:52:36.001+0000 7fa52c43e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:52:36.003 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:52:36.001+0000 7fa52c43e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:52:36.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.019+0000 7f30d5ffb700 1 -- 172.21.15.53:0/1434728299 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f30dc011c00 con 0x7f30c406ad70 2023-07-09T21:52:36.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.021+0000 7f30e75ff700 1 -- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f30c406ad70 msgr2=0x7f30c406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:36.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.021+0000 7f30e75ff700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f30c406ad70 0x7f30c406d220 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009c10 tx=0x7f30dc008030 comp rx=0 tx=0).stop 2023-07-09T21:52:36.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.021+0000 7f30e75ff700 1 -- 172.21.15.53:0/1434728299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e01601f0 msgr2=0x7f30e00c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:36.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.021+0000 7f30e75ff700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e01601f0 0x7f30e00c9350 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f30d800cc50 tx=0x7f30d800a340 comp rx=0 tx=0).stop 2023-07-09T21:52:36.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.022+0000 7f30e75ff700 1 -- 172.21.15.53:0/1434728299 shutdown_connections 2023-07-09T21:52:36.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.022+0000 7f30e75ff700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f30c406ad70 0x7f30c406d220 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.022+0000 7f30e75ff700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e01601f0 0x7f30e00c9350 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.022+0000 7f30e75ff700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e00b4860 0x7f30e0151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.022+0000 7f30e75ff700 1 --2- 172.21.15.53:0/1434728299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e00cd430 0x7f30e00c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.022+0000 7f30e75ff700 1 -- 172.21.15.53:0/1434728299 >> 172.21.15.53:0/1434728299 conn(0x7f30e0066860 msgr2=0x7f30e00b7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:36.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.022+0000 7f30e75ff700 1 -- 172.21.15.53:0/1434728299 shutdown_connections 2023-07-09T21:52:36.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.022+0000 7f30e75ff700 1 -- 172.21.15.53:0/1434728299 wait complete. 2023-07-09T21:52:36.041 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000470134 group_0000000000629258 2023-07-09T21:52:36.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.243+0000 7f44cf3ff700 1 Processor -- start 2023-07-09T21:52:36.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.244+0000 7f44cf3ff700 1 -- start start 2023-07-09T21:52:36.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.245+0000 7f44cf3ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f44c80d1160 0x7f44c815c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.245+0000 7f44cf3ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c806a7f0 con 0x7f44c806c240 2023-07-09T21:52:36.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.245+0000 7f44cf3ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c806b760 con 0x7f44c80d2990 2023-07-09T21:52:36.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.245+0000 7f44cf3ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c806ba40 con 0x7f44c80d1160 2023-07-09T21:52:36.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.245+0000 7f44cd19b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f44c806c240 0x7f44c80d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58422/0 (socket says 172.21.15.53:58422) 2023-07-09T21:52:36.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.245+0000 7f44cd19b700 1 -- 172.21.15.53:0/3571139316 learned_addr learned my addr 172.21.15.53:0/3571139316 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:36.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.245+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881361415 0 0) 0x7f44c806a7f0 con 0x7f44c806c240 2023-07-09T21:52:36.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.245+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44b40035b0 con 0x7f44c806c240 2023-07-09T21:52:36.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.245+0000 7f44cc99a700 1 --2- 172.21.15.53:0/3571139316 >> v2:172.21.15.184:3300/0 conn(0x7f44c80d1160 0x7f44c815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3780393628 0 0) 0x7f44b40035b0 con 0x7f44c806c240 2023-07-09T21:52:36.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 >> v2:172.21.15.184:3300/0 conn(0x7f44c80d1160 msgr2=0x7f44c815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:36.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44bffff700 1 --2- 172.21.15.53:0/3571139316 >> v2:172.21.15.184:3300/0 conn(0x7f44c80d1160 0x7f44c815c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 >> v1:172.21.15.184:6789/0 conn(0x7f44c80d2990 legacy=0x7f44c80cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:36.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c806bd20 con 0x7f44c806c240 2023-07-09T21:52:36.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f44c4001670 con 0x7f44c806c240 2023-07-09T21:52:36.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 >> v1:172.21.15.53:6789/0 conn(0x7f44c806c240 legacy=0x7f44c80d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:36.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44bffff700 1 --2- 172.21.15.53:0/3571139316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b4003ac0 0x7f44b4003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44bffff700 1 --2- 172.21.15.53:0/3571139316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b4004850 0x7f44b4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44bffff700 1 --2- 172.21.15.53:0/3571139316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44b4005200 0x7f44b400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c806ba40 con 0x7f44b4005200 2023-07-09T21:52:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b400c140 con 0x7f44b4004850 2023-07-09T21:52:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b400c300 con 0x7f44b4003ac0 2023-07-09T21:52:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44cd99c700 1 --2- 172.21.15.53:0/3571139316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44b4005200 0x7f44b400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44cc99a700 1 --2- 172.21.15.53:0/3571139316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b4004850 0x7f44b4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.246+0000 7f44cd19b700 1 --2- 172.21.15.53:0/3571139316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b4003ac0 0x7f44b4003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.247+0000 7f44cd99c700 1 -- 172.21.15.53:0/3571139316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b4003ac0 msgr2=0x7f44b4003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.247+0000 7f44cd99c700 1 --2- 172.21.15.53:0/3571139316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b4003ac0 0x7f44b4003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.247+0000 7f44cd99c700 1 -- 172.21.15.53:0/3571139316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b4004850 msgr2=0x7f44b4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:36.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.247+0000 7f44cd99c700 1 --2- 172.21.15.53:0/3571139316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b4004850 0x7f44b4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.247+0000 7f44cd99c700 1 -- 172.21.15.53:0/3571139316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b40035b0 con 0x7f44b4005200 2023-07-09T21:52:36.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.247+0000 7f44cd99c700 1 -- 172.21.15.53:0/3571139316 reap_dead start 2023-07-09T21:52:36.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.247+0000 7f44cd99c700 1 --2- 172.21.15.53:0/3571139316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44b4005200 0x7f44b400ba10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f44c000c160 tx=0x7f44b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766e7d78c626f1b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:36.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.247+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0001db0 con 0x7f44b4005200 2023-07-09T21:52:36.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.247+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c000cca0 con 0x7f44b4005200 2023-07-09T21:52:36.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.247+0000 7f44bffff700 1 -- 172.21.15.53:0/3571139316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0003c00 con 0x7f44b4005200 2023-07-09T21:52:36.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.248+0000 7f44cf3ff700 1 -- 172.21.15.53:0/3571139316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44b4005200 msgr2=0x7f44b400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:36.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.248+0000 7f44cf3ff700 1 --2- 172.21.15.53:0/3571139316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44b4005200 0x7f44b400ba10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f44c000c160 tx=0x7f44b4005880 comp rx=0 tx=0).stop 2023-07-09T21:52:36.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.248+0000 7f44cf3ff700 1 -- 172.21.15.53:0/3571139316 shutdown_connections 2023-07-09T21:52:36.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.248+0000 7f44cf3ff700 1 --2- 172.21.15.53:0/3571139316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44b4005200 0x7f44b400ba10 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.248+0000 7f44cf3ff700 1 -- 172.21.15.53:0/3571139316 >> 172.21.15.53:0/3571139316 conn(0x7f44c809c170 msgr2=0x7f44c80d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:36.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.248+0000 7f44cf3ff700 1 -- 172.21.15.53:0/3571139316 shutdown_connections 2023-07-09T21:52:36.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.248+0000 7f44cf3ff700 1 -- 172.21.15.53:0/3571139316 wait complete. 2023-07-09T21:52:36.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.250+0000 7f44cf3ff700 1 Processor -- start 2023-07-09T21:52:36.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.250+0000 7f44cf3ff700 1 -- start start 2023-07-09T21:52:36.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.251+0000 7f44cf3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b4005200 0x7f44c80a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.251+0000 7f44cf3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44c80c8440 0x7f44c8159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.251+0000 7f44cf3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44c80c7730 0x7f44c80c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.251+0000 7f44cf3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c809ce90 con 0x7f44c80c7730 2023-07-09T21:52:36.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.251+0000 7f44cf3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c8159ac0 con 0x7f44b4005200 2023-07-09T21:52:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.251+0000 7f44cf3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80c6690 con 0x7f44c80c8440 2023-07-09T21:52:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.251+0000 7f44cd99c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44c80c7730 0x7f44c80c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.251+0000 7f44cd99c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44c80c7730 0x7f44c80c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54944/0 (socket says 172.21.15.53:54944) 2023-07-09T21:52:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.251+0000 7f44cd99c700 1 -- 172.21.15.53:0/960159895 learned_addr learned my addr 172.21.15.53:0/960159895 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.251+0000 7f44cc99a700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44c80c8440 0x7f44c8159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.251+0000 7f44cd19b700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b4005200 0x7f44c80a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.252+0000 7f44cd99c700 1 -- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44c80c8440 msgr2=0x7f44c8159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.252+0000 7f44cd99c700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44c80c8440 0x7f44c8159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.252+0000 7f44cd99c700 1 -- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b4005200 msgr2=0x7f44c80a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.252+0000 7f44cd99c700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b4005200 0x7f44c80a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.252+0000 7f44cd99c700 1 -- 172.21.15.53:0/960159895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c80c6970 con 0x7f44c80c7730 2023-07-09T21:52:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.252+0000 7f44cd99c700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44c80c7730 0x7f44c80c7bb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f44c0005040 tx=0x7f44c00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.252+0000 7f44bdffb700 1 -- 172.21.15.53:0/960159895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0005070 con 0x7f44c80c7730 2023-07-09T21:52:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.252+0000 7f44bdffb700 1 -- 172.21.15.53:0/960159895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c00051d0 con 0x7f44c80c7730 2023-07-09T21:52:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.252+0000 7f44cf3ff700 1 -- 172.21.15.53:0/960159895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c80c6c50 con 0x7f44c80c7730 2023-07-09T21:52:36.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.252+0000 7f44bdffb700 1 -- 172.21.15.53:0/960159895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0005560 con 0x7f44c80c7730 2023-07-09T21:52:36.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.252+0000 7f44cf3ff700 1 -- 172.21.15.53:0/960159895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c80c7210 con 0x7f44c80c7730 2023-07-09T21:52:36.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.253+0000 7f44cf3ff700 1 -- 172.21.15.53:0/960159895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c8074350 con 0x7f44c80c7730 2023-07-09T21:52:36.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.254+0000 7f44bdffb700 1 -- 172.21.15.53:0/960159895 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f44c00056c0 con 0x7f44c80c7730 2023-07-09T21:52:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.256+0000 7f44bdffb700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f44ac06ad70 0x7f44ac06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.256+0000 7f44bdffb700 1 -- 172.21.15.53:0/960159895 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44c008a330 con 0x7f44c80c7730 2023-07-09T21:52:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.257+0000 7f44cd19b700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f44ac06ad70 0x7f44ac06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.257+0000 7f44cd19b700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f44ac06ad70 0x7f44ac06d220 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f44c4000c00 tx=0x7f44c4001b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:36.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.260+0000 7f44bdffb700 1 -- 172.21.15.53:0/960159895 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f44c0055440 con 0x7f44c80c7730 2023-07-09T21:52:36.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.498+0000 7f44cf3ff700 1 -- 172.21.15.53:0/960159895 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000470134", "group_name": "group_0000000000629258", "target": ["mon-mgr", ""]}) v1 -- 0x7f44c815c890 con 0x7f44ac06ad70 2023-07-09T21:52:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.525+0000 7f44bdffb700 1 -- 172.21.15.53:0/960159895 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f44c4001610 con 0x7f44ac06ad70 2023-07-09T21:52:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.528+0000 7f44cf3ff700 1 -- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f44ac06ad70 msgr2=0x7f44ac06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.528+0000 7f44cf3ff700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f44ac06ad70 0x7f44ac06d220 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f44c4000c00 tx=0x7f44c4001b20 comp rx=0 tx=0).stop 2023-07-09T21:52:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.528+0000 7f44cf3ff700 1 -- 172.21.15.53:0/960159895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44c80c7730 msgr2=0x7f44c80c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.528+0000 7f44cf3ff700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44c80c7730 0x7f44c80c7bb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f44c0005040 tx=0x7f44c00014a0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.528+0000 7f44cf3ff700 1 -- 172.21.15.53:0/960159895 shutdown_connections 2023-07-09T21:52:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.528+0000 7f44cf3ff700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f44ac06ad70 0x7f44ac06d220 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.528+0000 7f44cf3ff700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44c80c7730 0x7f44c80c7bb0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.528+0000 7f44cf3ff700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b4005200 0x7f44c80a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.528+0000 7f44cf3ff700 1 --2- 172.21.15.53:0/960159895 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44c80c8440 0x7f44c8159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.528+0000 7f44cf3ff700 1 -- 172.21.15.53:0/960159895 >> 172.21.15.53:0/960159895 conn(0x7f44c809c170 msgr2=0x7f44c815ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.528+0000 7f44cf3ff700 1 -- 172.21.15.53:0/960159895 shutdown_connections 2023-07-09T21:52:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.528+0000 7f44cf3ff700 1 -- 172.21.15.53:0/960159895 wait complete. 2023-07-09T21:52:36.547 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000470134 snapshot_0000000000463948 group_0000000000629258 2023-07-09T21:52:36.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.752+0000 7f47841ff700 1 Processor -- start 2023-07-09T21:52:36.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.752+0000 7f47841ff700 1 -- start start 2023-07-09T21:52:36.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.753+0000 7f47841ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f477c0b3ff0 0x7f477c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.754+0000 7f47841ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f477c0d0f60 0x7f477c0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.754+0000 7f47841ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c0b8e80 con 0x7f477c0d0b10 2023-07-09T21:52:36.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.754+0000 7f47841ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c0b1e30 con 0x7f477c0d0f60 2023-07-09T21:52:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.754+0000 7f47841ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0afaa0 con 0x7f477c0b3ff0 2023-07-09T21:52:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.754+0000 7f4781f9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f477c0b3ff0 0x7f477c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.754+0000 7f478179a700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f477c0d0b10 0x7f477c0b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:45760/0 (socket says 172.21.15.53:45760) 2023-07-09T21:52:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.754+0000 7f478179a700 1 -- 172.21.15.53:0/2926520926 learned_addr learned my addr 172.21.15.53:0/2926520926 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:36.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.754+0000 7f478279c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f477c0d0f60 0x7f477c0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.755+0000 7f4780f99700 1 -- 172.21.15.53:0/2926520926 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553827633 0 0) 0x7f476c001110 con 0x7f477c0d0b10 2023-07-09T21:52:36.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.755+0000 7f4780f99700 1 -- 172.21.15.53:0/2926520926 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47680035b0 con 0x7f477c0d0b10 2023-07-09T21:52:36.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.755+0000 7f478279c700 1 -- 172.21.15.53:0/2926520926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f477c0b3ff0 msgr2=0x7f477c0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:36.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.755+0000 7f478279c700 1 --2- 172.21.15.53:0/2926520926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f477c0b3ff0 0x7f477c0b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.755+0000 7f478279c700 1 -- 172.21.15.53:0/2926520926 >> v1:172.21.15.184:6789/0 conn(0x7f477c0d0b10 legacy=0x7f477c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:36.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.755+0000 7f478279c700 1 -- 172.21.15.53:0/2926520926 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0afd80 con 0x7f477c0d0f60 2023-07-09T21:52:36.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.755+0000 7f4781f9b700 1 --2- 172.21.15.53:0/2926520926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f477c0b3ff0 0x7f477c0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:52:36.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.755+0000 7f478279c700 1 --2- 172.21.15.53:0/2926520926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f477c0d0f60 0x7f477c0b2ce0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4774009d90 tx=0x7f477400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=259dbf2f186efa78 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:36.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.755+0000 7f4780f99700 1 -- 172.21.15.53:0/2926520926 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477400e070 con 0x7f477c0d0f60 2023-07-09T21:52:36.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.755+0000 7f4780f99700 1 -- 172.21.15.53:0/2926520926 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477400bb20 con 0x7f477c0d0f60 2023-07-09T21:52:36.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.755+0000 7f4780f99700 1 -- 172.21.15.53:0/2926520926 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774012430 con 0x7f477c0d0f60 2023-07-09T21:52:36.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.756+0000 7f47841ff700 1 -- 172.21.15.53:0/2926520926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f477c0d0f60 msgr2=0x7f477c0b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:36.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.756+0000 7f47841ff700 1 --2- 172.21.15.53:0/2926520926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f477c0d0f60 0x7f477c0b2ce0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4774009d90 tx=0x7f477400b330 comp rx=0 tx=0).stop 2023-07-09T21:52:36.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.756+0000 7f47841ff700 1 -- 172.21.15.53:0/2926520926 shutdown_connections 2023-07-09T21:52:36.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.756+0000 7f47841ff700 1 --2- 172.21.15.53:0/2926520926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f477c0d0f60 0x7f477c0b2ce0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.756+0000 7f47841ff700 1 --2- 172.21.15.53:0/2926520926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f477c0b3ff0 0x7f477c0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.756+0000 7f47841ff700 1 -- 172.21.15.53:0/2926520926 >> 172.21.15.53:0/2926520926 conn(0x7f477c09c1b0 msgr2=0x7f477c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:36.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.756+0000 7f47841ff700 1 -- 172.21.15.53:0/2926520926 shutdown_connections 2023-07-09T21:52:36.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.756+0000 7f47841ff700 1 -- 172.21.15.53:0/2926520926 wait complete. 2023-07-09T21:52:36.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.758+0000 7f47841ff700 1 Processor -- start 2023-07-09T21:52:36.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.758+0000 7f47841ff700 1 -- start start 2023-07-09T21:52:36.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.759+0000 7f47841ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f477c0b3ff0 0x7f477c14e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.759+0000 7f47841ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f477c0d0b10 0x7f477c15f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.759+0000 7f47841ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f477c0d0f60 0x7f477c0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.759+0000 7f47841ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c15f3e0 con 0x7f477c0d0f60 2023-07-09T21:52:36.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.759+0000 7f47841ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c15e760 con 0x7f477c0b3ff0 2023-07-09T21:52:36.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.759+0000 7f47841ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c15ea40 con 0x7f477c0d0b10 2023-07-09T21:52:36.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.759+0000 7f478279c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f477c0d0f60 0x7f477c0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.759+0000 7f478279c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f477c0d0f60 0x7f477c0ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54958/0 (socket says 172.21.15.53:54958) 2023-07-09T21:52:36.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.759+0000 7f478279c700 1 -- 172.21.15.53:0/1957430783 learned_addr learned my addr 172.21.15.53:0/1957430783 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:36.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.759+0000 7f4781f9b700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f477c0b3ff0 0x7f477c14e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.759+0000 7f478179a700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f477c0d0b10 0x7f477c15f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.759+0000 7f478279c700 1 -- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f477c0d0b10 msgr2=0x7f477c15f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:36.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.760+0000 7f478279c700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f477c0d0b10 0x7f477c15f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.760+0000 7f478279c700 1 -- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f477c0b3ff0 msgr2=0x7f477c14e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:36.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.760+0000 7f478279c700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f477c0b3ff0 0x7f477c14e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:36.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.760+0000 7f478279c700 1 -- 172.21.15.53:0/1957430783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47780094a0 con 0x7f477c0d0f60 2023-07-09T21:52:36.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.760+0000 7f478179a700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f477c0d0b10 0x7f477c15f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:36.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.760+0000 7f478279c700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f477c0d0f60 0x7f477c0ccb30 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4774014040 tx=0x7f4774004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:36.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.760+0000 7f47727fc700 1 -- 172.21.15.53:0/1957430783 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740129f0 con 0x7f477c0d0f60 2023-07-09T21:52:36.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.760+0000 7f47727fc700 1 -- 172.21.15.53:0/1957430783 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4774020070 con 0x7f477c0d0f60 2023-07-09T21:52:36.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.760+0000 7f47841ff700 1 -- 172.21.15.53:0/1957430783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4774009a70 con 0x7f477c0d0f60 2023-07-09T21:52:36.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.760+0000 7f47727fc700 1 -- 172.21.15.53:0/1957430783 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774012db0 con 0x7f477c0d0f60 2023-07-09T21:52:36.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.760+0000 7f47841ff700 1 -- 172.21.15.53:0/1957430783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c15f000 con 0x7f477c0d0f60 2023-07-09T21:52:36.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.761+0000 7f47841ff700 1 -- 172.21.15.53:0/1957430783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c15f520 con 0x7f477c0d0f60 2023-07-09T21:52:36.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.763+0000 7f47727fc700 1 -- 172.21.15.53:0/1957430783 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f4774004040 con 0x7f477c0d0f60 2023-07-09T21:52:36.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.764+0000 7f47727fc700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f476006ad70 0x7f476006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:36.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.764+0000 7f47727fc700 1 -- 172.21.15.53:0/1957430783 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4774022070 con 0x7f477c0d0f60 2023-07-09T21:52:36.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.765+0000 7f4781f9b700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f476006ad70 0x7f476006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:36.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.765+0000 7f4781f9b700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f476006ad70 0x7f476006d220 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f477c0b7260 tx=0x7f4778008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:36.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:36.767+0000 7f47727fc700 1 -- 172.21.15.53:0/1957430783 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4774056980 con 0x7f477c0d0f60 2023-07-09T21:52:37.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.009+0000 7f47841ff700 1 -- 172.21.15.53:0/1957430783 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000470134", "snap_name": "snapshot_0000000000463948", "group_name": "group_0000000000629258", "target": ["mon-mgr", ""]}) v1 -- 0x7f477c0b0340 con 0x7f476006ad70 2023-07-09T21:52:37.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.025+0000 7f47727fc700 1 -- 172.21.15.53:0/1957430783 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4778009e10 con 0x7f476006ad70 2023-07-09T21:52:37.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.027+0000 7f47841ff700 1 -- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f476006ad70 msgr2=0x7f476006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:37.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.027+0000 7f47841ff700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f476006ad70 0x7f476006d220 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f477c0b7260 tx=0x7f4778008040 comp rx=0 tx=0).stop 2023-07-09T21:52:37.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.027+0000 7f47841ff700 1 -- 172.21.15.53:0/1957430783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f477c0d0f60 msgr2=0x7f477c0ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:37.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.027+0000 7f47841ff700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f477c0d0f60 0x7f477c0ccb30 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4774014040 tx=0x7f4774004ad0 comp rx=0 tx=0).stop 2023-07-09T21:52:37.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.027+0000 7f47841ff700 1 -- 172.21.15.53:0/1957430783 shutdown_connections 2023-07-09T21:52:37.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.027+0000 7f47841ff700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f476006ad70 0x7f476006d220 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:37.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.027+0000 7f47841ff700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f477c0d0f60 0x7f477c0ccb30 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:37.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.027+0000 7f47841ff700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f477c0b3ff0 0x7f477c14e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:37.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.027+0000 7f47841ff700 1 --2- 172.21.15.53:0/1957430783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f477c0d0b10 0x7f477c15f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:37.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.027+0000 7f47841ff700 1 -- 172.21.15.53:0/1957430783 >> 172.21.15.53:0/1957430783 conn(0x7f477c09c1b0 msgr2=0x7f477c06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:37.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.027+0000 7f47841ff700 1 -- 172.21.15.53:0/1957430783 shutdown_connections 2023-07-09T21:52:37.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.027+0000 7f47841ff700 1 -- 172.21.15.53:0/1957430783 wait complete. 2023-07-09T21:52:37.047 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot metadata set cephfs subvolume_0000000000470134 snapshot_0000000000463948 key value group_0000000000629258 2023-07-09T21:52:37.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.255+0000 7fab5f7ff700 1 Processor -- start 2023-07-09T21:52:37.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.255+0000 7fab5f7ff700 1 -- start start 2023-07-09T21:52:37.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.257+0000 7fab5f7ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab580d10a0 0x7fab580b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:37.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.257+0000 7fab5f7ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab580cd410 con 0x7fab580cff20 2023-07-09T21:52:37.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.257+0000 7fab5f7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab580cd660 con 0x7fab580cfb50 2023-07-09T21:52:37.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.257+0000 7fab5f7ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab580d14a0 con 0x7fab580d10a0 2023-07-09T21:52:37.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.257+0000 7fab5dd9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab580d10a0 0x7fab580b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:37.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.257+0000 7fab5dd9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab580d10a0 0x7fab580b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54966/0 (socket says 172.21.15.53:54966) 2023-07-09T21:52:37.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.257+0000 7fab5dd9c700 1 -- 172.21.15.53:0/91035261 learned_addr learned my addr 172.21.15.53:0/91035261 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:37.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.257+0000 7fab5cd9a700 1 --1- 172.21.15.53:0/91035261 >> v1:172.21.15.53:6789/0 conn(0x7fab580cff20 0x7fab580b4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58428/0 (socket says 172.21.15.53:58428) 2023-07-09T21:52:37.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.257+0000 7fab5dd9c700 1 -- 172.21.15.53:0/91035261 >> v1:172.21.15.184:6789/0 conn(0x7fab580cfb50 legacy=0x7fab580d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:37.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.257+0000 7fab5dd9c700 1 -- 172.21.15.53:0/91035261 >> v1:172.21.15.53:6789/0 conn(0x7fab580cff20 legacy=0x7fab580b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:37.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.257+0000 7fab5dd9c700 1 -- 172.21.15.53:0/91035261 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab580cd940 con 0x7fab580d10a0 2023-07-09T21:52:37.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.258+0000 7fab5dd9c700 1 --2- 172.21.15.53:0/91035261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab580d10a0 0x7fab580b4f50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fab50009e50 tx=0x7fab5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dcbfbd61ed60022 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:37.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.258+0000 7fab4ffff700 1 -- 172.21.15.53:0/91035261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5000e070 con 0x7fab580d10a0 2023-07-09T21:52:37.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.258+0000 7fab4ffff700 1 -- 172.21.15.53:0/91035261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5000b9c0 con 0x7fab580d10a0 2023-07-09T21:52:37.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.258+0000 7fab4ffff700 1 -- 172.21.15.53:0/91035261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5000bd70 con 0x7fab580d10a0 2023-07-09T21:52:37.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.258+0000 7fab5f7ff700 1 -- 172.21.15.53:0/91035261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab580d10a0 msgr2=0x7fab580b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:37.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.258+0000 7fab5f7ff700 1 --2- 172.21.15.53:0/91035261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab580d10a0 0x7fab580b4f50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fab50009e50 tx=0x7fab5000b330 comp rx=0 tx=0).stop 2023-07-09T21:52:37.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.259+0000 7fab5f7ff700 1 -- 172.21.15.53:0/91035261 shutdown_connections 2023-07-09T21:52:37.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.259+0000 7fab5f7ff700 1 --2- 172.21.15.53:0/91035261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab580d10a0 0x7fab580b4f50 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:37.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.259+0000 7fab5f7ff700 1 -- 172.21.15.53:0/91035261 >> 172.21.15.53:0/91035261 conn(0x7fab5806a680 msgr2=0x7fab5806aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:37.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.259+0000 7fab5f7ff700 1 -- 172.21.15.53:0/91035261 shutdown_connections 2023-07-09T21:52:37.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.259+0000 7fab5f7ff700 1 -- 172.21.15.53:0/91035261 wait complete. 2023-07-09T21:52:37.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.260+0000 7fab5f7ff700 1 Processor -- start 2023-07-09T21:52:37.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.260+0000 7fab5f7ff700 1 -- start start 2023-07-09T21:52:37.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.261+0000 7fab5f7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab580cfb50 0x7fab5814b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:37.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.261+0000 7fab5f7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab580cff20 0x7fab580b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:37.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.261+0000 7fab5f7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab580d10a0 0x7fab580b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:37.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.261+0000 7fab5f7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab58158ad0 con 0x7fab580cfb50 2023-07-09T21:52:37.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.261+0000 7fab5f7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab58158db0 con 0x7fab580cff20 2023-07-09T21:52:37.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.261+0000 7fab5f7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab58159090 con 0x7fab580d10a0 2023-07-09T21:52:37.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.262+0000 7fab5d59b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab580cfb50 0x7fab5814b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:37.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.262+0000 7fab5d59b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab580cfb50 0x7fab5814b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54978/0 (socket says 172.21.15.53:54978) 2023-07-09T21:52:37.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.262+0000 7fab5d59b700 1 -- 172.21.15.53:0/2593737838 learned_addr learned my addr 172.21.15.53:0/2593737838 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:37.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.262+0000 7fab5cd9a700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab580cff20 0x7fab580b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:37.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.262+0000 7fab5dd9c700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab580d10a0 0x7fab580b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:37.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.262+0000 7fab5d59b700 1 -- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab580d10a0 msgr2=0x7fab580b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:37.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.262+0000 7fab5d59b700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab580d10a0 0x7fab580b7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:37.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.262+0000 7fab5d59b700 1 -- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab580cff20 msgr2=0x7fab580b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:37.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.262+0000 7fab5d59b700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab580cff20 0x7fab580b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:37.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.262+0000 7fab5d59b700 1 -- 172.21.15.53:0/2593737838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab50009b30 con 0x7fab580cfb50 2023-07-09T21:52:37.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.262+0000 7fab5d59b700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab580cfb50 0x7fab5814b370 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fab5400c4e0 tx=0x7fab5400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:37.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.263+0000 7fab4dffb700 1 -- 172.21.15.53:0/2593737838 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540052d0 con 0x7fab580cfb50 2023-07-09T21:52:37.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.263+0000 7fab4dffb700 1 -- 172.21.15.53:0/2593737838 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab54005430 con 0x7fab580cfb50 2023-07-09T21:52:37.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.263+0000 7fab5f7ff700 1 -- 172.21.15.53:0/2593737838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab58159370 con 0x7fab580cfb50 2023-07-09T21:52:37.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.263+0000 7fab4dffb700 1 -- 172.21.15.53:0/2593737838 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540038c0 con 0x7fab580cfb50 2023-07-09T21:52:37.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.263+0000 7fab5f7ff700 1 -- 172.21.15.53:0/2593737838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab58157da0 con 0x7fab580cfb50 2023-07-09T21:52:37.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.264+0000 7fab5f7ff700 1 -- 172.21.15.53:0/2593737838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab58159890 con 0x7fab580cfb50 2023-07-09T21:52:37.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.265+0000 7fab4dffb700 1 -- 172.21.15.53:0/2593737838 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fab54003a20 con 0x7fab580cfb50 2023-07-09T21:52:37.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.266+0000 7fab4dffb700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fab3c06ad70 0x7fab3c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:37.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.266+0000 7fab4dffb700 1 -- 172.21.15.53:0/2593737838 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab54088a90 con 0x7fab580cfb50 2023-07-09T21:52:37.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.266+0000 7fab5cd9a700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fab3c06ad70 0x7fab3c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:37.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.267+0000 7fab5cd9a700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fab3c06ad70 0x7fab3c06d220 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fab581f59e0 tx=0x7fab48007d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:37.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.270+0000 7fab4dffb700 1 -- 172.21.15.53:0/2593737838 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab58159890 con 0x7fab580cfb50 2023-07-09T21:52:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.513+0000 7fab5f7ff700 1 -- 172.21.15.53:0/2593737838 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot metadata set", "vol_name": "cephfs", "sub_name": "subvolume_0000000000470134", "snap_name": "snapshot_0000000000463948", "key_name": "key", "value": "value", "group_name": "group_0000000000629258", "target": ["mon-mgr", ""]}) v1 -- 0x7fab58158f20 con 0x7fab3c06ad70 2023-07-09T21:52:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.531+0000 7fab4dffb700 1 -- 172.21.15.53:0/2593737838 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fab48004870 con 0x7fab3c06ad70 2023-07-09T21:52:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.533+0000 7fab5f7ff700 1 -- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fab3c06ad70 msgr2=0x7fab3c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.533+0000 7fab5f7ff700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fab3c06ad70 0x7fab3c06d220 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fab581f59e0 tx=0x7fab48007d10 comp rx=0 tx=0).stop 2023-07-09T21:52:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.533+0000 7fab5f7ff700 1 -- 172.21.15.53:0/2593737838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab580cfb50 msgr2=0x7fab5814b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.533+0000 7fab5f7ff700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab580cfb50 0x7fab5814b370 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fab5400c4e0 tx=0x7fab5400c8a0 comp rx=0 tx=0).stop 2023-07-09T21:52:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.533+0000 7fab5f7ff700 1 -- 172.21.15.53:0/2593737838 shutdown_connections 2023-07-09T21:52:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.533+0000 7fab5f7ff700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fab3c06ad70 0x7fab3c06d220 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.533+0000 7fab5f7ff700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab580d10a0 0x7fab580b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.533+0000 7fab5f7ff700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab580cfb50 0x7fab5814b370 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.533+0000 7fab5f7ff700 1 --2- 172.21.15.53:0/2593737838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab580cff20 0x7fab580b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.533+0000 7fab5f7ff700 1 -- 172.21.15.53:0/2593737838 >> 172.21.15.53:0/2593737838 conn(0x7fab5806a680 msgr2=0x7fab580b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.533+0000 7fab5f7ff700 1 -- 172.21.15.53:0/2593737838 shutdown_connections 2023-07-09T21:52:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:37.533+0000 7fab5f7ff700 1 -- 172.21.15.53:0/2593737838 wait complete. 2023-07-09T21:52:37.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:37.553 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -p ./volumes/group_0000000000629258/subvolume_0000000000470134/.meta ./volumes/group_0000000000629258/subvolume_0000000000470134/.meta.stale_snap_section) 2023-07-09T21:52:38.484 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000470134 snapshot_0000000000463948 group_0000000000629258 2023-07-09T21:52:38.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.698+0000 7fe6a2dff700 1 Processor -- start 2023-07-09T21:52:38.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.698+0000 7fe6a2dff700 1 -- start start 2023-07-09T21:52:38.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.699+0000 7fe6a2dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe69c0d1220 0x7fe69c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:38.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.699+0000 7fe6a2dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe69c0b0e20 0x7fe69c0b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:38.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.699+0000 7fe6a2dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c0b8e80 con 0x7fe69c0b3ff0 2023-07-09T21:52:38.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.699+0000 7fe6a2dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c0afaa0 con 0x7fe69c0d1220 2023-07-09T21:52:38.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.699+0000 7fe6a2dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c0afd80 con 0x7fe69c0b0e20 2023-07-09T21:52:38.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.699+0000 7fe69bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe69c0d1220 0x7fe69c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:38.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.700+0000 7fe69bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe69c0d1220 0x7fe69c0b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54990/0 (socket says 172.21.15.53:54990) 2023-07-09T21:52:38.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.700+0000 7fe69bfff700 1 -- 172.21.15.53:0/3774374577 learned_addr learned my addr 172.21.15.53:0/3774374577 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:38.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.700+0000 7fe6a139c700 1 --2- 172.21.15.53:0/3774374577 >> v2:172.21.15.184:3300/0 conn(0x7fe69c0b0e20 0x7fe69c0b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:38.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.700+0000 7fe69bfff700 1 -- 172.21.15.53:0/3774374577 >> v2:172.21.15.184:3300/0 conn(0x7fe69c0b0e20 msgr2=0x7fe69c0b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:38.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.700+0000 7fe69bfff700 1 --2- 172.21.15.53:0/3774374577 >> v2:172.21.15.184:3300/0 conn(0x7fe69c0b0e20 0x7fe69c0b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:38.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.700+0000 7fe69bfff700 1 -- 172.21.15.53:0/3774374577 >> v1:172.21.15.184:6789/0 conn(0x7fe69c0b3ff0 legacy=0x7fe69c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:38.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.700+0000 7fe69bfff700 1 -- 172.21.15.53:0/3774374577 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0b0060 con 0x7fe69c0d1220 2023-07-09T21:52:38.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.700+0000 7fe69bfff700 1 --2- 172.21.15.53:0/3774374577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe69c0d1220 0x7fe69c0b43c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0d3ce0 tx=0x7fe688009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3799e083d05f2e7d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:38.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.701+0000 7fe69b7fe700 1 -- 172.21.15.53:0/3774374577 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68800b870 con 0x7fe69c0d1220 2023-07-09T21:52:38.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.701+0000 7fe69b7fe700 1 -- 172.21.15.53:0/3774374577 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68800b9d0 con 0x7fe69c0d1220 2023-07-09T21:52:38.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.701+0000 7fe69b7fe700 1 -- 172.21.15.53:0/3774374577 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68800bd60 con 0x7fe69c0d1220 2023-07-09T21:52:38.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.701+0000 7fe6a2dff700 1 -- 172.21.15.53:0/3774374577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe69c0d1220 msgr2=0x7fe69c0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:38.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.701+0000 7fe6a2dff700 1 --2- 172.21.15.53:0/3774374577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe69c0d1220 0x7fe69c0b43c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0d3ce0 tx=0x7fe688009bd0 comp rx=0 tx=0).stop 2023-07-09T21:52:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.701+0000 7fe6a2dff700 1 -- 172.21.15.53:0/3774374577 shutdown_connections 2023-07-09T21:52:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.701+0000 7fe6a2dff700 1 --2- 172.21.15.53:0/3774374577 >> v2:172.21.15.184:3300/0 conn(0x7fe69c0b0e20 0x7fe69c0b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.701+0000 7fe6a2dff700 1 --2- 172.21.15.53:0/3774374577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe69c0d1220 0x7fe69c0b43c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.701+0000 7fe6a2dff700 1 -- 172.21.15.53:0/3774374577 >> 172.21.15.53:0/3774374577 conn(0x7fe69c09c1b0 msgr2=0x7fe69c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.701+0000 7fe6a2dff700 1 -- 172.21.15.53:0/3774374577 shutdown_connections 2023-07-09T21:52:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.701+0000 7fe6a2dff700 1 -- 172.21.15.53:0/3774374577 wait complete. 2023-07-09T21:52:38.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.703+0000 7fe6a2dff700 1 Processor -- start 2023-07-09T21:52:38.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.703+0000 7fe6a2dff700 1 -- start start 2023-07-09T21:52:38.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.704+0000 7fe6a2dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe69c0b0e20 0x7fe69c1f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:38.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.704+0000 7fe6a2dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe69c0b3ff0 0x7fe69c14e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:38.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.704+0000 7fe6a2dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe69c0d1220 0x7fe69c1e6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:38.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.704+0000 7fe6a2dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0c7140 con 0x7fe69c0b0e20 2023-07-09T21:52:38.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.704+0000 7fe6a2dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c1e5eb0 con 0x7fe69c0d1220 2023-07-09T21:52:38.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.704+0000 7fe6a2dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0c67a0 con 0x7fe69c0b3ff0 2023-07-09T21:52:38.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.704+0000 7fe6a0b9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe69c0b0e20 0x7fe69c1f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:38.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.704+0000 7fe6a0b9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe69c0b0e20 0x7fe69c1f1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55006/0 (socket says 172.21.15.53:55006) 2023-07-09T21:52:38.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.704+0000 7fe6a0b9b700 1 -- 172.21.15.53:0/58344354 learned_addr learned my addr 172.21.15.53:0/58344354 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:38.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.705+0000 7fe69bfff700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe69c0b3ff0 0x7fe69c14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:38.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.705+0000 7fe6a139c700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe69c0d1220 0x7fe69c1e6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:38.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.705+0000 7fe6a0b9b700 1 -- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe69c0b3ff0 msgr2=0x7fe69c14e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:38.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.705+0000 7fe6a0b9b700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe69c0b3ff0 0x7fe69c14e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:38.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.705+0000 7fe6a0b9b700 1 -- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe69c0d1220 msgr2=0x7fe69c1e6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:38.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.705+0000 7fe6a0b9b700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe69c0d1220 0x7fe69c1e6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:38.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.705+0000 7fe6a0b9b700 1 -- 172.21.15.53:0/58344354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe688009550 con 0x7fe69c0b0e20 2023-07-09T21:52:38.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.705+0000 7fe6a0b9b700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe69c0b0e20 0x7fe69c1f1c30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe69000c4e0 tx=0x7fe69000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:38.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.705+0000 7fe6997fa700 1 -- 172.21.15.53:0/58344354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6900052d0 con 0x7fe69c0b0e20 2023-07-09T21:52:38.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.705+0000 7fe6997fa700 1 -- 172.21.15.53:0/58344354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe690005430 con 0x7fe69c0b0e20 2023-07-09T21:52:38.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.705+0000 7fe6a2dff700 1 -- 172.21.15.53:0/58344354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c0c6a80 con 0x7fe69c0b0e20 2023-07-09T21:52:38.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.705+0000 7fe6997fa700 1 -- 172.21.15.53:0/58344354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6900038c0 con 0x7fe69c0b0e20 2023-07-09T21:52:38.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.705+0000 7fe6a2dff700 1 -- 172.21.15.53:0/58344354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c14e780 con 0x7fe69c0b0e20 2023-07-09T21:52:38.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.707+0000 7fe6a2dff700 1 -- 172.21.15.53:0/58344354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69c0723e0 con 0x7fe69c0b0e20 2023-07-09T21:52:38.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.708+0000 7fe6997fa700 1 -- 172.21.15.53:0/58344354 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fe690003a20 con 0x7fe69c0b0e20 2023-07-09T21:52:38.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.709+0000 7fe6997fa700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe68006ae00 0x7fe68006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:38.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.709+0000 7fe6997fa700 1 -- 172.21.15.53:0/58344354 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe690088970 con 0x7fe69c0b0e20 2023-07-09T21:52:38.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.709+0000 7fe69bfff700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe68006ae00 0x7fe68006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:38.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.710+0000 7fe69bfff700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe68006ae00 0x7fe68006d2b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe688000c00 tx=0x7fe688008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:38.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.713+0000 7fe6997fa700 1 -- 172.21.15.53:0/58344354 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe690053910 con 0x7fe69c0b0e20 2023-07-09T21:52:38.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:38.962+0000 7fe6a2dff700 1 -- 172.21.15.53:0/58344354 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000470134", "snap_name": "snapshot_0000000000463948", "group_name": "group_0000000000629258", "target": ["mon-mgr", ""]}) v1 -- 0x7fe69c0b0620 con 0x7fe68006ae00 2023-07-09T21:52:39.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.002+0000 7fe6997fa700 1 -- 172.21.15.53:0/58344354 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe68800bb40 con 0x7fe68006ae00 2023-07-09T21:52:39.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.004+0000 7fe6a2dff700 1 -- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe68006ae00 msgr2=0x7fe68006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:39.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.004+0000 7fe6a2dff700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe68006ae00 0x7fe68006d2b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe688000c00 tx=0x7fe688008030 comp rx=0 tx=0).stop 2023-07-09T21:52:39.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.004+0000 7fe6a2dff700 1 -- 172.21.15.53:0/58344354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe69c0b0e20 msgr2=0x7fe69c1f1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:39.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.004+0000 7fe6a2dff700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe69c0b0e20 0x7fe69c1f1c30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe69000c4e0 tx=0x7fe69000c8a0 comp rx=0 tx=0).stop 2023-07-09T21:52:39.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.005+0000 7fe6a2dff700 1 -- 172.21.15.53:0/58344354 shutdown_connections 2023-07-09T21:52:39.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.005+0000 7fe6a2dff700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fe68006ae00 0x7fe68006d2b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:39.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.005+0000 7fe6a2dff700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe69c0d1220 0x7fe69c1e6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:39.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.005+0000 7fe6a2dff700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe69c0b0e20 0x7fe69c1f1c30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:39.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.005+0000 7fe6a2dff700 1 --2- 172.21.15.53:0/58344354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe69c0b3ff0 0x7fe69c14e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:39.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.005+0000 7fe6a2dff700 1 -- 172.21.15.53:0/58344354 >> 172.21.15.53:0/58344354 conn(0x7fe69c09c1b0 msgr2=0x7fe69c0b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:39.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.005+0000 7fe6a2dff700 1 -- 172.21.15.53:0/58344354 shutdown_connections 2023-07-09T21:52:39.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.005+0000 7fe6a2dff700 1 -- 172.21.15.53:0/58344354 wait complete. 2023-07-09T21:52:39.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:39.024 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -p ./volumes/group_0000000000629258/subvolume_0000000000470134/.meta.stale_snap_section ./volumes/group_0000000000629258/subvolume_0000000000470134/.meta) 2023-07-09T21:52:39.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:39.105 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo grep SNAP_METADATA_snapshot_0000000000463948 ./volumes/group_0000000000629258/subvolume_0000000000470134/.meta) 2023-07-09T21:52:39.172 INFO:teuthology.orchestra.run.smithi053.stdout:[SNAP_METADATA_snapshot_0000000000463948] 2023-07-09T21:52:39.176 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvolume_0000000000470134 group_0000000000629258 2023-07-09T21:52:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.381+0000 7fdfb7bff700 1 Processor -- start 2023-07-09T21:52:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.381+0000 7fdfb7bff700 1 -- start start 2023-07-09T21:52:39.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.382+0000 7fdfb7bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdfb00d28a0 0x7fdfb015c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:39.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.382+0000 7fdfb7bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdfb00d0a30 0x7fdfb00d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:39.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.382+0000 7fdfb7bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb00d2c70 con 0x7fdfb0160350 2023-07-09T21:52:39.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.382+0000 7fdfb7bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb00d1410 con 0x7fdfb00d28a0 2023-07-09T21:52:39.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.382+0000 7fdfb7bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb00d3de0 con 0x7fdfb00d0a30 2023-07-09T21:52:39.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.382+0000 7fdfb599b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdfb00d28a0 0x7fdfb015c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:39.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.382+0000 7fdfb599b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdfb00d28a0 0x7fdfb015c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55022/0 (socket says 172.21.15.53:55022) 2023-07-09T21:52:39.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.382+0000 7fdfb599b700 1 -- 172.21.15.53:0/1840332620 learned_addr learned my addr 172.21.15.53:0/1840332620 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.383+0000 7fdfb599b700 1 -- 172.21.15.53:0/1840332620 >> v2:172.21.15.184:3300/0 conn(0x7fdfb00d0a30 msgr2=0x7fdfb00d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.383+0000 7fdfb519a700 1 --2- 172.21.15.53:0/1840332620 >> v2:172.21.15.184:3300/0 conn(0x7fdfb00d0a30 0x7fdfb00d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.383+0000 7fdfb599b700 1 --2- 172.21.15.53:0/1840332620 >> v2:172.21.15.184:3300/0 conn(0x7fdfb00d0a30 0x7fdfb00d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.383+0000 7fdfb599b700 1 -- 172.21.15.53:0/1840332620 >> v1:172.21.15.184:6789/0 conn(0x7fdfb0160350 legacy=0x7fdfb01607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.383+0000 7fdfb599b700 1 -- 172.21.15.53:0/1840332620 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00d0190 con 0x7fdfb00d28a0 2023-07-09T21:52:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.383+0000 7fdfb519a700 1 --2- 172.21.15.53:0/1840332620 >> v2:172.21.15.184:3300/0 conn(0x7fdfb00d0a30 0x7fdfb00d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.383+0000 7fdfb599b700 1 --2- 172.21.15.53:0/1840332620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfb00d28a0 0x7fdfb015c7b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fdfb008ba80 tx=0x7fdfac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fe0e4706bfc4f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.383+0000 7fdfb4999700 1 -- 172.21.15.53:0/1840332620 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac004230 con 0x7fdfb00d28a0 2023-07-09T21:52:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.383+0000 7fdfb4999700 1 -- 172.21.15.53:0/1840332620 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac004390 con 0x7fdfb00d28a0 2023-07-09T21:52:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.383+0000 7fdfb4999700 1 -- 172.21.15.53:0/1840332620 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0036a0 con 0x7fdfb00d28a0 2023-07-09T21:52:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.384+0000 7fdfb7bff700 1 -- 172.21.15.53:0/1840332620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfb00d28a0 msgr2=0x7fdfb015c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.384+0000 7fdfb7bff700 1 --2- 172.21.15.53:0/1840332620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfb00d28a0 0x7fdfb015c7b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fdfb008ba80 tx=0x7fdfac009bd0 comp rx=0 tx=0).stop 2023-07-09T21:52:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.384+0000 7fdfb7bff700 1 -- 172.21.15.53:0/1840332620 shutdown_connections 2023-07-09T21:52:39.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.384+0000 7fdfb7bff700 1 --2- 172.21.15.53:0/1840332620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfb00d28a0 0x7fdfb015c7b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:39.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.384+0000 7fdfb7bff700 1 --2- 172.21.15.53:0/1840332620 >> v2:172.21.15.184:3300/0 conn(0x7fdfb00d0a30 0x7fdfb00d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:39.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.384+0000 7fdfb7bff700 1 -- 172.21.15.53:0/1840332620 >> 172.21.15.53:0/1840332620 conn(0x7fdfb009c1b0 msgr2=0x7fdfb00d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:39.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.384+0000 7fdfb7bff700 1 -- 172.21.15.53:0/1840332620 shutdown_connections 2023-07-09T21:52:39.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.384+0000 7fdfb7bff700 1 -- 172.21.15.53:0/1840332620 wait complete. 2023-07-09T21:52:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.386+0000 7fdfb7bff700 1 Processor -- start 2023-07-09T21:52:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.386+0000 7fdfb7bff700 1 -- start start 2023-07-09T21:52:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb7bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfb00d0a30 0x7fdfb015a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb7bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfb00d28a0 0x7fdfb01f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb7bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb0160350 0x7fdfb0156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb7bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb01f2050 con 0x7fdfb00d0a30 2023-07-09T21:52:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb7bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb00c9f30 con 0x7fdfb0160350 2023-07-09T21:52:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb7bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb01f6010 con 0x7fdfb00d28a0 2023-07-09T21:52:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb599b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfb00d0a30 0x7fdfb015a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb599b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfb00d0a30 0x7fdfb015a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55032/0 (socket says 172.21.15.53:55032) 2023-07-09T21:52:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb599b700 1 -- 172.21.15.53:0/2178222062 learned_addr learned my addr 172.21.15.53:0/2178222062 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb619c700 1 --2- 172.21.15.53:0/2178222062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb0160350 0x7fdfb0156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb599b700 1 -- 172.21.15.53:0/2178222062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfb00d28a0 msgr2=0x7fdfb01f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb519a700 1 --2- 172.21.15.53:0/2178222062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfb00d28a0 0x7fdfb01f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb599b700 1 --2- 172.21.15.53:0/2178222062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfb00d28a0 0x7fdfb01f5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb599b700 1 -- 172.21.15.53:0/2178222062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb0160350 msgr2=0x7fdfb0156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb599b700 1 --2- 172.21.15.53:0/2178222062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb0160350 0x7fdfb0156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.387+0000 7fdfb599b700 1 -- 172.21.15.53:0/2178222062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac009550 con 0x7fdfb00d0a30 2023-07-09T21:52:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.388+0000 7fdfb619c700 1 --2- 172.21.15.53:0/2178222062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb0160350 0x7fdfb0156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.388+0000 7fdfb599b700 1 --2- 172.21.15.53:0/2178222062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfb00d0a30 0x7fdfb015a7b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0067530 tx=0x7fdfac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.388+0000 7fdfa67fc700 1 -- 172.21.15.53:0/2178222062 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac003d80 con 0x7fdfb00d0a30 2023-07-09T21:52:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.388+0000 7fdfa67fc700 1 -- 172.21.15.53:0/2178222062 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac01f070 con 0x7fdfb00d0a30 2023-07-09T21:52:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.388+0000 7fdfa67fc700 1 -- 172.21.15.53:0/2178222062 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac011870 con 0x7fdfb00d0a30 2023-07-09T21:52:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.388+0000 7fdfb7bff700 1 -- 172.21.15.53:0/2178222062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb01f62f0 con 0x7fdfb00d0a30 2023-07-09T21:52:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.388+0000 7fdfb7bff700 1 -- 172.21.15.53:0/2178222062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb00ca460 con 0x7fdfb00d0a30 2023-07-09T21:52:39.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.389+0000 7fdfb7bff700 1 -- 172.21.15.53:0/2178222062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb0074350 con 0x7fdfb00d0a30 2023-07-09T21:52:39.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.390+0000 7fdfa67fc700 1 -- 172.21.15.53:0/2178222062 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fdfac021030 con 0x7fdfb00d0a30 2023-07-09T21:52:39.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.391+0000 7fdfa67fc700 1 --2- 172.21.15.53:0/2178222062 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdf9406ae00 0x7fdf9406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:39.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.391+0000 7fdfa67fc700 1 -- 172.21.15.53:0/2178222062 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdfac08ad10 con 0x7fdfb00d0a30 2023-07-09T21:52:39.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.391+0000 7fdfb519a700 1 --2- 172.21.15.53:0/2178222062 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdf9406ae00 0x7fdf9406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:39.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.392+0000 7fdfb519a700 1 --2- 172.21.15.53:0/2178222062 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdf9406ae00 0x7fdf9406d2b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0006fd0 tx=0x7fdfa0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:39.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.395+0000 7fdfa67fc700 1 -- 172.21.15.53:0/2178222062 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdfac090020 con 0x7fdfb00d0a30 2023-07-09T21:52:39.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.636+0000 7fdfb7bff700 1 -- 172.21.15.53:0/2178222062 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvolume_0000000000470134", "group_name": "group_0000000000629258", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfb00d0750 con 0x7fdf9406ae00 2023-07-09T21:52:39.668 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-09T21:52:39.667+0000 7fa52c43e700 -1 mgr.server reply reply (61) No data available error in getxattr 2023-07-09T21:52:39.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:39.667+0000 7fdfa67fc700 1 -- 172.21.15.53:0/2178222062 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: -61 error in getxattr) v1 ==== 25+0+0 (secure 0 0 0) 0x7fdfa000c040 con 0x7fdf9406ae00 2023-07-09T21:52:39.670 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENODATA: error in getxattr 2023-07-09T21:52:39.678 DEBUG:teuthology.orchestra.run:got remote process result: 61 2023-07-09T21:52:39.679 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:52:39.680 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:52:39.779 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:52:39.898 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:52:39.898 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:52:39.898 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:39.943 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:52:39.943 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:40.025 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:52:40.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.263+0000 7ff314fff700 1 Processor -- start 2023-07-09T21:52:40.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.263+0000 7ff314fff700 1 -- start start 2023-07-09T21:52:40.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.264+0000 7ff314fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3100b2180 0x7ff310070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:40.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.264+0000 7ff314fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3100b4000 0x7ff31006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:40.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.264+0000 7ff314fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31006c110 con 0x7ff310158fd0 2023-07-09T21:52:40.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.264+0000 7ff314fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff310071140 con 0x7ff3100b2180 2023-07-09T21:52:40.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.264+0000 7ff314fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff310070c50 con 0x7ff3100b4000 2023-07-09T21:52:40.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.264+0000 7ff307fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3100b2180 0x7ff310070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:40.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.264+0000 7ff30e59c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff310158fd0 0x7ff3100b1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58444/0 (socket says 172.21.15.53:58444) 2023-07-09T21:52:40.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.264+0000 7ff30e59c700 1 -- 172.21.15.53:0/2335096296 learned_addr learned my addr 172.21.15.53:0/2335096296 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:40.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.264+0000 7ff307fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3100b2180 0x7ff310070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55040/0 (socket says 172.21.15.53:55040) 2023-07-09T21:52:40.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.265+0000 7ff30ed9d700 1 --2- 172.21.15.53:0/2335096296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3100b4000 0x7ff31006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:40.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.265+0000 7ff307fff700 1 -- 172.21.15.53:0/2335096296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3100b4000 msgr2=0x7ff31006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:40.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.265+0000 7ff307fff700 1 --2- 172.21.15.53:0/2335096296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3100b4000 0x7ff31006c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.265+0000 7ff307fff700 1 -- 172.21.15.53:0/2335096296 >> v1:172.21.15.53:6789/0 conn(0x7ff310158fd0 legacy=0x7ff3100b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:40.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.265+0000 7ff307fff700 1 -- 172.21.15.53:0/2335096296 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff310070e60 con 0x7ff3100b2180 2023-07-09T21:52:40.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.265+0000 7ff30dd9b700 1 -- 172.21.15.53:0/2335096296 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111821316 0 0) 0x7ff31006c110 con 0x7ff310158fd0 2023-07-09T21:52:40.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.265+0000 7ff30ed9d700 1 --2- 172.21.15.53:0/2335096296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3100b4000 0x7ff31006c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:40.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.265+0000 7ff307fff700 1 --2- 172.21.15.53:0/2335096296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3100b2180 0x7ff310070710 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009840 tx=0x7ff2f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a511479990e9cc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:40.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.265+0000 7ff30dd9b700 1 -- 172.21.15.53:0/2335096296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8011830 con 0x7ff3100b2180 2023-07-09T21:52:40.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.265+0000 7ff30dd9b700 1 -- 172.21.15.53:0/2335096296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f8011990 con 0x7ff3100b2180 2023-07-09T21:52:40.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.265+0000 7ff30dd9b700 1 -- 172.21.15.53:0/2335096296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8011d20 con 0x7ff3100b2180 2023-07-09T21:52:40.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.266+0000 7ff314fff700 1 -- 172.21.15.53:0/2335096296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3100b2180 msgr2=0x7ff310070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:40.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.266+0000 7ff314fff700 1 --2- 172.21.15.53:0/2335096296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3100b2180 0x7ff310070710 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009840 tx=0x7ff2f8009b50 comp rx=0 tx=0).stop 2023-07-09T21:52:40.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.266+0000 7ff314fff700 1 -- 172.21.15.53:0/2335096296 shutdown_connections 2023-07-09T21:52:40.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.266+0000 7ff314fff700 1 --2- 172.21.15.53:0/2335096296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3100b4000 0x7ff31006c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.266+0000 7ff314fff700 1 --2- 172.21.15.53:0/2335096296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3100b2180 0x7ff310070710 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.266+0000 7ff314fff700 1 -- 172.21.15.53:0/2335096296 >> 172.21.15.53:0/2335096296 conn(0x7ff310069f30 msgr2=0x7ff31006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:40.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.266+0000 7ff314fff700 1 -- 172.21.15.53:0/2335096296 shutdown_connections 2023-07-09T21:52:40.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.266+0000 7ff314fff700 1 -- 172.21.15.53:0/2335096296 wait complete. 2023-07-09T21:52:40.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.268+0000 7ff314fff700 1 Processor -- start 2023-07-09T21:52:40.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.268+0000 7ff314fff700 1 -- start start 2023-07-09T21:52:40.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.269+0000 7ff314fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3100b2180 0x7ff31013e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:40.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.269+0000 7ff314fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3100b4000 0x7ff31013a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:40.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.269+0000 7ff314fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff310158fd0 0x7ff3101595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:40.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.269+0000 7ff314fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff310157540 con 0x7ff310158fd0 2023-07-09T21:52:40.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.269+0000 7ff314fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31015a410 con 0x7ff3100b2180 2023-07-09T21:52:40.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.269+0000 7ff314fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31015a6f0 con 0x7ff3100b4000 2023-07-09T21:52:40.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.269+0000 7ff30ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff310158fd0 0x7ff3101595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:40.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.269+0000 7ff30ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff310158fd0 0x7ff3101595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55042/0 (socket says 172.21.15.53:55042) 2023-07-09T21:52:40.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.269+0000 7ff30ed9d700 1 -- 172.21.15.53:0/1158471776 learned_addr learned my addr 172.21.15.53:0/1158471776 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:40.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.270+0000 7ff307fff700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3100b4000 0x7ff31013a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:40.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.270+0000 7ff30e59c700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3100b2180 0x7ff31013e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:40.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.270+0000 7ff30ed9d700 1 -- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3100b4000 msgr2=0x7ff31013a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:40.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.270+0000 7ff30ed9d700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3100b4000 0x7ff31013a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.270+0000 7ff30ed9d700 1 -- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3100b2180 msgr2=0x7ff31013e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:40.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.270+0000 7ff30ed9d700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3100b2180 0x7ff31013e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.270+0000 7ff30ed9d700 1 -- 172.21.15.53:0/1158471776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80094a0 con 0x7ff310158fd0 2023-07-09T21:52:40.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.270+0000 7ff30ed9d700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff310158fd0 0x7ff3101595b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff30800cef0 tx=0x7ff30800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:40.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.270+0000 7ff306ffd700 1 -- 172.21.15.53:0/1158471776 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30800ae50 con 0x7ff310158fd0 2023-07-09T21:52:40.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.270+0000 7ff306ffd700 1 -- 172.21.15.53:0/1158471776 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff308015440 con 0x7ff310158fd0 2023-07-09T21:52:40.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.270+0000 7ff314fff700 1 -- 172.21.15.53:0/1158471776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31015a9d0 con 0x7ff310158fd0 2023-07-09T21:52:40.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.270+0000 7ff306ffd700 1 -- 172.21.15.53:0/1158471776 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3080157f0 con 0x7ff310158fd0 2023-07-09T21:52:40.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.271+0000 7ff314fff700 1 -- 172.21.15.53:0/1158471776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31015a070 con 0x7ff310158fd0 2023-07-09T21:52:40.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.272+0000 7ff314fff700 1 -- 172.21.15.53:0/1158471776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31006bd80 con 0x7ff310158fd0 2023-07-09T21:52:40.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.272+0000 7ff306ffd700 1 -- 172.21.15.53:0/1158471776 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7ff30800d430 con 0x7ff310158fd0 2023-07-09T21:52:40.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.273+0000 7ff306ffd700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff2f006ae00 0x7ff2f006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:40.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.273+0000 7ff306ffd700 1 -- 172.21.15.53:0/1158471776 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff308089c70 con 0x7ff310158fd0 2023-07-09T21:52:40.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.274+0000 7ff30e59c700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff2f006ae00 0x7ff2f006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:40.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.275+0000 7ff30e59c700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff2f006ae00 0x7ff2f006d2b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff300000f60 tx=0x7ff300007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:40.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.278+0000 7ff306ffd700 1 -- 172.21.15.53:0/1158471776 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff31006bd80 con 0x7ff310158fd0 2023-07-09T21:52:40.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.485+0000 7ff314fff700 1 -- 172.21.15.53:0/1158471776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff31006bd80 con 0x7ff310158fd0 2023-07-09T21:52:40.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.486+0000 7ff306ffd700 1 -- 172.21.15.53:0/1158471776 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+18327 (secure 0 0 0) 0x7ff31006bd80 con 0x7ff310158fd0 2023-07-09T21:52:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:40.489 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":51,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:52:19.894140+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:52:16.672667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:52:17.375922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:52:40.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.488+0000 7ff314fff700 1 -- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff2f006ae00 msgr2=0x7ff2f006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:40.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.488+0000 7ff314fff700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff2f006ae00 0x7ff2f006d2b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff300000f60 tx=0x7ff300007c00 comp rx=0 tx=0).stop 2023-07-09T21:52:40.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.488+0000 7ff314fff700 1 -- 172.21.15.53:0/1158471776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff310158fd0 msgr2=0x7ff3101595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:40.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.488+0000 7ff314fff700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff310158fd0 0x7ff3101595b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff30800cef0 tx=0x7ff30800a340 comp rx=0 tx=0).stop 2023-07-09T21:52:40.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.489+0000 7ff314fff700 1 -- 172.21.15.53:0/1158471776 shutdown_connections 2023-07-09T21:52:40.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.489+0000 7ff314fff700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff2f006ae00 0x7ff2f006d2b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.489+0000 7ff314fff700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff310158fd0 0x7ff3101595b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.489+0000 7ff314fff700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3100b2180 0x7ff31013e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.489+0000 7ff314fff700 1 --2- 172.21.15.53:0/1158471776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3100b4000 0x7ff31013a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.489+0000 7ff314fff700 1 -- 172.21.15.53:0/1158471776 >> 172.21.15.53:0/1158471776 conn(0x7ff310069f30 msgr2=0x7ff3100af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:40.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.489+0000 7ff314fff700 1 -- 172.21.15.53:0/1158471776 shutdown_connections 2023-07-09T21:52:40.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.489+0000 7ff314fff700 1 -- 172.21.15.53:0/1158471776 wait complete. 2023-07-09T21:52:40.508 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:52:16.672667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:52:17.375922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:52:40.509 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:52:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.713+0000 7fa6709ff700 1 Processor -- start 2023-07-09T21:52:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.713+0000 7fa6709ff700 1 -- start start 2023-07-09T21:52:40.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.714+0000 7fa6709ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa66c0d12c0 0x7fa66c0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:40.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.714+0000 7fa6709ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa66c06b040 0x7fa66c06b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:40.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.714+0000 7fa6709ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c0b0560 con 0x7fa66c0cd560 2023-07-09T21:52:40.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.714+0000 7fa6709ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66c0d1690 con 0x7fa66c0d12c0 2023-07-09T21:52:40.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.714+0000 7fa6709ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c06b9f0 con 0x7fa66c06b040 2023-07-09T21:52:40.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.714+0000 7fa66a59c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa66c0d12c0 0x7fa66c0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:40.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.715+0000 7fa66ad9d700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa66c0cd560 0x7fa66c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58446/0 (socket says 172.21.15.53:58446) 2023-07-09T21:52:40.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.715+0000 7fa66a59c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa66c0d12c0 0x7fa66c0cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55048/0 (socket says 172.21.15.53:55048) 2023-07-09T21:52:40.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.715+0000 7fa66ad9d700 1 -- 172.21.15.53:0/805854445 learned_addr learned my addr 172.21.15.53:0/805854445 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:40.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.715+0000 7fa669d9b700 1 --2- 172.21.15.53:0/805854445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa66c06b040 0x7fa66c06b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:40.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.715+0000 7fa66a59c700 1 -- 172.21.15.53:0/805854445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa66c06b040 msgr2=0x7fa66c06b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:40.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.715+0000 7fa66a59c700 1 --2- 172.21.15.53:0/805854445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa66c06b040 0x7fa66c06b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.715+0000 7fa66a59c700 1 -- 172.21.15.53:0/805854445 >> v1:172.21.15.53:6789/0 conn(0x7fa66c0cd560 legacy=0x7fa66c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:40.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.715+0000 7fa66a59c700 1 -- 172.21.15.53:0/805854445 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c0cc760 con 0x7fa66c0d12c0 2023-07-09T21:52:40.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.715+0000 7fa66959a700 1 -- 172.21.15.53:0/805854445 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146460296 0 0) 0x7fa66c0b0560 con 0x7fa66c0cd560 2023-07-09T21:52:40.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.715+0000 7fa66a59c700 1 --2- 172.21.15.53:0/805854445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa66c0d12c0 0x7fa66c0cc220 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa65c009870 tx=0x7fa65c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c854c22147e18cb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:40.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.716+0000 7fa66959a700 1 -- 172.21.15.53:0/805854445 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c011830 con 0x7fa66c0d12c0 2023-07-09T21:52:40.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.716+0000 7fa66959a700 1 -- 172.21.15.53:0/805854445 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c011990 con 0x7fa66c0d12c0 2023-07-09T21:52:40.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.716+0000 7fa66959a700 1 -- 172.21.15.53:0/805854445 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c011d20 con 0x7fa66c0d12c0 2023-07-09T21:52:40.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.716+0000 7fa6709ff700 1 -- 172.21.15.53:0/805854445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa66c0d12c0 msgr2=0x7fa66c0cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:40.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.716+0000 7fa6709ff700 1 --2- 172.21.15.53:0/805854445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa66c0d12c0 0x7fa66c0cc220 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa65c009870 tx=0x7fa65c009b80 comp rx=0 tx=0).stop 2023-07-09T21:52:40.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.716+0000 7fa6709ff700 1 -- 172.21.15.53:0/805854445 shutdown_connections 2023-07-09T21:52:40.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.716+0000 7fa6709ff700 1 --2- 172.21.15.53:0/805854445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa66c0d12c0 0x7fa66c0cc220 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.716+0000 7fa6709ff700 1 --2- 172.21.15.53:0/805854445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa66c06b040 0x7fa66c06b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.716+0000 7fa6709ff700 1 -- 172.21.15.53:0/805854445 >> 172.21.15.53:0/805854445 conn(0x7fa66c0999e0 msgr2=0x7fa66c099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:40.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.716+0000 7fa6709ff700 1 -- 172.21.15.53:0/805854445 shutdown_connections 2023-07-09T21:52:40.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.716+0000 7fa6709ff700 1 -- 172.21.15.53:0/805854445 wait complete. 2023-07-09T21:52:40.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.719+0000 7fa6709ff700 1 Processor -- start 2023-07-09T21:52:40.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.719+0000 7fa6709ff700 1 -- start start 2023-07-09T21:52:40.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.720+0000 7fa6709ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa66c06b040 0x7fa66c0c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:40.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.720+0000 7fa6709ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa66c0cd560 0x7fa66c1f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:40.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.720+0000 7fa6709ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa66c0d12c0 0x7fa66c1574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:40.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.720+0000 7fa6709ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c1f3600 con 0x7fa66c0cd560 2023-07-09T21:52:40.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.720+0000 7fa6709ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c157a00 con 0x7fa66c0d12c0 2023-07-09T21:52:40.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.720+0000 7fa6709ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c15d050 con 0x7fa66c06b040 2023-07-09T21:52:40.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.720+0000 7fa669d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa66c0cd560 0x7fa66c1f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:40.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.720+0000 7fa669d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa66c0cd560 0x7fa66c1f30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55052/0 (socket says 172.21.15.53:55052) 2023-07-09T21:52:40.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.720+0000 7fa669d9b700 1 -- 172.21.15.53:0/2721479042 learned_addr learned my addr 172.21.15.53:0/2721479042 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:40.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.721+0000 7fa66a59c700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa66c06b040 0x7fa66c0c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:40.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.721+0000 7fa66ad9d700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa66c0d12c0 0x7fa66c1574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:40.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.721+0000 7fa669d9b700 1 -- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa66c06b040 msgr2=0x7fa66c0c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:40.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.721+0000 7fa669d9b700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa66c06b040 0x7fa66c0c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.721+0000 7fa669d9b700 1 -- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa66c0d12c0 msgr2=0x7fa66c1574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.721+0000 7fa669d9b700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa66c0d12c0 0x7fa66c1574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.721+0000 7fa669d9b700 1 -- 172.21.15.53:0/2721479042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c0094a0 con 0x7fa66c0cd560 2023-07-09T21:52:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.721+0000 7fa66ad9d700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa66c0d12c0 0x7fa66c1574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.721+0000 7fa669d9b700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa66c0cd560 0x7fa66c1f30c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa66000e870 tx=0x7fa66000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.721+0000 7fa65affd700 1 -- 172.21.15.53:0/2721479042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa660009590 con 0x7fa66c0cd560 2023-07-09T21:52:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.721+0000 7fa65affd700 1 -- 172.21.15.53:0/2721479042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa660013680 con 0x7fa66c0cd560 2023-07-09T21:52:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.721+0000 7fa65affd700 1 -- 172.21.15.53:0/2721479042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600139f0 con 0x7fa66c0cd560 2023-07-09T21:52:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.721+0000 7fa6709ff700 1 -- 172.21.15.53:0/2721479042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c0c8390 con 0x7fa66c0cd560 2023-07-09T21:52:40.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.722+0000 7fa6709ff700 1 -- 172.21.15.53:0/2721479042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c0c8950 con 0x7fa66c0cd560 2023-07-09T21:52:40.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.723+0000 7fa6709ff700 1 -- 172.21.15.53:0/2721479042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c06c370 con 0x7fa66c0cd560 2023-07-09T21:52:40.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.724+0000 7fa65affd700 1 -- 172.21.15.53:0/2721479042 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fa660013b50 con 0x7fa66c0cd560 2023-07-09T21:52:40.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.724+0000 7fa65affd700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa64c06ae00 0x7fa64c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:40.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.724+0000 7fa65affd700 1 -- 172.21.15.53:0/2721479042 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6600894f0 con 0x7fa66c0cd560 2023-07-09T21:52:40.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.725+0000 7fa66a59c700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa64c06ae00 0x7fa64c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:40.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.725+0000 7fa66a59c700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa64c06ae00 0x7fa64c06d2b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0097c0 tx=0x7fa65c01c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:40.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.729+0000 7fa65affd700 1 -- 172.21.15.53:0/2721479042 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa660054490 con 0x7fa66c0cd560 2023-07-09T21:52:40.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.937+0000 7fa6709ff700 1 -- 172.21.15.53:0/2721479042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa66c0b47d0 con 0x7fa66c0cd560 2023-07-09T21:52:40.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.937+0000 7fa65affd700 1 -- 172.21.15.53:0/2721479042 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa660057ab0 con 0x7fa66c0cd560 2023-07-09T21:52:40.939 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:52:40.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.940+0000 7fa6709ff700 1 -- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa64c06ae00 msgr2=0x7fa64c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:40.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.940+0000 7fa6709ff700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa64c06ae00 0x7fa64c06d2b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0097c0 tx=0x7fa65c01c040 comp rx=0 tx=0).stop 2023-07-09T21:52:40.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.940+0000 7fa6709ff700 1 -- 172.21.15.53:0/2721479042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa66c0cd560 msgr2=0x7fa66c1f30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:40.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.940+0000 7fa6709ff700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa66c0cd560 0x7fa66c1f30c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa66000e870 tx=0x7fa66000eb80 comp rx=0 tx=0).stop 2023-07-09T21:52:40.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.940+0000 7fa6709ff700 1 -- 172.21.15.53:0/2721479042 shutdown_connections 2023-07-09T21:52:40.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.940+0000 7fa6709ff700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa64c06ae00 0x7fa64c06d2b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.940+0000 7fa6709ff700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa66c0d12c0 0x7fa66c1574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.940+0000 7fa6709ff700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa66c06b040 0x7fa66c0c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.940+0000 7fa6709ff700 1 --2- 172.21.15.53:0/2721479042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa66c0cd560 0x7fa66c1f30c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:40.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.940+0000 7fa6709ff700 1 -- 172.21.15.53:0/2721479042 >> 172.21.15.53:0/2721479042 conn(0x7fa66c0999e0 msgr2=0x7fa66c06db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:40.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.940+0000 7fa6709ff700 1 -- 172.21.15.53:0/2721479042 shutdown_connections 2023-07-09T21:52:40.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:40.940+0000 7fa6709ff700 1 -- 172.21.15.53:0/2721479042 wait complete. 2023-07-09T21:52:40.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:52:41.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.161+0000 7fd5b0bff700 1 Processor -- start 2023-07-09T21:52:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.161+0000 7fd5b0bff700 1 -- start start 2023-07-09T21:52:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.162+0000 7fd5b0bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5ac0cd430 0x7fd5ac0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.162+0000 7fd5b0bff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ac0d02a0 con 0x7fd5ac0d22d0 2023-07-09T21:52:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.162+0000 7fd5b0bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ac161010 con 0x7fd5ac0b4860 2023-07-09T21:52:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.162+0000 7fd5b0bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac0cfce0 con 0x7fd5ac0cd430 2023-07-09T21:52:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.163+0000 7fd5aa59c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5ac0cd430 0x7fd5ac0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.163+0000 7fd5aa59c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5ac0cd430 0x7fd5ac0cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55066/0 (socket says 172.21.15.53:55066) 2023-07-09T21:52:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.163+0000 7fd5aa59c700 1 -- 172.21.15.53:0/783879252 learned_addr learned my addr 172.21.15.53:0/783879252 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.163+0000 7fd5aa59c700 1 -- 172.21.15.53:0/783879252 >> v1:172.21.15.184:6789/0 conn(0x7fd5ac0b4860 legacy=0x7fd5ac1601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.163+0000 7fd5aa59c700 1 -- 172.21.15.53:0/783879252 >> v1:172.21.15.53:6789/0 conn(0x7fd5ac0d22d0 legacy=0x7fd5ac160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.163+0000 7fd5aa59c700 1 -- 172.21.15.53:0/783879252 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac0cffc0 con 0x7fd5ac0cd430 2023-07-09T21:52:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.163+0000 7fd5a9d9b700 1 -- 172.21.15.53:0/783879252 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372603546 0 0) 0x7fd5ac0d02a0 con 0x7fd5ac0d22d0 2023-07-09T21:52:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.164+0000 7fd5aa59c700 1 --2- 172.21.15.53:0/783879252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5ac0cd430 0x7fd5ac0cd800 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0098f0 tx=0x7fd59c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ade3fb47ed824e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.164+0000 7fd5a9d9b700 1 -- 172.21.15.53:0/783879252 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c00b8a0 con 0x7fd5ac0cd430 2023-07-09T21:52:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.164+0000 7fd5a9d9b700 1 -- 172.21.15.53:0/783879252 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c00ba00 con 0x7fd5ac0cd430 2023-07-09T21:52:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.164+0000 7fd5a9d9b700 1 -- 172.21.15.53:0/783879252 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c00bd90 con 0x7fd5ac0cd430 2023-07-09T21:52:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.164+0000 7fd5b0bff700 1 -- 172.21.15.53:0/783879252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5ac0cd430 msgr2=0x7fd5ac0cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.164+0000 7fd5b0bff700 1 --2- 172.21.15.53:0/783879252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5ac0cd430 0x7fd5ac0cd800 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0098f0 tx=0x7fd59c009c00 comp rx=0 tx=0).stop 2023-07-09T21:52:41.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.164+0000 7fd5b0bff700 1 -- 172.21.15.53:0/783879252 shutdown_connections 2023-07-09T21:52:41.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.164+0000 7fd5b0bff700 1 --2- 172.21.15.53:0/783879252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5ac0cd430 0x7fd5ac0cd800 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.164+0000 7fd5b0bff700 1 -- 172.21.15.53:0/783879252 >> 172.21.15.53:0/783879252 conn(0x7fd5ac066860 msgr2=0x7fd5ac06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:41.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.164+0000 7fd5b0bff700 1 -- 172.21.15.53:0/783879252 shutdown_connections 2023-07-09T21:52:41.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.165+0000 7fd5b0bff700 1 -- 172.21.15.53:0/783879252 wait complete. 2023-07-09T21:52:41.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.167+0000 7fd5b0bff700 1 Processor -- start 2023-07-09T21:52:41.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.167+0000 7fd5b0bff700 1 -- start start 2023-07-09T21:52:41.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.168+0000 7fd5b0bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5ac0b4860 0x7fd5ac0d2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:41.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.168+0000 7fd5b0bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5ac0cd430 0x7fd5ac14e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:41.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.168+0000 7fd5b0bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5ac0d22d0 0x7fd5ac0c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:41.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.168+0000 7fd5b0bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac15fad0 con 0x7fd5ac0cd430 2023-07-09T21:52:41.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.168+0000 7fd5b0bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac14e870 con 0x7fd5ac0d22d0 2023-07-09T21:52:41.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.168+0000 7fd5b0bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac15f1c0 con 0x7fd5ac0b4860 2023-07-09T21:52:41.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.169+0000 7fd5a3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5ac0cd430 0x7fd5ac14e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:41.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.169+0000 7fd5a3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5ac0cd430 0x7fd5ac14e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55072/0 (socket says 172.21.15.53:55072) 2023-07-09T21:52:41.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.169+0000 7fd5a3fff700 1 -- 172.21.15.53:0/1031274023 learned_addr learned my addr 172.21.15.53:0/1031274023 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:41.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.169+0000 7fd5aa59c700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5ac0b4860 0x7fd5ac0d2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:41.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.169+0000 7fd5aad9d700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5ac0d22d0 0x7fd5ac0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:41.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.169+0000 7fd5a3fff700 1 -- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5ac0b4860 msgr2=0x7fd5ac0d2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.169+0000 7fd5a3fff700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5ac0b4860 0x7fd5ac0d2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.169+0000 7fd5a3fff700 1 -- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5ac0d22d0 msgr2=0x7fd5ac0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.169+0000 7fd5a3fff700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5ac0d22d0 0x7fd5ac0c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.169+0000 7fd5a3fff700 1 -- 172.21.15.53:0/1031274023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c009550 con 0x7fd5ac0cd430 2023-07-09T21:52:41.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.169+0000 7fd5aad9d700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5ac0d22d0 0x7fd5ac0c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:41.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.169+0000 7fd5a3fff700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5ac0cd430 0x7fd5ac14e330 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd59400c4e0 tx=0x7fd59400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:41.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.169+0000 7fd5a2ffd700 1 -- 172.21.15.53:0/1031274023 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940052d0 con 0x7fd5ac0cd430 2023-07-09T21:52:41.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.170+0000 7fd5a2ffd700 1 -- 172.21.15.53:0/1031274023 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd594005430 con 0x7fd5ac0cd430 2023-07-09T21:52:41.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.170+0000 7fd5a2ffd700 1 -- 172.21.15.53:0/1031274023 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940038c0 con 0x7fd5ac0cd430 2023-07-09T21:52:41.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.170+0000 7fd5b0bff700 1 -- 172.21.15.53:0/1031274023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ac0c6e50 con 0x7fd5ac0cd430 2023-07-09T21:52:41.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.170+0000 7fd5b0bff700 1 -- 172.21.15.53:0/1031274023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ac15f410 con 0x7fd5ac0cd430 2023-07-09T21:52:41.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.171+0000 7fd5b0bff700 1 -- 172.21.15.53:0/1031274023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ac074350 con 0x7fd5ac0cd430 2023-07-09T21:52:41.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.172+0000 7fd5a2ffd700 1 -- 172.21.15.53:0/1031274023 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fd594003a20 con 0x7fd5ac0cd430 2023-07-09T21:52:41.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.173+0000 7fd5a2ffd700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd58c06ae00 0x7fd58c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:41.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.173+0000 7fd5a2ffd700 1 -- 172.21.15.53:0/1031274023 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd594088b30 con 0x7fd5ac0cd430 2023-07-09T21:52:41.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.174+0000 7fd5aa59c700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd58c06ae00 0x7fd58c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:41.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.174+0000 7fd5aa59c700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd58c06ae00 0x7fd58c06d2b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd59c000c00 tx=0x7fd59c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:41.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.178+0000 7fd5a2ffd700 1 -- 172.21.15.53:0/1031274023 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd594053a40 con 0x7fd5ac0cd430 2023-07-09T21:52:41.244 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:52:41.248 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:52:41.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.387+0000 7fd5b0bff700 1 -- 172.21.15.53:0/1031274023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5ac0b1b50 con 0x7fd5ac0cd430 2023-07-09T21:52:41.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.388+0000 7fd5a2ffd700 1 -- 172.21.15.53:0/1031274023 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd594057060 con 0x7fd5ac0cd430 2023-07-09T21:52:41.389 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:52:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.390+0000 7fd5b0bff700 1 -- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd58c06ae00 msgr2=0x7fd58c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.390+0000 7fd5b0bff700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd58c06ae00 0x7fd58c06d2b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd59c000c00 tx=0x7fd59c008030 comp rx=0 tx=0).stop 2023-07-09T21:52:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.390+0000 7fd5b0bff700 1 -- 172.21.15.53:0/1031274023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5ac0cd430 msgr2=0x7fd5ac14e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.390+0000 7fd5b0bff700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5ac0cd430 0x7fd5ac14e330 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd59400c4e0 tx=0x7fd59400c7f0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.390+0000 7fd5b0bff700 1 -- 172.21.15.53:0/1031274023 shutdown_connections 2023-07-09T21:52:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.390+0000 7fd5b0bff700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd58c06ae00 0x7fd58c06d2b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.390+0000 7fd5b0bff700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5ac0d22d0 0x7fd5ac0c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.390+0000 7fd5b0bff700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5ac0b4860 0x7fd5ac0d2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.390+0000 7fd5b0bff700 1 --2- 172.21.15.53:0/1031274023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5ac0cd430 0x7fd5ac14e330 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.390+0000 7fd5b0bff700 1 -- 172.21.15.53:0/1031274023 >> 172.21.15.53:0/1031274023 conn(0x7fd5ac066860 msgr2=0x7fd5ac0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.390+0000 7fd5b0bff700 1 -- 172.21.15.53:0/1031274023 shutdown_connections 2023-07-09T21:52:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.390+0000 7fd5b0bff700 1 -- 172.21.15.53:0/1031274023 wait complete. 2023-07-09T21:52:41.409 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:52:41.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.612+0000 7fb7011ff700 1 Processor -- start 2023-07-09T21:52:41.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.612+0000 7fb7011ff700 1 -- start start 2023-07-09T21:52:41.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.613+0000 7fb7011ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb6fc0d30d0 0x7fb6fc0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:41.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.613+0000 7fb7011ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6fc0cd8e0 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.613+0000 7fb7011ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6fc0d2760 con 0x7fb6fc0cf030 2023-07-09T21:52:41.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.613+0000 7fb7011ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6fc0d1740 con 0x7fb6fc0d30d0 2023-07-09T21:52:41.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.614+0000 7fb6fa59c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb6fc0cffa0 0x7fb6fc0d29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58470/0 (socket says 172.21.15.53:58470) 2023-07-09T21:52:41.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.614+0000 7fb6fa59c700 1 -- 172.21.15.53:0/295163448 learned_addr learned my addr 172.21.15.53:0/295163448 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:41.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.614+0000 7fb6fb59e700 1 --2- 172.21.15.53:0/295163448 >> v2:172.21.15.53:3300/0 conn(0x7fb6fc0d30d0 0x7fb6fc0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:41.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.614+0000 7fb6f9d9b700 1 -- 172.21.15.53:0/295163448 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890044699 0 0) 0x7fb6fc0cd8e0 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.614+0000 7fb6f9d9b700 1 -- 172.21.15.53:0/295163448 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6e40035b0 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.614+0000 7fb6f9d9b700 1 -- 172.21.15.53:0/295163448 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065148990 0 0) 0x7fb6fc0d2760 con 0x7fb6fc0cf030 2023-07-09T21:52:41.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.614+0000 7fb6fb59e700 1 -- 172.21.15.53:0/295163448 >> v1:172.21.15.184:6789/0 conn(0x7fb6fc0cf030 legacy=0x7fb6fc0cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.614+0000 7fb6fb59e700 1 -- 172.21.15.53:0/295163448 >> v1:172.21.15.53:6789/0 conn(0x7fb6fc0cffa0 legacy=0x7fb6fc0d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.614+0000 7fb6fb59e700 1 -- 172.21.15.53:0/295163448 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc0d1a20 con 0x7fb6fc0d30d0 2023-07-09T21:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.615+0000 7fb6fb59e700 1 --2- 172.21.15.53:0/295163448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6fc0d30d0 0x7fb6fc0d34f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009d90 tx=0x7fb6f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab65f0eeb5e812a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.615+0000 7fb6f9d9b700 1 -- 172.21.15.53:0/295163448 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f400e070 con 0x7fb6fc0d30d0 2023-07-09T21:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.615+0000 7fb6f9d9b700 1 -- 172.21.15.53:0/295163448 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f400bb20 con 0x7fb6fc0d30d0 2023-07-09T21:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.615+0000 7fb6f9d9b700 1 -- 172.21.15.53:0/295163448 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f400bed0 con 0x7fb6fc0d30d0 2023-07-09T21:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.615+0000 7fb7011ff700 1 -- 172.21.15.53:0/295163448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6fc0d30d0 msgr2=0x7fb6fc0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.615+0000 7fb7011ff700 1 --2- 172.21.15.53:0/295163448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6fc0d30d0 0x7fb6fc0d34f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009d90 tx=0x7fb6f400b330 comp rx=0 tx=0).stop 2023-07-09T21:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.615+0000 7fb7011ff700 1 -- 172.21.15.53:0/295163448 shutdown_connections 2023-07-09T21:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.615+0000 7fb7011ff700 1 --2- 172.21.15.53:0/295163448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6fc0d30d0 0x7fb6fc0d34f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.615+0000 7fb7011ff700 1 -- 172.21.15.53:0/295163448 >> 172.21.15.53:0/295163448 conn(0x7fb6fc06c170 msgr2=0x7fb6fc06c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:41.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.615+0000 7fb7011ff700 1 -- 172.21.15.53:0/295163448 shutdown_connections 2023-07-09T21:52:41.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.616+0000 7fb7011ff700 1 -- 172.21.15.53:0/295163448 wait complete. 2023-07-09T21:52:41.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.617+0000 7fb7011ff700 1 Processor -- start 2023-07-09T21:52:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.617+0000 7fb7011ff700 1 -- start start 2023-07-09T21:52:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.618+0000 7fb7011ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6fc0cf030 0x7fb6fc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.618+0000 7fb7011ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6fc0cffa0 0x7fb6fc152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.618+0000 7fb7011ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6fc0d30d0 0x7fb6fc0cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.618+0000 7fb7011ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc153260 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.618+0000 7fb7011ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0cb5e0 con 0x7fb6fc0cf030 2023-07-09T21:52:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.618+0000 7fb7011ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0cc050 con 0x7fb6fc0d30d0 2023-07-09T21:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.619+0000 7fb6fa59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6fc0cffa0 0x7fb6fc152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.619+0000 7fb6fa59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6fc0cffa0 0x7fb6fc152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55098/0 (socket says 172.21.15.53:55098) 2023-07-09T21:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.619+0000 7fb6fa59c700 1 -- 172.21.15.53:0/3634841572 learned_addr learned my addr 172.21.15.53:0/3634841572 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.619+0000 7fb6fad9d700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6fc0cf030 0x7fb6fc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.619+0000 7fb6fb59e700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6fc0d30d0 0x7fb6fc0cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.619+0000 7fb6fa59c700 1 -- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6fc0d30d0 msgr2=0x7fb6fc0cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.619+0000 7fb6fa59c700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6fc0d30d0 0x7fb6fc0cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.619+0000 7fb6fa59c700 1 -- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6fc0cf030 msgr2=0x7fb6fc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.619+0000 7fb6fa59c700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6fc0cf030 0x7fb6fc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.619+0000 7fb6fa59c700 1 -- 172.21.15.53:0/3634841572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f4009a70 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.619+0000 7fb6fad9d700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6fc0cf030 0x7fb6fc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.619+0000 7fb6fb59e700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6fc0d30d0 0x7fb6fc0cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.619+0000 7fb6fa59c700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6fc0cffa0 0x7fb6fc152d20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000c500 tx=0x7fb6f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.620+0000 7fb6e37fe700 1 -- 172.21.15.53:0/3634841572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0005d70 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.620+0000 7fb6e37fe700 1 -- 172.21.15.53:0/3634841572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f00070d0 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.620+0000 7fb6e37fe700 1 -- 172.21.15.53:0/3634841572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0007440 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.620+0000 7fb7011ff700 1 -- 172.21.15.53:0/3634841572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6fc0cc330 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.620+0000 7fb7011ff700 1 -- 172.21.15.53:0/3634841572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6fc0cc8f0 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.621+0000 7fb7011ff700 1 -- 172.21.15.53:0/3634841572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6fc067350 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.622+0000 7fb6e37fe700 1 -- 172.21.15.53:0/3634841572 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fb6f00075a0 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.623+0000 7fb6e37fe700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb6e806ae00 0x7fb6e806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.623+0000 7fb6e37fe700 1 -- 172.21.15.53:0/3634841572 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb6f0088a60 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.623+0000 7fb6fad9d700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb6e806ae00 0x7fb6e806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.624+0000 7fb6fad9d700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb6e806ae00 0x7fb6e806d2b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec000f60 tx=0x7fb6ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.627+0000 7fb6e37fe700 1 -- 172.21.15.53:0/3634841572 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb6f0053a10 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.837+0000 7fb7011ff700 1 -- 172.21.15.53:0/3634841572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6fc0b5230 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.837+0000 7fb6e37fe700 1 -- 172.21.15.53:0/3634841572 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6f0017020 con 0x7fb6fc0cffa0 2023-07-09T21:52:41.839 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:52:41.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.840+0000 7fb7011ff700 1 -- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb6e806ae00 msgr2=0x7fb6e806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.840+0000 7fb7011ff700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb6e806ae00 0x7fb6e806d2b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec000f60 tx=0x7fb6ec009040 comp rx=0 tx=0).stop 2023-07-09T21:52:41.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.840+0000 7fb7011ff700 1 -- 172.21.15.53:0/3634841572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6fc0cffa0 msgr2=0x7fb6fc152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:41.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.840+0000 7fb7011ff700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6fc0cffa0 0x7fb6fc152d20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000c500 tx=0x7fb6f000c8c0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.840+0000 7fb7011ff700 1 -- 172.21.15.53:0/3634841572 shutdown_connections 2023-07-09T21:52:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.840+0000 7fb7011ff700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb6e806ae00 0x7fb6e806d2b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.840+0000 7fb7011ff700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6fc0d30d0 0x7fb6fc0cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.840+0000 7fb7011ff700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6fc0cf030 0x7fb6fc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.840+0000 7fb7011ff700 1 --2- 172.21.15.53:0/3634841572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6fc0cffa0 0x7fb6fc152d20 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.840+0000 7fb7011ff700 1 -- 172.21.15.53:0/3634841572 >> 172.21.15.53:0/3634841572 conn(0x7fb6fc06c170 msgr2=0x7fb6fc0b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.840+0000 7fb7011ff700 1 -- 172.21.15.53:0/3634841572 shutdown_connections 2023-07-09T21:52:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:41.840+0000 7fb7011ff700 1 -- 172.21.15.53:0/3634841572 wait complete. 2023-07-09T21:52:41.859 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:52:42.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.062+0000 7f460e1ff700 1 Processor -- start 2023-07-09T21:52:42.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.062+0000 7f460e1ff700 1 -- start start 2023-07-09T21:52:42.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.064+0000 7f460e1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f460815c860 0x7f46080c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:42.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.064+0000 7f460e1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f46080b49d0 0x7f46080b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:42.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.064+0000 7f460e1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46080d2260 con 0x7f46080cf2a0 2023-07-09T21:52:42.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.064+0000 7f460e1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4608146740 con 0x7f46080b49d0 2023-07-09T21:52:42.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.064+0000 7f460e1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46080cd5a0 con 0x7f460815c860 2023-07-09T21:52:42.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.064+0000 7f4606ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f460815c860 0x7f46080c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:42.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.064+0000 7f4606ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f460815c860 0x7f46080c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:42904/0 (socket says 172.21.15.53:42904) 2023-07-09T21:52:42.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.064+0000 7f4606ffd700 1 -- 172.21.15.53:0/3055727611 learned_addr learned my addr 172.21.15.53:0/3055727611 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:42.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.064+0000 7f4607fff700 1 --2- 172.21.15.53:0/3055727611 >> v2:172.21.15.184:3300/0 conn(0x7f46080b49d0 0x7f46080b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:42.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.065+0000 7f4606ffd700 1 -- 172.21.15.53:0/3055727611 >> v2:172.21.15.184:3300/0 conn(0x7f46080b49d0 msgr2=0x7f46080b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:42.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.065+0000 7f4606ffd700 1 --2- 172.21.15.53:0/3055727611 >> v2:172.21.15.184:3300/0 conn(0x7f46080b49d0 0x7f46080b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.065+0000 7f4606ffd700 1 -- 172.21.15.53:0/3055727611 >> v1:172.21.15.184:6789/0 conn(0x7f46080cf2a0 legacy=0x7f46080c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:42.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.065+0000 7f4606ffd700 1 -- 172.21.15.53:0/3055727611 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460815ccd0 con 0x7f460815c860 2023-07-09T21:52:42.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.065+0000 7f46067fc700 1 -- 172.21.15.53:0/3055727611 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746218083 0 0) 0x7f46080d2260 con 0x7f46080cf2a0 2023-07-09T21:52:42.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.065+0000 7f4606ffd700 1 --2- 172.21.15.53:0/3055727611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f460815c860 0x7f46080c71b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0098f0 tx=0x7f45fc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f508ce42561b7434 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:42.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.065+0000 7f46067fc700 1 -- 172.21.15.53:0/3055727611 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc011830 con 0x7f460815c860 2023-07-09T21:52:42.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.065+0000 7f46067fc700 1 -- 172.21.15.53:0/3055727611 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc011990 con 0x7f460815c860 2023-07-09T21:52:42.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.065+0000 7f46067fc700 1 -- 172.21.15.53:0/3055727611 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc011d20 con 0x7f460815c860 2023-07-09T21:52:42.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.066+0000 7f460e1ff700 1 -- 172.21.15.53:0/3055727611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f460815c860 msgr2=0x7f46080c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:42.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.066+0000 7f460e1ff700 1 --2- 172.21.15.53:0/3055727611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f460815c860 0x7f46080c71b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0098f0 tx=0x7f45fc009c00 comp rx=0 tx=0).stop 2023-07-09T21:52:42.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.066+0000 7f460e1ff700 1 -- 172.21.15.53:0/3055727611 shutdown_connections 2023-07-09T21:52:42.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.066+0000 7f460e1ff700 1 --2- 172.21.15.53:0/3055727611 >> v2:172.21.15.184:3300/0 conn(0x7f46080b49d0 0x7f46080b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.066+0000 7f460e1ff700 1 --2- 172.21.15.53:0/3055727611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f460815c860 0x7f46080c71b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.066+0000 7f460e1ff700 1 -- 172.21.15.53:0/3055727611 >> 172.21.15.53:0/3055727611 conn(0x7f4608065bd0 msgr2=0x7f4608065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:42.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.066+0000 7f460e1ff700 1 -- 172.21.15.53:0/3055727611 shutdown_connections 2023-07-09T21:52:42.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.066+0000 7f460e1ff700 1 -- 172.21.15.53:0/3055727611 wait complete. 2023-07-09T21:52:42.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.068+0000 7f460e1ff700 1 Processor -- start 2023-07-09T21:52:42.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.068+0000 7f460e1ff700 1 -- start start 2023-07-09T21:52:42.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f460e1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46080b49d0 0x7f46081f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:42.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f460e1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46080cf2a0 0x7f460815a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:42.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f460e1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f460815c860 0x7f460815a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:42.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f460e1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080ccc00 con 0x7f46080b49d0 2023-07-09T21:52:42.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f460e1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080cbff0 con 0x7f46080cf2a0 2023-07-09T21:52:42.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f460e1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46080cc2d0 con 0x7f460815c860 2023-07-09T21:52:42.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f46077fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46080b49d0 0x7f46081f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:42.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f46077fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46080b49d0 0x7f46081f20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55106/0 (socket says 172.21.15.53:55106) 2023-07-09T21:52:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f46077fe700 1 -- 172.21.15.53:0/3684726164 learned_addr learned my addr 172.21.15.53:0/3684726164 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f4607fff700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f460815c860 0x7f460815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f4606ffd700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46080cf2a0 0x7f460815a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f46077fe700 1 -- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f460815c860 msgr2=0x7f460815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f46077fe700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f460815c860 0x7f460815a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f46077fe700 1 -- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46080cf2a0 msgr2=0x7f460815a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f46077fe700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46080cf2a0 0x7f460815a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.069+0000 7f46077fe700 1 -- 172.21.15.53:0/3684726164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc009550 con 0x7f46080b49d0 2023-07-09T21:52:42.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.070+0000 7f46077fe700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46080b49d0 0x7f46081f20b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f45f8001eb0 tx=0x7f45f800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:42.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.070+0000 7f45effff700 1 -- 172.21.15.53:0/3684726164 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80054e0 con 0x7f46080b49d0 2023-07-09T21:52:42.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.070+0000 7f45effff700 1 -- 172.21.15.53:0/3684726164 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f8003680 con 0x7f46080b49d0 2023-07-09T21:52:42.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.070+0000 7f45effff700 1 -- 172.21.15.53:0/3684726164 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80039f0 con 0x7f46080b49d0 2023-07-09T21:52:42.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.070+0000 7f460e1ff700 1 -- 172.21.15.53:0/3684726164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46080cc5b0 con 0x7f46080b49d0 2023-07-09T21:52:42.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.070+0000 7f460e1ff700 1 -- 172.21.15.53:0/3684726164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4608157a80 con 0x7f46080b49d0 2023-07-09T21:52:42.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.071+0000 7f460e1ff700 1 -- 172.21.15.53:0/3684726164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4608074350 con 0x7f46080b49d0 2023-07-09T21:52:42.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.072+0000 7f45effff700 1 -- 172.21.15.53:0/3684726164 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f45f8003b50 con 0x7f46080b49d0 2023-07-09T21:52:42.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.073+0000 7f45effff700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f45f406ae00 0x7f45f406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:42.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.073+0000 7f45effff700 1 -- 172.21.15.53:0/3684726164 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45f8088960 con 0x7f46080b49d0 2023-07-09T21:52:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.073+0000 7f4606ffd700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f45f406ae00 0x7f45f406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.074+0000 7f4606ffd700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f45f406ae00 0x7f45f406d2b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f45fc000c00 tx=0x7f45fc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:42.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.077+0000 7f45effff700 1 -- 172.21.15.53:0/3684726164 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f45f8053910 con 0x7f46080b49d0 2023-07-09T21:52:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.285+0000 7f460e1ff700 1 -- 172.21.15.53:0/3684726164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46080c9850 con 0x7f46080b49d0 2023-07-09T21:52:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.286+0000 7f45effff700 1 -- 172.21.15.53:0/3684726164 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7f45f80170a0 con 0x7f46080b49d0 2023-07-09T21:52:42.287 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:52:42.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.288+0000 7f460e1ff700 1 -- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f45f406ae00 msgr2=0x7f45f406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:42.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.288+0000 7f460e1ff700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f45f406ae00 0x7f45f406d2b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f45fc000c00 tx=0x7f45fc008030 comp rx=0 tx=0).stop 2023-07-09T21:52:42.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.288+0000 7f460e1ff700 1 -- 172.21.15.53:0/3684726164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46080b49d0 msgr2=0x7f46081f20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:42.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.288+0000 7f460e1ff700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46080b49d0 0x7f46081f20b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f45f8001eb0 tx=0x7f45f800c800 comp rx=0 tx=0).stop 2023-07-09T21:52:42.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.288+0000 7f460e1ff700 1 -- 172.21.15.53:0/3684726164 shutdown_connections 2023-07-09T21:52:42.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.288+0000 7f460e1ff700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f45f406ae00 0x7f45f406d2b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.288+0000 7f460e1ff700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f460815c860 0x7f460815a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.288+0000 7f460e1ff700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46080b49d0 0x7f46081f20b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.288+0000 7f460e1ff700 1 --2- 172.21.15.53:0/3684726164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46080cf2a0 0x7f460815a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.288+0000 7f460e1ff700 1 -- 172.21.15.53:0/3684726164 >> 172.21.15.53:0/3684726164 conn(0x7f4608065bd0 msgr2=0x7f46080c6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:42.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.288+0000 7f460e1ff700 1 -- 172.21.15.53:0/3684726164 shutdown_connections 2023-07-09T21:52:42.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.288+0000 7f460e1ff700 1 -- 172.21.15.53:0/3684726164 wait complete. 2023-07-09T21:52:42.307 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:52:42.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.507+0000 7f97a35ff700 1 Processor -- start 2023-07-09T21:52:42.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.507+0000 7f97a35ff700 1 -- start start 2023-07-09T21:52:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.509+0000 7f97a35ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f979c0b43c0 0x7f979c0b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.509+0000 7f97a35ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979c0b8e80 con 0x7f979c0b3ff0 2023-07-09T21:52:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.509+0000 7f97a35ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979c0afaa0 con 0x7f979c0d1220 2023-07-09T21:52:42.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.509+0000 7f97a35ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979c0afd80 con 0x7f979c0b43c0 2023-07-09T21:52:42.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.509+0000 7f97a139b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f979c0b3ff0 0x7f979c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58474/0 (socket says 172.21.15.53:58474) 2023-07-09T21:52:42.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.509+0000 7f97a139b700 1 -- 172.21.15.53:0/3437021644 learned_addr learned my addr 172.21.15.53:0/3437021644 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:42.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.509+0000 7f97a1b9c700 1 --2- 172.21.15.53:0/3437021644 >> v2:172.21.15.53:3300/0 conn(0x7f979c0b43c0 0x7f979c0b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:42.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.509+0000 7f9793fff700 1 -- 172.21.15.53:0/3437021644 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401821779 0 0) 0x7f9798001110 con 0x7f979c0b3ff0 2023-07-09T21:52:42.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.509+0000 7f9793fff700 1 -- 172.21.15.53:0/3437021644 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97880035b0 con 0x7f979c0b3ff0 2023-07-09T21:52:42.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.509+0000 7f97a1b9c700 1 -- 172.21.15.53:0/3437021644 >> v1:172.21.15.184:6789/0 conn(0x7f979c0d1220 legacy=0x7f979c0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:42.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.509+0000 7f97a1b9c700 1 -- 172.21.15.53:0/3437021644 >> v1:172.21.15.53:6789/0 conn(0x7f979c0b3ff0 legacy=0x7f979c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:42.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.510+0000 7f97a1b9c700 1 -- 172.21.15.53:0/3437021644 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c0b0060 con 0x7f979c0b43c0 2023-07-09T21:52:42.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.510+0000 7f97a1b9c700 1 --2- 172.21.15.53:0/3437021644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f979c0b43c0 0x7f979c0b1530 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9794009d90 tx=0x7f979400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6462f8c9ab6b52 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.510+0000 7f9793fff700 1 -- 172.21.15.53:0/3437021644 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979400e070 con 0x7f979c0b43c0 2023-07-09T21:52:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.510+0000 7f9793fff700 1 -- 172.21.15.53:0/3437021644 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979400bb20 con 0x7f979c0b43c0 2023-07-09T21:52:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.510+0000 7f9793fff700 1 -- 172.21.15.53:0/3437021644 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9794012430 con 0x7f979c0b43c0 2023-07-09T21:52:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.510+0000 7f97a35ff700 1 -- 172.21.15.53:0/3437021644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f979c0b43c0 msgr2=0x7f979c0b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.510+0000 7f97a35ff700 1 --2- 172.21.15.53:0/3437021644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f979c0b43c0 0x7f979c0b1530 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9794009d90 tx=0x7f979400b330 comp rx=0 tx=0).stop 2023-07-09T21:52:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.511+0000 7f97a35ff700 1 -- 172.21.15.53:0/3437021644 shutdown_connections 2023-07-09T21:52:42.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.511+0000 7f97a35ff700 1 --2- 172.21.15.53:0/3437021644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f979c0b43c0 0x7f979c0b1530 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.511+0000 7f97a35ff700 1 -- 172.21.15.53:0/3437021644 >> 172.21.15.53:0/3437021644 conn(0x7f979c09c1b0 msgr2=0x7f979c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:42.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.511+0000 7f97a35ff700 1 -- 172.21.15.53:0/3437021644 shutdown_connections 2023-07-09T21:52:42.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.511+0000 7f97a35ff700 1 -- 172.21.15.53:0/3437021644 wait complete. 2023-07-09T21:52:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.512+0000 7f97a35ff700 1 Processor -- start 2023-07-09T21:52:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.513+0000 7f97a35ff700 1 -- start start 2023-07-09T21:52:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.513+0000 7f97a35ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f979c0b3ff0 0x7f979c15b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:42.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.513+0000 7f97a35ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f979c0b43c0 0x7f979c15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:42.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.513+0000 7f97a35ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f979c0d1220 0x7f979c0b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:42.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a35ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c0c9e70 con 0x7f979c0b3ff0 2023-07-09T21:52:42.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a35ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c0cc180 con 0x7f979c0b43c0 2023-07-09T21:52:42.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a35ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979c0c9b90 con 0x7f979c0d1220 2023-07-09T21:52:42.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a139b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f979c0b3ff0 0x7f979c15b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:42.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a139b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f979c0b3ff0 0x7f979c15b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55128/0 (socket says 172.21.15.53:55128) 2023-07-09T21:52:42.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a139b700 1 -- 172.21.15.53:0/1419658954 learned_addr learned my addr 172.21.15.53:0/1419658954 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:42.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a1b9c700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f979c0d1220 0x7f979c0b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:42.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a0b9a700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f979c0b43c0 0x7f979c15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a139b700 1 -- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f979c0d1220 msgr2=0x7f979c0b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a139b700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f979c0d1220 0x7f979c0b2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a139b700 1 -- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f979c0b43c0 msgr2=0x7f979c15bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a139b700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f979c0b43c0 0x7f979c15bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a139b700 1 -- 172.21.15.53:0/1419658954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9794009a70 con 0x7f979c0b3ff0 2023-07-09T21:52:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a1b9c700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f979c0d1220 0x7f979c0b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a0b9a700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f979c0b43c0 0x7f979c15bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.514+0000 7f97a139b700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f979c0b3ff0 0x7f979c15b210 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9798007fd0 tx=0x7f979800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.515+0000 7f9791ffb700 1 -- 172.21.15.53:0/1419658954 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798005d70 con 0x7f979c0b3ff0 2023-07-09T21:52:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.515+0000 7f9791ffb700 1 -- 172.21.15.53:0/1419658954 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97980070d0 con 0x7f979c0b3ff0 2023-07-09T21:52:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.515+0000 7f97a35ff700 1 -- 172.21.15.53:0/1419658954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979c0cc420 con 0x7f979c0b3ff0 2023-07-09T21:52:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.515+0000 7f9791ffb700 1 -- 172.21.15.53:0/1419658954 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798007460 con 0x7f979c0b3ff0 2023-07-09T21:52:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.515+0000 7f97a35ff700 1 -- 172.21.15.53:0/1419658954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979c0c9820 con 0x7f979c0b3ff0 2023-07-09T21:52:42.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.516+0000 7f97a35ff700 1 -- 172.21.15.53:0/1419658954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979c0cbfe0 con 0x7f979c0b3ff0 2023-07-09T21:52:42.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.517+0000 7f9791ffb700 1 -- 172.21.15.53:0/1419658954 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f97980075c0 con 0x7f979c0b3ff0 2023-07-09T21:52:42.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.518+0000 7f9791ffb700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f978006ae00 0x7f978006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:42.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.518+0000 7f9791ffb700 1 -- 172.21.15.53:0/1419658954 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9798088ac0 con 0x7f979c0b3ff0 2023-07-09T21:52:42.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.518+0000 7f97a0b9a700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f978006ae00 0x7f978006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:42.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.519+0000 7f97a0b9a700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f978006ae00 0x7f978006d2b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f979c15ff90 tx=0x7f978c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.522+0000 7f9791ffb700 1 -- 172.21.15.53:0/1419658954 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f979c0cbfe0 con 0x7f979c0b3ff0 2023-07-09T21:52:42.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.745+0000 7f97a35ff700 1 -- 172.21.15.53:0/1419658954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f979c0b8e80 con 0x7f979c0b3ff0 2023-07-09T21:52:42.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.746+0000 7f9791ffb700 1 -- 172.21.15.53:0/1419658954 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) v1 ==== 80+0+0 (secure 0 0 0) 0x7f979c0b8e80 con 0x7f979c0b3ff0 2023-07-09T21:52:42.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.748+0000 7f97a35ff700 1 -- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f978006ae00 msgr2=0x7f978006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:42.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.748+0000 7f97a35ff700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f978006ae00 0x7f978006d2b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f979c15ff90 tx=0x7f978c009040 comp rx=0 tx=0).stop 2023-07-09T21:52:42.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.748+0000 7f97a35ff700 1 -- 172.21.15.53:0/1419658954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f979c0b3ff0 msgr2=0x7f979c15b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:42.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.748+0000 7f97a35ff700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f979c0b3ff0 0x7f979c15b210 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9798007fd0 tx=0x7f979800ca90 comp rx=0 tx=0).stop 2023-07-09T21:52:42.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.748+0000 7f97a35ff700 1 -- 172.21.15.53:0/1419658954 shutdown_connections 2023-07-09T21:52:42.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.748+0000 7f97a35ff700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f978006ae00 0x7f978006d2b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.748+0000 7f97a35ff700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f979c0d1220 0x7f979c0b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.748+0000 7f97a35ff700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f979c0b3ff0 0x7f979c15b210 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.748+0000 7f97a35ff700 1 --2- 172.21.15.53:0/1419658954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f979c0b43c0 0x7f979c15bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:42.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.748+0000 7f97a35ff700 1 -- 172.21.15.53:0/1419658954 >> 172.21.15.53:0/1419658954 conn(0x7f979c09c1b0 msgr2=0x7f979c06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:42.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.749+0000 7f97a35ff700 1 -- 172.21.15.53:0/1419658954 shutdown_connections 2023-07-09T21:52:42.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:42.749+0000 7f97a35ff700 1 -- 172.21.15.53:0/1419658954 wait complete. 2023-07-09T21:52:42.752 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-07-09T21:52:42.768 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T21:52:42.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:42.769 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-09T21:52:42.865 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:52:42.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:42.866 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T21:52:42.910 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:52:42.911 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:42.958 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:52:42.959 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:43.042 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:52:43.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.242+0000 7f29099ff700 1 Processor -- start 2023-07-09T21:52:43.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.242+0000 7f29099ff700 1 -- start start 2023-07-09T21:52:43.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.243+0000 7f29099ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2904070720 0x7f29040cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.243+0000 7f29099ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f29040cef90 0x7f29040b2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.243+0000 7f29099ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2904070b90 con 0x7f2904070350 2023-07-09T21:52:43.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.243+0000 7f29099ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29040cdf90 con 0x7f29040cef90 2023-07-09T21:52:43.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.243+0000 7f29099ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290415a2f0 con 0x7f2904070720 2023-07-09T21:52:43.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.244+0000 7f29027fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2904070720 0x7f29040cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.244+0000 7f29027fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2904070720 0x7f29040cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:55010/0 (socket says 172.21.15.53:55010) 2023-07-09T21:52:43.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.244+0000 7f29027fc700 1 -- 172.21.15.53:0/2616578474 learned_addr learned my addr 172.21.15.53:0/2616578474 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:43.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.244+0000 7f29037fe700 1 --2- 172.21.15.53:0/2616578474 >> v2:172.21.15.184:3300/0 conn(0x7f29040cef90 0x7f29040b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.244+0000 7f29027fc700 1 -- 172.21.15.53:0/2616578474 >> v2:172.21.15.184:3300/0 conn(0x7f29040cef90 msgr2=0x7f29040b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:43.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.244+0000 7f29027fc700 1 --2- 172.21.15.53:0/2616578474 >> v2:172.21.15.184:3300/0 conn(0x7f29040cef90 0x7f29040b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.244+0000 7f29027fc700 1 -- 172.21.15.53:0/2616578474 >> v1:172.21.15.184:6789/0 conn(0x7f2904070350 legacy=0x7f29041597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:43.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.244+0000 7f29027fc700 1 -- 172.21.15.53:0/2616578474 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290415a5d0 con 0x7f2904070720 2023-07-09T21:52:43.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.244+0000 7f2901ffb700 1 -- 172.21.15.53:0/2616578474 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710700049 0 0) 0x7f2904070b90 con 0x7f2904070350 2023-07-09T21:52:43.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.244+0000 7f29037fe700 1 --2- 172.21.15.53:0/2616578474 >> v2:172.21.15.184:3300/0 conn(0x7f29040cef90 0x7f29040b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:52:43.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.245+0000 7f29027fc700 1 --2- 172.21.15.53:0/2616578474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2904070720 0x7f29040cea50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f28f80098f0 tx=0x7f28f8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=628579fa4801dd91 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:43.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.245+0000 7f2901ffb700 1 -- 172.21.15.53:0/2616578474 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8011830 con 0x7f2904070720 2023-07-09T21:52:43.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.245+0000 7f2901ffb700 1 -- 172.21.15.53:0/2616578474 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f8011990 con 0x7f2904070720 2023-07-09T21:52:43.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.245+0000 7f2901ffb700 1 -- 172.21.15.53:0/2616578474 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8011d20 con 0x7f2904070720 2023-07-09T21:52:43.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.245+0000 7f29099ff700 1 -- 172.21.15.53:0/2616578474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2904070720 msgr2=0x7f29040cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:43.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.245+0000 7f29099ff700 1 --2- 172.21.15.53:0/2616578474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2904070720 0x7f29040cea50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f28f80098f0 tx=0x7f28f8009c00 comp rx=0 tx=0).stop 2023-07-09T21:52:43.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.246+0000 7f29099ff700 1 -- 172.21.15.53:0/2616578474 shutdown_connections 2023-07-09T21:52:43.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.246+0000 7f29099ff700 1 --2- 172.21.15.53:0/2616578474 >> v2:172.21.15.184:3300/0 conn(0x7f29040cef90 0x7f29040b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.246+0000 7f29099ff700 1 --2- 172.21.15.53:0/2616578474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2904070720 0x7f29040cea50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.246+0000 7f29099ff700 1 -- 172.21.15.53:0/2616578474 >> 172.21.15.53:0/2616578474 conn(0x7f2904069f30 msgr2=0x7f290406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:43.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.246+0000 7f29099ff700 1 -- 172.21.15.53:0/2616578474 shutdown_connections 2023-07-09T21:52:43.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.246+0000 7f29099ff700 1 -- 172.21.15.53:0/2616578474 wait complete. 2023-07-09T21:52:43.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.247+0000 7f29099ff700 1 Processor -- start 2023-07-09T21:52:43.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.248+0000 7f29099ff700 1 -- start start 2023-07-09T21:52:43.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.249+0000 7f29099ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2904070350 0x7f29041df830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.249+0000 7f29099ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2904070720 0x7f290413e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.249+0000 7f29099ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29040cef90 0x7f290413e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.249+0000 7f29099ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2904155680 con 0x7f2904070350 2023-07-09T21:52:43.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.249+0000 7f29099ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2904155960 con 0x7f29040cef90 2023-07-09T21:52:43.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.249+0000 7f29099ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2904156660 con 0x7f2904070720 2023-07-09T21:52:43.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.249+0000 7f2902ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2904070350 0x7f29041df830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.249+0000 7f2902ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2904070350 0x7f29041df830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48154/0 (socket says 172.21.15.53:48154) 2023-07-09T21:52:43.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.249+0000 7f2902ffd700 1 -- 172.21.15.53:0/2587051734 learned_addr learned my addr 172.21.15.53:0/2587051734 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.249+0000 7f29027fc700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2904070720 0x7f290413e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.250+0000 7f29037fe700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29040cef90 0x7f290413e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.250+0000 7f2902ffd700 1 -- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2904070720 msgr2=0x7f290413e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.250+0000 7f2902ffd700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2904070720 0x7f290413e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.250+0000 7f2902ffd700 1 -- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29040cef90 msgr2=0x7f290413e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.250+0000 7f2902ffd700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29040cef90 0x7f290413e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.250+0000 7f2902ffd700 1 -- 172.21.15.53:0/2587051734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc009a70 con 0x7f2904070350 2023-07-09T21:52:43.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.250+0000 7f2902ffd700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2904070350 0x7f29041df830 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f28f40011e0 tx=0x7f28f400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:43.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.250+0000 7f28ebfff700 1 -- 172.21.15.53:0/2587051734 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f40054e0 con 0x7f2904070350 2023-07-09T21:52:43.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.250+0000 7f28ebfff700 1 -- 172.21.15.53:0/2587051734 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f4003680 con 0x7f2904070350 2023-07-09T21:52:43.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.250+0000 7f28ebfff700 1 -- 172.21.15.53:0/2587051734 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4003a30 con 0x7f2904070350 2023-07-09T21:52:43.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.250+0000 7f29099ff700 1 -- 172.21.15.53:0/2587051734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f8009550 con 0x7f2904070350 2023-07-09T21:52:43.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.251+0000 7f29099ff700 1 -- 172.21.15.53:0/2587051734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29041dfd70 con 0x7f2904070350 2023-07-09T21:52:43.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.251+0000 7f29099ff700 1 -- 172.21.15.53:0/2587051734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2904156c70 con 0x7f2904070350 2023-07-09T21:52:43.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.252+0000 7f28ebfff700 1 -- 172.21.15.53:0/2587051734 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f28f4003b90 con 0x7f2904070350 2023-07-09T21:52:43.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.253+0000 7f28ebfff700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f28f006ae00 0x7f28f006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.253+0000 7f28ebfff700 1 -- 172.21.15.53:0/2587051734 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28f4088af0 con 0x7f2904070350 2023-07-09T21:52:43.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.254+0000 7f29027fc700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f28f006ae00 0x7f28f006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.254+0000 7f29027fc700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f28f006ae00 0x7f28f006d2b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009c40 tx=0x7f28f8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:43.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.258+0000 7f28ebfff700 1 -- 172.21.15.53:0/2587051734 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f28f40539f0 con 0x7f2904070350 2023-07-09T21:52:43.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.472+0000 7f29099ff700 1 -- 172.21.15.53:0/2587051734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29041dff00 con 0x7f2904070350 2023-07-09T21:52:43.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.473+0000 7f28ebfff700 1 -- 172.21.15.53:0/2587051734 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f28f4017090 con 0x7f2904070350 2023-07-09T21:52:43.475 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:43.475 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":51,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:52:19.894140+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:52:16.672667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:52:17.375922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:52:43.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.476+0000 7f29099ff700 1 -- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f28f006ae00 msgr2=0x7f28f006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:43.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.476+0000 7f29099ff700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f28f006ae00 0x7f28f006d2b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009c40 tx=0x7f28f8008030 comp rx=0 tx=0).stop 2023-07-09T21:52:43.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.476+0000 7f29099ff700 1 -- 172.21.15.53:0/2587051734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2904070350 msgr2=0x7f29041df830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:43.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.476+0000 7f29099ff700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2904070350 0x7f29041df830 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f28f40011e0 tx=0x7f28f400ca30 comp rx=0 tx=0).stop 2023-07-09T21:52:43.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.476+0000 7f29099ff700 1 -- 172.21.15.53:0/2587051734 shutdown_connections 2023-07-09T21:52:43.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.476+0000 7f29099ff700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f28f006ae00 0x7f28f006d2b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.476+0000 7f29099ff700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29040cef90 0x7f290413e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.476+0000 7f29099ff700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2904070350 0x7f29041df830 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.476+0000 7f29099ff700 1 --2- 172.21.15.53:0/2587051734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2904070720 0x7f290413e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.476+0000 7f29099ff700 1 -- 172.21.15.53:0/2587051734 >> 172.21.15.53:0/2587051734 conn(0x7f2904069f30 msgr2=0x7f290414c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:43.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.476+0000 7f29099ff700 1 -- 172.21.15.53:0/2587051734 shutdown_connections 2023-07-09T21:52:43.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.476+0000 7f29099ff700 1 -- 172.21.15.53:0/2587051734 wait complete. 2023-07-09T21:52:43.495 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:52:16.672667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:52:17.375922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:52:43.496 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:52:43.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.703+0000 7f339c7ff700 1 Processor -- start 2023-07-09T21:52:43.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.703+0000 7f339c7ff700 1 -- start start 2023-07-09T21:52:43.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.704+0000 7f339c7ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f33940d1220 0x7f33940b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.704+0000 7f339c7ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33940b8e80 con 0x7f33940b0e20 2023-07-09T21:52:43.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.704+0000 7f339c7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33940afaa0 con 0x7f33940b3ff0 2023-07-09T21:52:43.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.704+0000 7f339c7ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33940afd80 con 0x7f33940d1220 2023-07-09T21:52:43.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.704+0000 7f339ad9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f33940b0e20 0x7f33940b1220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37986/0 (socket says 172.21.15.53:37986) 2023-07-09T21:52:43.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.704+0000 7f339ad9c700 1 -- 172.21.15.53:0/1839295437 learned_addr learned my addr 172.21.15.53:0/1839295437 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:43.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399d9a700 1 --2- 172.21.15.53:0/1839295437 >> v2:172.21.15.184:3300/0 conn(0x7f33940d1220 0x7f33940b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742846623 0 0) 0x7f338c001490 con 0x7f33940b0e20 2023-07-09T21:52:43.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33800035b0 con 0x7f33940b0e20 2023-07-09T21:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383251586 0 0) 0x7f33940afaa0 con 0x7f33940b3ff0 2023-07-09T21:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f338c001490 con 0x7f33940b3ff0 2023-07-09T21:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2175786031 0 0) 0x7f33800035b0 con 0x7f33940b0e20 2023-07-09T21:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 >> v2:172.21.15.184:3300/0 conn(0x7f33940d1220 msgr2=0x7f33940b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 --2- 172.21.15.53:0/1839295437 >> v2:172.21.15.184:3300/0 conn(0x7f33940d1220 0x7f33940b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 >> v1:172.21.15.184:6789/0 conn(0x7f33940b3ff0 legacy=0x7f33940d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33940b0060 con 0x7f33940b0e20 2023-07-09T21:52:43.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f338c001b80 con 0x7f33940b0e20 2023-07-09T21:52:43.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399d9a700 1 --2- 172.21.15.53:0/1839295437 >> v2:172.21.15.184:3300/0 conn(0x7f33940d1220 0x7f33940b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:52:43.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 >> v1:172.21.15.53:6789/0 conn(0x7f33940b0e20 legacy=0x7f33940b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:43.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 --2- 172.21.15.53:0/1839295437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3380003be0 0x7f3380003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 --2- 172.21.15.53:0/1839295437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3380004850 0x7f3380004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 --2- 172.21.15.53:0/1839295437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3380005200 0x7f338000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33940afd80 con 0x7f3380003be0 2023-07-09T21:52:43.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338000c030 con 0x7f3380004850 2023-07-09T21:52:43.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.705+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338000c1f0 con 0x7f3380005200 2023-07-09T21:52:43.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.706+0000 7f339a59b700 1 --2- 172.21.15.53:0/1839295437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3380003be0 0x7f3380003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.706+0000 7f3399d9a700 1 --2- 172.21.15.53:0/1839295437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3380004850 0x7f3380004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.706+0000 7f339ad9c700 1 --2- 172.21.15.53:0/1839295437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3380005200 0x7f338000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.706+0000 7f339a59b700 1 -- 172.21.15.53:0/1839295437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3380005200 msgr2=0x7f338000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:43.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.706+0000 7f339a59b700 1 --2- 172.21.15.53:0/1839295437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3380005200 0x7f338000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.706+0000 7f339a59b700 1 -- 172.21.15.53:0/1839295437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3380004850 msgr2=0x7f3380004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:43.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.706+0000 7f339a59b700 1 --2- 172.21.15.53:0/1839295437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3380004850 0x7f3380004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.706+0000 7f339a59b700 1 -- 172.21.15.53:0/1839295437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33800035b0 con 0x7f3380003be0 2023-07-09T21:52:43.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.706+0000 7f339ad9c700 1 --2- 172.21.15.53:0/1839295437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3380005200 0x7f338000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:43.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.706+0000 7f339ad9c700 1 -- 172.21.15.53:0/1839295437 reap_dead start 2023-07-09T21:52:43.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.706+0000 7f339a59b700 1 --2- 172.21.15.53:0/1839295437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3380003be0 0x7f3380003fd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3390001940 tx=0x7f3380005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45aeffbdb175335a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:43.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.707+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3390001430 con 0x7f3380003be0 2023-07-09T21:52:43.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.707+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3390001d70 con 0x7f3380003be0 2023-07-09T21:52:43.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.707+0000 7f3399599700 1 -- 172.21.15.53:0/1839295437 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3390005530 con 0x7f3380003be0 2023-07-09T21:52:43.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.707+0000 7f339c7ff700 1 -- 172.21.15.53:0/1839295437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3380003be0 msgr2=0x7f3380003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:43.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.707+0000 7f339c7ff700 1 --2- 172.21.15.53:0/1839295437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3380003be0 0x7f3380003fd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3390001940 tx=0x7f3380005880 comp rx=0 tx=0).stop 2023-07-09T21:52:43.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.707+0000 7f339c7ff700 1 -- 172.21.15.53:0/1839295437 shutdown_connections 2023-07-09T21:52:43.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.707+0000 7f339c7ff700 1 --2- 172.21.15.53:0/1839295437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3380003be0 0x7f3380003fd0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.707+0000 7f339c7ff700 1 -- 172.21.15.53:0/1839295437 >> 172.21.15.53:0/1839295437 conn(0x7f339409c1b0 msgr2=0x7f33940d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:43.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.707+0000 7f339c7ff700 1 -- 172.21.15.53:0/1839295437 shutdown_connections 2023-07-09T21:52:43.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.707+0000 7f339c7ff700 1 -- 172.21.15.53:0/1839295437 wait complete. 2023-07-09T21:52:43.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.709+0000 7f339c7ff700 1 Processor -- start 2023-07-09T21:52:43.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.709+0000 7f339c7ff700 1 -- start start 2023-07-09T21:52:43.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.710+0000 7f339c7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3380003be0 0x7f3394157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.710+0000 7f339c7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33940ca890 0x7f33940b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.710+0000 7f339c7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33940cad00 0x7f33940b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.710+0000 7f339c7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3394157bd0 con 0x7f33940ca890 2023-07-09T21:52:43.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.710+0000 7f339c7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33940cb270 con 0x7f3380003be0 2023-07-09T21:52:43.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.710+0000 7f339c7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33940cb550 con 0x7f33940cad00 2023-07-09T21:52:43.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.710+0000 7f3399d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33940ca890 0x7f33940b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.710+0000 7f3399d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33940ca890 0x7f33940b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48172/0 (socket says 172.21.15.53:48172) 2023-07-09T21:52:43.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.710+0000 7f3399d9a700 1 -- 172.21.15.53:0/2189195243 learned_addr learned my addr 172.21.15.53:0/2189195243 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:43.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f339a59b700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3380003be0 0x7f3394157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f339ad9c700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33940cad00 0x7f33940b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f3399d9a700 1 -- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33940cad00 msgr2=0x7f33940b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:43.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f3399d9a700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33940cad00 0x7f33940b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f3399d9a700 1 -- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3380003be0 msgr2=0x7f3394157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:43.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f3399d9a700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3380003be0 0x7f3394157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f3399d9a700 1 -- 172.21.15.53:0/2189195243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33940ce9d0 con 0x7f33940ca890 2023-07-09T21:52:43.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f339a59b700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3380003be0 0x7f3394157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:43.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f339ad9c700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33940cad00 0x7f33940b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:43.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f3399d9a700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33940ca890 0x7f33940b25b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3384011c20 tx=0x7f338400f240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:43.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f338affd700 1 -- 172.21.15.53:0/2189195243 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338400fb80 con 0x7f33940ca890 2023-07-09T21:52:43.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f338affd700 1 -- 172.21.15.53:0/2189195243 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338400fce0 con 0x7f33940ca890 2023-07-09T21:52:43.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f339c7ff700 1 -- 172.21.15.53:0/2189195243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33940cecb0 con 0x7f33940ca890 2023-07-09T21:52:43.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.711+0000 7f338affd700 1 -- 172.21.15.53:0/2189195243 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384004240 con 0x7f33940ca890 2023-07-09T21:52:43.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.712+0000 7f339c7ff700 1 -- 172.21.15.53:0/2189195243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33940ccfe0 con 0x7f33940ca890 2023-07-09T21:52:43.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.713+0000 7f339c7ff700 1 -- 172.21.15.53:0/2189195243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33940cf020 con 0x7f33940ca890 2023-07-09T21:52:43.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.714+0000 7f338affd700 1 -- 172.21.15.53:0/2189195243 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f33840043a0 con 0x7f33940ca890 2023-07-09T21:52:43.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.715+0000 7f338affd700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f337806ae00 0x7f337806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:43.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.715+0000 7f338affd700 1 -- 172.21.15.53:0/2189195243 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f3384089e10 con 0x7f33940ca890 2023-07-09T21:52:43.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.715+0000 7f339a59b700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f337806ae00 0x7f337806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:43.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.716+0000 7f339a59b700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f337806ae00 0x7f337806d2b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3390000c00 tx=0x7f339000a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:43.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.719+0000 7f338affd700 1 -- 172.21.15.53:0/2189195243 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f338408d030 con 0x7f33940ca890 2023-07-09T21:52:43.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.925+0000 7f339c7ff700 1 -- 172.21.15.53:0/2189195243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33940b08d0 con 0x7f33940ca890 2023-07-09T21:52:43.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.926+0000 7f338affd700 1 -- 172.21.15.53:0/2189195243 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3384022020 con 0x7f33940ca890 2023-07-09T21:52:43.927 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:52:43.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.928+0000 7f339c7ff700 1 -- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f337806ae00 msgr2=0x7f337806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:43.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.928+0000 7f339c7ff700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f337806ae00 0x7f337806d2b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3390000c00 tx=0x7f339000a000 comp rx=0 tx=0).stop 2023-07-09T21:52:43.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.928+0000 7f339c7ff700 1 -- 172.21.15.53:0/2189195243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33940ca890 msgr2=0x7f33940b25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:43.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.928+0000 7f339c7ff700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33940ca890 0x7f33940b25b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3384011c20 tx=0x7f338400f240 comp rx=0 tx=0).stop 2023-07-09T21:52:43.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.928+0000 7f339c7ff700 1 -- 172.21.15.53:0/2189195243 shutdown_connections 2023-07-09T21:52:43.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.928+0000 7f339c7ff700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f337806ae00 0x7f337806d2b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.928+0000 7f339c7ff700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33940cad00 0x7f33940b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.928+0000 7f339c7ff700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3380003be0 0x7f3394157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.928+0000 7f339c7ff700 1 --2- 172.21.15.53:0/2189195243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33940ca890 0x7f33940b25b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.928+0000 7f339c7ff700 1 -- 172.21.15.53:0/2189195243 >> 172.21.15.53:0/2189195243 conn(0x7f339409c1b0 msgr2=0x7f33940b7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.928+0000 7f339c7ff700 1 -- 172.21.15.53:0/2189195243 shutdown_connections 2023-07-09T21:52:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:43.928+0000 7f339c7ff700 1 -- 172.21.15.53:0/2189195243 wait complete. 2023-07-09T21:52:43.948 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:52:44.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.150+0000 7f59837ff700 1 Processor -- start 2023-07-09T21:52:44.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.150+0000 7f59837ff700 1 -- start start 2023-07-09T21:52:44.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.152+0000 7f59837ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f597c0b3ff0 0x7f597c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.152+0000 7f59837ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f597c0d0f90 0x7f597c0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.152+0000 7f59837ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597c0b8e80 con 0x7f597c0d0b10 2023-07-09T21:52:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.152+0000 7f59837ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c0b1e30 con 0x7f597c0d0f90 2023-07-09T21:52:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.152+0000 7f59837ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c0afaa0 con 0x7f597c0b3ff0 2023-07-09T21:52:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.152+0000 7f5981d9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f597c0d0f90 0x7f597c0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.152+0000 7f5981d9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f597c0d0f90 0x7f597c0b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48178/0 (socket says 172.21.15.53:48178) 2023-07-09T21:52:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.152+0000 7f5981d9c700 1 -- 172.21.15.53:0/2583091090 learned_addr learned my addr 172.21.15.53:0/2583091090 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.152+0000 7f598159b700 1 --2- 172.21.15.53:0/2583091090 >> v2:172.21.15.184:3300/0 conn(0x7f597c0b3ff0 0x7f597c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.153+0000 7f5981d9c700 1 -- 172.21.15.53:0/2583091090 >> v2:172.21.15.184:3300/0 conn(0x7f597c0b3ff0 msgr2=0x7f597c0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.153+0000 7f5981d9c700 1 --2- 172.21.15.53:0/2583091090 >> v2:172.21.15.184:3300/0 conn(0x7f597c0b3ff0 0x7f597c0b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.153+0000 7f5981d9c700 1 -- 172.21.15.53:0/2583091090 >> v1:172.21.15.184:6789/0 conn(0x7f597c0d0b10 legacy=0x7f597c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.153+0000 7f5981d9c700 1 -- 172.21.15.53:0/2583091090 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c0afd80 con 0x7f597c0d0f90 2023-07-09T21:52:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.153+0000 7f5981d9c700 1 --2- 172.21.15.53:0/2583091090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f597c0d0f90 0x7f597c0b2ce0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f597c0b5b00 tx=0x7f597400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d508b7f08aa8a807 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.153+0000 7f5973fff700 1 -- 172.21.15.53:0/2583091090 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400e070 con 0x7f597c0d0f90 2023-07-09T21:52:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.153+0000 7f5973fff700 1 -- 172.21.15.53:0/2583091090 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597400b910 con 0x7f597c0d0f90 2023-07-09T21:52:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.153+0000 7f5973fff700 1 -- 172.21.15.53:0/2583091090 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400bcc0 con 0x7f597c0d0f90 2023-07-09T21:52:44.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.154+0000 7f59837ff700 1 -- 172.21.15.53:0/2583091090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f597c0d0f90 msgr2=0x7f597c0b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:44.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.154+0000 7f59837ff700 1 --2- 172.21.15.53:0/2583091090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f597c0d0f90 0x7f597c0b2ce0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f597c0b5b00 tx=0x7f597400b330 comp rx=0 tx=0).stop 2023-07-09T21:52:44.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.154+0000 7f59837ff700 1 -- 172.21.15.53:0/2583091090 shutdown_connections 2023-07-09T21:52:44.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.154+0000 7f59837ff700 1 --2- 172.21.15.53:0/2583091090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f597c0d0f90 0x7f597c0b2ce0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.154+0000 7f59837ff700 1 --2- 172.21.15.53:0/2583091090 >> v2:172.21.15.184:3300/0 conn(0x7f597c0b3ff0 0x7f597c0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.154+0000 7f59837ff700 1 -- 172.21.15.53:0/2583091090 >> 172.21.15.53:0/2583091090 conn(0x7f597c09c1b0 msgr2=0x7f597c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:44.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.155+0000 7f59837ff700 1 -- 172.21.15.53:0/2583091090 shutdown_connections 2023-07-09T21:52:44.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.155+0000 7f59837ff700 1 -- 172.21.15.53:0/2583091090 wait complete. 2023-07-09T21:52:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.158+0000 7f59837ff700 1 Processor -- start 2023-07-09T21:52:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.158+0000 7f59837ff700 1 -- start start 2023-07-09T21:52:44.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.160+0000 7f59837ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f597c0b3ff0 0x7f597c0cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:44.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.160+0000 7f59837ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f597c0d0b10 0x7f597c0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:44.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.160+0000 7f59837ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f597c0d0f90 0x7f597c1edaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:44.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.160+0000 7f59837ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c15fc80 con 0x7f597c0b3ff0 2023-07-09T21:52:44.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.160+0000 7f59837ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c1ee030 con 0x7f597c0d0b10 2023-07-09T21:52:44.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.160+0000 7f59837ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c15e010 con 0x7f597c0d0f90 2023-07-09T21:52:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.160+0000 7f5980d9a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f597c0d0b10 0x7f597c0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.161+0000 7f5981d9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f597c0d0f90 0x7f597c1edaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.161+0000 7f5981d9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f597c0d0f90 0x7f597c1edaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:55054/0 (socket says 172.21.15.53:55054) 2023-07-09T21:52:44.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.161+0000 7f5981d9c700 1 -- 172.21.15.53:0/1733790108 learned_addr learned my addr 172.21.15.53:0/1733790108 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:44.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.161+0000 7f598159b700 1 --2- 172.21.15.53:0/1733790108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f597c0b3ff0 0x7f597c0cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:44.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.161+0000 7f5981d9c700 1 -- 172.21.15.53:0/1733790108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f597c0d0b10 msgr2=0x7f597c0caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:44.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.161+0000 7f5981d9c700 1 --2- 172.21.15.53:0/1733790108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f597c0d0b10 0x7f597c0caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.161+0000 7f5981d9c700 1 -- 172.21.15.53:0/1733790108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f597c0b3ff0 msgr2=0x7f597c0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:44.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.161+0000 7f5981d9c700 1 --2- 172.21.15.53:0/1733790108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f597c0b3ff0 0x7f597c0cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.161+0000 7f5981d9c700 1 -- 172.21.15.53:0/1733790108 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974009b30 con 0x7f597c0d0f90 2023-07-09T21:52:44.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.162+0000 7f5981d9c700 1 --2- 172.21.15.53:0/1733790108 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f597c0d0f90 0x7f597c1edaf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f597c0681d0 tx=0x7f5974004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:44.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.162+0000 7f5971ffb700 1 -- 172.21.15.53:0/1733790108 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974004880 con 0x7f597c0d0f90 2023-07-09T21:52:44.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.162+0000 7f5971ffb700 1 -- 172.21.15.53:0/1733790108 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59740099b0 con 0x7f597c0d0f90 2023-07-09T21:52:44.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.162+0000 7f5971ffb700 1 -- 172.21.15.53:0/1733790108 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597401b670 con 0x7f597c0d0f90 2023-07-09T21:52:44.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.163+0000 7f59837ff700 1 -- 172.21.15.53:0/1733790108 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597c1ee260 con 0x7f597c0d0f90 2023-07-09T21:52:44.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.163+0000 7f59837ff700 1 -- 172.21.15.53:0/1733790108 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597c1ee820 con 0x7f597c0d0f90 2023-07-09T21:52:44.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.164+0000 7f59837ff700 1 -- 172.21.15.53:0/1733790108 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597c15e1a0 con 0x7f597c0d0f90 2023-07-09T21:52:44.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.166+0000 7f5971ffb700 1 -- 172.21.15.53:0/1733790108 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f597401b7d0 con 0x7f597c0d0f90 2023-07-09T21:52:44.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.167+0000 7f5971ffb700 1 --2- 172.21.15.53:0/1733790108 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f596006ae50 0x7f596006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:44.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.167+0000 7f5971ffb700 1 -- 172.21.15.53:0/1733790108 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f597408af70 con 0x7f597c0d0f90 2023-07-09T21:52:44.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.168+0000 7f598159b700 1 --2- 172.21.15.53:0/1733790108 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f596006ae50 0x7f596006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:44.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.168+0000 7f598159b700 1 --2- 172.21.15.53:0/1733790108 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f596006ae50 0x7f596006d300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f597c0b3890 tx=0x7f5978009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:44.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.171+0000 7f5971ffb700 1 -- 172.21.15.53:0/1733790108 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5974055ec0 con 0x7f597c0d0f90 2023-07-09T21:52:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.378+0000 7f59837ff700 1 -- 172.21.15.53:0/1733790108 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f597c074350 con 0x7f597c0d0f90 2023-07-09T21:52:44.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.379+0000 7f5971ffb700 1 -- 172.21.15.53:0/1733790108 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59740594e0 con 0x7f597c0d0f90 2023-07-09T21:52:44.381 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:52:44.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.381+0000 7f59837ff700 1 -- 172.21.15.53:0/1733790108 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f596006ae50 msgr2=0x7f596006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:44.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.381+0000 7f59837ff700 1 --2- 172.21.15.53:0/1733790108 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f596006ae50 0x7f596006d300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f597c0b3890 tx=0x7f5978009210 comp rx=0 tx=0).stop 2023-07-09T21:52:44.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.381+0000 7f59837ff700 1 -- 172.21.15.53:0/1733790108 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f597c0d0f90 msgr2=0x7f597c1edaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:44.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.381+0000 7f59837ff700 1 --2- 172.21.15.53:0/1733790108 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f597c0d0f90 0x7f597c1edaf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f597c0681d0 tx=0x7f5974004ad0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.382+0000 7f59837ff700 1 -- 172.21.15.53:0/1733790108 shutdown_connections 2023-07-09T21:52:44.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.382+0000 7f59837ff700 1 --2- 172.21.15.53:0/1733790108 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f596006ae50 0x7f596006d300 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.382+0000 7f59837ff700 1 --2- 172.21.15.53:0/1733790108 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f597c0d0f90 0x7f597c1edaf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.382+0000 7f59837ff700 1 --2- 172.21.15.53:0/1733790108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f597c0b3ff0 0x7f597c0cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.382+0000 7f59837ff700 1 --2- 172.21.15.53:0/1733790108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f597c0d0b10 0x7f597c0caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.382+0000 7f59837ff700 1 -- 172.21.15.53:0/1733790108 >> 172.21.15.53:0/1733790108 conn(0x7f597c09c1b0 msgr2=0x7f597c0b5130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:44.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.382+0000 7f59837ff700 1 -- 172.21.15.53:0/1733790108 shutdown_connections 2023-07-09T21:52:44.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.382+0000 7f59837ff700 1 -- 172.21.15.53:0/1733790108 wait complete. 2023-07-09T21:52:44.401 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:52:44.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.602+0000 7fd107bff700 1 Processor -- start 2023-07-09T21:52:44.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.602+0000 7fd107bff700 1 -- start start 2023-07-09T21:52:44.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.604+0000 7fd107bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd1000b3ff0 0x7fd1000b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:44.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.604+0000 7fd107bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd1000d0f90 0x7fd1000b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:44.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.604+0000 7fd107bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1000b8e80 con 0x7fd1000d0b10 2023-07-09T21:52:44.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.604+0000 7fd107bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1000b1e30 con 0x7fd1000d0f90 2023-07-09T21:52:44.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.604+0000 7fd107bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1000afaa0 con 0x7fd1000b3ff0 2023-07-09T21:52:44.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.604+0000 7fd10619c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd1000d0f90 0x7fd1000b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:44.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.605+0000 7fd10619c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd1000d0f90 0x7fd1000b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48200/0 (socket says 172.21.15.53:48200) 2023-07-09T21:52:44.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.605+0000 7fd10619c700 1 -- 172.21.15.53:0/1057053795 learned_addr learned my addr 172.21.15.53:0/1057053795 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:44.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.605+0000 7fd10599b700 1 --2- 172.21.15.53:0/1057053795 >> v2:172.21.15.184:3300/0 conn(0x7fd1000b3ff0 0x7fd1000b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:44.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.605+0000 7fd10619c700 1 -- 172.21.15.53:0/1057053795 >> v2:172.21.15.184:3300/0 conn(0x7fd1000b3ff0 msgr2=0x7fd1000b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:44.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.605+0000 7fd10619c700 1 --2- 172.21.15.53:0/1057053795 >> v2:172.21.15.184:3300/0 conn(0x7fd1000b3ff0 0x7fd1000b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.605+0000 7fd10619c700 1 -- 172.21.15.53:0/1057053795 >> v1:172.21.15.184:6789/0 conn(0x7fd1000d0b10 legacy=0x7fd1000b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:44.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.605+0000 7fd10619c700 1 -- 172.21.15.53:0/1057053795 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1000afd80 con 0x7fd1000d0f90 2023-07-09T21:52:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.605+0000 7fd10619c700 1 --2- 172.21.15.53:0/1057053795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1000d0f90 0x7fd1000b2ce0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd1000b5b00 tx=0x7fd0f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95359e2a9171dc61 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.605+0000 7fd104999700 1 -- 172.21.15.53:0/1057053795 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f800e070 con 0x7fd1000d0f90 2023-07-09T21:52:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.606+0000 7fd104999700 1 -- 172.21.15.53:0/1057053795 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f800b9c0 con 0x7fd1000d0f90 2023-07-09T21:52:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.606+0000 7fd104999700 1 -- 172.21.15.53:0/1057053795 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f800bd70 con 0x7fd1000d0f90 2023-07-09T21:52:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.606+0000 7fd107bff700 1 -- 172.21.15.53:0/1057053795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1000d0f90 msgr2=0x7fd1000b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.606+0000 7fd107bff700 1 --2- 172.21.15.53:0/1057053795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1000d0f90 0x7fd1000b2ce0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd1000b5b00 tx=0x7fd0f800b330 comp rx=0 tx=0).stop 2023-07-09T21:52:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.606+0000 7fd107bff700 1 -- 172.21.15.53:0/1057053795 shutdown_connections 2023-07-09T21:52:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.606+0000 7fd107bff700 1 --2- 172.21.15.53:0/1057053795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1000d0f90 0x7fd1000b2ce0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.606+0000 7fd107bff700 1 --2- 172.21.15.53:0/1057053795 >> v2:172.21.15.184:3300/0 conn(0x7fd1000b3ff0 0x7fd1000b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.606+0000 7fd107bff700 1 -- 172.21.15.53:0/1057053795 >> 172.21.15.53:0/1057053795 conn(0x7fd10009c1b0 msgr2=0x7fd1000d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:44.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.606+0000 7fd107bff700 1 -- 172.21.15.53:0/1057053795 shutdown_connections 2023-07-09T21:52:44.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.606+0000 7fd107bff700 1 -- 172.21.15.53:0/1057053795 wait complete. 2023-07-09T21:52:44.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.608+0000 7fd107bff700 1 Processor -- start 2023-07-09T21:52:44.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.608+0000 7fd107bff700 1 -- start start 2023-07-09T21:52:44.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.609+0000 7fd107bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1000b3ff0 0x7fd10015e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:44.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.609+0000 7fd107bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1000d0b10 0x7fd10015f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:44.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.609+0000 7fd107bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1000d0f90 0x7fd1000cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:44.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.609+0000 7fd107bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10015d860 con 0x7fd1000d0b10 2023-07-09T21:52:44.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.609+0000 7fd107bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10015db00 con 0x7fd1000d0f90 2023-07-09T21:52:44.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.609+0000 7fd107bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10015dde0 con 0x7fd1000b3ff0 2023-07-09T21:52:44.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.609+0000 7fd10519a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1000d0b10 0x7fd10015f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:44.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.609+0000 7fd10519a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1000d0b10 0x7fd10015f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48210/0 (socket says 172.21.15.53:48210) 2023-07-09T21:52:44.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.609+0000 7fd10519a700 1 -- 172.21.15.53:0/3897308463 learned_addr learned my addr 172.21.15.53:0/3897308463 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:44.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.610+0000 7fd10599b700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1000b3ff0 0x7fd10015e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:44.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.610+0000 7fd10619c700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1000d0f90 0x7fd1000cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:44.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.610+0000 7fd10519a700 1 -- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1000b3ff0 msgr2=0x7fd10015e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:44.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.610+0000 7fd10519a700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1000b3ff0 0x7fd10015e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.610+0000 7fd10519a700 1 -- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1000d0f90 msgr2=0x7fd1000cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:44.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.610+0000 7fd10519a700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1000d0f90 0x7fd1000cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.610+0000 7fd10519a700 1 -- 172.21.15.53:0/3897308463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8009b30 con 0x7fd1000d0b10 2023-07-09T21:52:44.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.610+0000 7fd10619c700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1000d0f90 0x7fd1000cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:44.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.610+0000 7fd10519a700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1000d0b10 0x7fd10015f5f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c4e0 tx=0x7fd0f000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:44.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.610+0000 7fd0f67fc700 1 -- 172.21.15.53:0/3897308463 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00052d0 con 0x7fd1000d0b10 2023-07-09T21:52:44.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.610+0000 7fd0f67fc700 1 -- 172.21.15.53:0/3897308463 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0005430 con 0x7fd1000d0b10 2023-07-09T21:52:44.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.610+0000 7fd107bff700 1 -- 172.21.15.53:0/3897308463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10015e0c0 con 0x7fd1000d0b10 2023-07-09T21:52:44.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.610+0000 7fd0f67fc700 1 -- 172.21.15.53:0/3897308463 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00038c0 con 0x7fd1000d0b10 2023-07-09T21:52:44.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.611+0000 7fd107bff700 1 -- 172.21.15.53:0/3897308463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10014d2f0 con 0x7fd1000d0b10 2023-07-09T21:52:44.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.612+0000 7fd107bff700 1 -- 172.21.15.53:0/3897308463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10015e2b0 con 0x7fd1000d0b10 2023-07-09T21:52:44.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.613+0000 7fd0f67fc700 1 -- 172.21.15.53:0/3897308463 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fd0f0003a20 con 0x7fd1000d0b10 2023-07-09T21:52:44.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.614+0000 7fd0f67fc700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd0e406ae00 0x7fd0e406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:44.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.614+0000 7fd0f67fc700 1 -- 172.21.15.53:0/3897308463 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fd0f00888c0 con 0x7fd1000d0b10 2023-07-09T21:52:44.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.614+0000 7fd10599b700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd0e406ae00 0x7fd0e406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:44.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.615+0000 7fd10599b700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd0e406ae00 0x7fd0e406d2b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0099d0 tx=0x7fd0fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:44.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.618+0000 7fd0f67fc700 1 -- 172.21.15.53:0/3897308463 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd0f0053820 con 0x7fd1000d0b10 2023-07-09T21:52:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.822+0000 7fd107bff700 1 -- 172.21.15.53:0/3897308463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1000b8e80 con 0x7fd1000d0b10 2023-07-09T21:52:44.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.823+0000 7fd0f67fc700 1 -- 172.21.15.53:0/3897308463 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1000b8e80 con 0x7fd1000d0b10 2023-07-09T21:52:44.824 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:52:44.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.825+0000 7fd107bff700 1 -- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd0e406ae00 msgr2=0x7fd0e406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.825+0000 7fd107bff700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd0e406ae00 0x7fd0e406d2b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0099d0 tx=0x7fd0fc008040 comp rx=0 tx=0).stop 2023-07-09T21:52:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.825+0000 7fd107bff700 1 -- 172.21.15.53:0/3897308463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1000d0b10 msgr2=0x7fd10015f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.825+0000 7fd107bff700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1000d0b10 0x7fd10015f5f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c4e0 tx=0x7fd0f000c7f0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.825+0000 7fd107bff700 1 -- 172.21.15.53:0/3897308463 shutdown_connections 2023-07-09T21:52:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.825+0000 7fd107bff700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd0e406ae00 0x7fd0e406d2b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.825+0000 7fd107bff700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1000d0f90 0x7fd1000cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.825+0000 7fd107bff700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1000b3ff0 0x7fd10015e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.825+0000 7fd107bff700 1 --2- 172.21.15.53:0/3897308463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1000d0b10 0x7fd10015f5f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.825+0000 7fd107bff700 1 -- 172.21.15.53:0/3897308463 >> 172.21.15.53:0/3897308463 conn(0x7fd10009c1b0 msgr2=0x7fd10006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.825+0000 7fd107bff700 1 -- 172.21.15.53:0/3897308463 shutdown_connections 2023-07-09T21:52:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:44.825+0000 7fd107bff700 1 -- 172.21.15.53:0/3897308463 wait complete. 2023-07-09T21:52:44.845 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:52:45.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.048+0000 7f8e65dff700 1 Processor -- start 2023-07-09T21:52:45.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.048+0000 7f8e65dff700 1 -- start start 2023-07-09T21:52:45.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.049+0000 7f8e65dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e600ae1f0 0x7f8e600ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:45.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.049+0000 7f8e65dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e600cd1b0 0x7f8e600cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:45.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.049+0000 7f8e65dff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e600b21b0 con 0x7f8e601603d0 2023-07-09T21:52:45.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.049+0000 7f8e65dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e600cdb90 con 0x7f8e600ae1f0 2023-07-09T21:52:45.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.049+0000 7f8e65dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6006b8a0 con 0x7f8e600cd1b0 2023-07-09T21:52:45.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.050+0000 7f8e5f7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e600ae1f0 0x7f8e600ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:45.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.050+0000 7f8e5ffff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8e601603d0 0x7f8e60160850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37990/0 (socket says 172.21.15.53:37990) 2023-07-09T21:52:45.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.050+0000 7f8e5f7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e600ae1f0 0x7f8e600ae5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48222/0 (socket says 172.21.15.53:48222) 2023-07-09T21:52:45.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.050+0000 7f8e5ffff700 1 -- 172.21.15.53:0/53696466 learned_addr learned my addr 172.21.15.53:0/53696466 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:45.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.050+0000 7f8e5effd700 1 --2- 172.21.15.53:0/53696466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e600cd1b0 0x7f8e600cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:45.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.050+0000 7f8e5f7fe700 1 -- 172.21.15.53:0/53696466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e600cd1b0 msgr2=0x7f8e600cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:45.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.050+0000 7f8e5f7fe700 1 --2- 172.21.15.53:0/53696466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e600cd1b0 0x7f8e600cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.050+0000 7f8e5f7fe700 1 -- 172.21.15.53:0/53696466 >> v1:172.21.15.53:6789/0 conn(0x7f8e601603d0 legacy=0x7f8e60160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:45.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.050+0000 7f8e5f7fe700 1 -- 172.21.15.53:0/53696466 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6006ad20 con 0x7f8e600ae1f0 2023-07-09T21:52:45.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.050+0000 7f8e5e7fc700 1 -- 172.21.15.53:0/53696466 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157209176 0 0) 0x7f8e600b21b0 con 0x7f8e601603d0 2023-07-09T21:52:45.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.050+0000 7f8e5f7fe700 1 --2- 172.21.15.53:0/53696466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e600ae1f0 0x7f8e600ae5c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009840 tx=0x7f8e50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d240b133e408ba server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:45.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.051+0000 7f8e5e7fc700 1 -- 172.21.15.53:0/53696466 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50011830 con 0x7f8e600ae1f0 2023-07-09T21:52:45.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.051+0000 7f8e5e7fc700 1 -- 172.21.15.53:0/53696466 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e50011990 con 0x7f8e600ae1f0 2023-07-09T21:52:45.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.051+0000 7f8e5e7fc700 1 -- 172.21.15.53:0/53696466 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50011d20 con 0x7f8e600ae1f0 2023-07-09T21:52:45.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.051+0000 7f8e65dff700 1 -- 172.21.15.53:0/53696466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e600ae1f0 msgr2=0x7f8e600ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:45.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.051+0000 7f8e65dff700 1 --2- 172.21.15.53:0/53696466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e600ae1f0 0x7f8e600ae5c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009840 tx=0x7f8e50009b50 comp rx=0 tx=0).stop 2023-07-09T21:52:45.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.051+0000 7f8e65dff700 1 -- 172.21.15.53:0/53696466 shutdown_connections 2023-07-09T21:52:45.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.051+0000 7f8e65dff700 1 --2- 172.21.15.53:0/53696466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e600ae1f0 0x7f8e600ae5c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.051+0000 7f8e65dff700 1 --2- 172.21.15.53:0/53696466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e600cd1b0 0x7f8e600cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.051+0000 7f8e65dff700 1 -- 172.21.15.53:0/53696466 >> 172.21.15.53:0/53696466 conn(0x7f8e600cc990 msgr2=0x7f8e600cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:45.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.051+0000 7f8e65dff700 1 -- 172.21.15.53:0/53696466 shutdown_connections 2023-07-09T21:52:45.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.052+0000 7f8e65dff700 1 -- 172.21.15.53:0/53696466 wait complete. 2023-07-09T21:52:45.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.053+0000 7f8e65dff700 1 Processor -- start 2023-07-09T21:52:45.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.053+0000 7f8e65dff700 1 -- start start 2023-07-09T21:52:45.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.054+0000 7f8e65dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e600ae1f0 0x7f8e601f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:45.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.054+0000 7f8e65dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e600cd1b0 0x7f8e600c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:45.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.054+0000 7f8e65dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e601603d0 0x7f8e601f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:45.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.054+0000 7f8e65dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e601f6780 con 0x7f8e600cd1b0 2023-07-09T21:52:45.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.054+0000 7f8e65dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e600c3a60 con 0x7f8e600ae1f0 2023-07-09T21:52:45.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.054+0000 7f8e65dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e600c8370 con 0x7f8e601603d0 2023-07-09T21:52:45.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.055+0000 7f8e5effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e600cd1b0 0x7f8e600c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:45.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.055+0000 7f8e5effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e600cd1b0 0x7f8e600c3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48238/0 (socket says 172.21.15.53:48238) 2023-07-09T21:52:45.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.055+0000 7f8e5effd700 1 -- 172.21.15.53:0/4158841369 learned_addr learned my addr 172.21.15.53:0/4158841369 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:45.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.055+0000 7f8e5ffff700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e601603d0 0x7f8e601f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:45.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.055+0000 7f8e5f7fe700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e600ae1f0 0x7f8e601f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:45.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.055+0000 7f8e5effd700 1 -- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e601603d0 msgr2=0x7f8e601f1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:45.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.055+0000 7f8e5effd700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e601603d0 0x7f8e601f1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.055+0000 7f8e5effd700 1 -- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e600ae1f0 msgr2=0x7f8e601f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:45.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.055+0000 7f8e5effd700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e600ae1f0 0x7f8e601f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.055+0000 7f8e5effd700 1 -- 172.21.15.53:0/4158841369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e500094a0 con 0x7f8e600cd1b0 2023-07-09T21:52:45.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.055+0000 7f8e5ffff700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e601603d0 0x7f8e601f1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:45.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.055+0000 7f8e5effd700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e600cd1b0 0x7f8e600c3520 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400d800 tx=0x7f8e5400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:45.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.055+0000 7f8e47fff700 1 -- 172.21.15.53:0/4158841369 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e540125f0 con 0x7f8e600cd1b0 2023-07-09T21:52:45.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.056+0000 7f8e47fff700 1 -- 172.21.15.53:0/4158841369 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e54012750 con 0x7f8e600cd1b0 2023-07-09T21:52:45.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.056+0000 7f8e47fff700 1 -- 172.21.15.53:0/4158841369 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54012b00 con 0x7f8e600cd1b0 2023-07-09T21:52:45.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.056+0000 7f8e65dff700 1 -- 172.21.15.53:0/4158841369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6014d550 con 0x7f8e600cd1b0 2023-07-09T21:52:45.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.056+0000 7f8e65dff700 1 -- 172.21.15.53:0/4158841369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6014d8e0 con 0x7f8e600cd1b0 2023-07-09T21:52:45.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.057+0000 7f8e65dff700 1 -- 172.21.15.53:0/4158841369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e600c8530 con 0x7f8e600cd1b0 2023-07-09T21:52:45.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.058+0000 7f8e47fff700 1 -- 172.21.15.53:0/4158841369 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f8e54012c60 con 0x7f8e600cd1b0 2023-07-09T21:52:45.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.059+0000 7f8e47fff700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8e4c06ae00 0x7f8e4c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:45.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.059+0000 7f8e47fff700 1 -- 172.21.15.53:0/4158841369 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f8e54089ac0 con 0x7f8e600cd1b0 2023-07-09T21:52:45.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.059+0000 7f8e5f7fe700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8e4c06ae00 0x7f8e4c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:45.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.060+0000 7f8e5f7fe700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8e4c06ae00 0x7f8e4c06d2b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8e500090b0 tx=0x7f8e5001c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:45.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.063+0000 7f8e47fff700 1 -- 172.21.15.53:0/4158841369 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8e54054980 con 0x7f8e600cd1b0 2023-07-09T21:52:45.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.271+0000 7f8e65dff700 1 -- 172.21.15.53:0/4158841369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e6006b2b0 con 0x7f8e600cd1b0 2023-07-09T21:52:45.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.271+0000 7f8e47fff700 1 -- 172.21.15.53:0/4158841369 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e54057fa0 con 0x7f8e600cd1b0 2023-07-09T21:52:45.272 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:52:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.273+0000 7f8e65dff700 1 -- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8e4c06ae00 msgr2=0x7f8e4c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.273+0000 7f8e65dff700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8e4c06ae00 0x7f8e4c06d2b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8e500090b0 tx=0x7f8e5001c040 comp rx=0 tx=0).stop 2023-07-09T21:52:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.273+0000 7f8e65dff700 1 -- 172.21.15.53:0/4158841369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e600cd1b0 msgr2=0x7f8e600c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.273+0000 7f8e65dff700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e600cd1b0 0x7f8e600c3520 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400d800 tx=0x7f8e5400dbc0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.274+0000 7f8e65dff700 1 -- 172.21.15.53:0/4158841369 shutdown_connections 2023-07-09T21:52:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.274+0000 7f8e65dff700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8e4c06ae00 0x7f8e4c06d2b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.274+0000 7f8e65dff700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e601603d0 0x7f8e601f1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.274+0000 7f8e65dff700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e600ae1f0 0x7f8e601f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.274+0000 7f8e65dff700 1 --2- 172.21.15.53:0/4158841369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e600cd1b0 0x7f8e600c3520 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.274+0000 7f8e65dff700 1 -- 172.21.15.53:0/4158841369 >> 172.21.15.53:0/4158841369 conn(0x7f8e600cc990 msgr2=0x7f8e600b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.274+0000 7f8e65dff700 1 -- 172.21.15.53:0/4158841369 shutdown_connections 2023-07-09T21:52:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.274+0000 7f8e65dff700 1 -- 172.21.15.53:0/4158841369 wait complete. 2023-07-09T21:52:45.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:52:45.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.493+0000 7fd80d1ff700 1 Processor -- start 2023-07-09T21:52:45.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.493+0000 7fd80d1ff700 1 -- start start 2023-07-09T21:52:45.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.494+0000 7fd80d1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd8080b3ff0 0x7fd8080b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:45.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.494+0000 7fd80d1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8080d0f90 0x7fd8080b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:45.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.494+0000 7fd80d1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8080b8e80 con 0x7fd8080d0b10 2023-07-09T21:52:45.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.494+0000 7fd80d1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8080b1e30 con 0x7fd8080b3ff0 2023-07-09T21:52:45.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.494+0000 7fd80d1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080d1410 con 0x7fd8080d0f90 2023-07-09T21:52:45.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.495+0000 7fd80759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8080d0f90 0x7fd8080b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:45.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.495+0000 7fd80659c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fd8080d0b10 0x7fd8080b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:32770/0 (socket says 172.21.15.53:32770) 2023-07-09T21:52:45.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.495+0000 7fd80759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8080d0f90 0x7fd8080b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:55100/0 (socket says 172.21.15.53:55100) 2023-07-09T21:52:45.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.495+0000 7fd80659c700 1 -- 172.21.15.53:0/4098179816 learned_addr learned my addr 172.21.15.53:0/4098179816 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:45.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.495+0000 7fd806d9d700 1 --2- 172.21.15.53:0/4098179816 >> v2:172.21.15.184:3300/0 conn(0x7fd8080b3ff0 0x7fd8080b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.495+0000 7fd805d9b700 1 -- 172.21.15.53:0/4098179816 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918202701 0 0) 0x7fd7fc001110 con 0x7fd8080d0b10 2023-07-09T21:52:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.495+0000 7fd805d9b700 1 -- 172.21.15.53:0/4098179816 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f00035b0 con 0x7fd8080d0b10 2023-07-09T21:52:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.495+0000 7fd80759e700 1 -- 172.21.15.53:0/4098179816 >> v2:172.21.15.184:3300/0 conn(0x7fd8080b3ff0 msgr2=0x7fd8080b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.495+0000 7fd80759e700 1 --2- 172.21.15.53:0/4098179816 >> v2:172.21.15.184:3300/0 conn(0x7fd8080b3ff0 0x7fd8080b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.495+0000 7fd80759e700 1 -- 172.21.15.53:0/4098179816 >> v1:172.21.15.184:6789/0 conn(0x7fd8080d0b10 legacy=0x7fd8080b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.495+0000 7fd80759e700 1 -- 172.21.15.53:0/4098179816 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8080afaa0 con 0x7fd8080d0f90 2023-07-09T21:52:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.496+0000 7fd80759e700 1 --2- 172.21.15.53:0/4098179816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8080d0f90 0x7fd8080b2ce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd800009d90 tx=0x7fd80000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a0ad30cf128a63 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.496+0000 7fd805d9b700 1 -- 172.21.15.53:0/4098179816 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000e070 con 0x7fd8080d0f90 2023-07-09T21:52:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.496+0000 7fd805d9b700 1 -- 172.21.15.53:0/4098179816 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80000bb20 con 0x7fd8080d0f90 2023-07-09T21:52:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.496+0000 7fd805d9b700 1 -- 172.21.15.53:0/4098179816 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800012430 con 0x7fd8080d0f90 2023-07-09T21:52:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.497+0000 7fd80d1ff700 1 -- 172.21.15.53:0/4098179816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8080d0f90 msgr2=0x7fd8080b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.497+0000 7fd80d1ff700 1 --2- 172.21.15.53:0/4098179816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8080d0f90 0x7fd8080b2ce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd800009d90 tx=0x7fd80000b330 comp rx=0 tx=0).stop 2023-07-09T21:52:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.497+0000 7fd80d1ff700 1 -- 172.21.15.53:0/4098179816 shutdown_connections 2023-07-09T21:52:45.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.497+0000 7fd80d1ff700 1 --2- 172.21.15.53:0/4098179816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8080d0f90 0x7fd8080b2ce0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.497+0000 7fd80d1ff700 1 --2- 172.21.15.53:0/4098179816 >> v2:172.21.15.184:3300/0 conn(0x7fd8080b3ff0 0x7fd8080b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.497+0000 7fd80d1ff700 1 -- 172.21.15.53:0/4098179816 >> 172.21.15.53:0/4098179816 conn(0x7fd80809c1b0 msgr2=0x7fd8080d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:45.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.497+0000 7fd80d1ff700 1 -- 172.21.15.53:0/4098179816 shutdown_connections 2023-07-09T21:52:45.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.497+0000 7fd80d1ff700 1 -- 172.21.15.53:0/4098179816 wait complete. 2023-07-09T21:52:45.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.499+0000 7fd80d1ff700 1 Processor -- start 2023-07-09T21:52:45.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.499+0000 7fd80d1ff700 1 -- start start 2023-07-09T21:52:45.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd80d1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8080b3ff0 0x7fd80814a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:45.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd80d1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8080d0b10 0x7fd80806b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:45.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd80d1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8080d0f90 0x7fd80806b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:45.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd80d1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080cd570 con 0x7fd8080b3ff0 2023-07-09T21:52:45.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd80d1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80815f750 con 0x7fd8080d0b10 2023-07-09T21:52:45.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd80d1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80815fa30 con 0x7fd8080d0f90 2023-07-09T21:52:45.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd806d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8080b3ff0 0x7fd80814a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:45.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd806d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8080b3ff0 0x7fd80814a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48252/0 (socket says 172.21.15.53:48252) 2023-07-09T21:52:45.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd806d9d700 1 -- 172.21.15.53:0/2656478963 learned_addr learned my addr 172.21.15.53:0/2656478963 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:45.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd80659c700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8080d0b10 0x7fd80806b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:45.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd80759e700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8080d0f90 0x7fd80806b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:45.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd806d9d700 1 -- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8080d0f90 msgr2=0x7fd80806b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:45.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd806d9d700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8080d0f90 0x7fd80806b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd806d9d700 1 -- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8080d0b10 msgr2=0x7fd80806b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:45.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd806d9d700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8080d0b10 0x7fd80806b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd806d9d700 1 -- 172.21.15.53:0/2656478963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800009a70 con 0x7fd8080b3ff0 2023-07-09T21:52:45.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd80659c700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8080d0b10 0x7fd80806b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:45.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.500+0000 7fd80759e700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8080d0f90 0x7fd80806b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:45.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.501+0000 7fd806d9d700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8080b3ff0 0x7fd80814a8a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800e9d0 tx=0x7fd7f800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:45.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.501+0000 7fd7ef7fe700 1 -- 172.21.15.53:0/2656478963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8009730 con 0x7fd8080b3ff0 2023-07-09T21:52:45.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.501+0000 7fd7ef7fe700 1 -- 172.21.15.53:0/2656478963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f800c850 con 0x7fd8080b3ff0 2023-07-09T21:52:45.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.501+0000 7fd80d1ff700 1 -- 172.21.15.53:0/2656478963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80815fd10 con 0x7fd8080b3ff0 2023-07-09T21:52:45.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.501+0000 7fd7ef7fe700 1 -- 172.21.15.53:0/2656478963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f800cbe0 con 0x7fd8080b3ff0 2023-07-09T21:52:45.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.501+0000 7fd80d1ff700 1 -- 172.21.15.53:0/2656478963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80814ade0 con 0x7fd8080b3ff0 2023-07-09T21:52:45.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.502+0000 7fd80d1ff700 1 -- 172.21.15.53:0/2656478963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8080cda00 con 0x7fd8080b3ff0 2023-07-09T21:52:45.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.503+0000 7fd7ef7fe700 1 -- 172.21.15.53:0/2656478963 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fd7f800cd40 con 0x7fd8080b3ff0 2023-07-09T21:52:45.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.504+0000 7fd7ef7fe700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd7f406ae00 0x7fd7f406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:45.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.504+0000 7fd7ef7fe700 1 -- 172.21.15.53:0/2656478963 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fd7f8089b40 con 0x7fd8080b3ff0 2023-07-09T21:52:45.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.505+0000 7fd80659c700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd7f406ae00 0x7fd7f406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:45.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.505+0000 7fd80659c700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd7f406ae00 0x7fd7f406d2b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd80806c650 tx=0x7fd7fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:45.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.508+0000 7fd7ef7fe700 1 -- 172.21.15.53:0/2656478963 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd8080cda00 con 0x7fd8080b3ff0 2023-07-09T21:52:45.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.734+0000 7fd80d1ff700 1 -- 172.21.15.53:0/2656478963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd8080cda00 con 0x7fd8080b3ff0 2023-07-09T21:52:45.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.735+0000 7fd7ef7fe700 1 -- 172.21.15.53:0/2656478963 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v52) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd8080cda00 con 0x7fd8080b3ff0 2023-07-09T21:52:45.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.737+0000 7fd80d1ff700 1 -- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd7f406ae00 msgr2=0x7fd7f406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:45.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.737+0000 7fd80d1ff700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd7f406ae00 0x7fd7f406d2b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd80806c650 tx=0x7fd7fc009040 comp rx=0 tx=0).stop 2023-07-09T21:52:45.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.737+0000 7fd80d1ff700 1 -- 172.21.15.53:0/2656478963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8080b3ff0 msgr2=0x7fd80814a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:45.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.737+0000 7fd80d1ff700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8080b3ff0 0x7fd80814a8a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800e9d0 tx=0x7fd7f800ed90 comp rx=0 tx=0).stop 2023-07-09T21:52:45.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.737+0000 7fd80d1ff700 1 -- 172.21.15.53:0/2656478963 shutdown_connections 2023-07-09T21:52:45.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.737+0000 7fd80d1ff700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd7f406ae00 0x7fd7f406d2b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.737+0000 7fd80d1ff700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8080d0f90 0x7fd80806b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.737+0000 7fd80d1ff700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8080b3ff0 0x7fd80814a8a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.737+0000 7fd80d1ff700 1 --2- 172.21.15.53:0/2656478963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8080d0b10 0x7fd80806b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:45.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.737+0000 7fd80d1ff700 1 -- 172.21.15.53:0/2656478963 >> 172.21.15.53:0/2656478963 conn(0x7fd80809c1b0 msgr2=0x7fd808072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:45.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.737+0000 7fd80d1ff700 1 -- 172.21.15.53:0/2656478963 shutdown_connections 2023-07-09T21:52:45.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:45.737+0000 7fd80d1ff700 1 -- 172.21.15.53:0/2656478963 wait complete. 2023-07-09T21:52:45.741 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-07-09T21:52:45.757 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T21:52:45.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:45.757 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-09T21:52:45.856 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:52:45.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:45.857 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T21:52:45.901 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:52:45.901 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:45.945 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348820k,nr_inodes=4087205,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-09T21:52:45.945 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:52:45.945 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:45.988 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345736k,nr_inodes=4086434,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-09T21:52:45.989 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:52:46.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.188+0000 7f1fd77ff700 1 Processor -- start 2023-07-09T21:52:46.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.188+0000 7f1fd77ff700 1 -- start start 2023-07-09T21:52:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.189+0000 7f1fd77ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd00b1e00 0x7f1fd00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.189+0000 7f1fd77ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1fd00b2350 0x7f1fd00d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.189+0000 7f1fd77ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1fd00d1050 0x7f1fd00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.189+0000 7f1fd77ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd00d14a0 con 0x7f1fd00b2350 2023-07-09T21:52:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.189+0000 7f1fd77ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd00d2ce0 con 0x7f1fd00d1050 2023-07-09T21:52:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.189+0000 7f1fd77ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00b3350 con 0x7f1fd00b1e00 2023-07-09T21:52:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.189+0000 7f1fd4d9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1fd00b2350 0x7f1fd00d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.189+0000 7f1fd4d9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1fd00b2350 0x7f1fd00d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48258/0 (socket says 172.21.15.53:48258) 2023-07-09T21:52:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.189+0000 7f1fd4d9a700 1 -- 172.21.15.53:0/3510106374 learned_addr learned my addr 172.21.15.53:0/3510106374 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:46.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.190+0000 7f1fd559b700 1 --2- 172.21.15.53:0/3510106374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd00b1e00 0x7f1fd00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:46.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.190+0000 7f1fd5d9c700 1 --2- 172.21.15.53:0/3510106374 >> v2:172.21.15.184:3300/0 conn(0x7f1fd00d1050 0x7f1fd00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:46.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.190+0000 7f1fd4d9a700 1 -- 172.21.15.53:0/3510106374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd00b1e00 msgr2=0x7f1fd00b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:46.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.190+0000 7f1fd4d9a700 1 --2- 172.21.15.53:0/3510106374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd00b1e00 0x7f1fd00b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.190+0000 7f1fd4d9a700 1 -- 172.21.15.53:0/3510106374 >> v2:172.21.15.184:3300/0 conn(0x7f1fd00d1050 msgr2=0x7f1fd00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:46.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.190+0000 7f1fd4d9a700 1 --2- 172.21.15.53:0/3510106374 >> v2:172.21.15.184:3300/0 conn(0x7f1fd00d1050 0x7f1fd00afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.190+0000 7f1fd4d9a700 1 -- 172.21.15.53:0/3510106374 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd00b3630 con 0x7f1fd00b2350 2023-07-09T21:52:46.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.190+0000 7f1fd559b700 1 --2- 172.21.15.53:0/3510106374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd00b1e00 0x7f1fd00b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:46.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.190+0000 7f1fd5d9c700 1 --2- 172.21.15.53:0/3510106374 >> v2:172.21.15.184:3300/0 conn(0x7f1fd00d1050 0x7f1fd00afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:46.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.190+0000 7f1fd4d9a700 1 --2- 172.21.15.53:0/3510106374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd00b2350 0x7f1fd00d0b10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00b3280 tx=0x7f1fc0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237d3079d1fed752 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:46.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.190+0000 7f1fc7fff700 1 -- 172.21.15.53:0/3510106374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc000b870 con 0x7f1fd00b2350 2023-07-09T21:52:46.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.190+0000 7f1fc7fff700 1 -- 172.21.15.53:0/3510106374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc000b9d0 con 0x7f1fd00b2350 2023-07-09T21:52:46.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.190+0000 7f1fc7fff700 1 -- 172.21.15.53:0/3510106374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc000bd60 con 0x7f1fd00b2350 2023-07-09T21:52:46.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.191+0000 7f1fd77ff700 1 -- 172.21.15.53:0/3510106374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd00b2350 msgr2=0x7f1fd00d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:46.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.191+0000 7f1fd77ff700 1 --2- 172.21.15.53:0/3510106374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd00b2350 0x7f1fd00d0b10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00b3280 tx=0x7f1fc0009bd0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.191+0000 7f1fd77ff700 1 -- 172.21.15.53:0/3510106374 shutdown_connections 2023-07-09T21:52:46.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.191+0000 7f1fd77ff700 1 --2- 172.21.15.53:0/3510106374 >> v2:172.21.15.184:3300/0 conn(0x7f1fd00d1050 0x7f1fd00afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.191+0000 7f1fd77ff700 1 --2- 172.21.15.53:0/3510106374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd00b1e00 0x7f1fd00b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.191+0000 7f1fd77ff700 1 --2- 172.21.15.53:0/3510106374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd00b2350 0x7f1fd00d0b10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.191+0000 7f1fd77ff700 1 -- 172.21.15.53:0/3510106374 >> 172.21.15.53:0/3510106374 conn(0x7f1fd009c1d0 msgr2=0x7f1fd00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:46.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.191+0000 7f1fd77ff700 1 -- 172.21.15.53:0/3510106374 shutdown_connections 2023-07-09T21:52:46.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.191+0000 7f1fd77ff700 1 -- 172.21.15.53:0/3510106374 wait complete. 2023-07-09T21:52:46.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.193+0000 7f1fd77ff700 1 Processor -- start 2023-07-09T21:52:46.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.193+0000 7f1fd77ff700 1 -- start start 2023-07-09T21:52:46.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.194+0000 7f1fd77ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fd00b1e00 0x7f1fd0157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:46.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.194+0000 7f1fd77ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd00b2350 0x7f1fd0150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:46.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.194+0000 7f1fd77ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd00d1050 0x7f1fd00ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:46.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.194+0000 7f1fd77ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00cec60 con 0x7f1fd00b2350 2023-07-09T21:52:46.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.194+0000 7f1fd77ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00cef40 con 0x7f1fd00b1e00 2023-07-09T21:52:46.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.194+0000 7f1fd77ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00cf220 con 0x7f1fd00d1050 2023-07-09T21:52:46.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.194+0000 7f1fd4d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd00b2350 0x7f1fd0150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:46.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.194+0000 7f1fd4d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd00b2350 0x7f1fd0150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48272/0 (socket says 172.21.15.53:48272) 2023-07-09T21:52:46.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.194+0000 7f1fd4d9a700 1 -- 172.21.15.53:0/804341400 learned_addr learned my addr 172.21.15.53:0/804341400 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:46.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.194+0000 7f1fd559b700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fd00b1e00 0x7f1fd0157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:46.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.194+0000 7f1fd5d9c700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd00d1050 0x7f1fd00ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:46.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.194+0000 7f1fd4d9a700 1 -- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd00d1050 msgr2=0x7f1fd00ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:46.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.194+0000 7f1fd4d9a700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd00d1050 0x7f1fd00ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.195+0000 7f1fd4d9a700 1 -- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fd00b1e00 msgr2=0x7f1fd0157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:46.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.195+0000 7f1fd4d9a700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fd00b1e00 0x7f1fd0157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.195+0000 7f1fd4d9a700 1 -- 172.21.15.53:0/804341400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0009550 con 0x7f1fd00b2350 2023-07-09T21:52:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.195+0000 7f1fd559b700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fd00b1e00 0x7f1fd0157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.195+0000 7f1fd5d9c700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd00d1050 0x7f1fd00ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.195+0000 7f1fd4d9a700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd00b2350 0x7f1fd0150b40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0014040 tx=0x7f1fc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.195+0000 7f1fc5ffb700 1 -- 172.21.15.53:0/804341400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0004500 con 0x7f1fd00b2350 2023-07-09T21:52:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.195+0000 7f1fc5ffb700 1 -- 172.21.15.53:0/804341400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc00036a0 con 0x7f1fd00b2350 2023-07-09T21:52:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.195+0000 7f1fd77ff700 1 -- 172.21.15.53:0/804341400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd00cf500 con 0x7f1fd00b2350 2023-07-09T21:52:46.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.195+0000 7f1fc5ffb700 1 -- 172.21.15.53:0/804341400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0003a30 con 0x7f1fd00b2350 2023-07-09T21:52:46.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.195+0000 7f1fd77ff700 1 -- 172.21.15.53:0/804341400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd0151080 con 0x7f1fd00b2350 2023-07-09T21:52:46.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.196+0000 7f1fbb7fe700 1 -- 172.21.15.53:0/804341400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa80052f0 con 0x7f1fd00b2350 2023-07-09T21:52:46.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.197+0000 7f1fc5ffb700 1 -- 172.21.15.53:0/804341400 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f1fc0003b90 con 0x7f1fd00b2350 2023-07-09T21:52:46.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.198+0000 7f1fc5ffb700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1fb406ae00 0x7f1fb406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:46.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.198+0000 7f1fc5ffb700 1 -- 172.21.15.53:0/804341400 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f1fc008abf0 con 0x7f1fd00b2350 2023-07-09T21:52:46.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.199+0000 7f1fd559b700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1fb406ae00 0x7f1fb406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:46.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.199+0000 7f1fd559b700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1fb406ae00 0x7f1fb406d2b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc008890 tx=0x7f1fcc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:46.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.203+0000 7f1fc5ffb700 1 -- 172.21.15.53:0/804341400 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1fc0055be0 con 0x7f1fd00b2350 2023-07-09T21:52:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.457+0000 7f1fbb7fe700 1 -- 172.21.15.53:0/804341400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fa80055a0 con 0x7f1fd00b2350 2023-07-09T21:52:46.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.457+0000 7f1fc5ffb700 1 -- 172.21.15.53:0/804341400 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f1fc0015090 con 0x7f1fd00b2350 2023-07-09T21:52:46.459 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:46.459 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2286885595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2286885595},{"type":"v1","addr":"172.21.15.184:6837","nonce":2286885595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2019231045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2019231045},{"type":"v1","addr":"172.21.15.53:6834","nonce":2019231045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/1440999283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1440999283},{"type":"v1","addr":"172.21.15.184:6836","nonce":1440999283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:52:18.405674+0000","modified":"2023-07-09T21:52:21.909106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3167613257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3167613257},{"type":"v1","addr":"172.21.15.53:6835","nonce":3167613257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T21:52:46.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.459+0000 7f1fbb7fe700 1 -- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1fb406ae00 msgr2=0x7f1fb406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:46.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.459+0000 7f1fbb7fe700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1fb406ae00 0x7f1fb406d2b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc008890 tx=0x7f1fcc008040 comp rx=0 tx=0).stop 2023-07-09T21:52:46.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.459+0000 7f1fbb7fe700 1 -- 172.21.15.53:0/804341400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd00b2350 msgr2=0x7f1fd0150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:46.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.459+0000 7f1fbb7fe700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd00b2350 0x7f1fd0150b40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0014040 tx=0x7f1fc0004750 comp rx=0 tx=0).stop 2023-07-09T21:52:46.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.460+0000 7f1fbb7fe700 1 -- 172.21.15.53:0/804341400 shutdown_connections 2023-07-09T21:52:46.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.460+0000 7f1fbb7fe700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1fb406ae00 0x7f1fb406d2b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.460+0000 7f1fbb7fe700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd00d1050 0x7f1fd00ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.460+0000 7f1fbb7fe700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fd00b1e00 0x7f1fd0157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.460+0000 7f1fbb7fe700 1 --2- 172.21.15.53:0/804341400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd00b2350 0x7f1fd0150b40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.460+0000 7f1fbb7fe700 1 -- 172.21.15.53:0/804341400 >> 172.21.15.53:0/804341400 conn(0x7f1fd009c1d0 msgr2=0x7f1fd00b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:46.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.460+0000 7f1fbb7fe700 1 -- 172.21.15.53:0/804341400 shutdown_connections 2023-07-09T21:52:46.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.460+0000 7f1fbb7fe700 1 -- 172.21.15.53:0/804341400 wait complete. 2023-07-09T21:52:46.464 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2023-07-09T21:52:46.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:52:46.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.678+0000 7f45379ff700 1 Processor -- start 2023-07-09T21:52:46.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.678+0000 7f45379ff700 1 -- start start 2023-07-09T21:52:46.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f45379ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45300b4510 0x7f45300b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:46.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f45379ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45300d1220 0x7f45300b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:46.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f45379ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45300b7f50 con 0x7f45300cd590 2023-07-09T21:52:46.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f45379ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45300b48e0 con 0x7f45300d1220 2023-07-09T21:52:46.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f45379ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45300b7340 con 0x7f45300b4510 2023-07-09T21:52:46.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f4535f9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45300d1220 0x7f45300b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:46.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f4535f9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45300d1220 0x7f45300b83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48280/0 (socket says 172.21.15.53:48280) 2023-07-09T21:52:46.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f4535f9c700 1 -- 172.21.15.53:0/1083447507 learned_addr learned my addr 172.21.15.53:0/1083447507 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:46.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f453579b700 1 --2- 172.21.15.53:0/1083447507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45300b4510 0x7f45300b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:46.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f4535f9c700 1 -- 172.21.15.53:0/1083447507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45300b4510 msgr2=0x7f45300b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:46.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f4535f9c700 1 --2- 172.21.15.53:0/1083447507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45300b4510 0x7f45300b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f4535f9c700 1 -- 172.21.15.53:0/1083447507 >> v1:172.21.15.184:6789/0 conn(0x7f45300cd590 legacy=0x7f45300d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:46.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f4535f9c700 1 -- 172.21.15.53:0/1083447507 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45300b7620 con 0x7f45300d1220 2023-07-09T21:52:46.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.680+0000 7f453579b700 1 --2- 172.21.15.53:0/1083447507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45300b4510 0x7f45300b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:46.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.681+0000 7f4535f9c700 1 --2- 172.21.15.53:0/1083447507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45300d1220 0x7f45300b83e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4528009e50 tx=0x7f452800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9399698fab5f54ec server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:46.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.681+0000 7f4527fff700 1 -- 172.21.15.53:0/1083447507 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452800e070 con 0x7f45300d1220 2023-07-09T21:52:46.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.681+0000 7f4527fff700 1 -- 172.21.15.53:0/1083447507 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452800b9c0 con 0x7f45300d1220 2023-07-09T21:52:46.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.681+0000 7f4527fff700 1 -- 172.21.15.53:0/1083447507 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452800bd70 con 0x7f45300d1220 2023-07-09T21:52:46.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.681+0000 7f45379ff700 1 -- 172.21.15.53:0/1083447507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45300d1220 msgr2=0x7f45300b83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:46.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.681+0000 7f45379ff700 1 --2- 172.21.15.53:0/1083447507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45300d1220 0x7f45300b83e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4528009e50 tx=0x7f452800b330 comp rx=0 tx=0).stop 2023-07-09T21:52:46.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.682+0000 7f45379ff700 1 -- 172.21.15.53:0/1083447507 shutdown_connections 2023-07-09T21:52:46.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.682+0000 7f45379ff700 1 --2- 172.21.15.53:0/1083447507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45300d1220 0x7f45300b83e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.682+0000 7f45379ff700 1 --2- 172.21.15.53:0/1083447507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45300b4510 0x7f45300b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.682+0000 7f45379ff700 1 -- 172.21.15.53:0/1083447507 >> 172.21.15.53:0/1083447507 conn(0x7f453009c1d0 msgr2=0x7f45300d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:46.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.682+0000 7f45379ff700 1 -- 172.21.15.53:0/1083447507 shutdown_connections 2023-07-09T21:52:46.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.682+0000 7f45379ff700 1 -- 172.21.15.53:0/1083447507 wait complete. 2023-07-09T21:52:46.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.684+0000 7f45379ff700 1 Processor -- start 2023-07-09T21:52:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.684+0000 7f45379ff700 1 -- start start 2023-07-09T21:52:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f45379ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45300b4510 0x7f45301492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f45379ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45300cd590 0x7f45301f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f45379ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45300d1220 0x7f453015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f45379ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45301497f0 con 0x7f45300d1220 2023-07-09T21:52:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f45379ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453015e410 con 0x7f45300cd590 2023-07-09T21:52:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f45379ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453015d800 con 0x7f45300b4510 2023-07-09T21:52:46.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f4535f9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45300d1220 0x7f453015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:46.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f4535f9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45300d1220 0x7f453015cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48288/0 (socket says 172.21.15.53:48288) 2023-07-09T21:52:46.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f4535f9c700 1 -- 172.21.15.53:0/160005968 learned_addr learned my addr 172.21.15.53:0/160005968 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:46.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f453579b700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45300b4510 0x7f45301492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:46.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f4534f9a700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45300cd590 0x7f45301f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:46.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f4535f9c700 1 -- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45300b4510 msgr2=0x7f45301492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:46.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f4535f9c700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45300b4510 0x7f45301492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f4535f9c700 1 -- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45300cd590 msgr2=0x7f45301f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:46.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f4535f9c700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45300cd590 0x7f45301f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.686+0000 7f4535f9c700 1 -- 172.21.15.53:0/160005968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4528009b30 con 0x7f45300d1220 2023-07-09T21:52:46.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.687+0000 7f4535f9c700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45300d1220 0x7f453015cdb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4530067360 tx=0x7f4528004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:46.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.687+0000 7f4525ffb700 1 -- 172.21.15.53:0/160005968 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528004800 con 0x7f45300d1220 2023-07-09T21:52:46.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.687+0000 7f4525ffb700 1 -- 172.21.15.53:0/160005968 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4528004960 con 0x7f45300d1220 2023-07-09T21:52:46.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.687+0000 7f4525ffb700 1 -- 172.21.15.53:0/160005968 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452801c680 con 0x7f45300d1220 2023-07-09T21:52:46.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.687+0000 7f45379ff700 1 -- 172.21.15.53:0/160005968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453015dae0 con 0x7f45300d1220 2023-07-09T21:52:46.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.687+0000 7f45379ff700 1 -- 172.21.15.53:0/160005968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453015e0a0 con 0x7f45300d1220 2023-07-09T21:52:46.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.688+0000 7f45379ff700 1 -- 172.21.15.53:0/160005968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453004e280 con 0x7f45300d1220 2023-07-09T21:52:46.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.689+0000 7f4525ffb700 1 -- 172.21.15.53:0/160005968 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f452801c7e0 con 0x7f45300d1220 2023-07-09T21:52:46.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.690+0000 7f4525ffb700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f451406ae00 0x7f451406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:46.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.690+0000 7f4525ffb700 1 -- 172.21.15.53:0/160005968 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f452808b330 con 0x7f45300d1220 2023-07-09T21:52:46.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.690+0000 7f453579b700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f451406ae00 0x7f451406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:46.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.691+0000 7f453579b700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f451406ae00 0x7f451406d2b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f452c00c960 tx=0x7f452c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:46.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.694+0000 7f4525ffb700 1 -- 172.21.15.53:0/160005968 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4528056170 con 0x7f45300d1220 2023-07-09T21:52:46.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.904+0000 7f45379ff700 1 -- 172.21.15.53:0/160005968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f453015e550 con 0x7f45300d1220 2023-07-09T21:52:46.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.906+0000 7f4525ffb700 1 -- 172.21.15.53:0/160005968 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18435 (secure 0 0 0) 0x7f4528059790 con 0x7f45300d1220 2023-07-09T21:52:46.907 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:46.907 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":52,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:52:43.613556+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:52:16.672667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:52:17.375922+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":52,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:52:46.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.908+0000 7f45379ff700 1 -- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f451406ae00 msgr2=0x7f451406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:46.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.908+0000 7f45379ff700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f451406ae00 0x7f451406d2b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f452c00c960 tx=0x7f452c008040 comp rx=0 tx=0).stop 2023-07-09T21:52:46.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.908+0000 7f45379ff700 1 -- 172.21.15.53:0/160005968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45300d1220 msgr2=0x7f453015cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:46.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.908+0000 7f45379ff700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45300d1220 0x7f453015cdb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4530067360 tx=0x7f4528004ad0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.908+0000 7f45379ff700 1 -- 172.21.15.53:0/160005968 shutdown_connections 2023-07-09T21:52:46.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.908+0000 7f45379ff700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f451406ae00 0x7f451406d2b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.908+0000 7f45379ff700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45300d1220 0x7f453015cdb0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.908+0000 7f45379ff700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45300b4510 0x7f45301492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.908+0000 7f45379ff700 1 --2- 172.21.15.53:0/160005968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45300cd590 0x7f45301f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:46.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.908+0000 7f45379ff700 1 -- 172.21.15.53:0/160005968 >> 172.21.15.53:0/160005968 conn(0x7f453009c1d0 msgr2=0x7f45300ce010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:46.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.908+0000 7f45379ff700 1 -- 172.21.15.53:0/160005968 shutdown_connections 2023-07-09T21:52:46.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:46.908+0000 7f45379ff700 1 -- 172.21.15.53:0/160005968 wait complete. 2023-07-09T21:52:46.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:50:08.910389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:50:15.789288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:52:16.672667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:52:17.375922+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 52, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:52:46.929 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:52:47.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.131+0000 7fcd23bff700 1 Processor -- start 2023-07-09T21:52:47.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.131+0000 7fcd23bff700 1 -- start start 2023-07-09T21:52:47.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.132+0000 7fcd23bff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcd1c0b3ff0 0x7fcd1c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.132+0000 7fcd23bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcd1c0d0f90 0x7fcd1c0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.132+0000 7fcd23bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c0b8e80 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.132+0000 7fcd23bff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c0b1e30 con 0x7fcd1c0b3ff0 2023-07-09T21:52:47.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.132+0000 7fcd23bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c0afaa0 con 0x7fcd1c0d0f90 2023-07-09T21:52:47.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.132+0000 7fcd2199b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcd1c0b3ff0 0x7fcd1c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.132+0000 7fcd2199b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcd1c0b3ff0 0x7fcd1c0b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48300/0 (socket says 172.21.15.53:48300) 2023-07-09T21:52:47.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.132+0000 7fcd2199b700 1 -- 172.21.15.53:0/1277896170 learned_addr learned my addr 172.21.15.53:0/1277896170 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:47.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.133+0000 7fcd2219c700 1 --2- 172.21.15.53:0/1277896170 >> v2:172.21.15.184:3300/0 conn(0x7fcd1c0d0f90 0x7fcd1c0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.133+0000 7fcd2199b700 1 -- 172.21.15.53:0/1277896170 >> v2:172.21.15.184:3300/0 conn(0x7fcd1c0d0f90 msgr2=0x7fcd1c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:47.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.133+0000 7fcd2199b700 1 --2- 172.21.15.53:0/1277896170 >> v2:172.21.15.184:3300/0 conn(0x7fcd1c0d0f90 0x7fcd1c0b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.133+0000 7fcd2199b700 1 -- 172.21.15.53:0/1277896170 >> v1:172.21.15.184:6789/0 conn(0x7fcd1c0d0b10 legacy=0x7fcd1c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:47.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.133+0000 7fcd2199b700 1 -- 172.21.15.53:0/1277896170 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c0afd80 con 0x7fcd1c0b3ff0 2023-07-09T21:52:47.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.133+0000 7fcd2199b700 1 --2- 172.21.15.53:0/1277896170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd1c0b3ff0 0x7fcd1c0b43c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0674e0 tx=0x7fcd18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cce56a9a9feccd0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:47.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.133+0000 7fcd20999700 1 -- 172.21.15.53:0/1277896170 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1800b870 con 0x7fcd1c0b3ff0 2023-07-09T21:52:47.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.133+0000 7fcd20999700 1 -- 172.21.15.53:0/1277896170 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1800b9d0 con 0x7fcd1c0b3ff0 2023-07-09T21:52:47.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.133+0000 7fcd20999700 1 -- 172.21.15.53:0/1277896170 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1800bd60 con 0x7fcd1c0b3ff0 2023-07-09T21:52:47.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.134+0000 7fcd23bff700 1 -- 172.21.15.53:0/1277896170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd1c0b3ff0 msgr2=0x7fcd1c0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:47.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.134+0000 7fcd23bff700 1 --2- 172.21.15.53:0/1277896170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd1c0b3ff0 0x7fcd1c0b43c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0674e0 tx=0x7fcd18009bd0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.134+0000 7fcd23bff700 1 -- 172.21.15.53:0/1277896170 shutdown_connections 2023-07-09T21:52:47.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.134+0000 7fcd23bff700 1 --2- 172.21.15.53:0/1277896170 >> v2:172.21.15.184:3300/0 conn(0x7fcd1c0d0f90 0x7fcd1c0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.134+0000 7fcd23bff700 1 --2- 172.21.15.53:0/1277896170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd1c0b3ff0 0x7fcd1c0b43c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.134+0000 7fcd23bff700 1 -- 172.21.15.53:0/1277896170 >> 172.21.15.53:0/1277896170 conn(0x7fcd1c09c1b0 msgr2=0x7fcd1c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:47.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.134+0000 7fcd23bff700 1 -- 172.21.15.53:0/1277896170 shutdown_connections 2023-07-09T21:52:47.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.134+0000 7fcd23bff700 1 -- 172.21.15.53:0/1277896170 wait complete. 2023-07-09T21:52:47.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.136+0000 7fcd23bff700 1 Processor -- start 2023-07-09T21:52:47.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.136+0000 7fcd23bff700 1 -- start start 2023-07-09T21:52:47.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd23bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd1c0b3ff0 0x7fcd1c15b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd23bff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd1c0d0b10 0x7fcd1c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd23bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd1c0d0f90 0x7fcd1c156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd23bff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1f2150 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd23bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c15df70 con 0x7fcd1c0d0f90 2023-07-09T21:52:47.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd23bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1f3100 con 0x7fcd1c0b3ff0 2023-07-09T21:52:47.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd2119a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd1c0d0b10 0x7fcd1c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd2119a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd1c0d0b10 0x7fcd1c0ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48314/0 (socket says 172.21.15.53:48314) 2023-07-09T21:52:47.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd2119a700 1 -- 172.21.15.53:0/2142830025 learned_addr learned my addr 172.21.15.53:0/2142830025 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:47.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd2199b700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd1c0b3ff0 0x7fcd1c15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd2219c700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd1c0d0f90 0x7fcd1c156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd2119a700 1 -- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd1c0b3ff0 msgr2=0x7fcd1c15b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:47.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd2119a700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd1c0b3ff0 0x7fcd1c15b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd2119a700 1 -- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd1c0d0f90 msgr2=0x7fcd1c156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:47.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd2119a700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd1c0d0f90 0x7fcd1c156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.137+0000 7fcd2119a700 1 -- 172.21.15.53:0/2142830025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18009550 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.138+0000 7fcd2119a700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd1c0d0b10 0x7fcd1c0ca9d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00c4e0 tx=0x7fcd0c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:47.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.138+0000 7fcd127fc700 1 -- 172.21.15.53:0/2142830025 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0052d0 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.138+0000 7fcd127fc700 1 -- 172.21.15.53:0/2142830025 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c005430 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.138+0000 7fcd127fc700 1 -- 172.21.15.53:0/2142830025 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0038c0 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.138+0000 7fcd23bff700 1 -- 172.21.15.53:0/2142830025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c0cb4d0 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.138+0000 7fcd23bff700 1 -- 172.21.15.53:0/2142830025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c1f2900 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.139+0000 7fcd23bff700 1 -- 172.21.15.53:0/2142830025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1c074350 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.140+0000 7fcd127fc700 1 -- 172.21.15.53:0/2142830025 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fcd0c003a20 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.141+0000 7fcd127fc700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcd0006ae00 0x7fcd0006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.141+0000 7fcd127fc700 1 -- 172.21.15.53:0/2142830025 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fcd0c0887c0 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.142+0000 7fcd2199b700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcd0006ae00 0x7fcd0006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.142+0000 7fcd2199b700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcd0006ae00 0x7fcd0006d2b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcd18000c00 tx=0x7fcd18008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.145+0000 7fcd127fc700 1 -- 172.21.15.53:0/2142830025 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcd0c053710 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.354+0000 7fcd23bff700 1 -- 172.21.15.53:0/2142830025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd1c0b8e80 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.354+0000 7fcd127fc700 1 -- 172.21.15.53:0/2142830025 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd1c0b8e80 con 0x7fcd1c0d0b10 2023-07-09T21:52:47.356 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-07-09T21:52:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.357+0000 7fcd23bff700 1 -- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcd0006ae00 msgr2=0x7fcd0006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.357+0000 7fcd23bff700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcd0006ae00 0x7fcd0006d2b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcd18000c00 tx=0x7fcd18008030 comp rx=0 tx=0).stop 2023-07-09T21:52:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.357+0000 7fcd23bff700 1 -- 172.21.15.53:0/2142830025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd1c0d0b10 msgr2=0x7fcd1c0ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.357+0000 7fcd23bff700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd1c0d0b10 0x7fcd1c0ca9d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00c4e0 tx=0x7fcd0c00c8a0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.357+0000 7fcd23bff700 1 -- 172.21.15.53:0/2142830025 shutdown_connections 2023-07-09T21:52:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.357+0000 7fcd23bff700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcd0006ae00 0x7fcd0006d2b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.357+0000 7fcd23bff700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd1c0d0f90 0x7fcd1c156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.357+0000 7fcd23bff700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd1c0b3ff0 0x7fcd1c15b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.357+0000 7fcd23bff700 1 --2- 172.21.15.53:0/2142830025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd1c0d0b10 0x7fcd1c0ca9d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.357+0000 7fcd23bff700 1 -- 172.21.15.53:0/2142830025 >> 172.21.15.53:0/2142830025 conn(0x7fcd1c09c1b0 msgr2=0x7fcd1c06b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.357+0000 7fcd23bff700 1 -- 172.21.15.53:0/2142830025 shutdown_connections 2023-07-09T21:52:47.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.357+0000 7fcd23bff700 1 -- 172.21.15.53:0/2142830025 wait complete. 2023-07-09T21:52:47.377 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:52:47.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.579+0000 7f204ddff700 1 Processor -- start 2023-07-09T21:52:47.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.579+0000 7f204ddff700 1 -- start start 2023-07-09T21:52:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.580+0000 7f204ddff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f20480d0430 0x7f20480b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.580+0000 7f204ddff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204815cd60 con 0x7f20480b6430 2023-07-09T21:52:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.580+0000 7f204ddff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20480cf340 con 0x7f20480b4600 2023-07-09T21:52:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.580+0000 7f204ddff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20480d1550 con 0x7f20480d0430 2023-07-09T21:52:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.580+0000 7f2047fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f20480b6430 0x7f20480b6840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38006/0 (socket says 172.21.15.53:38006) 2023-07-09T21:52:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.580+0000 7f2047fff700 1 -- 172.21.15.53:0/1756628312 learned_addr learned my addr 172.21.15.53:0/1756628312 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:47.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f2046ffd700 1 --2- 172.21.15.53:0/1756628312 >> v2:172.21.15.184:3300/0 conn(0x7f20480d0430 0x7f20480b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231229395 0 0) 0x7f204815cd60 con 0x7f20480b6430 2023-07-09T21:52:47.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20300035b0 con 0x7f20480b6430 2023-07-09T21:52:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2195992967 0 0) 0x7f20300035b0 con 0x7f20480b6430 2023-07-09T21:52:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 >> v2:172.21.15.184:3300/0 conn(0x7f20480d0430 msgr2=0x7f20480b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 --2- 172.21.15.53:0/1756628312 >> v2:172.21.15.184:3300/0 conn(0x7f20480d0430 0x7f20480b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 >> v1:172.21.15.184:6789/0 conn(0x7f20480b4600 legacy=0x7f20480cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480d0e90 con 0x7f20480b6430 2023-07-09T21:52:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7f20400019f0 con 0x7f20480b6430 2023-07-09T21:52:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 >> v1:172.21.15.53:6789/0 conn(0x7f20480b6430 legacy=0x7f20480b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 --2- 172.21.15.53:0/1756628312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2030003a50 0x7f2030003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 --2- 172.21.15.53:0/1756628312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2030004850 0x7f2030004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 --2- 172.21.15.53:0/1756628312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2030005250 0x7f203000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480d1550 con 0x7f2030004850 2023-07-09T21:52:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203000c160 con 0x7f2030005250 2023-07-09T21:52:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203000c320 con 0x7f2030003a50 2023-07-09T21:52:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.581+0000 7f2046ffd700 1 --2- 172.21.15.53:0/1756628312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2030004850 0x7f2030004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f20477fe700 1 --2- 172.21.15.53:0/1756628312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2030003a50 0x7f2030003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f2047fff700 1 --2- 172.21.15.53:0/1756628312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2030005250 0x7f203000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f2046ffd700 1 -- 172.21.15.53:0/1756628312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2030003a50 msgr2=0x7f2030003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:47.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f2046ffd700 1 --2- 172.21.15.53:0/1756628312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2030003a50 0x7f2030003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f2046ffd700 1 -- 172.21.15.53:0/1756628312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2030005250 msgr2=0x7f203000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:47.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f2046ffd700 1 --2- 172.21.15.53:0/1756628312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2030005250 0x7f203000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f2046ffd700 1 -- 172.21.15.53:0/1756628312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20300035b0 con 0x7f2030004850 2023-07-09T21:52:47.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f2047fff700 1 --2- 172.21.15.53:0/1756628312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2030005250 0x7f203000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:47.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f20477fe700 1 --2- 172.21.15.53:0/1756628312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2030003a50 0x7f2030003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:47.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f2047fff700 1 -- 172.21.15.53:0/1756628312 reap_dead start 2023-07-09T21:52:47.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f2046ffd700 1 --2- 172.21.15.53:0/1756628312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2030004850 0x7f2030004cc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f203c009b60 tx=0x7f2030005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d7803ef6ec9d73 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:47.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c00e6c0 con 0x7f2030004850 2023-07-09T21:52:47.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c00e820 con 0x7f2030004850 2023-07-09T21:52:47.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.582+0000 7f20467fc700 1 -- 172.21.15.53:0/1756628312 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c00eb90 con 0x7f2030004850 2023-07-09T21:52:47.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.583+0000 7f204ddff700 1 -- 172.21.15.53:0/1756628312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2030004850 msgr2=0x7f2030004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:47.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.583+0000 7f204ddff700 1 --2- 172.21.15.53:0/1756628312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2030004850 0x7f2030004cc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f203c009b60 tx=0x7f2030005880 comp rx=0 tx=0).stop 2023-07-09T21:52:47.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.583+0000 7f204ddff700 1 -- 172.21.15.53:0/1756628312 shutdown_connections 2023-07-09T21:52:47.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.583+0000 7f204ddff700 1 --2- 172.21.15.53:0/1756628312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2030004850 0x7f2030004cc0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.583+0000 7f204ddff700 1 -- 172.21.15.53:0/1756628312 >> 172.21.15.53:0/1756628312 conn(0x7f204809c200 msgr2=0x7f20480d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:47.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.583+0000 7f204ddff700 1 -- 172.21.15.53:0/1756628312 shutdown_connections 2023-07-09T21:52:47.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.583+0000 7f204ddff700 1 -- 172.21.15.53:0/1756628312 wait complete. 2023-07-09T21:52:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.586+0000 7f204ddff700 1 Processor -- start 2023-07-09T21:52:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.586+0000 7f204ddff700 1 -- start start 2023-07-09T21:52:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.587+0000 7f204ddff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2030004850 0x7f2048156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.587+0000 7f204ddff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f204815abb0 0x7f20480ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.587+0000 7f204ddff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2048159ef0 0x7f204815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.587+0000 7f204ddff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204815a8a0 con 0x7f2030004850 2023-07-09T21:52:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.587+0000 7f204ddff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480ca060 con 0x7f204815abb0 2023-07-09T21:52:47.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.587+0000 7f204ddff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20480ca340 con 0x7f2048159ef0 2023-07-09T21:52:47.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.587+0000 7f20477fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2030004850 0x7f2048156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.587+0000 7f20477fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2030004850 0x7f2048156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48328/0 (socket says 172.21.15.53:48328) 2023-07-09T21:52:47.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.587+0000 7f20477fe700 1 -- 172.21.15.53:0/712100257 learned_addr learned my addr 172.21.15.53:0/712100257 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:47.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f2046ffd700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f204815abb0 0x7f20480ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f2047fff700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2048159ef0 0x7f204815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f20477fe700 1 -- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2048159ef0 msgr2=0x7f204815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:47.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f20477fe700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2048159ef0 0x7f204815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f20477fe700 1 -- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f204815abb0 msgr2=0x7f20480ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:47.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f20477fe700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f204815abb0 0x7f20480ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f20477fe700 1 -- 172.21.15.53:0/712100257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480cc730 con 0x7f2030004850 2023-07-09T21:52:47.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f2046ffd700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f204815abb0 0x7f20480ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:47.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f2047fff700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2048159ef0 0x7f204815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:47.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f20477fe700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2030004850 0x7f2048156d50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2038000c00 tx=0x7f203800e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:47.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f202ffff700 1 -- 172.21.15.53:0/712100257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20380052e0 con 0x7f2030004850 2023-07-09T21:52:47.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f202ffff700 1 -- 172.21.15.53:0/712100257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2038005440 con 0x7f2030004850 2023-07-09T21:52:47.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f202ffff700 1 -- 172.21.15.53:0/712100257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20380038c0 con 0x7f2030004850 2023-07-09T21:52:47.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f204ddff700 1 -- 172.21.15.53:0/712100257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20480cca10 con 0x7f2030004850 2023-07-09T21:52:47.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.588+0000 7f204ddff700 1 -- 172.21.15.53:0/712100257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20480cd470 con 0x7f2030004850 2023-07-09T21:52:47.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.589+0000 7f204ddff700 1 -- 172.21.15.53:0/712100257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20480ccd80 con 0x7f2030004850 2023-07-09T21:52:47.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.591+0000 7f202ffff700 1 -- 172.21.15.53:0/712100257 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f2038003a20 con 0x7f2030004850 2023-07-09T21:52:47.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.591+0000 7f202ffff700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f203406ae00 0x7f203406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:47.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.591+0000 7f202ffff700 1 -- 172.21.15.53:0/712100257 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f2038088b70 con 0x7f2030004850 2023-07-09T21:52:47.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.592+0000 7f2046ffd700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f203406ae00 0x7f203406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:47.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.592+0000 7f2046ffd700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f203406ae00 0x7f203406d2b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f20480b7710 tx=0x7f203c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:47.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.596+0000 7f202ffff700 1 -- 172.21.15.53:0/712100257 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2038053c10 con 0x7f2030004850 2023-07-09T21:52:47.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.807+0000 7f204ddff700 1 -- 172.21.15.53:0/712100257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2048074350 con 0x7f2030004850 2023-07-09T21:52:47.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.807+0000 7f202ffff700 1 -- 172.21.15.53:0/712100257 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2038057230 con 0x7f2030004850 2023-07-09T21:52:47.809 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-07-09T21:52:47.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.810+0000 7f204ddff700 1 -- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f203406ae00 msgr2=0x7f203406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:47.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.810+0000 7f204ddff700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f203406ae00 0x7f203406d2b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f20480b7710 tx=0x7f203c008030 comp rx=0 tx=0).stop 2023-07-09T21:52:47.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.810+0000 7f204ddff700 1 -- 172.21.15.53:0/712100257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2030004850 msgr2=0x7f2048156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:47.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.810+0000 7f204ddff700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2030004850 0x7f2048156d50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2038000c00 tx=0x7f203800e7f0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.810+0000 7f204ddff700 1 -- 172.21.15.53:0/712100257 shutdown_connections 2023-07-09T21:52:47.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.810+0000 7f204ddff700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f203406ae00 0x7f203406d2b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.810+0000 7f204ddff700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2048159ef0 0x7f204815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.810+0000 7f204ddff700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2030004850 0x7f2048156d50 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.810+0000 7f204ddff700 1 --2- 172.21.15.53:0/712100257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f204815abb0 0x7f20480ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:47.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.810+0000 7f204ddff700 1 -- 172.21.15.53:0/712100257 >> 172.21.15.53:0/712100257 conn(0x7f204809c200 msgr2=0x7f20480d2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:47.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.810+0000 7f204ddff700 1 -- 172.21.15.53:0/712100257 shutdown_connections 2023-07-09T21:52:47.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:47.810+0000 7f204ddff700 1 -- 172.21.15.53:0/712100257 wait complete. 2023-07-09T21:52:47.829 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:52:48.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.031+0000 7fb3899ff700 1 Processor -- start 2023-07-09T21:52:48.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.031+0000 7fb3899ff700 1 -- start start 2023-07-09T21:52:48.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.033+0000 7fb3899ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3840cf2a0 0x7fb38415c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.033+0000 7fb3899ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3840b49d0 0x7fb3840b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.033+0000 7fb3899ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3840d2260 con 0x7fb3840c6aa0 2023-07-09T21:52:48.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.033+0000 7fb3899ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb384146740 con 0x7fb3840b49d0 2023-07-09T21:52:48.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.033+0000 7fb3899ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840cd5a0 con 0x7fb3840cf2a0 2023-07-09T21:52:48.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.033+0000 7fb3837fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3840b49d0 0x7fb3840b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.033+0000 7fb3837fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3840b49d0 0x7fb3840b4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48338/0 (socket says 172.21.15.53:48338) 2023-07-09T21:52:48.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.033+0000 7fb3837fe700 1 -- 172.21.15.53:0/3528961993 learned_addr learned my addr 172.21.15.53:0/3528961993 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:48.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.033+0000 7fb382ffd700 1 --2- 172.21.15.53:0/3528961993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3840cf2a0 0x7fb38415c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.033+0000 7fb3837fe700 1 -- 172.21.15.53:0/3528961993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3840cf2a0 msgr2=0x7fb38415c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:48.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.033+0000 7fb3837fe700 1 --2- 172.21.15.53:0/3528961993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3840cf2a0 0x7fb38415c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.033+0000 7fb3837fe700 1 -- 172.21.15.53:0/3528961993 >> v1:172.21.15.184:6789/0 conn(0x7fb3840c6aa0 legacy=0x7fb3840c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.033+0000 7fb3837fe700 1 -- 172.21.15.53:0/3528961993 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3840cd7f0 con 0x7fb3840b49d0 2023-07-09T21:52:48.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.034+0000 7fb3837fe700 1 --2- 172.21.15.53:0/3528961993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3840b49d0 0x7fb3840b4e50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009e50 tx=0x7fb37c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce5b93d68326392 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:48.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.034+0000 7fb381ffb700 1 -- 172.21.15.53:0/3528961993 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c00e070 con 0x7fb3840b49d0 2023-07-09T21:52:48.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.034+0000 7fb381ffb700 1 -- 172.21.15.53:0/3528961993 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c00b9c0 con 0x7fb3840b49d0 2023-07-09T21:52:48.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.034+0000 7fb381ffb700 1 -- 172.21.15.53:0/3528961993 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c00bd70 con 0x7fb3840b49d0 2023-07-09T21:52:48.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.034+0000 7fb3899ff700 1 -- 172.21.15.53:0/3528961993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3840b49d0 msgr2=0x7fb3840b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.034+0000 7fb3899ff700 1 --2- 172.21.15.53:0/3528961993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3840b49d0 0x7fb3840b4e50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009e50 tx=0x7fb37c00b330 comp rx=0 tx=0).stop 2023-07-09T21:52:48.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.034+0000 7fb3899ff700 1 -- 172.21.15.53:0/3528961993 shutdown_connections 2023-07-09T21:52:48.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.034+0000 7fb3899ff700 1 --2- 172.21.15.53:0/3528961993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3840b49d0 0x7fb3840b4e50 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.034+0000 7fb3899ff700 1 --2- 172.21.15.53:0/3528961993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3840cf2a0 0x7fb38415c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.035+0000 7fb3899ff700 1 -- 172.21.15.53:0/3528961993 >> 172.21.15.53:0/3528961993 conn(0x7fb384065bd0 msgr2=0x7fb384065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.035+0000 7fb3899ff700 1 -- 172.21.15.53:0/3528961993 shutdown_connections 2023-07-09T21:52:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.035+0000 7fb3899ff700 1 -- 172.21.15.53:0/3528961993 wait complete. 2023-07-09T21:52:48.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.036+0000 7fb3899ff700 1 Processor -- start 2023-07-09T21:52:48.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.036+0000 7fb3899ff700 1 -- start start 2023-07-09T21:52:48.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.037+0000 7fb3899ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3840b49d0 0x7fb3840cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.037+0000 7fb3899ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3840c6aa0 0x7fb3840ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.037+0000 7fb3899ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3840cf2a0 0x7fb38415b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.037+0000 7fb3899ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840cc6d0 con 0x7fb3840b49d0 2023-07-09T21:52:48.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.037+0000 7fb3899ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3841f31a0 con 0x7fb3840cf2a0 2023-07-09T21:52:48.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.037+0000 7fb3899ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3841f2620 con 0x7fb3840c6aa0 2023-07-09T21:52:48.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.038+0000 7fb382ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3840b49d0 0x7fb3840cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.038+0000 7fb382ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3840b49d0 0x7fb3840cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48342/0 (socket says 172.21.15.53:48342) 2023-07-09T21:52:48.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.038+0000 7fb382ffd700 1 -- 172.21.15.53:0/480136442 learned_addr learned my addr 172.21.15.53:0/480136442 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:48.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.038+0000 7fb3837fe700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3840cf2a0 0x7fb38415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.038+0000 7fb3827fc700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3840c6aa0 0x7fb3840ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.038+0000 7fb382ffd700 1 -- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3840c6aa0 msgr2=0x7fb3840ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.038+0000 7fb382ffd700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3840c6aa0 0x7fb3840ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.038+0000 7fb382ffd700 1 -- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3840cf2a0 msgr2=0x7fb38415b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.038+0000 7fb382ffd700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3840cf2a0 0x7fb38415b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.038+0000 7fb382ffd700 1 -- 172.21.15.53:0/480136442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c009b30 con 0x7fb3840b49d0 2023-07-09T21:52:48.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.038+0000 7fb382ffd700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3840b49d0 0x7fb3840cc9b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb37400d800 tx=0x7fb37400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:48.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.039+0000 7fb36bfff700 1 -- 172.21.15.53:0/480136442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3740125f0 con 0x7fb3840b49d0 2023-07-09T21:52:48.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.039+0000 7fb36bfff700 1 -- 172.21.15.53:0/480136442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb374012750 con 0x7fb3840b49d0 2023-07-09T21:52:48.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.039+0000 7fb36bfff700 1 -- 172.21.15.53:0/480136442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb374012b00 con 0x7fb3840b49d0 2023-07-09T21:52:48.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.039+0000 7fb3899ff700 1 -- 172.21.15.53:0/480136442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3841f2900 con 0x7fb3840b49d0 2023-07-09T21:52:48.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.039+0000 7fb3899ff700 1 -- 172.21.15.53:0/480136442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3841f2ec0 con 0x7fb3840b49d0 2023-07-09T21:52:48.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.040+0000 7fb3899ff700 1 -- 172.21.15.53:0/480136442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb384074350 con 0x7fb3840b49d0 2023-07-09T21:52:48.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.041+0000 7fb36bfff700 1 -- 172.21.15.53:0/480136442 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fb374012c60 con 0x7fb3840b49d0 2023-07-09T21:52:48.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.042+0000 7fb36bfff700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb37006ae00 0x7fb37006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.042+0000 7fb36bfff700 1 -- 172.21.15.53:0/480136442 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fb3740899e0 con 0x7fb3840b49d0 2023-07-09T21:52:48.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.042+0000 7fb3827fc700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb37006ae00 0x7fb37006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.043+0000 7fb3827fc700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb37006ae00 0x7fb37006d2b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb378000f60 tx=0x7fb378009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:48.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.046+0000 7fb36bfff700 1 -- 172.21.15.53:0/480136442 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb3740548a0 con 0x7fb3840b49d0 2023-07-09T21:52:48.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.254+0000 7fb3899ff700 1 -- 172.21.15.53:0/480136442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb3840d3df0 con 0x7fb3840b49d0 2023-07-09T21:52:48.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.255+0000 7fb36bfff700 1 -- 172.21.15.53:0/480136442 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb374057ec0 con 0x7fb3840b49d0 2023-07-09T21:52:48.256 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-07-09T21:52:48.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.257+0000 7fb3899ff700 1 -- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb37006ae00 msgr2=0x7fb37006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.257+0000 7fb3899ff700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb37006ae00 0x7fb37006d2b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb378000f60 tx=0x7fb378009040 comp rx=0 tx=0).stop 2023-07-09T21:52:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.257+0000 7fb3899ff700 1 -- 172.21.15.53:0/480136442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3840b49d0 msgr2=0x7fb3840cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.257+0000 7fb3899ff700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3840b49d0 0x7fb3840cc9b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb37400d800 tx=0x7fb37400db10 comp rx=0 tx=0).stop 2023-07-09T21:52:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.257+0000 7fb3899ff700 1 -- 172.21.15.53:0/480136442 shutdown_connections 2023-07-09T21:52:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.257+0000 7fb3899ff700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb37006ae00 0x7fb37006d2b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.257+0000 7fb3899ff700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3840cf2a0 0x7fb38415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.257+0000 7fb3899ff700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3840b49d0 0x7fb3840cc9b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.257+0000 7fb3899ff700 1 --2- 172.21.15.53:0/480136442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3840c6aa0 0x7fb3840ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.257+0000 7fb3899ff700 1 -- 172.21.15.53:0/480136442 >> 172.21.15.53:0/480136442 conn(0x7fb384065bd0 msgr2=0x7fb3840d23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.257+0000 7fb3899ff700 1 -- 172.21.15.53:0/480136442 shutdown_connections 2023-07-09T21:52:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.257+0000 7fb3899ff700 1 -- 172.21.15.53:0/480136442 wait complete. 2023-07-09T21:52:48.277 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:52:48.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.478+0000 7fdc8f9ff700 1 Processor -- start 2023-07-09T21:52:48.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.479+0000 7fdc8f9ff700 1 -- start start 2023-07-09T21:52:48.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.480+0000 7fdc8f9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880b3ff0 0x7fdc880b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.480+0000 7fdc8f9ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc880b8e80 con 0x7fdc880d0f60 2023-07-09T21:52:48.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.480+0000 7fdc8f9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc880b33f0 con 0x7fdc880d0b10 2023-07-09T21:52:48.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.480+0000 7fdc8f9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880b1e30 con 0x7fdc880b3ff0 2023-07-09T21:52:48.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.480+0000 7fdc8df9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdc880d0f60 0x7fdc880b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38018/0 (socket says 172.21.15.53:38018) 2023-07-09T21:52:48.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.480+0000 7fdc8df9c700 1 -- 172.21.15.53:0/1255074297 learned_addr learned my addr 172.21.15.53:0/1255074297 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:48.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.480+0000 7fdc8d79b700 1 --2- 172.21.15.53:0/1255074297 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880b3ff0 0x7fdc880b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.480+0000 7fdc7ffff700 1 -- 172.21.15.53:0/1255074297 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77973552 0 0) 0x7fdc80001490 con 0x7fdc880d0f60 2023-07-09T21:52:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.481+0000 7fdc7ffff700 1 -- 172.21.15.53:0/1255074297 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc740035b0 con 0x7fdc880d0f60 2023-07-09T21:52:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.481+0000 7fdc7ffff700 1 -- 172.21.15.53:0/1255074297 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399342041 0 0) 0x7fdc880b33f0 con 0x7fdc880d0b10 2023-07-09T21:52:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.481+0000 7fdc7ffff700 1 -- 172.21.15.53:0/1255074297 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc80001490 con 0x7fdc880d0b10 2023-07-09T21:52:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.481+0000 7fdc7ffff700 1 -- 172.21.15.53:0/1255074297 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3011200858 0 0) 0x7fdc740035b0 con 0x7fdc880d0f60 2023-07-09T21:52:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.481+0000 7fdc8d79b700 1 -- 172.21.15.53:0/1255074297 >> v1:172.21.15.184:6789/0 conn(0x7fdc880d0b10 legacy=0x7fdc880b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.481+0000 7fdc8d79b700 1 -- 172.21.15.53:0/1255074297 >> v1:172.21.15.53:6789/0 conn(0x7fdc880d0f60 legacy=0x7fdc880b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.481+0000 7fdc8d79b700 1 -- 172.21.15.53:0/1255074297 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc880afaa0 con 0x7fdc880b3ff0 2023-07-09T21:52:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.481+0000 7fdc8d79b700 1 --2- 172.21.15.53:0/1255074297 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880b3ff0 0x7fdc880b43c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009870 tx=0x7fdc84009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9be2130a3f1a4bfa server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.482+0000 7fdc7ffff700 1 -- 172.21.15.53:0/1255074297 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80001b80 con 0x7fdc880b3ff0 2023-07-09T21:52:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.482+0000 7fdc7ffff700 1 -- 172.21.15.53:0/1255074297 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc84004030 con 0x7fdc880b3ff0 2023-07-09T21:52:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.482+0000 7fdc7ffff700 1 -- 172.21.15.53:0/1255074297 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc840043a0 con 0x7fdc880b3ff0 2023-07-09T21:52:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.482+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1255074297 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880b3ff0 msgr2=0x7fdc880b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.482+0000 7fdc8f9ff700 1 --2- 172.21.15.53:0/1255074297 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880b3ff0 0x7fdc880b43c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009870 tx=0x7fdc84009b80 comp rx=0 tx=0).stop 2023-07-09T21:52:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.482+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1255074297 shutdown_connections 2023-07-09T21:52:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.482+0000 7fdc8f9ff700 1 --2- 172.21.15.53:0/1255074297 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880b3ff0 0x7fdc880b43c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.482+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1255074297 >> 172.21.15.53:0/1255074297 conn(0x7fdc8809c1b0 msgr2=0x7fdc880d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.482+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1255074297 shutdown_connections 2023-07-09T21:52:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.482+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1255074297 wait complete. 2023-07-09T21:52:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.485+0000 7fdc8f9ff700 1 Processor -- start 2023-07-09T21:52:48.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.485+0000 7fdc8f9ff700 1 -- start start 2023-07-09T21:52:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.486+0000 7fdc8f9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880b3ff0 0x7fdc8815b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.486+0000 7fdc8f9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc880d0b10 0x7fdc880cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.486+0000 7fdc8f9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc880d0f60 0x7fdc880cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.486+0000 7fdc8f9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8815edd0 con 0x7fdc880d0f60 2023-07-09T21:52:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.486+0000 7fdc8f9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc881f5580 con 0x7fdc880d0b10 2023-07-09T21:52:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.486+0000 7fdc8f9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc881f5860 con 0x7fdc880b3ff0 2023-07-09T21:52:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.486+0000 7fdc8df9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc880d0f60 0x7fdc880cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.486+0000 7fdc8df9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc880d0f60 0x7fdc880cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48352/0 (socket says 172.21.15.53:48352) 2023-07-09T21:52:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.486+0000 7fdc8df9c700 1 -- 172.21.15.53:0/1590255966 learned_addr learned my addr 172.21.15.53:0/1590255966 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc8cf9a700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc880d0b10 0x7fdc880cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc8d79b700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880b3ff0 0x7fdc8815b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc8df9c700 1 -- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880b3ff0 msgr2=0x7fdc8815b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc8df9c700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880b3ff0 0x7fdc8815b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc8df9c700 1 -- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc880d0b10 msgr2=0x7fdc880cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc8df9c700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc880d0b10 0x7fdc880cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc8df9c700 1 -- 172.21.15.53:0/1590255966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840094a0 con 0x7fdc880d0f60 2023-07-09T21:52:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc8d79b700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880b3ff0 0x7fdc8815b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc8df9c700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc880d0f60 0x7fdc880cc720 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fdc80002000 tx=0x7fdc8000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:48.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc7dffb700 1 -- 172.21.15.53:0/1590255966 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8000ad80 con 0x7fdc880d0f60 2023-07-09T21:52:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc7dffb700 1 -- 172.21.15.53:0/1590255966 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc800070d0 con 0x7fdc880d0f60 2023-07-09T21:52:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1590255966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc881f5b40 con 0x7fdc880d0f60 2023-07-09T21:52:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc7dffb700 1 -- 172.21.15.53:0/1590255966 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80007440 con 0x7fdc880d0f60 2023-07-09T21:52:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.487+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1590255966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc881f6100 con 0x7fdc880d0f60 2023-07-09T21:52:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.489+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1590255966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc881f6320 con 0x7fdc880d0f60 2023-07-09T21:52:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.489+0000 7fdc7dffb700 1 -- 172.21.15.53:0/1590255966 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fdc800075a0 con 0x7fdc880d0f60 2023-07-09T21:52:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.490+0000 7fdc7dffb700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdc6c06ae00 0x7fdc6c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.491+0000 7fdc7dffb700 1 -- 172.21.15.53:0/1590255966 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fdc80089220 con 0x7fdc880d0f60 2023-07-09T21:52:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.491+0000 7fdc8d79b700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdc6c06ae00 0x7fdc6c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.492+0000 7fdc8d79b700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdc6c06ae00 0x7fdc6c06d2b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdc84000c00 tx=0x7fdc84008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.495+0000 7fdc7dffb700 1 -- 172.21.15.53:0/1590255966 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdc80054170 con 0x7fdc880d0f60 2023-07-09T21:52:48.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.701+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1590255966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc880b8e80 con 0x7fdc880d0f60 2023-07-09T21:52:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.701+0000 7fdc7dffb700 1 -- 172.21.15.53:0/1590255966 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc880b8e80 con 0x7fdc880d0f60 2023-07-09T21:52:48.703 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-07-09T21:52:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.704+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdc6c06ae00 msgr2=0x7fdc6c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.704+0000 7fdc8f9ff700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdc6c06ae00 0x7fdc6c06d2b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdc84000c00 tx=0x7fdc84008030 comp rx=0 tx=0).stop 2023-07-09T21:52:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.704+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1590255966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc880d0f60 msgr2=0x7fdc880cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.704+0000 7fdc8f9ff700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc880d0f60 0x7fdc880cc720 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fdc80002000 tx=0x7fdc8000a340 comp rx=0 tx=0).stop 2023-07-09T21:52:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.704+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1590255966 shutdown_connections 2023-07-09T21:52:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.704+0000 7fdc8f9ff700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdc6c06ae00 0x7fdc6c06d2b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.704+0000 7fdc8f9ff700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc880d0f60 0x7fdc880cc720 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.704+0000 7fdc8f9ff700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880b3ff0 0x7fdc8815b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.704+0000 7fdc8f9ff700 1 --2- 172.21.15.53:0/1590255966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc880d0b10 0x7fdc880cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.704+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1590255966 >> 172.21.15.53:0/1590255966 conn(0x7fdc8809c1b0 msgr2=0x7fdc880b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.704+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1590255966 shutdown_connections 2023-07-09T21:52:48.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.704+0000 7fdc8f9ff700 1 -- 172.21.15.53:0/1590255966 wait complete. 2023-07-09T21:52:48.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:52:48.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.922+0000 7f8c5cbff700 1 Processor -- start 2023-07-09T21:52:48.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.922+0000 7f8c5cbff700 1 -- start start 2023-07-09T21:52:48.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.923+0000 7f8c5cbff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8c580b1e00 0x7f8c580b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.924+0000 7f8c5cbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c580d1220 0x7f8c580afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.924+0000 7f8c5cbff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c580d2ce0 con 0x7f8c580b2350 2023-07-09T21:52:48.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.924+0000 7f8c5cbff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c580b3350 con 0x7f8c580b1e00 2023-07-09T21:52:48.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.924+0000 7f8c5cbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580b3630 con 0x7f8c580d1220 2023-07-09T21:52:48.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.924+0000 7f8c5659c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8c580b1e00 0x7f8c580b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.924+0000 7f8c5659c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8c580b1e00 0x7f8c580b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48356/0 (socket says 172.21.15.53:48356) 2023-07-09T21:52:48.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.924+0000 7f8c5659c700 1 -- 172.21.15.53:0/2276534902 learned_addr learned my addr 172.21.15.53:0/2276534902 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:48.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.924+0000 7f8c56d9d700 1 --2- 172.21.15.53:0/2276534902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c580d1220 0x7f8c580afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.924+0000 7f8c5659c700 1 -- 172.21.15.53:0/2276534902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c580d1220 msgr2=0x7f8c580afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:48.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.924+0000 7f8c5659c700 1 --2- 172.21.15.53:0/2276534902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c580d1220 0x7f8c580afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.924+0000 7f8c5659c700 1 -- 172.21.15.53:0/2276534902 >> v1:172.21.15.184:6789/0 conn(0x7f8c580b2350 legacy=0x7f8c580d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.924+0000 7f8c5659c700 1 -- 172.21.15.53:0/2276534902 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c580b3910 con 0x7f8c580b1e00 2023-07-09T21:52:48.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.925+0000 7f8c5659c700 1 --2- 172.21.15.53:0/2276534902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c580b1e00 0x7f8c580b43f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8c480098e0 tx=0x7f8c48009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d96dbcd60176a8f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:48.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.925+0000 7f8c55d9b700 1 -- 172.21.15.53:0/2276534902 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800b8a0 con 0x7f8c580b1e00 2023-07-09T21:52:48.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.925+0000 7f8c55d9b700 1 -- 172.21.15.53:0/2276534902 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4800ba00 con 0x7f8c580b1e00 2023-07-09T21:52:48.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.925+0000 7f8c55d9b700 1 -- 172.21.15.53:0/2276534902 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800bdb0 con 0x7f8c580b1e00 2023-07-09T21:52:48.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.926+0000 7f8c5cbff700 1 -- 172.21.15.53:0/2276534902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c580b1e00 msgr2=0x7f8c580b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.926+0000 7f8c5cbff700 1 --2- 172.21.15.53:0/2276534902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c580b1e00 0x7f8c580b43f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8c480098e0 tx=0x7f8c48009bf0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.926+0000 7f8c5cbff700 1 -- 172.21.15.53:0/2276534902 shutdown_connections 2023-07-09T21:52:48.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.926+0000 7f8c5cbff700 1 --2- 172.21.15.53:0/2276534902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c580d1220 0x7f8c580afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.926+0000 7f8c5cbff700 1 --2- 172.21.15.53:0/2276534902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c580b1e00 0x7f8c580b43f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.926+0000 7f8c5cbff700 1 -- 172.21.15.53:0/2276534902 >> 172.21.15.53:0/2276534902 conn(0x7f8c5809c1d0 msgr2=0x7f8c580d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:48.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.926+0000 7f8c5cbff700 1 -- 172.21.15.53:0/2276534902 shutdown_connections 2023-07-09T21:52:48.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.926+0000 7f8c5cbff700 1 -- 172.21.15.53:0/2276534902 wait complete. 2023-07-09T21:52:48.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.927+0000 7f8c5cbff700 1 Processor -- start 2023-07-09T21:52:48.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.928+0000 7f8c5cbff700 1 -- start start 2023-07-09T21:52:48.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.928+0000 7f8c5cbff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c580b1e00 0x7f8c580cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.928+0000 7f8c5cbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c580b2350 0x7f8c580cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.929+0000 7f8c5cbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c580d1220 0x7f8c580cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.929+0000 7f8c5cbff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580b7a70 con 0x7f8c580b1e00 2023-07-09T21:52:48.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.929+0000 7f8c5cbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580d0410 con 0x7f8c580b2350 2023-07-09T21:52:48.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.929+0000 7f8c5cbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580b6780 con 0x7f8c580d1220 2023-07-09T21:52:48.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.929+0000 7f8c5659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c580b1e00 0x7f8c580cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.929+0000 7f8c5659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c580b1e00 0x7f8c580cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48364/0 (socket says 172.21.15.53:48364) 2023-07-09T21:52:48.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.929+0000 7f8c5659c700 1 -- 172.21.15.53:0/629269891 learned_addr learned my addr 172.21.15.53:0/629269891 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:48.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.929+0000 7f8c5659c700 1 -- 172.21.15.53:0/629269891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c580d1220 msgr2=0x7f8c580cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.929+0000 7f8c5659c700 1 --2- 172.21.15.53:0/629269891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c580d1220 0x7f8c580cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.929+0000 7f8c5659c700 1 -- 172.21.15.53:0/629269891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c580b2350 msgr2=0x7f8c580cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:48.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.929+0000 7f8c5659c700 1 --2- 172.21.15.53:0/629269891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c580b2350 0x7f8c580cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:48.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.929+0000 7f8c5659c700 1 -- 172.21.15.53:0/629269891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c480094f0 con 0x7f8c580b1e00 2023-07-09T21:52:48.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.929+0000 7f8c5659c700 1 --2- 172.21.15.53:0/629269891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c580b1e00 0x7f8c580cd570 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8c580673b0 tx=0x7f8c48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:48.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.930+0000 7f8c4effd700 1 -- 172.21.15.53:0/629269891 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48011d50 con 0x7f8c580b1e00 2023-07-09T21:52:48.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.930+0000 7f8c4effd700 1 -- 172.21.15.53:0/629269891 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4801f070 con 0x7f8c580b1e00 2023-07-09T21:52:48.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.930+0000 7f8c4effd700 1 -- 172.21.15.53:0/629269891 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c480266c0 con 0x7f8c580b1e00 2023-07-09T21:52:48.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.930+0000 7f8c5cbff700 1 -- 172.21.15.53:0/629269891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c580b75e0 con 0x7f8c580b1e00 2023-07-09T21:52:48.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.930+0000 7f8c5cbff700 1 -- 172.21.15.53:0/629269891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c580b6cb0 con 0x7f8c580b1e00 2023-07-09T21:52:48.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.931+0000 7f8c5cbff700 1 -- 172.21.15.53:0/629269891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5804e280 con 0x7f8c580b1e00 2023-07-09T21:52:48.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.932+0000 7f8c4effd700 1 -- 172.21.15.53:0/629269891 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f8c48026820 con 0x7f8c580b1e00 2023-07-09T21:52:48.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.933+0000 7f8c4effd700 1 --2- 172.21.15.53:0/629269891 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8c3806ae00 0x7f8c3806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:48.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.933+0000 7f8c4effd700 1 -- 172.21.15.53:0/629269891 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f8c48021070 con 0x7f8c580b1e00 2023-07-09T21:52:48.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.933+0000 7f8c4ffff700 1 --2- 172.21.15.53:0/629269891 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8c3806ae00 0x7f8c3806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:48.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.934+0000 7f8c4ffff700 1 --2- 172.21.15.53:0/629269891 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8c3806ae00 0x7f8c3806d2b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8c40000f60 tx=0x7f8c40007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:48.937+0000 7f8c4effd700 1 -- 172.21.15.53:0/629269891 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8c48056220 con 0x7f8c580b1e00 2023-07-09T21:52:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.192+0000 7f8c5cbff700 1 -- 172.21.15.53:0/629269891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c5808c5a0 con 0x7f8c580b1e00 2023-07-09T21:52:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.193+0000 7f8c4effd700 1 -- 172.21.15.53:0/629269891 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f8c48015090 con 0x7f8c580b1e00 2023-07-09T21:52:49.194 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:49.194 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2286885595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2286885595},{"type":"v1","addr":"172.21.15.184:6837","nonce":2286885595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2019231045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2019231045},{"type":"v1","addr":"172.21.15.53:6834","nonce":2019231045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/1440999283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1440999283},{"type":"v1","addr":"172.21.15.184:6836","nonce":1440999283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:52:18.405674+0000","modified":"2023-07-09T21:52:21.909106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3167613257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3167613257},{"type":"v1","addr":"172.21.15.53:6835","nonce":3167613257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T21:52:49.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.195+0000 7f8c5cbff700 1 -- 172.21.15.53:0/629269891 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8c3806ae00 msgr2=0x7f8c3806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.195+0000 7f8c5cbff700 1 --2- 172.21.15.53:0/629269891 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8c3806ae00 0x7f8c3806d2b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8c40000f60 tx=0x7f8c40007a40 comp rx=0 tx=0).stop 2023-07-09T21:52:49.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.195+0000 7f8c5cbff700 1 -- 172.21.15.53:0/629269891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c580b1e00 msgr2=0x7f8c580cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.195+0000 7f8c5cbff700 1 --2- 172.21.15.53:0/629269891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c580b1e00 0x7f8c580cd570 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8c580673b0 tx=0x7f8c48004750 comp rx=0 tx=0).stop 2023-07-09T21:52:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.195+0000 7f8c5cbff700 1 -- 172.21.15.53:0/629269891 shutdown_connections 2023-07-09T21:52:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.195+0000 7f8c5cbff700 1 --2- 172.21.15.53:0/629269891 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f8c3806ae00 0x7f8c3806d2b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.195+0000 7f8c5cbff700 1 --2- 172.21.15.53:0/629269891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c580d1220 0x7f8c580cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.195+0000 7f8c5cbff700 1 --2- 172.21.15.53:0/629269891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c580b1e00 0x7f8c580cd570 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.195+0000 7f8c5cbff700 1 --2- 172.21.15.53:0/629269891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c580b2350 0x7f8c580cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.195+0000 7f8c5cbff700 1 -- 172.21.15.53:0/629269891 >> 172.21.15.53:0/629269891 conn(0x7f8c5809c1d0 msgr2=0x7f8c5815b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.195+0000 7f8c5cbff700 1 -- 172.21.15.53:0/629269891 shutdown_connections 2023-07-09T21:52:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.195+0000 7f8c5cbff700 1 -- 172.21.15.53:0/629269891 wait complete. 2023-07-09T21:52:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2023-07-09T21:52:49.219 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:52:49.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.418+0000 7f546c3ff700 1 Processor -- start 2023-07-09T21:52:49.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.419+0000 7f546c3ff700 1 -- start start 2023-07-09T21:52:49.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.420+0000 7f546c3ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f54640b2690 0x7f54640b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:49.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.420+0000 7f546c3ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54640b3030 con 0x7f5464070720 2023-07-09T21:52:49.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.421+0000 7f546c3ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5464070bc0 con 0x7f5464070350 2023-07-09T21:52:49.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.421+0000 7f546c3ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54640cdf90 con 0x7f54640b2690 2023-07-09T21:52:49.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.421+0000 7f546999a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5464070720 0x7f54640cea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38034/0 (socket says 172.21.15.53:38034) 2023-07-09T21:52:49.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.421+0000 7f546999a700 1 -- 172.21.15.53:0/2375427539 learned_addr learned my addr 172.21.15.53:0/2375427539 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:49.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.421+0000 7f546a99c700 1 --2- 172.21.15.53:0/2375427539 >> v2:172.21.15.53:3300/0 conn(0x7f54640b2690 0x7f54640b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:49.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.421+0000 7f546a99c700 1 -- 172.21.15.53:0/2375427539 >> v1:172.21.15.184:6789/0 conn(0x7f5464070350 legacy=0x7f54641597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.421+0000 7f546a99c700 1 -- 172.21.15.53:0/2375427539 >> v1:172.21.15.53:6789/0 conn(0x7f5464070720 legacy=0x7f54640cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.421+0000 7f546a99c700 1 -- 172.21.15.53:0/2375427539 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546415a2f0 con 0x7f54640b2690 2023-07-09T21:52:49.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.421+0000 7f5469199700 1 -- 172.21.15.53:0/2375427539 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475671994 0 0) 0x7f54640b3030 con 0x7f5464070720 2023-07-09T21:52:49.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.422+0000 7f546a99c700 1 --2- 172.21.15.53:0/2375427539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54640b2690 0x7f54640b2af0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f545c009d90 tx=0x7f545c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d82f9938d9bb72 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.422+0000 7f5469199700 1 -- 172.21.15.53:0/2375427539 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c00e070 con 0x7f54640b2690 2023-07-09T21:52:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.422+0000 7f5469199700 1 -- 172.21.15.53:0/2375427539 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c00bbd0 con 0x7f54640b2690 2023-07-09T21:52:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.422+0000 7f5469199700 1 -- 172.21.15.53:0/2375427539 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c012430 con 0x7f54640b2690 2023-07-09T21:52:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.422+0000 7f546c3ff700 1 -- 172.21.15.53:0/2375427539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54640b2690 msgr2=0x7f54640b2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.422+0000 7f546c3ff700 1 --2- 172.21.15.53:0/2375427539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54640b2690 0x7f54640b2af0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f545c009d90 tx=0x7f545c00b330 comp rx=0 tx=0).stop 2023-07-09T21:52:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.422+0000 7f546c3ff700 1 -- 172.21.15.53:0/2375427539 shutdown_connections 2023-07-09T21:52:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.422+0000 7f546c3ff700 1 --2- 172.21.15.53:0/2375427539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54640b2690 0x7f54640b2af0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.422+0000 7f546c3ff700 1 -- 172.21.15.53:0/2375427539 >> 172.21.15.53:0/2375427539 conn(0x7f5464069f30 msgr2=0x7f546406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:49.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.423+0000 7f546c3ff700 1 -- 172.21.15.53:0/2375427539 shutdown_connections 2023-07-09T21:52:49.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.423+0000 7f546c3ff700 1 -- 172.21.15.53:0/2375427539 wait complete. 2023-07-09T21:52:49.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.424+0000 7f546c3ff700 1 Processor -- start 2023-07-09T21:52:49.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.424+0000 7f546c3ff700 1 -- start start 2023-07-09T21:52:49.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.425+0000 7f546c3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5464070350 0x7f5464152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:49.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.425+0000 7f546c3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5464070720 0x7f5464137d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:49.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.425+0000 7f546c3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54640b2690 0x7f54641df5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:49.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.425+0000 7f546c3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54641397a0 con 0x7f5464070720 2023-07-09T21:52:49.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.425+0000 7f546c3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5464138b90 con 0x7f5464070350 2023-07-09T21:52:49.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.425+0000 7f546c3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5464138e70 con 0x7f54640b2690 2023-07-09T21:52:49.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f546999a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5464070720 0x7f5464137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:49.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f546999a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5464070720 0x7f5464137d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48380/0 (socket says 172.21.15.53:48380) 2023-07-09T21:52:49.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f546999a700 1 -- 172.21.15.53:0/957432425 learned_addr learned my addr 172.21.15.53:0/957432425 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:49.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f546a19b700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5464070350 0x7f5464152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:49.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f546a99c700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54640b2690 0x7f54641df5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:49.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f546999a700 1 -- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54640b2690 msgr2=0x7f54641df5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f546999a700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54640b2690 0x7f54641df5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f546999a700 1 -- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5464070350 msgr2=0x7f5464152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f546999a700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5464070350 0x7f5464152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f546999a700 1 -- 172.21.15.53:0/957432425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c009a70 con 0x7f5464070720 2023-07-09T21:52:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f546a19b700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5464070350 0x7f5464152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f546999a700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5464070720 0x7f5464137d20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f545400c520 tx=0x7f545400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f545affd700 1 -- 172.21.15.53:0/957432425 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454004c80 con 0x7f5464070720 2023-07-09T21:52:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f545affd700 1 -- 172.21.15.53:0/957432425 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5454004e00 con 0x7f5464070720 2023-07-09T21:52:49.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.426+0000 7f545affd700 1 -- 172.21.15.53:0/957432425 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454007310 con 0x7f5464070720 2023-07-09T21:52:49.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.427+0000 7f546c3ff700 1 -- 172.21.15.53:0/957432425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5464139150 con 0x7f5464070720 2023-07-09T21:52:49.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.427+0000 7f546c3ff700 1 -- 172.21.15.53:0/957432425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5464152e70 con 0x7f5464070720 2023-07-09T21:52:49.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.428+0000 7f546c3ff700 1 -- 172.21.15.53:0/957432425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54640b1c20 con 0x7f5464070720 2023-07-09T21:52:49.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.429+0000 7f545affd700 1 -- 172.21.15.53:0/957432425 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f5454007470 con 0x7f5464070720 2023-07-09T21:52:49.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.430+0000 7f545affd700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f544806ae00 0x7f544806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:49.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.430+0000 7f545affd700 1 -- 172.21.15.53:0/957432425 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f5454089460 con 0x7f5464070720 2023-07-09T21:52:49.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.430+0000 7f546a19b700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f544806ae00 0x7f544806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.431+0000 7f546a19b700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f544806ae00 0x7f544806d2b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5460000f60 tx=0x7f5460009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:49.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.434+0000 7f545affd700 1 -- 172.21.15.53:0/957432425 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5454054320 con 0x7f5464070720 2023-07-09T21:52:49.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.645+0000 7f546c3ff700 1 -- 172.21.15.53:0/957432425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f546404e280 con 0x7f5464070720 2023-07-09T21:52:49.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.646+0000 7f545affd700 1 -- 172.21.15.53:0/957432425 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18435 (secure 0 0 0) 0x7f5454057940 con 0x7f5464070720 2023-07-09T21:52:49.648 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:49.648 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":52,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:52:43.613556+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:52:16.672667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:52:17.375922+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":52,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:52:49.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.648+0000 7f546c3ff700 1 -- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f544806ae00 msgr2=0x7f544806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.648+0000 7f546c3ff700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f544806ae00 0x7f544806d2b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5460000f60 tx=0x7f5460009040 comp rx=0 tx=0).stop 2023-07-09T21:52:49.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.648+0000 7f546c3ff700 1 -- 172.21.15.53:0/957432425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5464070720 msgr2=0x7f5464137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.648+0000 7f546c3ff700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5464070720 0x7f5464137d20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f545400c520 tx=0x7f545400c8e0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.648+0000 7f546c3ff700 1 -- 172.21.15.53:0/957432425 shutdown_connections 2023-07-09T21:52:49.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.648+0000 7f546c3ff700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f544806ae00 0x7f544806d2b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.648+0000 7f546c3ff700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54640b2690 0x7f54641df5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.648+0000 7f546c3ff700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5464070350 0x7f5464152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.648+0000 7f546c3ff700 1 --2- 172.21.15.53:0/957432425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5464070720 0x7f5464137d20 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.648+0000 7f546c3ff700 1 -- 172.21.15.53:0/957432425 >> 172.21.15.53:0/957432425 conn(0x7f5464069f30 msgr2=0x7f54640cccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:49.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.649+0000 7f546c3ff700 1 -- 172.21.15.53:0/957432425 shutdown_connections 2023-07-09T21:52:49.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.649+0000 7f546c3ff700 1 -- 172.21.15.53:0/957432425 wait complete. 2023-07-09T21:52:49.668 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T21:52:49.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:52:49.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.868+0000 7fa97f5ff700 1 Processor -- start 2023-07-09T21:52:49.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.868+0000 7fa97f5ff700 1 -- start start 2023-07-09T21:52:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.869+0000 7fa97f5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9780b2350 0x7fa9780b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.869+0000 7fa97f5ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780d2ce0 con 0x7fa9780b1e00 2023-07-09T21:52:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.869+0000 7fa97f5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780b3350 con 0x7fa9780d1220 2023-07-09T21:52:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.869+0000 7fa97f5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780b3630 con 0x7fa9780b2350 2023-07-09T21:52:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.869+0000 7fa97d39b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa9780b1e00 0x7fa9780d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38038/0 (socket says 172.21.15.53:38038) 2023-07-09T21:52:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.869+0000 7fa97d39b700 1 -- 172.21.15.53:0/173962412 learned_addr learned my addr 172.21.15.53:0/173962412 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.869+0000 7fa97db9c700 1 --2- 172.21.15.53:0/173962412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9780b2350 0x7fa9780b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.870+0000 7fa96ffff700 1 -- 172.21.15.53:0/173962412 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158726501 0 0) 0x7fa9780d2ce0 con 0x7fa9780b1e00 2023-07-09T21:52:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.870+0000 7fa96ffff700 1 -- 172.21.15.53:0/173962412 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9640035b0 con 0x7fa9780b1e00 2023-07-09T21:52:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.870+0000 7fa96ffff700 1 -- 172.21.15.53:0/173962412 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365878451 0 0) 0x7fa9780b3350 con 0x7fa9780d1220 2023-07-09T21:52:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.870+0000 7fa96ffff700 1 -- 172.21.15.53:0/173962412 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9780d2ce0 con 0x7fa9780d1220 2023-07-09T21:52:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.870+0000 7fa97db9c700 1 -- 172.21.15.53:0/173962412 >> v1:172.21.15.184:6789/0 conn(0x7fa9780d1220 legacy=0x7fa9780afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.870+0000 7fa97db9c700 1 -- 172.21.15.53:0/173962412 >> v1:172.21.15.53:6789/0 conn(0x7fa9780b1e00 legacy=0x7fa9780d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.870+0000 7fa97db9c700 1 -- 172.21.15.53:0/173962412 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780b3910 con 0x7fa9780b2350 2023-07-09T21:52:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.870+0000 7fa97db9c700 1 --2- 172.21.15.53:0/173962412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9780b2350 0x7fa9780b43f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa970009dc0 tx=0x7fa97000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ea52f0302ced303 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.871+0000 7fa96ffff700 1 -- 172.21.15.53:0/173962412 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000e070 con 0x7fa9780b2350 2023-07-09T21:52:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.871+0000 7fa96ffff700 1 -- 172.21.15.53:0/173962412 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000bb20 con 0x7fa9780b2350 2023-07-09T21:52:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.871+0000 7fa96ffff700 1 -- 172.21.15.53:0/173962412 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970012430 con 0x7fa9780b2350 2023-07-09T21:52:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.871+0000 7fa97f5ff700 1 -- 172.21.15.53:0/173962412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9780b2350 msgr2=0x7fa9780b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.871+0000 7fa97f5ff700 1 --2- 172.21.15.53:0/173962412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9780b2350 0x7fa9780b43f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa970009dc0 tx=0x7fa97000b330 comp rx=0 tx=0).stop 2023-07-09T21:52:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.871+0000 7fa97f5ff700 1 -- 172.21.15.53:0/173962412 shutdown_connections 2023-07-09T21:52:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.871+0000 7fa97f5ff700 1 --2- 172.21.15.53:0/173962412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9780b2350 0x7fa9780b43f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.871+0000 7fa97f5ff700 1 -- 172.21.15.53:0/173962412 >> 172.21.15.53:0/173962412 conn(0x7fa97809c1d0 msgr2=0x7fa9780d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.871+0000 7fa97f5ff700 1 -- 172.21.15.53:0/173962412 shutdown_connections 2023-07-09T21:52:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.871+0000 7fa97f5ff700 1 -- 172.21.15.53:0/173962412 wait complete. 2023-07-09T21:52:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.874+0000 7fa97f5ff700 1 Processor -- start 2023-07-09T21:52:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.874+0000 7fa97f5ff700 1 -- start start 2023-07-09T21:52:49.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.875+0000 7fa97f5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9780b1e00 0x7fa9780cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:49.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.875+0000 7fa97f5ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9780b2350 0x7fa97814c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:49.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.875+0000 7fa97f5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9780d1220 0x7fa9781f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:49.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.875+0000 7fa97f5ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780cd910 con 0x7fa9780b2350 2023-07-09T21:52:49.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.875+0000 7fa97f5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780cd570 con 0x7fa9780b1e00 2023-07-09T21:52:49.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.875+0000 7fa97f5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97814c6f0 con 0x7fa9780d1220 2023-07-09T21:52:49.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.875+0000 7fa97cb9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9780b2350 0x7fa97814c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:49.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.876+0000 7fa97cb9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9780b2350 0x7fa97814c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48384/0 (socket says 172.21.15.53:48384) 2023-07-09T21:52:49.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.876+0000 7fa97cb9a700 1 -- 172.21.15.53:0/1745972700 learned_addr learned my addr 172.21.15.53:0/1745972700 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:49.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.876+0000 7fa97d39b700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9780b1e00 0x7fa9780cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:49.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.876+0000 7fa97db9c700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9780d1220 0x7fa9781f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:49.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.876+0000 7fa97cb9a700 1 -- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9780d1220 msgr2=0x7fa9781f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.876+0000 7fa97cb9a700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9780d1220 0x7fa9781f20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.876+0000 7fa97cb9a700 1 -- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9780b1e00 msgr2=0x7fa9780cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:49.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.876+0000 7fa97cb9a700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9780b1e00 0x7fa9780cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:49.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.876+0000 7fa97cb9a700 1 -- 172.21.15.53:0/1745972700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009a70 con 0x7fa9780b2350 2023-07-09T21:52:49.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.876+0000 7fa97cb9a700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9780b2350 0x7fa97814c1b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c450 tx=0x7fa96800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:49.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.876+0000 7fa96dffb700 1 -- 172.21.15.53:0/1745972700 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680052d0 con 0x7fa9780b2350 2023-07-09T21:52:49.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.876+0000 7fa96dffb700 1 -- 172.21.15.53:0/1745972700 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa968005430 con 0x7fa9780b2350 2023-07-09T21:52:49.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.876+0000 7fa97f5ff700 1 -- 172.21.15.53:0/1745972700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9781f29f0 con 0x7fa9780b2350 2023-07-09T21:52:49.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.877+0000 7fa96dffb700 1 -- 172.21.15.53:0/1745972700 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680038c0 con 0x7fa9780b2350 2023-07-09T21:52:49.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.877+0000 7fa97f5ff700 1 -- 172.21.15.53:0/1745972700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9781f2fb0 con 0x7fa9780b2350 2023-07-09T21:52:49.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.878+0000 7fa97f5ff700 1 -- 172.21.15.53:0/1745972700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9780cda50 con 0x7fa9780b2350 2023-07-09T21:52:49.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.879+0000 7fa96dffb700 1 -- 172.21.15.53:0/1745972700 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fa968003a20 con 0x7fa9780b2350 2023-07-09T21:52:49.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.880+0000 7fa96dffb700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa95c06ae00 0x7fa95c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:49.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.880+0000 7fa96dffb700 1 -- 172.21.15.53:0/1745972700 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fa968088a60 con 0x7fa9780b2350 2023-07-09T21:52:49.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.880+0000 7fa97d39b700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa95c06ae00 0x7fa95c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:49.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.881+0000 7fa97d39b700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa95c06ae00 0x7fa95c06d2b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa9740010e0 tx=0x7fa974007c70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:49.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:49.884+0000 7fa96dffb700 1 -- 172.21.15.53:0/1745972700 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa9780cda50 con 0x7fa9780b2350 2023-07-09T21:52:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.141+0000 7fa97f5ff700 1 -- 172.21.15.53:0/1745972700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9780cda50 con 0x7fa9780b2350 2023-07-09T21:52:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.142+0000 7fa96dffb700 1 -- 172.21.15.53:0/1745972700 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fa9780cda50 con 0x7fa9780b2350 2023-07-09T21:52:50.144 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:50.144 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2286885595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2286885595},{"type":"v1","addr":"172.21.15.184:6837","nonce":2286885595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2019231045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2019231045},{"type":"v1","addr":"172.21.15.53:6834","nonce":2019231045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/1440999283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1440999283},{"type":"v1","addr":"172.21.15.184:6836","nonce":1440999283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:52:18.405674+0000","modified":"2023-07-09T21:52:21.909106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3167613257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3167613257},{"type":"v1","addr":"172.21.15.53:6835","nonce":3167613257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T21:52:50.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.144+0000 7fa97f5ff700 1 -- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa95c06ae00 msgr2=0x7fa95c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:50.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.144+0000 7fa97f5ff700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa95c06ae00 0x7fa95c06d2b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa9740010e0 tx=0x7fa974007c70 comp rx=0 tx=0).stop 2023-07-09T21:52:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.144+0000 7fa97f5ff700 1 -- 172.21.15.53:0/1745972700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9780b2350 msgr2=0x7fa97814c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.144+0000 7fa97f5ff700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9780b2350 0x7fa97814c1b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c450 tx=0x7fa96800c760 comp rx=0 tx=0).stop 2023-07-09T21:52:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.144+0000 7fa97f5ff700 1 -- 172.21.15.53:0/1745972700 shutdown_connections 2023-07-09T21:52:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.144+0000 7fa97f5ff700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa95c06ae00 0x7fa95c06d2b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.144+0000 7fa97f5ff700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9780d1220 0x7fa9781f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.144+0000 7fa97f5ff700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9780b1e00 0x7fa9780cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.144+0000 7fa97f5ff700 1 --2- 172.21.15.53:0/1745972700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9780b2350 0x7fa97814c1b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.144+0000 7fa97f5ff700 1 -- 172.21.15.53:0/1745972700 >> 172.21.15.53:0/1745972700 conn(0x7fa97809c1d0 msgr2=0x7fa9780b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:50.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.144+0000 7fa97f5ff700 1 -- 172.21.15.53:0/1745972700 shutdown_connections 2023-07-09T21:52:50.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.144+0000 7fa97f5ff700 1 -- 172.21.15.53:0/1745972700 wait complete. 2023-07-09T21:52:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2023-07-09T21:52:50.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:52:50.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.361+0000 7f363b7ff700 1 Processor -- start 2023-07-09T21:52:50.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.361+0000 7f363b7ff700 1 -- start start 2023-07-09T21:52:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.363+0000 7f363b7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36340cd5e0 0x7f36340cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.363+0000 7f363b7ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36340cdef0 0x7f363406e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.363+0000 7f363b7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363406dd30 con 0x7f363406e700 2023-07-09T21:52:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.363+0000 7f363b7ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363415cda0 con 0x7f36340cdef0 2023-07-09T21:52:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.363+0000 7f363b7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36340cc8f0 con 0x7f36340cd5e0 2023-07-09T21:52:50.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.363+0000 7f3638d9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36340cdef0 0x7f363406e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:50.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.363+0000 7f3638d9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36340cdef0 0x7f363406e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48392/0 (socket says 172.21.15.53:48392) 2023-07-09T21:52:50.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.363+0000 7f3638d9a700 1 -- 172.21.15.53:0/990325139 learned_addr learned my addr 172.21.15.53:0/990325139 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:50.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.363+0000 7f363959b700 1 --2- 172.21.15.53:0/990325139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36340cd5e0 0x7f36340cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:50.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.363+0000 7f3638d9a700 1 -- 172.21.15.53:0/990325139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36340cd5e0 msgr2=0x7f36340cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:50.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.363+0000 7f3638d9a700 1 --2- 172.21.15.53:0/990325139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36340cd5e0 0x7f36340cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.363+0000 7f3638d9a700 1 -- 172.21.15.53:0/990325139 >> v1:172.21.15.184:6789/0 conn(0x7f363406e700 legacy=0x7f363406eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:50.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.363+0000 7f3638d9a700 1 -- 172.21.15.53:0/990325139 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36340ccbd0 con 0x7f36340cdef0 2023-07-09T21:52:50.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.364+0000 7f3638d9a700 1 --2- 172.21.15.53:0/990325139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36340cdef0 0x7f363406e1c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f36240098f0 tx=0x7f3624009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d7f1b95b2094dd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:50.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.364+0000 7f362bfff700 1 -- 172.21.15.53:0/990325139 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400b8a0 con 0x7f36340cdef0 2023-07-09T21:52:50.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.364+0000 7f362bfff700 1 -- 172.21.15.53:0/990325139 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362400ba00 con 0x7f36340cdef0 2023-07-09T21:52:50.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.364+0000 7f362bfff700 1 -- 172.21.15.53:0/990325139 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400bd90 con 0x7f36340cdef0 2023-07-09T21:52:50.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.364+0000 7f363b7ff700 1 -- 172.21.15.53:0/990325139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36340cdef0 msgr2=0x7f363406e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:50.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.364+0000 7f363b7ff700 1 --2- 172.21.15.53:0/990325139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36340cdef0 0x7f363406e1c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f36240098f0 tx=0x7f3624009c00 comp rx=0 tx=0).stop 2023-07-09T21:52:50.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.364+0000 7f363b7ff700 1 -- 172.21.15.53:0/990325139 shutdown_connections 2023-07-09T21:52:50.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.364+0000 7f363b7ff700 1 --2- 172.21.15.53:0/990325139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36340cd5e0 0x7f36340cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.364+0000 7f363b7ff700 1 --2- 172.21.15.53:0/990325139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36340cdef0 0x7f363406e1c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.364+0000 7f363b7ff700 1 -- 172.21.15.53:0/990325139 >> 172.21.15.53:0/990325139 conn(0x7f36340999e0 msgr2=0x7f3634099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:50.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.365+0000 7f363b7ff700 1 -- 172.21.15.53:0/990325139 shutdown_connections 2023-07-09T21:52:50.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.365+0000 7f363b7ff700 1 -- 172.21.15.53:0/990325139 wait complete. 2023-07-09T21:52:50.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.366+0000 7f363b7ff700 1 Processor -- start 2023-07-09T21:52:50.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.366+0000 7f363b7ff700 1 -- start start 2023-07-09T21:52:50.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.367+0000 7f363b7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f363406e700 0x7f36341566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:50.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.367+0000 7f363b7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36340cd5e0 0x7f36340b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:50.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.367+0000 7f363b7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36340cdef0 0x7f3634157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:50.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.367+0000 7f363b7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3634156bf0 con 0x7f36340cd5e0 2023-07-09T21:52:50.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.367+0000 7f363b7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36340c4680 con 0x7f36340cdef0 2023-07-09T21:52:50.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.367+0000 7f363b7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36340c4960 con 0x7f363406e700 2023-07-09T21:52:50.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.368+0000 7f3638d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36340cd5e0 0x7f36340b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:50.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.368+0000 7f3638d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36340cd5e0 0x7f36340b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48404/0 (socket says 172.21.15.53:48404) 2023-07-09T21:52:50.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.368+0000 7f3638d9a700 1 -- 172.21.15.53:0/2573338540 learned_addr learned my addr 172.21.15.53:0/2573338540 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:50.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.368+0000 7f3638d9a700 1 -- 172.21.15.53:0/2573338540 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f363406e700 msgr2=0x7f36341566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:50.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.368+0000 7f3638d9a700 1 --2- 172.21.15.53:0/2573338540 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f363406e700 0x7f36341566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.368+0000 7f3638d9a700 1 -- 172.21.15.53:0/2573338540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36340cdef0 msgr2=0x7f3634157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:50.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.368+0000 7f3638d9a700 1 --2- 172.21.15.53:0/2573338540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36340cdef0 0x7f3634157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.368+0000 7f3638d9a700 1 -- 172.21.15.53:0/2573338540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3624009550 con 0x7f36340cd5e0 2023-07-09T21:52:50.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.368+0000 7f3638d9a700 1 --2- 172.21.15.53:0/2573338540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36340cd5e0 0x7f36340b16b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3624014040 tx=0x7f3624004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:50.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.368+0000 7f3629ffb700 1 -- 172.21.15.53:0/2573338540 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36240036a0 con 0x7f36340cd5e0 2023-07-09T21:52:50.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.368+0000 7f3629ffb700 1 -- 172.21.15.53:0/2573338540 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362401e070 con 0x7f36340cd5e0 2023-07-09T21:52:50.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.368+0000 7f363b7ff700 1 -- 172.21.15.53:0/2573338540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36340b1fb0 con 0x7f36340cd5e0 2023-07-09T21:52:50.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.369+0000 7f3629ffb700 1 -- 172.21.15.53:0/2573338540 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624003a60 con 0x7f36340cd5e0 2023-07-09T21:52:50.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.369+0000 7f363b7ff700 1 -- 172.21.15.53:0/2573338540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36340b2570 con 0x7f36340cd5e0 2023-07-09T21:52:50.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.370+0000 7f363b7ff700 1 -- 172.21.15.53:0/2573338540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363406f840 con 0x7f36340cd5e0 2023-07-09T21:52:50.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.370+0000 7f3629ffb700 1 -- 172.21.15.53:0/2573338540 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f3624003bc0 con 0x7f36340cd5e0 2023-07-09T21:52:50.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.371+0000 7f3629ffb700 1 --2- 172.21.15.53:0/2573338540 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f361806ae00 0x7f361806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:50.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.372+0000 7f3629ffb700 1 -- 172.21.15.53:0/2573338540 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f3624020070 con 0x7f36340cd5e0 2023-07-09T21:52:50.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.372+0000 7f363959b700 1 --2- 172.21.15.53:0/2573338540 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f361806ae00 0x7f361806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:50.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.373+0000 7f363959b700 1 --2- 172.21.15.53:0/2573338540 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f361806ae00 0x7f361806d2b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f36300097f0 tx=0x7f3630008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:50.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.376+0000 7f3629ffb700 1 -- 172.21.15.53:0/2573338540 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3624055b00 con 0x7f36340cd5e0 2023-07-09T21:52:50.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.629+0000 7f363b7ff700 1 -- 172.21.15.53:0/2573338540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36340c4aa0 con 0x7f36340cd5e0 2023-07-09T21:52:50.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.629+0000 7f3629ffb700 1 -- 172.21.15.53:0/2573338540 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f36340c4aa0 con 0x7f36340cd5e0 2023-07-09T21:52:50.631 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:50.631 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2286885595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2286885595},{"type":"v1","addr":"172.21.15.184:6837","nonce":2286885595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2019231045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2019231045},{"type":"v1","addr":"172.21.15.53:6834","nonce":2019231045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/1440999283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1440999283},{"type":"v1","addr":"172.21.15.184:6836","nonce":1440999283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:52:18.405674+0000","modified":"2023-07-09T21:52:21.909106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3167613257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3167613257},{"type":"v1","addr":"172.21.15.53:6835","nonce":3167613257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T21:52:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.632+0000 7f363b7ff700 1 -- 172.21.15.53:0/2573338540 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f361806ae00 msgr2=0x7f361806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.632+0000 7f363b7ff700 1 --2- 172.21.15.53:0/2573338540 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f361806ae00 0x7f361806d2b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f36300097f0 tx=0x7f3630008040 comp rx=0 tx=0).stop 2023-07-09T21:52:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.632+0000 7f363b7ff700 1 -- 172.21.15.53:0/2573338540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36340cd5e0 msgr2=0x7f36340b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.632+0000 7f363b7ff700 1 --2- 172.21.15.53:0/2573338540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36340cd5e0 0x7f36340b16b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3624014040 tx=0x7f3624004750 comp rx=0 tx=0).stop 2023-07-09T21:52:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.632+0000 7f363b7ff700 1 -- 172.21.15.53:0/2573338540 shutdown_connections 2023-07-09T21:52:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.632+0000 7f363b7ff700 1 --2- 172.21.15.53:0/2573338540 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f361806ae00 0x7f361806d2b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.632+0000 7f363b7ff700 1 --2- 172.21.15.53:0/2573338540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36340cdef0 0x7f3634157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.632+0000 7f363b7ff700 1 --2- 172.21.15.53:0/2573338540 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f363406e700 0x7f36341566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.632+0000 7f363b7ff700 1 --2- 172.21.15.53:0/2573338540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36340cd5e0 0x7f36340b16b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.632+0000 7f363b7ff700 1 -- 172.21.15.53:0/2573338540 >> 172.21.15.53:0/2573338540 conn(0x7f36340999e0 msgr2=0x7f36340b6130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.632+0000 7f363b7ff700 1 -- 172.21.15.53:0/2573338540 shutdown_connections 2023-07-09T21:52:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.632+0000 7f363b7ff700 1 -- 172.21.15.53:0/2573338540 wait complete. 2023-07-09T21:52:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2023-07-09T21:52:50.652 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:52:50.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.852+0000 7ff6adbff700 1 Processor -- start 2023-07-09T21:52:50.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.852+0000 7ff6adbff700 1 -- start start 2023-07-09T21:52:50.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.854+0000 7ff6adbff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff6a80b2350 0x7ff6a80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:50.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.854+0000 7ff6adbff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a80d2ce0 con 0x7ff6a80d1220 2023-07-09T21:52:50.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.854+0000 7ff6adbff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a80b3350 con 0x7ff6a80b1e00 2023-07-09T21:52:50.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.854+0000 7ff6adbff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a80b3630 con 0x7ff6a80b2350 2023-07-09T21:52:50.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.854+0000 7ff6a7fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff6a80b2350 0x7ff6a80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:50.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.854+0000 7ff6a7fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff6a80b2350 0x7ff6a80b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48412/0 (socket says 172.21.15.53:48412) 2023-07-09T21:52:50.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.854+0000 7ff6a7fff700 1 -- 172.21.15.53:0/1710260786 learned_addr learned my addr 172.21.15.53:0/1710260786 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:50.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.854+0000 7ff6a6ffd700 1 --1- 172.21.15.53:0/1710260786 >> v1:172.21.15.53:6789/0 conn(0x7ff6a80d1220 0x7ff6a80afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38042/0 (socket says 172.21.15.53:38042) 2023-07-09T21:52:50.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.854+0000 7ff6a7fff700 1 -- 172.21.15.53:0/1710260786 >> v1:172.21.15.184:6789/0 conn(0x7ff6a80b1e00 legacy=0x7ff6a80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:50.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.854+0000 7ff6a7fff700 1 -- 172.21.15.53:0/1710260786 >> v1:172.21.15.53:6789/0 conn(0x7ff6a80d1220 legacy=0x7ff6a80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:50.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.854+0000 7ff6a7fff700 1 -- 172.21.15.53:0/1710260786 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a80b3910 con 0x7ff6a80b2350 2023-07-09T21:52:50.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.855+0000 7ff6a7fff700 1 --2- 172.21.15.53:0/1710260786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6a80b2350 0x7ff6a80b43f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009e50 tx=0x7ff6a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dde392a79b6e62 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:50.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.855+0000 7ff6a67fc700 1 -- 172.21.15.53:0/1710260786 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000e070 con 0x7ff6a80b2350 2023-07-09T21:52:50.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.855+0000 7ff6a67fc700 1 -- 172.21.15.53:0/1710260786 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0003a20 con 0x7ff6a80b2350 2023-07-09T21:52:50.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.855+0000 7ff6a67fc700 1 -- 172.21.15.53:0/1710260786 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0003dd0 con 0x7ff6a80b2350 2023-07-09T21:52:50.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.855+0000 7ff6adbff700 1 -- 172.21.15.53:0/1710260786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6a80b2350 msgr2=0x7ff6a80b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:50.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.855+0000 7ff6adbff700 1 --2- 172.21.15.53:0/1710260786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6a80b2350 0x7ff6a80b43f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009e50 tx=0x7ff6a000b330 comp rx=0 tx=0).stop 2023-07-09T21:52:50.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.855+0000 7ff6adbff700 1 -- 172.21.15.53:0/1710260786 shutdown_connections 2023-07-09T21:52:50.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.855+0000 7ff6adbff700 1 --2- 172.21.15.53:0/1710260786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6a80b2350 0x7ff6a80b43f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.855+0000 7ff6adbff700 1 -- 172.21.15.53:0/1710260786 >> 172.21.15.53:0/1710260786 conn(0x7ff6a809c1d0 msgr2=0x7ff6a80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:50.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.856+0000 7ff6adbff700 1 -- 172.21.15.53:0/1710260786 shutdown_connections 2023-07-09T21:52:50.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.856+0000 7ff6adbff700 1 -- 172.21.15.53:0/1710260786 wait complete. 2023-07-09T21:52:50.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.857+0000 7ff6adbff700 1 Processor -- start 2023-07-09T21:52:50.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.857+0000 7ff6adbff700 1 -- start start 2023-07-09T21:52:50.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.858+0000 7ff6adbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a80b1e00 0x7ff6a8154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:50.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.858+0000 7ff6adbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a80b2350 0x7ff6a80ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:50.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.858+0000 7ff6adbff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6a80d1220 0x7ff6a80c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:50.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.858+0000 7ff6adbff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a8154670 con 0x7ff6a80d1220 2023-07-09T21:52:50.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.858+0000 7ff6adbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80ce6f0 con 0x7ff6a80b1e00 2023-07-09T21:52:50.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.858+0000 7ff6adbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80b8ad0 con 0x7ff6a80b2350 2023-07-09T21:52:50.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.859+0000 7ff6a7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6a80d1220 0x7ff6a80c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:50.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.859+0000 7ff6a7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6a80d1220 0x7ff6a80c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48414/0 (socket says 172.21.15.53:48414) 2023-07-09T21:52:50.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.859+0000 7ff6a7fff700 1 -- 172.21.15.53:0/2096469759 learned_addr learned my addr 172.21.15.53:0/2096469759 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:50.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.859+0000 7ff6a77fe700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a80b1e00 0x7ff6a8154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:50.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.859+0000 7ff6a6ffd700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a80b2350 0x7ff6a80ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:50.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.859+0000 7ff6a7fff700 1 -- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a80b2350 msgr2=0x7ff6a80ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:50.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.859+0000 7ff6a7fff700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a80b2350 0x7ff6a80ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.859+0000 7ff6a7fff700 1 -- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a80b1e00 msgr2=0x7ff6a8154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:50.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.859+0000 7ff6a7fff700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a80b1e00 0x7ff6a8154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:50.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.859+0000 7ff6a7fff700 1 -- 172.21.15.53:0/2096469759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a0009b30 con 0x7ff6a80d1220 2023-07-09T21:52:50.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.859+0000 7ff6a6ffd700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a80b2350 0x7ff6a80ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:50.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.859+0000 7ff6a7fff700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6a80d1220 0x7ff6a80c6ab0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0015040 tx=0x7ff6a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:50.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.860+0000 7ff68ffff700 1 -- 172.21.15.53:0/2096469759 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0004240 con 0x7ff6a80d1220 2023-07-09T21:52:50.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.860+0000 7ff68ffff700 1 -- 172.21.15.53:0/2096469759 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a00043a0 con 0x7ff6a80d1220 2023-07-09T21:52:50.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.860+0000 7ff68ffff700 1 -- 172.21.15.53:0/2096469759 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0004730 con 0x7ff6a80d1220 2023-07-09T21:52:50.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.860+0000 7ff6adbff700 1 -- 172.21.15.53:0/2096469759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a80cd6d0 con 0x7ff6a80d1220 2023-07-09T21:52:50.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.860+0000 7ff6adbff700 1 -- 172.21.15.53:0/2096469759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a80cdc90 con 0x7ff6a80d1220 2023-07-09T21:52:50.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.861+0000 7ff6adbff700 1 -- 172.21.15.53:0/2096469759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a804e280 con 0x7ff6a80d1220 2023-07-09T21:52:50.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.862+0000 7ff68ffff700 1 -- 172.21.15.53:0/2096469759 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7ff6a0019070 con 0x7ff6a80d1220 2023-07-09T21:52:50.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.863+0000 7ff68ffff700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff69406ae00 0x7ff69406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:50.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.863+0000 7ff68ffff700 1 -- 172.21.15.53:0/2096469759 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7ff6a008a780 con 0x7ff6a80d1220 2023-07-09T21:52:50.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.863+0000 7ff6a77fe700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff69406ae00 0x7ff69406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:50.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.864+0000 7ff6a77fe700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff69406ae00 0x7ff69406d2b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff698004f80 tx=0x7ff698009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:50.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:50.867+0000 7ff68ffff700 1 -- 172.21.15.53:0/2096469759 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff6a00555c0 con 0x7ff6a80d1220 2023-07-09T21:52:51.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.082+0000 7ff6adbff700 1 -- 172.21.15.53:0/2096469759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6a815bdb0 con 0x7ff6a80d1220 2023-07-09T21:52:51.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.084+0000 7ff68ffff700 1 -- 172.21.15.53:0/2096469759 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18435 (secure 0 0 0) 0x7ff6a0017090 con 0x7ff6a80d1220 2023-07-09T21:52:51.085 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:51.085 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":52,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:52:43.613556+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:52:16.672667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:52:17.375922+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":52,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:52:51.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.086+0000 7ff6adbff700 1 -- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff69406ae00 msgr2=0x7ff69406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:51.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.086+0000 7ff6adbff700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff69406ae00 0x7ff69406d2b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff698004f80 tx=0x7ff698009040 comp rx=0 tx=0).stop 2023-07-09T21:52:51.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.086+0000 7ff6adbff700 1 -- 172.21.15.53:0/2096469759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6a80d1220 msgr2=0x7ff6a80c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:51.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.086+0000 7ff6adbff700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6a80d1220 0x7ff6a80c6ab0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0015040 tx=0x7ff6a0004ad0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.086+0000 7ff6adbff700 1 -- 172.21.15.53:0/2096469759 shutdown_connections 2023-07-09T21:52:51.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.086+0000 7ff6adbff700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ff69406ae00 0x7ff69406d2b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.086+0000 7ff6adbff700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6a80d1220 0x7ff6a80c6ab0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.086+0000 7ff6adbff700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a80b1e00 0x7ff6a8154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.086+0000 7ff6adbff700 1 --2- 172.21.15.53:0/2096469759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a80b2350 0x7ff6a80ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.086+0000 7ff6adbff700 1 -- 172.21.15.53:0/2096469759 >> 172.21.15.53:0/2096469759 conn(0x7ff6a809c1d0 msgr2=0x7ff6a80b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:51.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.086+0000 7ff6adbff700 1 -- 172.21.15.53:0/2096469759 shutdown_connections 2023-07-09T21:52:51.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.086+0000 7ff6adbff700 1 -- 172.21.15.53:0/2096469759 wait complete. 2023-07-09T21:52:51.105 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T21:52:51.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.304+0000 7fdfaa9ff700 1 Processor -- start 2023-07-09T21:52:51.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.305+0000 7fdfaa9ff700 1 -- start start 2023-07-09T21:52:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.306+0000 7fdfaa9ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdfa40b4600 0x7fdfa40cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.306+0000 7fdfaa9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa40d0260 0x7fdfa40cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.306+0000 7fdfaa9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa415cd60 con 0x7fdfa40cda80 2023-07-09T21:52:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.306+0000 7fdfaa9ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa40d1550 con 0x7fdfa40b4600 2023-07-09T21:52:51.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.306+0000 7fdfaa9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40d2d90 con 0x7fdfa40d0260 2023-07-09T21:52:51.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.306+0000 7fdfa3fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdfa40b4600 0x7fdfa40cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:51.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.306+0000 7fdfa3fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdfa40b4600 0x7fdfa40cfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48428/0 (socket says 172.21.15.53:48428) 2023-07-09T21:52:51.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.306+0000 7fdfa3fff700 1 -- 172.21.15.53:0/2878922386 learned_addr learned my addr 172.21.15.53:0/2878922386 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.306+0000 7fdfa37fe700 1 --2- 172.21.15.53:0/2878922386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa40d0260 0x7fdfa40cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.307+0000 7fdfa3fff700 1 -- 172.21.15.53:0/2878922386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa40d0260 msgr2=0x7fdfa40cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.307+0000 7fdfa3fff700 1 --2- 172.21.15.53:0/2878922386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa40d0260 0x7fdfa40cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.307+0000 7fdfa3fff700 1 -- 172.21.15.53:0/2878922386 >> v1:172.21.15.184:6789/0 conn(0x7fdfa40cda80 legacy=0x7fdfa40b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.307+0000 7fdfa3fff700 1 -- 172.21.15.53:0/2878922386 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa40cf340 con 0x7fdfa40b4600 2023-07-09T21:52:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.307+0000 7fdfa3fff700 1 --2- 172.21.15.53:0/2878922386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfa40b4600 0x7fdfa40cfd20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009920 tx=0x7fdf94009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674c03e941fb0e8d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.307+0000 7fdfa2ffd700 1 -- 172.21.15.53:0/2878922386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9400ba20 con 0x7fdfa40b4600 2023-07-09T21:52:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.307+0000 7fdfa2ffd700 1 -- 172.21.15.53:0/2878922386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9400bb80 con 0x7fdfa40b4600 2023-07-09T21:52:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.307+0000 7fdfa2ffd700 1 -- 172.21.15.53:0/2878922386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94009e70 con 0x7fdfa40b4600 2023-07-09T21:52:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.308+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/2878922386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfa40b4600 msgr2=0x7fdfa40cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.308+0000 7fdfaa9ff700 1 --2- 172.21.15.53:0/2878922386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfa40b4600 0x7fdfa40cfd20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009920 tx=0x7fdf94009c30 comp rx=0 tx=0).stop 2023-07-09T21:52:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.308+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/2878922386 shutdown_connections 2023-07-09T21:52:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.308+0000 7fdfaa9ff700 1 --2- 172.21.15.53:0/2878922386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfa40b4600 0x7fdfa40cfd20 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.308+0000 7fdfaa9ff700 1 --2- 172.21.15.53:0/2878922386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa40d0260 0x7fdfa40cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.308+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/2878922386 >> 172.21.15.53:0/2878922386 conn(0x7fdfa409c200 msgr2=0x7fdfa40d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.308+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/2878922386 shutdown_connections 2023-07-09T21:52:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.308+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/2878922386 wait complete. 2023-07-09T21:52:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.310+0000 7fdfaa9ff700 1 Processor -- start 2023-07-09T21:52:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.310+0000 7fdfaa9ff700 1 -- start start 2023-07-09T21:52:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfaa9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa40cda80 0x7fdfa41504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfaa9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfa40d0260 0x7fdfa40cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfaa9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa40c8e80 0x7fdfa40c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfaa9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40ca9d0 con 0x7fdfa40d0260 2023-07-09T21:52:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfaa9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40cacb0 con 0x7fdfa40cda80 2023-07-09T21:52:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfaa9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40caf90 con 0x7fdfa40c8e80 2023-07-09T21:52:51.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfa37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfa40d0260 0x7fdfa40cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:51.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfa37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfa40d0260 0x7fdfa40cbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48444/0 (socket says 172.21.15.53:48444) 2023-07-09T21:52:51.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfa37fe700 1 -- 172.21.15.53:0/1056498815 learned_addr learned my addr 172.21.15.53:0/1056498815 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:51.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfa3fff700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa40cda80 0x7fdfa41504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:51.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfa8f9c700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa40c8e80 0x7fdfa40c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:51.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfa37fe700 1 -- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa40c8e80 msgr2=0x7fdfa40c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:51.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfa37fe700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa40c8e80 0x7fdfa40c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfa37fe700 1 -- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa40cda80 msgr2=0x7fdfa41504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfa37fe700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa40cda80 0x7fdfa41504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.312+0000 7fdfa37fe700 1 -- 172.21.15.53:0/1056498815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94009550 con 0x7fdfa40d0260 2023-07-09T21:52:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.313+0000 7fdfa37fe700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfa40d0260 0x7fdfa40cbd50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800e810 tx=0x7fdf9800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:51.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.313+0000 7fdfa0ff9700 1 -- 172.21.15.53:0/1056498815 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98013610 con 0x7fdfa40d0260 2023-07-09T21:52:51.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.313+0000 7fdfa0ff9700 1 -- 172.21.15.53:0/1056498815 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf98013770 con 0x7fdfa40d0260 2023-07-09T21:52:51.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.313+0000 7fdfa0ff9700 1 -- 172.21.15.53:0/1056498815 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98013b20 con 0x7fdfa40d0260 2023-07-09T21:52:51.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.313+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/1056498815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa40cb270 con 0x7fdfa40d0260 2023-07-09T21:52:51.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.313+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/1056498815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa40cb830 con 0x7fdfa40d0260 2023-07-09T21:52:51.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.314+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/1056498815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa40cbba0 con 0x7fdfa40d0260 2023-07-09T21:52:51.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.315+0000 7fdfa0ff9700 1 -- 172.21.15.53:0/1056498815 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fdf98013c80 con 0x7fdfa40d0260 2023-07-09T21:52:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.316+0000 7fdfa0ff9700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdf9006ae00 0x7fdf9006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.316+0000 7fdfa0ff9700 1 -- 172.21.15.53:0/1056498815 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fdf980893d0 con 0x7fdfa40d0260 2023-07-09T21:52:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.316+0000 7fdfa3fff700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdf9006ae00 0x7fdf9006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.317+0000 7fdfa3fff700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdf9006ae00 0x7fdf9006d2b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdf94000c00 tx=0x7fdf94008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:51.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.320+0000 7fdfa0ff9700 1 -- 172.21.15.53:0/1056498815 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf98057c20 con 0x7fdfa40d0260 2023-07-09T21:52:51.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.572+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/1056498815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdfa4074350 con 0x7fdfa40d0260 2023-07-09T21:52:51.574 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-07-09T21:52:51.573+0000 7f231e3f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T21:52:51.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.577+0000 7fdfa0ff9700 1 -- 172.21.15.53:0/1056498815 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdf980577b0 con 0x7fdfa40d0260 2023-07-09T21:52:51.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.580+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdf9006ae00 msgr2=0x7fdf9006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:51.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.580+0000 7fdfaa9ff700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdf9006ae00 0x7fdf9006d2b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdf94000c00 tx=0x7fdf94008030 comp rx=0 tx=0).stop 2023-07-09T21:52:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.580+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/1056498815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfa40d0260 msgr2=0x7fdfa40cbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.580+0000 7fdfaa9ff700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfa40d0260 0x7fdfa40cbd50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800e810 tx=0x7fdf9800eb20 comp rx=0 tx=0).stop 2023-07-09T21:52:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.580+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/1056498815 shutdown_connections 2023-07-09T21:52:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.580+0000 7fdfaa9ff700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fdf9006ae00 0x7fdf9006d2b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.580+0000 7fdfaa9ff700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa40c8e80 0x7fdfa40c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.580+0000 7fdfaa9ff700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa40cda80 0x7fdfa41504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.580+0000 7fdfaa9ff700 1 --2- 172.21.15.53:0/1056498815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfa40d0260 0x7fdfa40cbd50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.580+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/1056498815 >> 172.21.15.53:0/1056498815 conn(0x7fdfa409c200 msgr2=0x7fdfa415b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:51.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.580+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/1056498815 shutdown_connections 2023-07-09T21:52:51.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.580+0000 7fdfaa9ff700 1 -- 172.21.15.53:0/1056498815 wait complete. 2023-07-09T21:52:51.583 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T21:52:51.600 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T21:52:51.653 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-07-09T21:52:51.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.806+0000 7f868d7ff700 1 Processor -- start 2023-07-09T21:52:51.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.807+0000 7f868d7ff700 1 -- start start 2023-07-09T21:52:51.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.808+0000 7f868d7ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f86880b12f0 0x7f86880ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:51.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.808+0000 7f868d7ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868815ce70 con 0x7f86880adea0 2023-07-09T21:52:51.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.808+0000 7f868d7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868815d0c0 con 0x7f86880c99e0 2023-07-09T21:52:51.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.808+0000 7f868d7ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868815da60 con 0x7f86880b12f0 2023-07-09T21:52:51.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.808+0000 7f86867fc700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f86880adea0 0x7f86880c92d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38052/0 (socket says 172.21.15.53:38052) 2023-07-09T21:52:51.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.808+0000 7f86867fc700 1 -- 172.21.15.53:0/2640868239 learned_addr learned my addr 172.21.15.53:0/2640868239 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:51.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.808+0000 7f8686ffd700 1 --2- 172.21.15.53:0/2640868239 >> v2:172.21.15.53:3300/0 conn(0x7f86880b12f0 0x7f86880ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:51.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.809+0000 7f8685ffb700 1 -- 172.21.15.53:0/2640868239 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6579641 0 0) 0x7f868815ce70 con 0x7f86880adea0 2023-07-09T21:52:51.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.809+0000 7f8685ffb700 1 -- 172.21.15.53:0/2640868239 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86700035b0 con 0x7f86880adea0 2023-07-09T21:52:51.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.809+0000 7f8686ffd700 1 -- 172.21.15.53:0/2640868239 >> v1:172.21.15.184:6789/0 conn(0x7f86880c99e0 legacy=0x7f86880cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:51.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.809+0000 7f8686ffd700 1 -- 172.21.15.53:0/2640868239 >> v1:172.21.15.53:6789/0 conn(0x7f86880adea0 legacy=0x7f86880c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:51.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.809+0000 7f8686ffd700 1 -- 172.21.15.53:0/2640868239 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868815d3a0 con 0x7f86880b12f0 2023-07-09T21:52:51.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.809+0000 7f8686ffd700 1 --2- 172.21.15.53:0/2640868239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86880b12f0 0x7f86880ad8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8678009840 tx=0x7f8678009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4d9339eac5058a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:51.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.809+0000 7f8685ffb700 1 -- 172.21.15.53:0/2640868239 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678011830 con 0x7f86880b12f0 2023-07-09T21:52:51.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.809+0000 7f8685ffb700 1 -- 172.21.15.53:0/2640868239 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8678011990 con 0x7f86880b12f0 2023-07-09T21:52:51.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.809+0000 7f8685ffb700 1 -- 172.21.15.53:0/2640868239 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678011d20 con 0x7f86880b12f0 2023-07-09T21:52:51.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.810+0000 7f868d7ff700 1 -- 172.21.15.53:0/2640868239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86880b12f0 msgr2=0x7f86880ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:51.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.810+0000 7f868d7ff700 1 --2- 172.21.15.53:0/2640868239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86880b12f0 0x7f86880ad8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8678009840 tx=0x7f8678009b50 comp rx=0 tx=0).stop 2023-07-09T21:52:51.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.810+0000 7f868d7ff700 1 -- 172.21.15.53:0/2640868239 shutdown_connections 2023-07-09T21:52:51.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.810+0000 7f868d7ff700 1 --2- 172.21.15.53:0/2640868239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86880b12f0 0x7f86880ad8f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.810+0000 7f868d7ff700 1 -- 172.21.15.53:0/2640868239 >> 172.21.15.53:0/2640868239 conn(0x7f86880b05d0 msgr2=0x7f86880b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:51.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.810+0000 7f868d7ff700 1 -- 172.21.15.53:0/2640868239 shutdown_connections 2023-07-09T21:52:51.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.810+0000 7f868d7ff700 1 -- 172.21.15.53:0/2640868239 wait complete. 2023-07-09T21:52:51.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.812+0000 7f868d7ff700 1 Processor -- start 2023-07-09T21:52:51.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.812+0000 7f868d7ff700 1 -- start start 2023-07-09T21:52:51.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f868d7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86880adea0 0x7f86881e7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:51.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f868d7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86880b12f0 0x7f8688152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:51.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f868d7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86880c99e0 0x7f8688153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:51.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f868d7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880c6810 con 0x7f86880adea0 2023-07-09T21:52:51.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f868d7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880c6af0 con 0x7f86880c99e0 2023-07-09T21:52:51.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f868d7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86880c6dd0 con 0x7f86880b12f0 2023-07-09T21:52:51.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f8686ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86880adea0 0x7f86881e7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:51.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f8686ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86880adea0 0x7f86881e7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48486/0 (socket says 172.21.15.53:48486) 2023-07-09T21:52:51.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f8686ffd700 1 -- 172.21.15.53:0/3300598944 learned_addr learned my addr 172.21.15.53:0/3300598944 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:51.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f8686ffd700 1 -- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86880b12f0 msgr2=0x7f8688152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:51.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f8686ffd700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86880b12f0 0x7f8688152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f8686ffd700 1 -- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86880c99e0 msgr2=0x7f8688153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:51.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f86877fe700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86880c99e0 0x7f8688153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:51.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f8686ffd700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86880c99e0 0x7f8688153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:51.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f8686ffd700 1 -- 172.21.15.53:0/3300598944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86780094a0 con 0x7f86880adea0 2023-07-09T21:52:51.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.813+0000 7f86877fe700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86880c99e0 0x7f8688153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:51.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.814+0000 7f8686ffd700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86880adea0 0x7f86881e7430 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8678009fd0 tx=0x7f8678004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:51.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.814+0000 7f866f7fe700 1 -- 172.21.15.53:0/3300598944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86780038a0 con 0x7f86880adea0 2023-07-09T21:52:51.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.814+0000 7f866f7fe700 1 -- 172.21.15.53:0/3300598944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867801f070 con 0x7f86880adea0 2023-07-09T21:52:51.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.814+0000 7f868d7ff700 1 -- 172.21.15.53:0/3300598944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86880c70b0 con 0x7f86880adea0 2023-07-09T21:52:51.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.814+0000 7f866f7fe700 1 -- 172.21.15.53:0/3300598944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678003c40 con 0x7f86880adea0 2023-07-09T21:52:51.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.814+0000 7f868d7ff700 1 -- 172.21.15.53:0/3300598944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86881e7970 con 0x7f86880adea0 2023-07-09T21:52:51.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.815+0000 7f868d7ff700 1 -- 172.21.15.53:0/3300598944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86880c75d0 con 0x7f86880adea0 2023-07-09T21:52:51.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.816+0000 7f866f7fe700 1 -- 172.21.15.53:0/3300598944 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f8678026480 con 0x7f86880adea0 2023-07-09T21:52:51.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.817+0000 7f866f7fe700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f867406ae00 0x7f867406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:51.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.817+0000 7f866f7fe700 1 -- 172.21.15.53:0/3300598944 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6176+0+0 (secure 0 0 0) 0x7f8678021070 con 0x7f86880adea0 2023-07-09T21:52:51.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.818+0000 7f86867fc700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f867406ae00 0x7f867406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:51.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.818+0000 7f86867fc700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f867406ae00 0x7f867406d2b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f86881f5710 tx=0x7f867c0079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:51.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:51.821+0000 7f866f7fe700 1 -- 172.21.15.53:0/3300598944 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f86880c75d0 con 0x7f86880adea0 2023-07-09T21:52:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.078+0000 7f868d7ff700 1 -- 172.21.15.53:0/3300598944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f86880c75d0 con 0x7f86880adea0 2023-07-09T21:52:52.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.650+0000 7f866f7fe700 1 -- 172.21.15.53:0/3300598944 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8678055f20 con 0x7f86880adea0 2023-07-09T21:52:52.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.653+0000 7f868d7ff700 1 -- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f867406ae00 msgr2=0x7f867406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.653+0000 7f868d7ff700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f867406ae00 0x7f867406d2b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f86881f5710 tx=0x7f867c0079c0 comp rx=0 tx=0).stop 2023-07-09T21:52:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.653+0000 7f868d7ff700 1 -- 172.21.15.53:0/3300598944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86880adea0 msgr2=0x7f86881e7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.653+0000 7f868d7ff700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86880adea0 0x7f86881e7430 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8678009fd0 tx=0x7f8678004750 comp rx=0 tx=0).stop 2023-07-09T21:52:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.653+0000 7f868d7ff700 1 -- 172.21.15.53:0/3300598944 shutdown_connections 2023-07-09T21:52:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.653+0000 7f868d7ff700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f867406ae00 0x7f867406d2b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.653+0000 7f868d7ff700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86880c99e0 0x7f8688153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.653+0000 7f868d7ff700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86880adea0 0x7f86881e7430 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.653+0000 7f868d7ff700 1 --2- 172.21.15.53:0/3300598944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86880b12f0 0x7f8688152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.653+0000 7f868d7ff700 1 -- 172.21.15.53:0/3300598944 >> 172.21.15.53:0/3300598944 conn(0x7f86880b05d0 msgr2=0x7f86880c9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.653+0000 7f868d7ff700 1 -- 172.21.15.53:0/3300598944 shutdown_connections 2023-07-09T21:52:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.653+0000 7f868d7ff700 1 -- 172.21.15.53:0/3300598944 wait complete. 2023-07-09T21:52:52.675 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T21:52:52.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.880+0000 7ffb341ff700 1 Processor -- start 2023-07-09T21:52:52.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.880+0000 7ffb341ff700 1 -- start start 2023-07-09T21:52:52.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.881+0000 7ffb341ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ffb2c0d1140 0x7ffb2c15c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:52.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.881+0000 7ffb341ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2c0ce030 0x7ffb2c0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:52.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.881+0000 7ffb341ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2c0d2c70 con 0x7ffb2c0d28a0 2023-07-09T21:52:52.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.881+0000 7ffb341ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c0d3de0 con 0x7ffb2c0d1140 2023-07-09T21:52:52.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.881+0000 7ffb341ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c15ccf0 con 0x7ffb2c0ce030 2023-07-09T21:52:52.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.882+0000 7ffb31f9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffb2c0d28a0 0x7ffb2c0d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41512/0 (socket says 172.21.15.53:41512) 2023-07-09T21:52:52.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.882+0000 7ffb31f9b700 1 -- 172.21.15.53:0/2930468956 learned_addr learned my addr 172.21.15.53:0/2930468956 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:52.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.882+0000 7ffb3279c700 1 --2- 172.21.15.53:0/2930468956 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2c0ce030 0x7ffb2c0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:52.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.882+0000 7ffb3179a700 1 --2- 172.21.15.53:0/2930468956 >> v2:172.21.15.184:3300/0 conn(0x7ffb2c0d1140 0x7ffb2c15c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:52.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.882+0000 7ffb30f99700 1 -- 172.21.15.53:0/2930468956 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762225125 0 0) 0x7ffb2c0d2c70 con 0x7ffb2c0d28a0 2023-07-09T21:52:52.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.882+0000 7ffb30f99700 1 -- 172.21.15.53:0/2930468956 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb180035b0 con 0x7ffb2c0d28a0 2023-07-09T21:52:52.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.882+0000 7ffb3279c700 1 -- 172.21.15.53:0/2930468956 >> v2:172.21.15.184:3300/0 conn(0x7ffb2c0d1140 msgr2=0x7ffb2c15c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:52.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.882+0000 7ffb3279c700 1 --2- 172.21.15.53:0/2930468956 >> v2:172.21.15.184:3300/0 conn(0x7ffb2c0d1140 0x7ffb2c15c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:52.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.882+0000 7ffb3279c700 1 -- 172.21.15.53:0/2930468956 >> v1:172.21.15.53:6789/0 conn(0x7ffb2c0d28a0 legacy=0x7ffb2c0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:52.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.882+0000 7ffb3279c700 1 -- 172.21.15.53:0/2930468956 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c0d0190 con 0x7ffb2c0ce030 2023-07-09T21:52:52.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.883+0000 7ffb3279c700 1 --2- 172.21.15.53:0/2930468956 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2c0ce030 0x7ffb2c0ce490 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009d90 tx=0x7ffb2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ae3c1f6f21825b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:52.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.883+0000 7ffb30f99700 1 -- 172.21.15.53:0/2930468956 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400e070 con 0x7ffb2c0ce030 2023-07-09T21:52:52.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.883+0000 7ffb30f99700 1 -- 172.21.15.53:0/2930468956 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2400bb20 con 0x7ffb2c0ce030 2023-07-09T21:52:52.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.883+0000 7ffb30f99700 1 -- 172.21.15.53:0/2930468956 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24012430 con 0x7ffb2c0ce030 2023-07-09T21:52:52.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.883+0000 7ffb341ff700 1 -- 172.21.15.53:0/2930468956 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2c0ce030 msgr2=0x7ffb2c0ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:52.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.883+0000 7ffb341ff700 1 --2- 172.21.15.53:0/2930468956 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2c0ce030 0x7ffb2c0ce490 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009d90 tx=0x7ffb2400b330 comp rx=0 tx=0).stop 2023-07-09T21:52:52.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.884+0000 7ffb341ff700 1 -- 172.21.15.53:0/2930468956 shutdown_connections 2023-07-09T21:52:52.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.884+0000 7ffb341ff700 1 --2- 172.21.15.53:0/2930468956 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2c0ce030 0x7ffb2c0ce490 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:52.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.884+0000 7ffb341ff700 1 --2- 172.21.15.53:0/2930468956 >> v2:172.21.15.184:3300/0 conn(0x7ffb2c0d1140 0x7ffb2c15c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:52.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.884+0000 7ffb341ff700 1 -- 172.21.15.53:0/2930468956 >> 172.21.15.53:0/2930468956 conn(0x7ffb2c09c1b0 msgr2=0x7ffb2c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:52.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.884+0000 7ffb341ff700 1 -- 172.21.15.53:0/2930468956 shutdown_connections 2023-07-09T21:52:52.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.884+0000 7ffb341ff700 1 -- 172.21.15.53:0/2930468956 wait complete. 2023-07-09T21:52:52.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.885+0000 7ffb341ff700 1 Processor -- start 2023-07-09T21:52:52.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.885+0000 7ffb341ff700 1 -- start start 2023-07-09T21:52:52.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.886+0000 7ffb341ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2c0ce030 0x7ffb2c14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:52.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.886+0000 7ffb341ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb2c0d1140 0x7ffb2c0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:52.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.886+0000 7ffb341ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2c0d28a0 0x7ffb2c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:52.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.886+0000 7ffb341ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c157a20 con 0x7ffb2c0ce030 2023-07-09T21:52:52.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.886+0000 7ffb341ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c15f720 con 0x7ffb2c0d1140 2023-07-09T21:52:52.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.886+0000 7ffb341ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c15eb10 con 0x7ffb2c0d28a0 2023-07-09T21:52:52.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.887+0000 7ffb31f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2c0ce030 0x7ffb2c14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:52.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.887+0000 7ffb31f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2c0ce030 0x7ffb2c14e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54700/0 (socket says 172.21.15.53:54700) 2023-07-09T21:52:52.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.887+0000 7ffb31f9b700 1 -- 172.21.15.53:0/2940472290 learned_addr learned my addr 172.21.15.53:0/2940472290 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:52.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.887+0000 7ffb3279c700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2c0d28a0 0x7ffb2c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:52.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.887+0000 7ffb3179a700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb2c0d1140 0x7ffb2c0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:52.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.887+0000 7ffb31f9b700 1 -- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2c0d28a0 msgr2=0x7ffb2c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:52.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.887+0000 7ffb31f9b700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2c0d28a0 0x7ffb2c0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:52.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.887+0000 7ffb31f9b700 1 -- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb2c0d1140 msgr2=0x7ffb2c0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:52.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.887+0000 7ffb31f9b700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb2c0d1140 0x7ffb2c0b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:52.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.887+0000 7ffb31f9b700 1 -- 172.21.15.53:0/2940472290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb24009a70 con 0x7ffb2c0ce030 2023-07-09T21:52:52.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.887+0000 7ffb31f9b700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2c0ce030 0x7ffb2c14e3b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ffb28001eb0 tx=0x7ffb2800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:52.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.888+0000 7ffb227fc700 1 -- 172.21.15.53:0/2940472290 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28005d70 con 0x7ffb2c0ce030 2023-07-09T21:52:52.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.888+0000 7ffb227fc700 1 -- 172.21.15.53:0/2940472290 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb280070d0 con 0x7ffb2c0ce030 2023-07-09T21:52:52.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.888+0000 7ffb341ff700 1 -- 172.21.15.53:0/2940472290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c15edf0 con 0x7ffb2c0ce030 2023-07-09T21:52:52.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.888+0000 7ffb227fc700 1 -- 172.21.15.53:0/2940472290 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28007460 con 0x7ffb2c0ce030 2023-07-09T21:52:52.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.888+0000 7ffb341ff700 1 -- 172.21.15.53:0/2940472290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c15f3b0 con 0x7ffb2c0ce030 2023-07-09T21:52:52.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.889+0000 7ffb341ff700 1 -- 172.21.15.53:0/2940472290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2c074350 con 0x7ffb2c0ce030 2023-07-09T21:52:52.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.890+0000 7ffb227fc700 1 -- 172.21.15.53:0/2940472290 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7ffb280075c0 con 0x7ffb2c0ce030 2023-07-09T21:52:52.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.891+0000 7ffb227fc700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ffb1006ae00 0x7ffb1006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:52.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.891+0000 7ffb227fc700 1 -- 172.21.15.53:0/2940472290 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6176+0+0 (secure 0 0 0) 0x7ffb28088b10 con 0x7ffb2c0ce030 2023-07-09T21:52:52.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.891+0000 7ffb3179a700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ffb1006ae00 0x7ffb1006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:52.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.892+0000 7ffb3179a700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ffb1006ae00 0x7ffb1006d2b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0cf8a0 tx=0x7ffb1c009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:52.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:52.895+0000 7ffb227fc700 1 -- 172.21.15.53:0/2940472290 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffb28053a50 con 0x7ffb2c0ce030 2023-07-09T21:52:53.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.103+0000 7ffb341ff700 1 -- 172.21.15.53:0/2940472290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffb2c06cee0 con 0x7ffb2c0ce030 2023-07-09T21:52:53.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.657+0000 7ffb227fc700 1 -- 172.21.15.53:0/2940472290 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v54) v1 ==== 181+0+0 (secure 0 0 0) 0x7ffb28057070 con 0x7ffb2c0ce030 2023-07-09T21:52:53.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.661+0000 7ffb341ff700 1 -- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ffb1006ae00 msgr2=0x7ffb1006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:53.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.661+0000 7ffb341ff700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ffb1006ae00 0x7ffb1006d2b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0cf8a0 tx=0x7ffb1c009210 comp rx=0 tx=0).stop 2023-07-09T21:52:53.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.661+0000 7ffb341ff700 1 -- 172.21.15.53:0/2940472290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2c0ce030 msgr2=0x7ffb2c14e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:53.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.661+0000 7ffb341ff700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2c0ce030 0x7ffb2c14e3b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ffb28001eb0 tx=0x7ffb2800c7b0 comp rx=0 tx=0).stop 2023-07-09T21:52:53.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.661+0000 7ffb341ff700 1 -- 172.21.15.53:0/2940472290 shutdown_connections 2023-07-09T21:52:53.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.661+0000 7ffb341ff700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ffb1006ae00 0x7ffb1006d2b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:53.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.661+0000 7ffb341ff700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2c0d28a0 0x7ffb2c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:53.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.661+0000 7ffb341ff700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2c0ce030 0x7ffb2c14e3b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:53.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.661+0000 7ffb341ff700 1 --2- 172.21.15.53:0/2940472290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb2c0d1140 0x7ffb2c0b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:53.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.661+0000 7ffb341ff700 1 -- 172.21.15.53:0/2940472290 >> 172.21.15.53:0/2940472290 conn(0x7ffb2c09c1b0 msgr2=0x7ffb2c0d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:53.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.662+0000 7ffb341ff700 1 -- 172.21.15.53:0/2940472290 shutdown_connections 2023-07-09T21:52:53.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.662+0000 7ffb341ff700 1 -- 172.21.15.53:0/2940472290 wait complete. 2023-07-09T21:52:53.667 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-07-09T21:52:53.684 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T21:52:53.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.899+0000 7fa8e8fff700 1 Processor -- start 2023-07-09T21:52:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.899+0000 7fa8e8fff700 1 -- start start 2023-07-09T21:52:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.900+0000 7fa8e8fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa8e415c7b0 0x7fa8e40ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.900+0000 7fa8e8fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e40d2c70 con 0x7fa8e40d28a0 2023-07-09T21:52:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.901+0000 7fa8e8fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e40d0190 con 0x7fa8e40d1140 2023-07-09T21:52:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.901+0000 7fa8e8fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e40d3de0 con 0x7fa8e415c7b0 2023-07-09T21:52:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.901+0000 7fa8e259c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa8e40d28a0 0x7fa8e40d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41518/0 (socket says 172.21.15.53:41518) 2023-07-09T21:52:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.901+0000 7fa8e259c700 1 -- 172.21.15.53:0/463555556 learned_addr learned my addr 172.21.15.53:0/463555556 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.901+0000 7fa8e2d9d700 1 --2- 172.21.15.53:0/463555556 >> v2:172.21.15.184:3300/0 conn(0x7fa8e415c7b0 0x7fa8e40ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.901+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090587726 0 0) 0x7fa8e40d2c70 con 0x7fa8e40d28a0 2023-07-09T21:52:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.901+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8cc0035b0 con 0x7fa8e40d28a0 2023-07-09T21:52:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.901+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161269585 0 0) 0x7fa8e40d0190 con 0x7fa8e40d1140 2023-07-09T21:52:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.901+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e40d2c70 con 0x7fa8e40d1140 2023-07-09T21:52:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.901+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 64621821 0 0) 0x7fa8cc0035b0 con 0x7fa8e40d28a0 2023-07-09T21:52:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.901+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 >> v2:172.21.15.184:3300/0 conn(0x7fa8e415c7b0 msgr2=0x7fa8e40ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e159a700 1 --2- 172.21.15.53:0/463555556 >> v2:172.21.15.184:3300/0 conn(0x7fa8e415c7b0 0x7fa8e40ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 >> v1:172.21.15.184:6789/0 conn(0x7fa8e40d1140 legacy=0x7fa8e40ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40d0470 con 0x7fa8e40d28a0 2023-07-09T21:52:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 956545419 0 0) 0x7fa8d4001670 con 0x7fa8e40d28a0 2023-07-09T21:52:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e2d9d700 1 --2- 172.21.15.53:0/463555556 >> v2:172.21.15.184:3300/0 conn(0x7fa8e415c7b0 0x7fa8e40ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:52:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 >> v1:172.21.15.53:6789/0 conn(0x7fa8e40d28a0 legacy=0x7fa8e40d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e159a700 1 --2- 172.21.15.53:0/463555556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8cc003ca0 0x7fa8cc004090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e159a700 1 --2- 172.21.15.53:0/463555556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8cc004850 0x7fa8cc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e159a700 1 --2- 172.21.15.53:0/463555556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8cc005250 0x7fa8cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40d3de0 con 0x7fa8cc005250 2023-07-09T21:52:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc00c160 con 0x7fa8cc004850 2023-07-09T21:52:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc00c320 con 0x7fa8cc003ca0 2023-07-09T21:52:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e2d9d700 1 --2- 172.21.15.53:0/463555556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8cc005250 0x7fa8cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e259c700 1 --2- 172.21.15.53:0/463555556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8cc003ca0 0x7fa8cc004090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e1d9b700 1 --2- 172.21.15.53:0/463555556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8cc004850 0x7fa8cc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e2d9d700 1 -- 172.21.15.53:0/463555556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8cc003ca0 msgr2=0x7fa8cc004090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e2d9d700 1 --2- 172.21.15.53:0/463555556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8cc003ca0 0x7fa8cc004090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e2d9d700 1 -- 172.21.15.53:0/463555556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8cc004850 msgr2=0x7fa8cc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e2d9d700 1 --2- 172.21.15.53:0/463555556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8cc004850 0x7fa8cc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.902+0000 7fa8e2d9d700 1 -- 172.21.15.53:0/463555556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0035b0 con 0x7fa8cc005250 2023-07-09T21:52:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.903+0000 7fa8e2d9d700 1 -- 172.21.15.53:0/463555556 reap_dead start 2023-07-09T21:52:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.903+0000 7fa8e2d9d700 1 --2- 172.21.15.53:0/463555556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8cc005250 0x7fa8cc00ba10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00e350 tx=0x7fa8cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca5757fd2f7d968 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.903+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc00edf0 con 0x7fa8cc005250 2023-07-09T21:52:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.903+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc00f040 con 0x7fa8cc005250 2023-07-09T21:52:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.903+0000 7fa8e159a700 1 -- 172.21.15.53:0/463555556 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0146c0 con 0x7fa8cc005250 2023-07-09T21:52:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.903+0000 7fa8e8fff700 1 -- 172.21.15.53:0/463555556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8cc005250 msgr2=0x7fa8cc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.903+0000 7fa8e8fff700 1 --2- 172.21.15.53:0/463555556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8cc005250 0x7fa8cc00ba10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00e350 tx=0x7fa8cc005880 comp rx=0 tx=0).stop 2023-07-09T21:52:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.904+0000 7fa8e8fff700 1 -- 172.21.15.53:0/463555556 shutdown_connections 2023-07-09T21:52:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.904+0000 7fa8e8fff700 1 --2- 172.21.15.53:0/463555556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8cc005250 0x7fa8cc00ba10 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.904+0000 7fa8e8fff700 1 -- 172.21.15.53:0/463555556 >> 172.21.15.53:0/463555556 conn(0x7fa8e409c1b0 msgr2=0x7fa8e40d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.904+0000 7fa8e8fff700 1 -- 172.21.15.53:0/463555556 shutdown_connections 2023-07-09T21:52:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.904+0000 7fa8e8fff700 1 -- 172.21.15.53:0/463555556 wait complete. 2023-07-09T21:52:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.905+0000 7fa8e8fff700 1 Processor -- start 2023-07-09T21:52:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.906+0000 7fa8e8fff700 1 -- start start 2023-07-09T21:52:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e8fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8cc005250 0x7fa8e40cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e8fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8e40c9420 0x7fa8e40c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e8fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8e40c6d40 0x7fa8e40c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e8fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40c8f90 con 0x7fa8cc005250 2023-07-09T21:52:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e8fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e41567a0 con 0x7fa8e40c6d40 2023-07-09T21:52:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e8fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40c7710 con 0x7fa8e40c9420 2023-07-09T21:52:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8cc005250 0x7fa8e40cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8cc005250 0x7fa8e40cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54722/0 (socket says 172.21.15.53:54722) 2023-07-09T21:52:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e259c700 1 -- 172.21.15.53:0/3582439226 learned_addr learned my addr 172.21.15.53:0/3582439226 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e1d9b700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8e40c9420 0x7fa8e40c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e2d9d700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8e40c6d40 0x7fa8e40c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:53.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e259c700 1 -- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8e40c9420 msgr2=0x7fa8e40c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:53.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e259c700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8e40c9420 0x7fa8e40c6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:53.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e259c700 1 -- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8e40c6d40 msgr2=0x7fa8e40c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:53.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e259c700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8e40c6d40 0x7fa8e40c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:53.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.907+0000 7fa8e259c700 1 -- 172.21.15.53:0/3582439226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40c79f0 con 0x7fa8cc005250 2023-07-09T21:52:53.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.908+0000 7fa8e259c700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8cc005250 0x7fa8e40cb460 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4000c00 tx=0x7fa8d4007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:53.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.908+0000 7fa8d2ffd700 1 -- 172.21.15.53:0/3582439226 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4012560 con 0x7fa8cc005250 2023-07-09T21:52:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.908+0000 7fa8d2ffd700 1 -- 172.21.15.53:0/3582439226 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d40126e0 con 0x7fa8cc005250 2023-07-09T21:52:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.908+0000 7fa8d2ffd700 1 -- 172.21.15.53:0/3582439226 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4012a90 con 0x7fa8cc005250 2023-07-09T21:52:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.908+0000 7fa8e8fff700 1 -- 172.21.15.53:0/3582439226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e40c8940 con 0x7fa8cc005250 2023-07-09T21:52:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.908+0000 7fa8e8fff700 1 -- 172.21.15.53:0/3582439226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e40c71e0 con 0x7fa8cc005250 2023-07-09T21:52:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.909+0000 7fa8e8fff700 1 -- 172.21.15.53:0/3582439226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e4071970 con 0x7fa8cc005250 2023-07-09T21:52:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.910+0000 7fa8d2ffd700 1 -- 172.21.15.53:0/3582439226 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fa8d4012bf0 con 0x7fa8cc005250 2023-07-09T21:52:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.911+0000 7fa8d2ffd700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa8c406ae00 0x7fa8c406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.911+0000 7fa8d2ffd700 1 -- 172.21.15.53:0/3582439226 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa8d4089570 con 0x7fa8cc005250 2023-07-09T21:52:53.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.911+0000 7fa8e1d9b700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa8c406ae00 0x7fa8c406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:53.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.912+0000 7fa8e1d9b700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa8c406ae00 0x7fa8c406d2b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa8e41601a0 tx=0x7fa8d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:53.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:53.915+0000 7fa8d2ffd700 1 -- 172.21.15.53:0/3582439226 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa8d40545c0 con 0x7fa8cc005250 2023-07-09T21:52:54.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.123+0000 7fa8e8fff700 1 -- 172.21.15.53:0/3582439226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa8e40c9270 con 0x7fa8cc005250 2023-07-09T21:52:54.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.666+0000 7fa8d2ffd700 1 -- 172.21.15.53:0/3582439226 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v55) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa8d4057be0 con 0x7fa8cc005250 2023-07-09T21:52:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.672+0000 7fa8e8fff700 1 -- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa8c406ae00 msgr2=0x7fa8c406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.672+0000 7fa8e8fff700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa8c406ae00 0x7fa8c406d2b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa8e41601a0 tx=0x7fa8d8009040 comp rx=0 tx=0).stop 2023-07-09T21:52:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.672+0000 7fa8e8fff700 1 -- 172.21.15.53:0/3582439226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8cc005250 msgr2=0x7fa8e40cb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.672+0000 7fa8e8fff700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8cc005250 0x7fa8e40cb460 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4000c00 tx=0x7fa8d4007570 comp rx=0 tx=0).stop 2023-07-09T21:52:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.672+0000 7fa8e8fff700 1 -- 172.21.15.53:0/3582439226 shutdown_connections 2023-07-09T21:52:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.672+0000 7fa8e8fff700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fa8c406ae00 0x7fa8c406d2b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.672+0000 7fa8e8fff700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8e40c6d40 0x7fa8e40c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.672+0000 7fa8e8fff700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8cc005250 0x7fa8e40cb460 secure :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4000c00 tx=0x7fa8d4007570 comp rx=0 tx=0).stop 2023-07-09T21:52:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.672+0000 7fa8e8fff700 1 --2- 172.21.15.53:0/3582439226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8e40c9420 0x7fa8e40c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.672+0000 7fa8e8fff700 1 -- 172.21.15.53:0/3582439226 >> 172.21.15.53:0/3582439226 conn(0x7fa8e409c1b0 msgr2=0x7fa8e406b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.673+0000 7fa8e8fff700 1 -- 172.21.15.53:0/3582439226 shutdown_connections 2023-07-09T21:52:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.674+0000 7fa8e8fff700 1 -- 172.21.15.53:0/3582439226 wait complete. 2023-07-09T21:52:54.677 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-07-09T21:52:54.697 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T21:52:54.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.905+0000 7f32649ff700 1 Processor -- start 2023-07-09T21:52:54.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.905+0000 7f32649ff700 1 -- start start 2023-07-09T21:52:54.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.906+0000 7f32649ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32600cd430 0x7f32600cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:54.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.906+0000 7f32649ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f32600b4860 0x7f32600b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:54.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.907+0000 7f32649ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32600d02a0 con 0x7f32601601f0 2023-07-09T21:52:54.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.907+0000 7f32649ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32600b5210 con 0x7f32600b4860 2023-07-09T21:52:54.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.907+0000 7f32649ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32600cfce0 con 0x7f32600cd430 2023-07-09T21:52:54.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.907+0000 7f325ed9d700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f32601601f0 0x7f3260160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41526/0 (socket says 172.21.15.53:41526) 2023-07-09T21:52:54.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.907+0000 7f325ed9d700 1 -- 172.21.15.53:0/3213625322 learned_addr learned my addr 172.21.15.53:0/3213625322 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:54.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.907+0000 7f325e59c700 1 --2- 172.21.15.53:0/3213625322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32600cd430 0x7f32600cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:54.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.907+0000 7f3257fff700 1 --2- 172.21.15.53:0/3213625322 >> v2:172.21.15.184:3300/0 conn(0x7f32600b4860 0x7f32600b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:54.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.907+0000 7f325dd9b700 1 -- 172.21.15.53:0/3213625322 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464883003 0 0) 0x7f32600d02a0 con 0x7f32601601f0 2023-07-09T21:52:54.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.907+0000 7f325dd9b700 1 -- 172.21.15.53:0/3213625322 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f324c0035b0 con 0x7f32601601f0 2023-07-09T21:52:54.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.908+0000 7f325dd9b700 1 -- 172.21.15.53:0/3213625322 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2275348727 0 0) 0x7f324c0035b0 con 0x7f32601601f0 2023-07-09T21:52:54.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.908+0000 7f325e59c700 1 -- 172.21.15.53:0/3213625322 >> v2:172.21.15.184:3300/0 conn(0x7f32600b4860 msgr2=0x7f32600b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:54.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.908+0000 7f325e59c700 1 --2- 172.21.15.53:0/3213625322 >> v2:172.21.15.184:3300/0 conn(0x7f32600b4860 0x7f32600b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:54.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.908+0000 7f325e59c700 1 -- 172.21.15.53:0/3213625322 >> v1:172.21.15.53:6789/0 conn(0x7f32601601f0 legacy=0x7f3260160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:54.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.908+0000 7f325e59c700 1 -- 172.21.15.53:0/3213625322 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32600cffc0 con 0x7f32600cd430 2023-07-09T21:52:54.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.908+0000 7f325e59c700 1 --2- 172.21.15.53:0/3213625322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32600cd430 0x7f32600cd800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3250009840 tx=0x7f3250009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71cc3e3c68e4aff6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:54.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.908+0000 7f325dd9b700 1 -- 172.21.15.53:0/3213625322 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32580019f0 con 0x7f32600cd430 2023-07-09T21:52:54.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.908+0000 7f325dd9b700 1 -- 172.21.15.53:0/3213625322 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250004030 con 0x7f32600cd430 2023-07-09T21:52:54.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.908+0000 7f325dd9b700 1 -- 172.21.15.53:0/3213625322 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32500043a0 con 0x7f32600cd430 2023-07-09T21:52:54.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.909+0000 7f32649ff700 1 -- 172.21.15.53:0/3213625322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32600cd430 msgr2=0x7f32600cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:54.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.909+0000 7f32649ff700 1 --2- 172.21.15.53:0/3213625322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32600cd430 0x7f32600cd800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3250009840 tx=0x7f3250009b50 comp rx=0 tx=0).stop 2023-07-09T21:52:54.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.909+0000 7f32649ff700 1 -- 172.21.15.53:0/3213625322 shutdown_connections 2023-07-09T21:52:54.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.909+0000 7f32649ff700 1 --2- 172.21.15.53:0/3213625322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32600cd430 0x7f32600cd800 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:54.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.909+0000 7f32649ff700 1 --2- 172.21.15.53:0/3213625322 >> v2:172.21.15.184:3300/0 conn(0x7f32600b4860 0x7f32600b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:54.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.909+0000 7f32649ff700 1 -- 172.21.15.53:0/3213625322 >> 172.21.15.53:0/3213625322 conn(0x7f3260066860 msgr2=0x7f326006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:54.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.909+0000 7f32649ff700 1 -- 172.21.15.53:0/3213625322 shutdown_connections 2023-07-09T21:52:54.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.909+0000 7f32649ff700 1 -- 172.21.15.53:0/3213625322 wait complete. 2023-07-09T21:52:54.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.911+0000 7f32649ff700 1 Processor -- start 2023-07-09T21:52:54.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.911+0000 7f32649ff700 1 -- start start 2023-07-09T21:52:54.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.912+0000 7f32649ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32600b4860 0x7f326015f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:54.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.912+0000 7f32649ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32600cd430 0x7f32600b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:54.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.912+0000 7f32649ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32601601f0 0x7f32600c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:54.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.912+0000 7f32649ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32600c70f0 con 0x7f32600b4860 2023-07-09T21:52:54.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.912+0000 7f32649ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326015fac0 con 0x7f32601601f0 2023-07-09T21:52:54.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.912+0000 7f32649ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32601f56d0 con 0x7f32600cd430 2023-07-09T21:52:54.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.912+0000 7f325e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32600b4860 0x7f326015f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:54.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.912+0000 7f325e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32600b4860 0x7f326015f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54726/0 (socket says 172.21.15.53:54726) 2023-07-09T21:52:54.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.912+0000 7f325e59c700 1 -- 172.21.15.53:0/1716021598 learned_addr learned my addr 172.21.15.53:0/1716021598 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:54.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.912+0000 7f325ed9d700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32601601f0 0x7f32600c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:54.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.912+0000 7f3257fff700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32600cd430 0x7f32600b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:54.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.913+0000 7f325e59c700 1 -- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32600cd430 msgr2=0x7f32600b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:54.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.913+0000 7f325e59c700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32600cd430 0x7f32600b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:54.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.913+0000 7f325e59c700 1 -- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32601601f0 msgr2=0x7f32600c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:54.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.913+0000 7f325e59c700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32601601f0 0x7f32600c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:54.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.913+0000 7f325e59c700 1 -- 172.21.15.53:0/1716021598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32500094a0 con 0x7f32600b4860 2023-07-09T21:52:54.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.913+0000 7f325ed9d700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32601601f0 0x7f32600c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:54.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.913+0000 7f325e59c700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32600b4860 0x7f326015f3c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f32500090b0 tx=0x7f3250004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:54.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.913+0000 7f3256ffd700 1 -- 172.21.15.53:0/1716021598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250004570 con 0x7f32600b4860 2023-07-09T21:52:54.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.913+0000 7f3256ffd700 1 -- 172.21.15.53:0/1716021598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325001f070 con 0x7f32600b4860 2023-07-09T21:52:54.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.913+0000 7f32649ff700 1 -- 172.21.15.53:0/1716021598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32601f59b0 con 0x7f32600b4860 2023-07-09T21:52:54.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.913+0000 7f3256ffd700 1 -- 172.21.15.53:0/1716021598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011870 con 0x7f32600b4860 2023-07-09T21:52:54.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.913+0000 7f32649ff700 1 -- 172.21.15.53:0/1716021598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32601f5f70 con 0x7f32600b4860 2023-07-09T21:52:54.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.914+0000 7f32649ff700 1 -- 172.21.15.53:0/1716021598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3260074350 con 0x7f32600b4860 2023-07-09T21:52:54.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.915+0000 7f3256ffd700 1 -- 172.21.15.53:0/1716021598 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f32500119d0 con 0x7f32600b4860 2023-07-09T21:52:54.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.916+0000 7f3256ffd700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f324006ae00 0x7f324006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:54.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.916+0000 7f3256ffd700 1 -- 172.21.15.53:0/1716021598 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f3250021070 con 0x7f32600b4860 2023-07-09T21:52:54.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.917+0000 7f3257fff700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f324006ae00 0x7f324006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:54.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.917+0000 7f3257fff700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f324006ae00 0x7f324006d2b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f32600c8ac0 tx=0x7f3248008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:54.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:54.921+0000 7f3256ffd700 1 -- 172.21.15.53:0/1716021598 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3250055f60 con 0x7f32600b4860 2023-07-09T21:52:55.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.127+0000 7f32649ff700 1 -- 172.21.15.53:0/1716021598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f32600b1600 con 0x7f32600b4860 2023-07-09T21:52:55.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.132+0000 7f3256ffd700 1 -- 172.21.15.53:0/1716021598 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3250059580 con 0x7f32600b4860 2023-07-09T21:52:55.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.134+0000 7f32649ff700 1 -- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f324006ae00 msgr2=0x7f324006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:55.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.134+0000 7f32649ff700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f324006ae00 0x7f324006d2b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f32600c8ac0 tx=0x7f3248008040 comp rx=0 tx=0).stop 2023-07-09T21:52:55.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.134+0000 7f32649ff700 1 -- 172.21.15.53:0/1716021598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32600b4860 msgr2=0x7f326015f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:55.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.134+0000 7f32649ff700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32600b4860 0x7f326015f3c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f32500090b0 tx=0x7f3250004750 comp rx=0 tx=0).stop 2023-07-09T21:52:55.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.134+0000 7f32649ff700 1 -- 172.21.15.53:0/1716021598 shutdown_connections 2023-07-09T21:52:55.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.134+0000 7f32649ff700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f324006ae00 0x7f324006d2b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:55.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.134+0000 7f32649ff700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32601601f0 0x7f32600c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.134+0000 7f32649ff700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32600b4860 0x7f326015f3c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.134+0000 7f32649ff700 1 --2- 172.21.15.53:0/1716021598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32600cd430 0x7f32600b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.134+0000 7f32649ff700 1 -- 172.21.15.53:0/1716021598 >> 172.21.15.53:0/1716021598 conn(0x7f3260066860 msgr2=0x7f32600b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.134+0000 7f32649ff700 1 -- 172.21.15.53:0/1716021598 shutdown_connections 2023-07-09T21:52:55.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.134+0000 7f32649ff700 1 -- 172.21.15.53:0/1716021598 wait complete. 2023-07-09T21:52:55.154 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata' 2023-07-09T21:52:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.353+0000 7f2f973ff700 1 Processor -- start 2023-07-09T21:52:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.353+0000 7f2f973ff700 1 -- start start 2023-07-09T21:52:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.354+0000 7f2f973ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f900d1220 0x7f2f900b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.354+0000 7f2f973ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2f900b2350 0x7f2f900afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f973ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f900d2ce0 con 0x7f2f900b1e00 2023-07-09T21:52:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f973ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f900b3350 con 0x7f2f900d1220 2023-07-09T21:52:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f973ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f900b3630 con 0x7f2f900b2350 2023-07-09T21:52:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f9519b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2f900b1e00 0x7f2f900d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41528/0 (socket says 172.21.15.53:41528) 2023-07-09T21:52:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f9519b700 1 -- 172.21.15.53:0/3041366310 learned_addr learned my addr 172.21.15.53:0/3041366310 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f9499a700 1 --2- 172.21.15.53:0/3041366310 >> v2:172.21.15.53:3300/0 conn(0x7f2f900d1220 0x7f2f900b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:55.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f87fff700 1 -- 172.21.15.53:0/3041366310 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135093328 0 0) 0x7f2f900d2ce0 con 0x7f2f900b1e00 2023-07-09T21:52:55.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f9599c700 1 --2- 172.21.15.53:0/3041366310 >> v2:172.21.15.184:3300/0 conn(0x7f2f900b2350 0x7f2f900afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:55.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f87fff700 1 -- 172.21.15.53:0/3041366310 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f7c0035b0 con 0x7f2f900b1e00 2023-07-09T21:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f9499a700 1 -- 172.21.15.53:0/3041366310 >> v2:172.21.15.184:3300/0 conn(0x7f2f900b2350 msgr2=0x7f2f900afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f9499a700 1 --2- 172.21.15.53:0/3041366310 >> v2:172.21.15.184:3300/0 conn(0x7f2f900b2350 0x7f2f900afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f9499a700 1 -- 172.21.15.53:0/3041366310 >> v1:172.21.15.53:6789/0 conn(0x7f2f900b1e00 legacy=0x7f2f900d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f9499a700 1 -- 172.21.15.53:0/3041366310 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f900b3910 con 0x7f2f900d1220 2023-07-09T21:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.355+0000 7f2f9599c700 1 --2- 172.21.15.53:0/3041366310 >> v2:172.21.15.184:3300/0 conn(0x7f2f900b2350 0x7f2f900afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.356+0000 7f2f9499a700 1 --2- 172.21.15.53:0/3041366310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f900d1220 0x7f2f900b43f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2f9008d650 tx=0x7f2f80009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9650f754e1fa634d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.356+0000 7f2f87fff700 1 -- 172.21.15.53:0/3041366310 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80011830 con 0x7f2f900d1220 2023-07-09T21:52:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.356+0000 7f2f87fff700 1 -- 172.21.15.53:0/3041366310 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f80011990 con 0x7f2f900d1220 2023-07-09T21:52:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.356+0000 7f2f87fff700 1 -- 172.21.15.53:0/3041366310 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80011d00 con 0x7f2f900d1220 2023-07-09T21:52:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.356+0000 7f2f973ff700 1 -- 172.21.15.53:0/3041366310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f900d1220 msgr2=0x7f2f900b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.356+0000 7f2f973ff700 1 --2- 172.21.15.53:0/3041366310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f900d1220 0x7f2f900b43f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2f9008d650 tx=0x7f2f80009b20 comp rx=0 tx=0).stop 2023-07-09T21:52:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.356+0000 7f2f973ff700 1 -- 172.21.15.53:0/3041366310 shutdown_connections 2023-07-09T21:52:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.356+0000 7f2f973ff700 1 --2- 172.21.15.53:0/3041366310 >> v2:172.21.15.184:3300/0 conn(0x7f2f900b2350 0x7f2f900afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.356+0000 7f2f973ff700 1 --2- 172.21.15.53:0/3041366310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f900d1220 0x7f2f900b43f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.356+0000 7f2f973ff700 1 -- 172.21.15.53:0/3041366310 >> 172.21.15.53:0/3041366310 conn(0x7f2f9009c1d0 msgr2=0x7f2f900d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.357+0000 7f2f973ff700 1 -- 172.21.15.53:0/3041366310 shutdown_connections 2023-07-09T21:52:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.357+0000 7f2f973ff700 1 -- 172.21.15.53:0/3041366310 wait complete. 2023-07-09T21:52:55.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.358+0000 7f2f973ff700 1 Processor -- start 2023-07-09T21:52:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.358+0000 7f2f973ff700 1 -- start start 2023-07-09T21:52:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.359+0000 7f2f973ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f900b1e00 0x7f2f900cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.359+0000 7f2f973ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f900b2350 0x7f2f900cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.359+0000 7f2f973ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f900d1220 0x7f2f900cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.359+0000 7f2f973ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f901f39b0 con 0x7f2f900b2350 2023-07-09T21:52:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.359+0000 7f2f973ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f901f3c90 con 0x7f2f900d1220 2023-07-09T21:52:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.359+0000 7f2f973ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f901f3f70 con 0x7f2f900b1e00 2023-07-09T21:52:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.360+0000 7f2f9499a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f900b2350 0x7f2f900cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.360+0000 7f2f9499a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f900b2350 0x7f2f900cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54752/0 (socket says 172.21.15.53:54752) 2023-07-09T21:52:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.360+0000 7f2f9499a700 1 -- 172.21.15.53:0/673994921 learned_addr learned my addr 172.21.15.53:0/673994921 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.360+0000 7f2f9519b700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f900b1e00 0x7f2f900cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.360+0000 7f2f9599c700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f900d1220 0x7f2f900cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.360+0000 7f2f9499a700 1 -- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f900b1e00 msgr2=0x7f2f900cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:55.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.360+0000 7f2f9499a700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f900b1e00 0x7f2f900cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:55.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.360+0000 7f2f9499a700 1 -- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f900d1220 msgr2=0x7f2f900cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:55.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.360+0000 7f2f9499a700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f900d1220 0x7f2f900cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:55.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.360+0000 7f2f9499a700 1 -- 172.21.15.53:0/673994921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800094a0 con 0x7f2f900b2350 2023-07-09T21:52:55.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.360+0000 7f2f9599c700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f900d1220 0x7f2f900cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:55.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.360+0000 7f2f9519b700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f900b1e00 0x7f2f900cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:52:55.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.360+0000 7f2f9499a700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f900b2350 0x7f2f900cc4d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2f80000c00 tx=0x7f2f80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:55.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.361+0000 7f2f85ffb700 1 -- 172.21.15.53:0/673994921 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8001a880 con 0x7f2f900b2350 2023-07-09T21:52:55.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.361+0000 7f2f85ffb700 1 -- 172.21.15.53:0/673994921 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8001aa00 con 0x7f2f900b2350 2023-07-09T21:52:55.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.361+0000 7f2f973ff700 1 -- 172.21.15.53:0/673994921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f901f4250 con 0x7f2f900b2350 2023-07-09T21:52:55.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.361+0000 7f2f85ffb700 1 -- 172.21.15.53:0/673994921 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8001adb0 con 0x7f2f900b2350 2023-07-09T21:52:55.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.361+0000 7f2f973ff700 1 -- 172.21.15.53:0/673994921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f90152cd0 con 0x7f2f900b2350 2023-07-09T21:52:55.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.362+0000 7f2f973ff700 1 -- 172.21.15.53:0/673994921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f901f4770 con 0x7f2f900b2350 2023-07-09T21:52:55.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.363+0000 7f2f85ffb700 1 -- 172.21.15.53:0/673994921 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f2f80022070 con 0x7f2f900b2350 2023-07-09T21:52:55.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.364+0000 7f2f85ffb700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2f7406ae00 0x7f2f7406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:55.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.364+0000 7f2f85ffb700 1 -- 172.21.15.53:0/673994921 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f2f8008a390 con 0x7f2f900b2350 2023-07-09T21:52:55.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.364+0000 7f2f9519b700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2f7406ae00 0x7f2f7406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:55.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.365+0000 7f2f9519b700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2f7406ae00 0x7f2f7406d2b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c001360 tx=0x7f2f8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:55.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.368+0000 7f2f85ffb700 1 -- 172.21.15.53:0/673994921 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2f901f4770 con 0x7f2f900b2350 2023-07-09T21:52:55.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.656+0000 7f2f973ff700 1 -- 172.21.15.53:0/673994921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]} v 0) v1 -- 0x7f2f901f4770 con 0x7f2f900b2350 2023-07-09T21:52:55.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.678+0000 7f2f85ffb700 1 -- 172.21.15.53:0/673994921 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]}]=0 v166) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2f901f4770 con 0x7f2f900b2350 2023-07-09T21:52:55.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.681+0000 7f2f973ff700 1 -- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2f7406ae00 msgr2=0x7f2f7406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:55.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.681+0000 7f2f973ff700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2f7406ae00 0x7f2f7406d2b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c001360 tx=0x7f2f8c009040 comp rx=0 tx=0).stop 2023-07-09T21:52:55.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.681+0000 7f2f973ff700 1 -- 172.21.15.53:0/673994921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f900b2350 msgr2=0x7f2f900cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.681+0000 7f2f973ff700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f900b2350 0x7f2f900cc4d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2f80000c00 tx=0x7f2f80004750 comp rx=0 tx=0).stop 2023-07-09T21:52:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.681+0000 7f2f973ff700 1 -- 172.21.15.53:0/673994921 shutdown_connections 2023-07-09T21:52:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.681+0000 7f2f973ff700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2f7406ae00 0x7f2f7406d2b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.681+0000 7f2f973ff700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f900d1220 0x7f2f900cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.681+0000 7f2f973ff700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f900b1e00 0x7f2f900cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.681+0000 7f2f973ff700 1 --2- 172.21.15.53:0/673994921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f900b2350 0x7f2f900cc4d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.681+0000 7f2f973ff700 1 -- 172.21.15.53:0/673994921 >> 172.21.15.53:0/673994921 conn(0x7f2f9009c1d0 msgr2=0x7f2f900b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.681+0000 7f2f973ff700 1 -- 172.21.15.53:0/673994921 shutdown_connections 2023-07-09T21:52:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:55.681+0000 7f2f973ff700 1 -- 172.21.15.53:0/673994921 wait complete. 2023-07-09T21:52:55.701 INFO:tasks.cephfs_test_runner:test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) ... ERROR 2023-07-09T21:52:55.702 INFO:tasks.cephfs_test_runner: 2023-07-09T21:52:55.702 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-09T21:52:55.702 INFO:tasks.cephfs_test_runner:ERROR: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-07-09T21:52:55.703 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-09T21:52:55.703 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-09T21:52:55.703 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks/cephfs/test_volumes.py", line 5576, in test_clean_stale_subvolume_snapshot_metadata 2023-07-09T21:52:55.704 INFO:tasks.cephfs_test_runner: _ = json.loads(self._get_subvolume_info(self.volname, subvolname, group)) 2023-07-09T21:52:55.704 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks/cephfs/test_volumes.py", line 245, in _get_subvolume_info 2023-07-09T21:52:55.704 INFO:tasks.cephfs_test_runner: subvol_md = self._fs_cmd(*args) 2023-07-09T21:52:55.704 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-07-09T21:52:55.704 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-07-09T21:52:55.705 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd 2023-07-09T21:52:55.705 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-07-09T21:52:55.705 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd 2023-07-09T21:52:55.705 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-07-09T21:52:55.705 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/remote.py", line 522, in run 2023-07-09T21:52:55.706 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-07-09T21:52:55.706 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 455, in run 2023-07-09T21:52:55.706 INFO:tasks.cephfs_test_runner: r.wait() 2023-07-09T21:52:55.706 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 161, in wait 2023-07-09T21:52:55.706 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-07-09T21:52:55.707 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-07-09T21:52:55.707 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-07-09T21:52:55.707 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi053 with status 61: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvolume_0000000000470134 group_0000000000629258' 2023-07-09T21:52:55.707 INFO:tasks.cephfs_test_runner: 2023-07-09T21:52:55.707 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-09T21:52:55.708 INFO:tasks.cephfs_test_runner:Ran 7 tests in 105.712s 2023-07-09T21:52:55.708 INFO:tasks.cephfs_test_runner: 2023-07-09T21:52:55.708 INFO:tasks.cephfs_test_runner:FAILED (errors=1, skipped=5) 2023-07-09T21:52:55.709 INFO:tasks.cephfs_test_runner: 2023-07-09T21:52:55.709 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-09T21:52:55.709 INFO:tasks.cephfs_test_runner:ERROR: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-07-09T21:52:55.709 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-09T21:52:55.710 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-09T21:52:55.710 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks/cephfs/test_volumes.py", line 5576, in test_clean_stale_subvolume_snapshot_metadata 2023-07-09T21:52:55.710 INFO:tasks.cephfs_test_runner: _ = json.loads(self._get_subvolume_info(self.volname, subvolname, group)) 2023-07-09T21:52:55.710 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks/cephfs/test_volumes.py", line 245, in _get_subvolume_info 2023-07-09T21:52:55.710 INFO:tasks.cephfs_test_runner: subvol_md = self._fs_cmd(*args) 2023-07-09T21:52:55.711 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-07-09T21:52:55.711 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-07-09T21:52:55.711 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd 2023-07-09T21:52:55.711 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-07-09T21:52:55.711 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd 2023-07-09T21:52:55.712 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-07-09T21:52:55.712 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/remote.py", line 522, in run 2023-07-09T21:52:55.712 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-07-09T21:52:55.712 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 455, in run 2023-07-09T21:52:55.712 INFO:tasks.cephfs_test_runner: r.wait() 2023-07-09T21:52:55.713 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 161, in wait 2023-07-09T21:52:55.713 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-07-09T21:52:55.713 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-07-09T21:52:55.713 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-07-09T21:52:55.713 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi053 with status 61: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvolume_0000000000470134 group_0000000000629258' 2023-07-09T21:52:55.713 INFO:tasks.cephfs_test_runner: 2023-07-09T21:52:55.714 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-07-09T21:52:55.780 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8a2ac253bc2c42ebb316b610ca455488 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-07-09T21:52:55.783 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-09T21:52:55.792 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-07-09T21:52:55.800 INFO:tasks.kclient:Unmounting kernel clients... 2023-07-09T21:52:55.801 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:52:55.801 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:55.857 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348820k,nr_inodes=4087205,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-09T21:52:55.857 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-07-09T21:52:55.858 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:55.939 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348820k,nr_inodes=4087205,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-09T21:52:55.940 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:52:55.940 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:55.989 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345736k,nr_inodes=4086434,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-09T21:52:55.990 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-09T21:52:55.990 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:52:56.079 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345736k,nr_inodes=4086434,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-09T21:52:56.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:56.081 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-07-09T21:52:56.124 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T21:52:56.125 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:52:56.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:56.126 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:52:56.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:56.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:52:56.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:56.311 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2023-07-09T21:52:56.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:56.421 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-07-09T21:52:56.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:56.467 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2023-07-09T21:52:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:Cannot find device "ceph-brx" 2023-07-09T21:52:56.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:52:56.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:56.583 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-07-09T21:52:56.634 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T21:52:56.635 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T21:52:56.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:56.635 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T21:52:56.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:56.714 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T21:52:56.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:56.787 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-07-09T21:52:56.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:56.895 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-07-09T21:52:56.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:52:56.941 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-07-09T21:52:57.052 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-07-09T21:52:57.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:52:57.055 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-09T21:52:57.065 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-09T21:52:57.066 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:52:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.269+0000 7f1be25ff700 1 Processor -- start 2023-07-09T21:52:57.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.269+0000 7f1be25ff700 1 -- start start 2023-07-09T21:52:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.270+0000 7f1be25ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1bdc070350 0x7f1bdc070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.270+0000 7f1be25ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bdc1597c0 0x7f1bdc159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:57.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.270+0000 7f1be25ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bdc0cdf90 con 0x7f1bdc0cea50 2023-07-09T21:52:57.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.270+0000 7f1be25ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bdc15a2f0 con 0x7f1bdc070350 2023-07-09T21:52:57.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.270+0000 7f1be25ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc15a5d0 con 0x7f1bdc1597c0 2023-07-09T21:52:57.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.271+0000 7f1bdb7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bdc1597c0 0x7f1bdc159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:57.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.271+0000 7f1bdb7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bdc1597c0 0x7f1bdc159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:54672/0 (socket says 172.21.15.53:54672) 2023-07-09T21:52:57.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.271+0000 7f1bdb7fe700 1 -- 172.21.15.53:0/1702641225 learned_addr learned my addr 172.21.15.53:0/1702641225 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:57.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.271+0000 7f1bdbfff700 1 --2- 172.21.15.53:0/1702641225 >> v2:172.21.15.184:3300/0 conn(0x7f1bdc070350 0x7f1bdc070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:57.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.271+0000 7f1bdaffd700 1 -- 172.21.15.53:0/1702641225 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115095621 0 0) 0x7f1bdc0cdf90 con 0x7f1bdc0cea50 2023-07-09T21:52:57.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.271+0000 7f1bdaffd700 1 -- 172.21.15.53:0/1702641225 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc40035b0 con 0x7f1bdc0cea50 2023-07-09T21:52:57.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.271+0000 7f1bdbfff700 1 -- 172.21.15.53:0/1702641225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bdc1597c0 msgr2=0x7f1bdc159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:57.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.271+0000 7f1bdbfff700 1 --2- 172.21.15.53:0/1702641225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bdc1597c0 0x7f1bdc159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.271+0000 7f1bdbfff700 1 -- 172.21.15.53:0/1702641225 >> v1:172.21.15.184:6789/0 conn(0x7f1bdc0cea50 legacy=0x7f1bdc0b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:57.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.271+0000 7f1bdbfff700 1 -- 172.21.15.53:0/1702641225 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc0ce250 con 0x7f1bdc070350 2023-07-09T21:52:57.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.271+0000 7f1bdb7fe700 1 --2- 172.21.15.53:0/1702641225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bdc1597c0 0x7f1bdc159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:52:57.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.272+0000 7f1bdbfff700 1 --2- 172.21.15.53:0/1702641225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bdc070350 0x7f1bdc070720 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009840 tx=0x7f1bcc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3357b38ab83abf25 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:57.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.272+0000 7f1bdaffd700 1 -- 172.21.15.53:0/1702641225 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc011830 con 0x7f1bdc070350 2023-07-09T21:52:57.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.272+0000 7f1bdaffd700 1 -- 172.21.15.53:0/1702641225 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc011990 con 0x7f1bdc070350 2023-07-09T21:52:57.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.272+0000 7f1bdaffd700 1 -- 172.21.15.53:0/1702641225 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc011d20 con 0x7f1bdc070350 2023-07-09T21:52:57.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.272+0000 7f1be25ff700 1 -- 172.21.15.53:0/1702641225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bdc070350 msgr2=0x7f1bdc070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:57.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.272+0000 7f1be25ff700 1 --2- 172.21.15.53:0/1702641225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bdc070350 0x7f1bdc070720 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009840 tx=0x7f1bcc009b50 comp rx=0 tx=0).stop 2023-07-09T21:52:57.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.272+0000 7f1be25ff700 1 -- 172.21.15.53:0/1702641225 shutdown_connections 2023-07-09T21:52:57.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.272+0000 7f1be25ff700 1 --2- 172.21.15.53:0/1702641225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bdc070350 0x7f1bdc070720 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.273+0000 7f1be25ff700 1 --2- 172.21.15.53:0/1702641225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bdc1597c0 0x7f1bdc159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.273+0000 7f1be25ff700 1 -- 172.21.15.53:0/1702641225 >> 172.21.15.53:0/1702641225 conn(0x7f1bdc069f30 msgr2=0x7f1bdc06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:57.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.273+0000 7f1be25ff700 1 -- 172.21.15.53:0/1702641225 shutdown_connections 2023-07-09T21:52:57.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.273+0000 7f1be25ff700 1 -- 172.21.15.53:0/1702641225 wait complete. 2023-07-09T21:52:57.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.275+0000 7f1be25ff700 1 Processor -- start 2023-07-09T21:52:57.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.275+0000 7f1be25ff700 1 -- start start 2023-07-09T21:52:57.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1be25ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bdc070350 0x7f1bdc1f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:57.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1be25ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bdc0cea50 0x7f1bdc153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:57.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1be25ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bdc1597c0 0x7f1bdc070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:57.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1be25ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc153bc0 con 0x7f1bdc070350 2023-07-09T21:52:57.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1be25ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc150590 con 0x7f1bdc0cea50 2023-07-09T21:52:57.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1be25ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc150870 con 0x7f1bdc1597c0 2023-07-09T21:52:57.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1bdbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bdc070350 0x7f1bdc1f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:57.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1bdbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bdc070350 0x7f1bdc1f35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54760/0 (socket says 172.21.15.53:54760) 2023-07-09T21:52:57.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1bdbfff700 1 -- 172.21.15.53:0/1623096212 learned_addr learned my addr 172.21.15.53:0/1623096212 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:57.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1bdb7fe700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bdc0cea50 0x7f1bdc153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:57.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1be0b9c700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bdc1597c0 0x7f1bdc070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:57.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1bdbfff700 1 -- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bdc1597c0 msgr2=0x7f1bdc070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:57.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1bdbfff700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bdc1597c0 0x7f1bdc070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1bdbfff700 1 -- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bdc0cea50 msgr2=0x7f1bdc153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:57.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1bdbfff700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bdc0cea50 0x7f1bdc153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1bdbfff700 1 -- 172.21.15.53:0/1623096212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd000b7f0 con 0x7f1bdc070350 2023-07-09T21:52:57.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.276+0000 7f1be0b9c700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bdc1597c0 0x7f1bdc070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:57.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.277+0000 7f1bdbfff700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bdc070350 0x7f1bdc1f35f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0090b0 tx=0x7f1bcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:57.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.277+0000 7f1bd8ff9700 1 -- 172.21.15.53:0/1623096212 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0036a0 con 0x7f1bdc070350 2023-07-09T21:52:57.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.277+0000 7f1bd8ff9700 1 -- 172.21.15.53:0/1623096212 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc01f070 con 0x7f1bdc070350 2023-07-09T21:52:57.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.277+0000 7f1bd8ff9700 1 -- 172.21.15.53:0/1623096212 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc003a60 con 0x7f1bdc070350 2023-07-09T21:52:57.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.277+0000 7f1be25ff700 1 -- 172.21.15.53:0/1623096212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc0094a0 con 0x7f1bdc070350 2023-07-09T21:52:57.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.277+0000 7f1be25ff700 1 -- 172.21.15.53:0/1623096212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bdc150e30 con 0x7f1bdc070350 2023-07-09T21:52:57.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.278+0000 7f1be25ff700 1 -- 172.21.15.53:0/1623096212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bdc0ce510 con 0x7f1bdc070350 2023-07-09T21:52:57.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.279+0000 7f1bd8ff9700 1 -- 172.21.15.53:0/1623096212 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f1bcc003bc0 con 0x7f1bdc070350 2023-07-09T21:52:57.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.280+0000 7f1bd8ff9700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1bc806ae00 0x7f1bc806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:57.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.280+0000 7f1bd8ff9700 1 -- 172.21.15.53:0/1623096212 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f1bcc021070 con 0x7f1bdc070350 2023-07-09T21:52:57.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.281+0000 7f1bdb7fe700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1bc806ae00 0x7f1bc806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.281+0000 7f1bdb7fe700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1bc806ae00 0x7f1bc806d2b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000b240 tx=0x7f1bd000b4d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.285+0000 7f1bd8ff9700 1 -- 172.21.15.53:0/1623096212 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1bdc0ce510 con 0x7f1bdc070350 2023-07-09T21:52:57.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.488+0000 7f1be25ff700 1 -- 172.21.15.53:0/1623096212 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1bdc0ce510 con 0x7f1bc806ae00 2023-07-09T21:52:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.491+0000 7f1bd8ff9700 1 -- 172.21.15.53:0/1623096212 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73106 (secure 0 0 0) 0x7f1bdc0ce510 con 0x7f1bc806ae00 2023-07-09T21:52:57.494 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:57.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.494+0000 7f1be25ff700 1 -- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1bc806ae00 msgr2=0x7f1bc806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:57.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.494+0000 7f1be25ff700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1bc806ae00 0x7f1bc806d2b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000b240 tx=0x7f1bd000b4d0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.494+0000 7f1be25ff700 1 -- 172.21.15.53:0/1623096212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bdc070350 msgr2=0x7f1bdc1f35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:57.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.494+0000 7f1be25ff700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bdc070350 0x7f1bdc1f35f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0090b0 tx=0x7f1bcc004750 comp rx=0 tx=0).stop 2023-07-09T21:52:57.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.494+0000 7f1be25ff700 1 -- 172.21.15.53:0/1623096212 shutdown_connections 2023-07-09T21:52:57.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.494+0000 7f1be25ff700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f1bc806ae00 0x7f1bc806d2b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.494+0000 7f1be25ff700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bdc1597c0 0x7f1bdc070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.494+0000 7f1be25ff700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bdc070350 0x7f1bdc1f35f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.494+0000 7f1be25ff700 1 --2- 172.21.15.53:0/1623096212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bdc0cea50 0x7f1bdc153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.494+0000 7f1be25ff700 1 -- 172.21.15.53:0/1623096212 >> 172.21.15.53:0/1623096212 conn(0x7f1bdc069f30 msgr2=0x7f1bdc0cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.494+0000 7f1be25ff700 1 -- 172.21.15.53:0/1623096212 shutdown_connections 2023-07-09T21:52:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.494+0000 7f1be25ff700 1 -- 172.21.15.53:0/1623096212 wait complete. 2023-07-09T21:52:57.499 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:52:57.514 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2023-07-09T21:52:56.888355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230136,"kb_used_data":6328,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754744584,"statfs":{"total":773094113280,"available":772858454016,"internally_reserved":0,"allocated":6479872,"data_stored":3607734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-139237,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":-5,"num_read_kb":-3,"num_write":-105,"num_write_kb":-185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001402"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-09T21:52:53.657315+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:52:53.657315+0000","last_peered":"2023-07-09T21:52:53.657315+0000","last_clean":"2023-07-09T21:52:53.657315+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:52:53.657315+0000","last_undegraded":"2023-07-09T21:52:53.657315+0000","last_fullsized":"2023-07-09T21:52:53.657315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:40:53.507614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:51.579876+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:52:51.579876+0000","last_peered":"2023-07-09T21:52:51.579876+0000","last_clean":"2023-07-09T21:52:51.579876+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:52:51.579876+0000","last_undegraded":"2023-07-09T21:52:51.579876+0000","last_fullsized":"2023-07-09T21:52:51.579876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:35:04.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.051168+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:52:52.051168+0000","last_peered":"2023-07-09T21:52:52.051168+0000","last_clean":"2023-07-09T21:52:52.051168+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:52:52.051168+0000","last_undegraded":"2023-07-09T21:52:52.051168+0000","last_fullsized":"2023-07-09T21:52:52.051168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:55:00.293625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:51.580501+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:52:51.580501+0000","last_peered":"2023-07-09T21:52:51.580501+0000","last_clean":"2023-07-09T21:52:51.580501+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:52:51.580501+0000","last_undegraded":"2023-07-09T21:52:51.580501+0000","last_fullsized":"2023-07-09T21:52:51.580501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:24:53.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":222,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.051144+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:52:52.051144+0000","last_peered":"2023-07-09T21:52:52.051144+0000","last_clean":"2023-07-09T21:52:52.051144+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:52:52.051144+0000","last_undegraded":"2023-07-09T21:52:52.051144+0000","last_fullsized":"2023-07-09T21:52:52.051144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:54:48.978657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.051313+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:52:52.051313+0000","last_peered":"2023-07-09T21:52:52.051313+0000","last_clean":"2023-07-09T21:52:52.051313+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:52:52.051313+0000","last_undegraded":"2023-07-09T21:52:52.051313+0000","last_fullsized":"2023-07-09T21:52:52.051313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:47:44.136990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.052045+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:52:52.052045+0000","last_peered":"2023-07-09T21:52:52.052045+0000","last_clean":"2023-07-09T21:52:52.052045+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:52:52.052045+0000","last_undegraded":"2023-07-09T21:52:52.052045+0000","last_fullsized":"2023-07-09T21:52:52.052045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:09:12.531270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-09T21:52:53.658211+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:52:53.658211+0000","last_peered":"2023-07-09T21:52:53.658211+0000","last_clean":"2023-07-09T21:52:53.658211+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:52:53.658211+0000","last_undegraded":"2023-07-09T21:52:53.658211+0000","last_fullsized":"2023-07-09T21:52:53.658211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:31.720010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.051088+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:52:52.051088+0000","last_peered":"2023-07-09T21:52:52.051088+0000","last_clean":"2023-07-09T21:52:52.051088+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:52:52.051088+0000","last_undegraded":"2023-07-09T21:52:52.051088+0000","last_fullsized":"2023-07-09T21:52:52.051088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:45:09.892202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":626688,"data_stored":270965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95099999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.752}]},{"osd":1,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.45900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81999999999999995,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.79000000000000004,"15min":0.82099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78700000000000003,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97099999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.78500000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92900000000000005,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89200000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.51700000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":1.214,"15min":1.214},"last":0.53800000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.61499999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":630784,"data_stored":270555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52000000000000002,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55500000000000005,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.53700000000000003,"15min":0.55600000000000005},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56699999999999995,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.60599999999999998,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.63300000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.3180000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.68100000000000005,"15min":0.70899999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63400000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60399999999999998,"5min":3.129,"15min":3.129},"last":0.47099999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94499999999999995,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.998,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.389}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91200000000000003,"5min":1.929,"15min":1.929},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.85099999999999998,"15min":0.86399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97599999999999998,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.98999999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93500000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.95199999999999996,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.0529999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":2.766,"15min":2.766},"last":1.446},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.93400000000000005,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.72299999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":770048,"data_stored":408082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":1.232,"15min":1.3700000000000001},"min":{"1min":0.28899999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":16.946000000000002,"15min":16.946000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.93200000000000005,"15min":1.0089999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":9.5449999999999999,"15min":9.5449999999999999},"last":0.50700000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.92100000000000004,"15min":0.99399999999999999},"min":{"1min":0.38200000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65200000000000002,"5min":9.6950000000000003,"15min":9.6950000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.95099999999999996,"15min":1.0329999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63200000000000001,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.46300000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.995,"15min":1.077},"min":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69199999999999995,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.327,"15min":1.4630000000000001},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73599999999999999,"5min":17.004000000000001,"15min":17.004000000000001},"last":0.63}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.048,"15min":1.1000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.081,"5min":6.2510000000000003,"15min":6.2510000000000003},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.2849999999999999,"15min":1.3680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2050000000000001,"5min":9.6630000000000003,"15min":9.6630000000000003},"last":0.85899999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":1.091,"15min":1.139},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2370000000000001,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.2849999999999999,"15min":1.369},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.1619999999999999,"5min":9.5879999999999992,"15min":9.5879999999999992},"last":0.90200000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":1.2849999999999999,"15min":1.371},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.048,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":1.266,"15min":1.349},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0529999999999999,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":0.88500000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.2250000000000001,"15min":1.2969999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.103,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.1160000000000001,"15min":1.1659999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.163,"5min":6.2169999999999996,"15min":6.2169999999999996},"last":0.92100000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1220608,"data_stored":860605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.92200000000000004,"15min":1.01},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55000000000000004,"5min":11.949999999999999,"15min":11.949999999999999},"last":0.317},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60199999999999998,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.439}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73899999999999999,"5min":1.212,"15min":1.212},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.48299999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":1.4179999999999999,"15min":1.5720000000000001},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90900000000000003,"15min":0.97499999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65100000000000002,"5min":10.952,"15min":10.952},"last":0.54500000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":1.696,"15min":1.859},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":22.974,"15min":22.974},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":1.264,"15min":1.3520000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.98799999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52300000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":1.589,"15min":1.589},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.748,"5min":1.6890000000000001,"15min":1.8460000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":22.933,"15min":22.933},"last":0.80200000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93100000000000005,"5min":1.623,"15min":1.623},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.6830000000000001,"15min":1.8400000000000001},"min":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98199999999999998,"5min":22.867999999999999,"15min":22.867999999999999},"last":0.82299999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.1639999999999999,"15min":1.23},"min":{"1min":0.57499999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.93300000000000005,"5min":10.907999999999999,"15min":10.907999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83299999999999996,"15min":0.83999999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.99299999999999999,"5min":1.546,"15min":1.546},"last":0.83899999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1228800,"data_stored":861009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.57099999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85799999999999998,"5min":1.464,"15min":1.464},"last":0.628},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94999999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71199999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89100000000000001,"5min":1.121,"15min":1.121},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.78600000000000003,"15min":0.80400000000000005},"min":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.88}]},{"osd":3,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70799999999999996,"15min":0.71699999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.091,"15min":1.091},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96599999999999997,"5min":1.405,"15min":1.405},"last":0.73099999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.95399999999999996,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70399999999999996,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82799999999999996,"5min":1.341,"15min":1.341},"last":0.68000000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.443,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.871,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.90100000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88100000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.84399999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542179,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":401844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57599999999999996,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.435,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68200000000000005,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.35799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.53800000000000003,"5min":1.21,"15min":1.21},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.54900000000000004,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60699999999999998,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.56100000000000005,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.016,"5min":1.258,"15min":1.258},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0049999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.80900000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95599999999999996,"5min":1.486,"15min":1.486},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98999999999999999,"5min":1.327,"15min":1.327},"last":0.88400000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":1.302,"15min":1.302},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.86199999999999999,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":0.90500000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.04,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.008,"5min":1.349,"15min":1.349},"last":0.92300000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":270303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.74199999999999999,"15min":0.69999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":7.9779999999999998,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.41399999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":7.8650000000000002,"5min":7.8650000000000002,"15min":7.8650000000000002},"last":0.434},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.421,"15min":1.421},"last":0.60099999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.73199999999999998,"15min":0.68200000000000005},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":7.9390000000000001,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88300000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.47399999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1799999999999999,"5min":1.597,"15min":1.597},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.93700000000000006,"5min":1.216,"15min":1.216},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91200000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0609999999999999,"5min":1.069,"15min":1.069},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":1.093,"15min":1.093},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.038,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76800000000000002,"15min":0.76300000000000001},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.054,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.64300000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":614400,"data_stored":264371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.54400000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84799999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.68799999999999994}]},{"osd":1,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.86399999999999999,"5min":1.113,"15min":1.113},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84199999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85599999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.46800000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.621}]},{"osd":3,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93400000000000005,"5min":1.018,"15min":1.018},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95099999999999996,"5min":1.171,"15min":1.171},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98199999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.754,"15min":0.749},"min":{"1min":0.56699999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96399999999999997,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.999,"5min":1.133,"15min":1.133},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.022,"5min":1.123,"15min":1.123},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:52:57.517 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:52:57.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.715+0000 7fbe6d9ff700 1 Processor -- start 2023-07-09T21:52:57.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.715+0000 7fbe6d9ff700 1 -- start start 2023-07-09T21:52:57.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.717+0000 7fbe6d9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbe680d1220 0x7fbe680b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:57.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.717+0000 7fbe6d9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe680b2350 0x7fbe680afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:57.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.717+0000 7fbe6d9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe680d2ce0 con 0x7fbe680b1e00 2023-07-09T21:52:57.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.717+0000 7fbe6d9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe680b3350 con 0x7fbe680d1220 2023-07-09T21:52:57.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.717+0000 7fbe6d9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe680b3630 con 0x7fbe680b2350 2023-07-09T21:52:57.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.718+0000 7fbe677fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe680b2350 0x7fbe680afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:57.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.718+0000 7fbe66ffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fbe680b1e00 0x7fbe680d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:57572/0 (socket says 172.21.15.53:57572) 2023-07-09T21:52:57.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.718+0000 7fbe66ffd700 1 -- 172.21.15.53:0/3017702122 learned_addr learned my addr 172.21.15.53:0/3017702122 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:57.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.718+0000 7fbe5ffff700 1 --2- 172.21.15.53:0/3017702122 >> v2:172.21.15.184:3300/0 conn(0x7fbe680d1220 0x7fbe680b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:57.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.718+0000 7fbe667fc700 1 -- 172.21.15.53:0/3017702122 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585746778 0 0) 0x7fbe680d2ce0 con 0x7fbe680b1e00 2023-07-09T21:52:57.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.718+0000 7fbe667fc700 1 -- 172.21.15.53:0/3017702122 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe540035b0 con 0x7fbe680b1e00 2023-07-09T21:52:57.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.718+0000 7fbe5ffff700 1 -- 172.21.15.53:0/3017702122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe680b2350 msgr2=0x7fbe680afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.718+0000 7fbe5ffff700 1 --2- 172.21.15.53:0/3017702122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe680b2350 0x7fbe680afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.718+0000 7fbe5ffff700 1 -- 172.21.15.53:0/3017702122 >> v1:172.21.15.184:6789/0 conn(0x7fbe680b1e00 legacy=0x7fbe680d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.718+0000 7fbe5ffff700 1 -- 172.21.15.53:0/3017702122 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe680b3910 con 0x7fbe680d1220 2023-07-09T21:52:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.718+0000 7fbe677fe700 1 --2- 172.21.15.53:0/3017702122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe680b2350 0x7fbe680afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:52:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.719+0000 7fbe5ffff700 1 --2- 172.21.15.53:0/3017702122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe680d1220 0x7fbe680b43f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009840 tx=0x7fbe50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9765fc5ff3a27a97 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.719+0000 7fbe667fc700 1 -- 172.21.15.53:0/3017702122 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50011830 con 0x7fbe680d1220 2023-07-09T21:52:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.719+0000 7fbe667fc700 1 -- 172.21.15.53:0/3017702122 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe50011990 con 0x7fbe680d1220 2023-07-09T21:52:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.719+0000 7fbe667fc700 1 -- 172.21.15.53:0/3017702122 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50011d20 con 0x7fbe680d1220 2023-07-09T21:52:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.719+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/3017702122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe680d1220 msgr2=0x7fbe680b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.719+0000 7fbe6d9ff700 1 --2- 172.21.15.53:0/3017702122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe680d1220 0x7fbe680b43f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009840 tx=0x7fbe50009b50 comp rx=0 tx=0).stop 2023-07-09T21:52:57.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.719+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/3017702122 shutdown_connections 2023-07-09T21:52:57.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.719+0000 7fbe6d9ff700 1 --2- 172.21.15.53:0/3017702122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe680b2350 0x7fbe680afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.719+0000 7fbe6d9ff700 1 --2- 172.21.15.53:0/3017702122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe680d1220 0x7fbe680b43f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.720+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/3017702122 >> 172.21.15.53:0/3017702122 conn(0x7fbe6809c1d0 msgr2=0x7fbe680d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:57.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.720+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/3017702122 shutdown_connections 2023-07-09T21:52:57.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.720+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/3017702122 wait complete. 2023-07-09T21:52:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.721+0000 7fbe6d9ff700 1 Processor -- start 2023-07-09T21:52:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.721+0000 7fbe6d9ff700 1 -- start start 2023-07-09T21:52:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.722+0000 7fbe6d9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe680b1e00 0x7fbe681505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.722+0000 7fbe6d9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe680b2350 0x7fbe6814fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.722+0000 7fbe6d9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe680d1220 0x7fbe6815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.722+0000 7fbe6d9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6815fee0 con 0x7fbe680d1220 2023-07-09T21:52:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.722+0000 7fbe6d9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6815f2c0 con 0x7fbe680b2350 2023-07-09T21:52:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.722+0000 7fbe6d9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6815de40 con 0x7fbe680b1e00 2023-07-09T21:52:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.723+0000 7fbe677fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe680d1220 0x7fbe6815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.723+0000 7fbe5ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe680b2350 0x7fbe6814fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.723+0000 7fbe66ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe680b1e00 0x7fbe681505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.723+0000 7fbe677fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe680d1220 0x7fbe6815d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54762/0 (socket says 172.21.15.53:54762) 2023-07-09T21:52:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.723+0000 7fbe5ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe680b2350 0x7fbe6814fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:59078/0 (socket says 172.21.15.53:59078) 2023-07-09T21:52:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.723+0000 7fbe677fe700 1 -- 172.21.15.53:0/1025582349 learned_addr learned my addr 172.21.15.53:0/1025582349 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.723+0000 7fbe5ffff700 1 -- 172.21.15.53:0/1025582349 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe680b1e00 msgr2=0x7fbe681505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.723+0000 7fbe5ffff700 1 --2- 172.21.15.53:0/1025582349 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe680b1e00 0x7fbe681505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.723+0000 7fbe5ffff700 1 -- 172.21.15.53:0/1025582349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe680d1220 msgr2=0x7fbe6815d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.723+0000 7fbe5ffff700 1 --2- 172.21.15.53:0/1025582349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe680d1220 0x7fbe6815d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.723+0000 7fbe5ffff700 1 -- 172.21.15.53:0/1025582349 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe60009a70 con 0x7fbe680b2350 2023-07-09T21:52:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.724+0000 7fbe5ffff700 1 --2- 172.21.15.53:0/1025582349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe680b2350 0x7fbe6814fff0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbe50016000 tx=0x7fbe50004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:57.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.724+0000 7fbe64ff9700 1 -- 172.21.15.53:0/1025582349 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50004590 con 0x7fbe680b2350 2023-07-09T21:52:57.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.724+0000 7fbe64ff9700 1 -- 172.21.15.53:0/1025582349 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5001e070 con 0x7fbe680b2350 2023-07-09T21:52:57.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.724+0000 7fbe64ff9700 1 -- 172.21.15.53:0/1025582349 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe500038e0 con 0x7fbe680b2350 2023-07-09T21:52:57.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.724+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/1025582349 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe500094a0 con 0x7fbe680b2350 2023-07-09T21:52:57.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.724+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/1025582349 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6815f820 con 0x7fbe680b2350 2023-07-09T21:52:57.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.725+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/1025582349 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe68160020 con 0x7fbe680b2350 2023-07-09T21:52:57.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.726+0000 7fbe64ff9700 1 -- 172.21.15.53:0/1025582349 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fbe50003a40 con 0x7fbe680b2350 2023-07-09T21:52:57.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.727+0000 7fbe64ff9700 1 --2- 172.21.15.53:0/1025582349 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbe4806ae00 0x7fbe4806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:57.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.727+0000 7fbe64ff9700 1 -- 172.21.15.53:0/1025582349 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7fbe50089ff0 con 0x7fbe680b2350 2023-07-09T21:52:57.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.727+0000 7fbe66ffd700 1 --2- 172.21.15.53:0/1025582349 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbe4806ae00 0x7fbe4806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:57.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.728+0000 7fbe66ffd700 1 --2- 172.21.15.53:0/1025582349 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbe4806ae00 0x7fbe4806d2b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbe58001230 tx=0x7fbe58007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:57.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.733+0000 7fbe64ff9700 1 -- 172.21.15.53:0/1025582349 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbe68160020 con 0x7fbe680b2350 2023-07-09T21:52:57.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.938+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/1025582349 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe680b3ed0 con 0x7fbe4806ae00 2023-07-09T21:52:57.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.941+0000 7fbe64ff9700 1 -- 172.21.15.53:0/1025582349 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73106 (secure 0 0 0) 0x7fbe58005990 con 0x7fbe4806ae00 2023-07-09T21:52:57.945 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:57.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.944+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/1025582349 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbe4806ae00 msgr2=0x7fbe4806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:57.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.944+0000 7fbe6d9ff700 1 --2- 172.21.15.53:0/1025582349 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbe4806ae00 0x7fbe4806d2b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbe58001230 tx=0x7fbe58007df0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.944+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/1025582349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe680b2350 msgr2=0x7fbe6814fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:57.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.944+0000 7fbe6d9ff700 1 --2- 172.21.15.53:0/1025582349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe680b2350 0x7fbe6814fff0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbe50016000 tx=0x7fbe50004750 comp rx=0 tx=0).stop 2023-07-09T21:52:57.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.944+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/1025582349 shutdown_connections 2023-07-09T21:52:57.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.944+0000 7fbe6d9ff700 1 --2- 172.21.15.53:0/1025582349 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fbe4806ae00 0x7fbe4806d2b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.944+0000 7fbe6d9ff700 1 --2- 172.21.15.53:0/1025582349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe680d1220 0x7fbe6815d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.944+0000 7fbe6d9ff700 1 --2- 172.21.15.53:0/1025582349 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe680b1e00 0x7fbe681505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.944+0000 7fbe6d9ff700 1 --2- 172.21.15.53:0/1025582349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe680b2350 0x7fbe6814fff0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:57.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.944+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/1025582349 >> 172.21.15.53:0/1025582349 conn(0x7fbe6809c1d0 msgr2=0x7fbe680b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:57.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.944+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/1025582349 shutdown_connections 2023-07-09T21:52:57.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:57.944+0000 7fbe6d9ff700 1 -- 172.21.15.53:0/1025582349 wait complete. 2023-07-09T21:52:57.949 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:52:57.964 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2023-07-09T21:52:56.888355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230136,"kb_used_data":6328,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754744584,"statfs":{"total":773094113280,"available":772858454016,"internally_reserved":0,"allocated":6479872,"data_stored":3607734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-139237,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":-5,"num_read_kb":-3,"num_write":-105,"num_write_kb":-185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001402"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-09T21:52:53.657315+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:52:53.657315+0000","last_peered":"2023-07-09T21:52:53.657315+0000","last_clean":"2023-07-09T21:52:53.657315+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:52:53.657315+0000","last_undegraded":"2023-07-09T21:52:53.657315+0000","last_fullsized":"2023-07-09T21:52:53.657315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:40:53.507614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:51.579876+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:52:51.579876+0000","last_peered":"2023-07-09T21:52:51.579876+0000","last_clean":"2023-07-09T21:52:51.579876+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:52:51.579876+0000","last_undegraded":"2023-07-09T21:52:51.579876+0000","last_fullsized":"2023-07-09T21:52:51.579876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:35:04.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.051168+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:52:52.051168+0000","last_peered":"2023-07-09T21:52:52.051168+0000","last_clean":"2023-07-09T21:52:52.051168+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:52:52.051168+0000","last_undegraded":"2023-07-09T21:52:52.051168+0000","last_fullsized":"2023-07-09T21:52:52.051168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:55:00.293625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:51.580501+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:52:51.580501+0000","last_peered":"2023-07-09T21:52:51.580501+0000","last_clean":"2023-07-09T21:52:51.580501+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:52:51.580501+0000","last_undegraded":"2023-07-09T21:52:51.580501+0000","last_fullsized":"2023-07-09T21:52:51.580501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:24:53.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":222,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.051144+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:52:52.051144+0000","last_peered":"2023-07-09T21:52:52.051144+0000","last_clean":"2023-07-09T21:52:52.051144+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:52:52.051144+0000","last_undegraded":"2023-07-09T21:52:52.051144+0000","last_fullsized":"2023-07-09T21:52:52.051144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:54:48.978657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.051313+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:52:52.051313+0000","last_peered":"2023-07-09T21:52:52.051313+0000","last_clean":"2023-07-09T21:52:52.051313+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:52:52.051313+0000","last_undegraded":"2023-07-09T21:52:52.051313+0000","last_fullsized":"2023-07-09T21:52:52.051313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:47:44.136990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.052045+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:52:52.052045+0000","last_peered":"2023-07-09T21:52:52.052045+0000","last_clean":"2023-07-09T21:52:52.052045+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:52:52.052045+0000","last_undegraded":"2023-07-09T21:52:52.052045+0000","last_fullsized":"2023-07-09T21:52:52.052045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:09:12.531270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-09T21:52:53.658211+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:52:53.658211+0000","last_peered":"2023-07-09T21:52:53.658211+0000","last_clean":"2023-07-09T21:52:53.658211+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:52:53.658211+0000","last_undegraded":"2023-07-09T21:52:53.658211+0000","last_fullsized":"2023-07-09T21:52:53.658211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:31.720010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.051088+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:52:52.051088+0000","last_peered":"2023-07-09T21:52:52.051088+0000","last_clean":"2023-07-09T21:52:52.051088+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:52:52.051088+0000","last_undegraded":"2023-07-09T21:52:52.051088+0000","last_fullsized":"2023-07-09T21:52:52.051088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:45:09.892202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":626688,"data_stored":270965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95099999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.752}]},{"osd":1,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.45900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81999999999999995,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.79000000000000004,"15min":0.82099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78700000000000003,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97099999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.78500000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92900000000000005,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89200000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.51700000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":1.214,"15min":1.214},"last":0.53800000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.61499999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":630784,"data_stored":270555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52000000000000002,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55500000000000005,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.53700000000000003,"15min":0.55600000000000005},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56699999999999995,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.60599999999999998,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.63300000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.3180000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.68100000000000005,"15min":0.70899999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63400000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60399999999999998,"5min":3.129,"15min":3.129},"last":0.47099999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94499999999999995,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.998,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.389}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91200000000000003,"5min":1.929,"15min":1.929},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.85099999999999998,"15min":0.86399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97599999999999998,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.98999999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93500000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.95199999999999996,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.0529999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":2.766,"15min":2.766},"last":1.446},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.93400000000000005,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.72299999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":770048,"data_stored":408082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":1.232,"15min":1.3700000000000001},"min":{"1min":0.28899999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":16.946000000000002,"15min":16.946000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.93200000000000005,"15min":1.0089999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":9.5449999999999999,"15min":9.5449999999999999},"last":0.50700000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.92100000000000004,"15min":0.99399999999999999},"min":{"1min":0.38200000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65200000000000002,"5min":9.6950000000000003,"15min":9.6950000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.95099999999999996,"15min":1.0329999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63200000000000001,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.46300000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.995,"15min":1.077},"min":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69199999999999995,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.327,"15min":1.4630000000000001},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73599999999999999,"5min":17.004000000000001,"15min":17.004000000000001},"last":0.63}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.048,"15min":1.1000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.081,"5min":6.2510000000000003,"15min":6.2510000000000003},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.2849999999999999,"15min":1.3680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2050000000000001,"5min":9.6630000000000003,"15min":9.6630000000000003},"last":0.85899999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":1.091,"15min":1.139},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2370000000000001,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.2849999999999999,"15min":1.369},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.1619999999999999,"5min":9.5879999999999992,"15min":9.5879999999999992},"last":0.90200000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":1.2849999999999999,"15min":1.371},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.048,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":1.266,"15min":1.349},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0529999999999999,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":0.88500000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.2250000000000001,"15min":1.2969999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.103,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.1160000000000001,"15min":1.1659999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.163,"5min":6.2169999999999996,"15min":6.2169999999999996},"last":0.92100000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1220608,"data_stored":860605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.92200000000000004,"15min":1.01},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55000000000000004,"5min":11.949999999999999,"15min":11.949999999999999},"last":0.317},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60199999999999998,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.439}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73899999999999999,"5min":1.212,"15min":1.212},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.48299999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":1.4179999999999999,"15min":1.5720000000000001},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90900000000000003,"15min":0.97499999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65100000000000002,"5min":10.952,"15min":10.952},"last":0.54500000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":1.696,"15min":1.859},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":22.974,"15min":22.974},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":1.264,"15min":1.3520000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.98799999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52300000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":1.589,"15min":1.589},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.748,"5min":1.6890000000000001,"15min":1.8460000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":22.933,"15min":22.933},"last":0.80200000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93100000000000005,"5min":1.623,"15min":1.623},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.6830000000000001,"15min":1.8400000000000001},"min":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98199999999999998,"5min":22.867999999999999,"15min":22.867999999999999},"last":0.82299999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.1639999999999999,"15min":1.23},"min":{"1min":0.57499999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.93300000000000005,"5min":10.907999999999999,"15min":10.907999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83299999999999996,"15min":0.83999999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.99299999999999999,"5min":1.546,"15min":1.546},"last":0.83899999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1228800,"data_stored":861009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.57099999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85799999999999998,"5min":1.464,"15min":1.464},"last":0.628},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94999999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71199999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89100000000000001,"5min":1.121,"15min":1.121},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.78600000000000003,"15min":0.80400000000000005},"min":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.88}]},{"osd":3,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70799999999999996,"15min":0.71699999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.091,"15min":1.091},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96599999999999997,"5min":1.405,"15min":1.405},"last":0.73099999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.95399999999999996,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70399999999999996,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82799999999999996,"5min":1.341,"15min":1.341},"last":0.68000000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.443,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.871,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.90100000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88100000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.84399999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542179,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":401844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57599999999999996,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.435,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68200000000000005,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.35799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.53800000000000003,"5min":1.21,"15min":1.21},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.54900000000000004,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60699999999999998,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.56100000000000005,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.016,"5min":1.258,"15min":1.258},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0049999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.80900000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95599999999999996,"5min":1.486,"15min":1.486},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98999999999999999,"5min":1.327,"15min":1.327},"last":0.88400000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":1.302,"15min":1.302},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.86199999999999999,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":0.90500000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.04,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.008,"5min":1.349,"15min":1.349},"last":0.92300000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":270303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.74199999999999999,"15min":0.69999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":7.9779999999999998,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.41399999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":7.8650000000000002,"5min":7.8650000000000002,"15min":7.8650000000000002},"last":0.434},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.421,"15min":1.421},"last":0.60099999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.73199999999999998,"15min":0.68200000000000005},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":7.9390000000000001,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88300000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.47399999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1799999999999999,"5min":1.597,"15min":1.597},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.93700000000000006,"5min":1.216,"15min":1.216},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91200000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0609999999999999,"5min":1.069,"15min":1.069},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":1.093,"15min":1.093},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.038,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76800000000000002,"15min":0.76300000000000001},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.054,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.64300000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":614400,"data_stored":264371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.54400000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84799999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.68799999999999994}]},{"osd":1,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.86399999999999999,"5min":1.113,"15min":1.113},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84199999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85599999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.46800000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.621}]},{"osd":3,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93400000000000005,"5min":1.018,"15min":1.018},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95099999999999996,"5min":1.171,"15min":1.171},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98199999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.754,"15min":0.749},"min":{"1min":0.56699999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96399999999999997,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.999,"5min":1.133,"15min":1.133},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.022,"5min":1.123,"15min":1.123},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:52:57.966 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-09T21:52:57.967 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:52:58.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.164+0000 7f2ec81ff700 1 Processor -- start 2023-07-09T21:52:58.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.164+0000 7f2ec81ff700 1 -- start start 2023-07-09T21:52:58.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.165+0000 7f2ec81ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2ec00d1220 0x7f2ec00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:58.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.165+0000 7f2ec81ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ec00b2350 0x7f2ec00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:58.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.165+0000 7f2ec81ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec00d2ce0 con 0x7f2ec00b1e00 2023-07-09T21:52:58.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.165+0000 7f2ec81ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec00b3350 con 0x7f2ec00d1220 2023-07-09T21:52:58.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.165+0000 7f2ec81ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec00b3630 con 0x7f2ec00b2350 2023-07-09T21:52:58.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.166+0000 7f2ec679c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ec00b2350 0x7f2ec00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:58.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.166+0000 7f2ec679c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ec00b2350 0x7f2ec00afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:54720/0 (socket says 172.21.15.53:54720) 2023-07-09T21:52:58.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.166+0000 7f2ec679c700 1 -- 172.21.15.53:0/2199780066 learned_addr learned my addr 172.21.15.53:0/2199780066 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:58.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.166+0000 7f2ec5f9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2ec00b1e00 0x7f2ec00d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:57580/0 (socket says 172.21.15.53:57580) 2023-07-09T21:52:58.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.166+0000 7f2ec579a700 1 --2- 172.21.15.53:0/2199780066 >> v2:172.21.15.184:3300/0 conn(0x7f2ec00d1220 0x7f2ec00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:58.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.166+0000 7f2ec4f99700 1 -- 172.21.15.53:0/2199780066 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688248512 0 0) 0x7f2ec00d2ce0 con 0x7f2ec00b1e00 2023-07-09T21:52:58.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.166+0000 7f2ec4f99700 1 -- 172.21.15.53:0/2199780066 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eac0035b0 con 0x7f2ec00b1e00 2023-07-09T21:52:58.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.166+0000 7f2ec579a700 1 -- 172.21.15.53:0/2199780066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ec00b2350 msgr2=0x7f2ec00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:52:58.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.166+0000 7f2ec579a700 1 --2- 172.21.15.53:0/2199780066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ec00b2350 0x7f2ec00afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.166+0000 7f2ec579a700 1 -- 172.21.15.53:0/2199780066 >> v1:172.21.15.184:6789/0 conn(0x7f2ec00b1e00 legacy=0x7f2ec00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:58.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.166+0000 7f2ec579a700 1 -- 172.21.15.53:0/2199780066 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec00b3910 con 0x7f2ec00d1220 2023-07-09T21:52:58.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.166+0000 7f2ec679c700 1 --2- 172.21.15.53:0/2199780066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ec00b2350 0x7f2ec00afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:52:58.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.167+0000 7f2ec579a700 1 --2- 172.21.15.53:0/2199780066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ec00d1220 0x7f2ec00b43f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009840 tx=0x7f2eb0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eb93abf8a9c5134 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:58.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.167+0000 7f2ec4f99700 1 -- 172.21.15.53:0/2199780066 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0011830 con 0x7f2ec00d1220 2023-07-09T21:52:58.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.167+0000 7f2ec4f99700 1 -- 172.21.15.53:0/2199780066 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb0011990 con 0x7f2ec00d1220 2023-07-09T21:52:58.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.167+0000 7f2ec4f99700 1 -- 172.21.15.53:0/2199780066 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0011d20 con 0x7f2ec00d1220 2023-07-09T21:52:58.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.168+0000 7f2ec81ff700 1 -- 172.21.15.53:0/2199780066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ec00d1220 msgr2=0x7f2ec00b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.168+0000 7f2ec81ff700 1 --2- 172.21.15.53:0/2199780066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ec00d1220 0x7f2ec00b43f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009840 tx=0x7f2eb0009b50 comp rx=0 tx=0).stop 2023-07-09T21:52:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.168+0000 7f2ec81ff700 1 -- 172.21.15.53:0/2199780066 shutdown_connections 2023-07-09T21:52:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.168+0000 7f2ec81ff700 1 --2- 172.21.15.53:0/2199780066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ec00b2350 0x7f2ec00afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.168+0000 7f2ec81ff700 1 --2- 172.21.15.53:0/2199780066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ec00d1220 0x7f2ec00b43f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.168+0000 7f2ec81ff700 1 -- 172.21.15.53:0/2199780066 >> 172.21.15.53:0/2199780066 conn(0x7f2ec009c1d0 msgr2=0x7f2ec00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:58.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.168+0000 7f2ec81ff700 1 -- 172.21.15.53:0/2199780066 shutdown_connections 2023-07-09T21:52:58.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.168+0000 7f2ec81ff700 1 -- 172.21.15.53:0/2199780066 wait complete. 2023-07-09T21:52:58.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.170+0000 7f2ec81ff700 1 Processor -- start 2023-07-09T21:52:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.170+0000 7f2ec81ff700 1 -- start start 2023-07-09T21:52:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.171+0000 7f2ec81ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ec00b1e00 0x7f2ec00c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:58.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.171+0000 7f2ec81ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ec00b2350 0x7f2ec00b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:58.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.171+0000 7f2ec81ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ec00d1220 0x7f2ec01f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:58.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.171+0000 7f2ec81ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec01f2eb0 con 0x7f2ec00b2350 2023-07-09T21:52:58.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.171+0000 7f2ec81ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec00b62f0 con 0x7f2ec00d1220 2023-07-09T21:52:58.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.171+0000 7f2ec81ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec01f28f0 con 0x7f2ec00b1e00 2023-07-09T21:52:58.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.171+0000 7f2ec579a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ec00b2350 0x7f2ec00b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:58.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.171+0000 7f2ec579a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ec00b2350 0x7f2ec00b73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54774/0 (socket says 172.21.15.53:54774) 2023-07-09T21:52:58.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.171+0000 7f2ec579a700 1 -- 172.21.15.53:0/4186877893 learned_addr learned my addr 172.21.15.53:0/4186877893 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:58.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.171+0000 7f2ec5f9b700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ec00b1e00 0x7f2ec00c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:58.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.171+0000 7f2ec679c700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ec00d1220 0x7f2ec01f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:58.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.172+0000 7f2ec579a700 1 -- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ec00b1e00 msgr2=0x7f2ec00c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:58.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.172+0000 7f2ec579a700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ec00b1e00 0x7f2ec00c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.172+0000 7f2ec579a700 1 -- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ec00d1220 msgr2=0x7f2ec01f1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:58.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.172+0000 7f2ec579a700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ec00d1220 0x7f2ec01f1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.172+0000 7f2ec579a700 1 -- 172.21.15.53:0/4186877893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8009b30 con 0x7f2ec00b2350 2023-07-09T21:52:58.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.172+0000 7f2ec579a700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ec00b2350 0x7f2ec00b73a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00090b0 tx=0x7f2eb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:58.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.172+0000 7f2eb67fc700 1 -- 172.21.15.53:0/4186877893 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00044d0 con 0x7f2ec00b2350 2023-07-09T21:52:58.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.172+0000 7f2eb67fc700 1 -- 172.21.15.53:0/4186877893 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb001e070 con 0x7f2ec00b2350 2023-07-09T21:52:58.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.172+0000 7f2eb67fc700 1 -- 172.21.15.53:0/4186877893 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00038e0 con 0x7f2ec00b2350 2023-07-09T21:52:58.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.172+0000 7f2ec81ff700 1 -- 172.21.15.53:0/4186877893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb00094a0 con 0x7f2ec00b2350 2023-07-09T21:52:58.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.172+0000 7f2ec81ff700 1 -- 172.21.15.53:0/4186877893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec00b5f10 con 0x7f2ec00b2350 2023-07-09T21:52:58.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.173+0000 7f2ec81ff700 1 -- 172.21.15.53:0/4186877893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec00b5d70 con 0x7f2ec00b2350 2023-07-09T21:52:58.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.174+0000 7f2eb67fc700 1 -- 172.21.15.53:0/4186877893 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f2eb0003a40 con 0x7f2ec00b2350 2023-07-09T21:52:58.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.175+0000 7f2eb67fc700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2ea406ae00 0x7f2ea406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:58.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.175+0000 7f2eb67fc700 1 -- 172.21.15.53:0/4186877893 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f2eb0020070 con 0x7f2ec00b2350 2023-07-09T21:52:58.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.176+0000 7f2ec5f9b700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2ea406ae00 0x7f2ea406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:58.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.176+0000 7f2ec5f9b700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2ea406ae00 0x7f2ea406d2b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000fb0 tx=0x7f2ebc007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:58.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.180+0000 7f2eb67fc700 1 -- 172.21.15.53:0/4186877893 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2ec00b5d70 con 0x7f2ec00b2350 2023-07-09T21:52:58.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.381+0000 7f2ec81ff700 1 -- 172.21.15.53:0/4186877893 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ec00b3ed0 con 0x7f2ea406ae00 2023-07-09T21:52:58.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.385+0000 7f2eb67fc700 1 -- 172.21.15.53:0/4186877893 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73106 (secure 0 0 0) 0x7f2ebc001340 con 0x7f2ea406ae00 2023-07-09T21:52:58.387 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.387+0000 7f2ec81ff700 1 -- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2ea406ae00 msgr2=0x7f2ea406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.387+0000 7f2ec81ff700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2ea406ae00 0x7f2ea406d2b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000fb0 tx=0x7f2ebc007d70 comp rx=0 tx=0).stop 2023-07-09T21:52:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.387+0000 7f2ec81ff700 1 -- 172.21.15.53:0/4186877893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ec00b2350 msgr2=0x7f2ec00b73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.387+0000 7f2ec81ff700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ec00b2350 0x7f2ec00b73a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00090b0 tx=0x7f2eb0004750 comp rx=0 tx=0).stop 2023-07-09T21:52:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.387+0000 7f2ec81ff700 1 -- 172.21.15.53:0/4186877893 shutdown_connections 2023-07-09T21:52:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.387+0000 7f2ec81ff700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2ea406ae00 0x7f2ea406d2b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.387+0000 7f2ec81ff700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ec00d1220 0x7f2ec01f1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.387+0000 7f2ec81ff700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ec00b1e00 0x7f2ec00c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.387+0000 7f2ec81ff700 1 --2- 172.21.15.53:0/4186877893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ec00b2350 0x7f2ec00b73a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.387+0000 7f2ec81ff700 1 -- 172.21.15.53:0/4186877893 >> 172.21.15.53:0/4186877893 conn(0x7f2ec009c1d0 msgr2=0x7f2ec00d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:58.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.387+0000 7f2ec81ff700 1 -- 172.21.15.53:0/4186877893 shutdown_connections 2023-07-09T21:52:58.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.387+0000 7f2ec81ff700 1 -- 172.21.15.53:0/4186877893 wait complete. 2023-07-09T21:52:58.392 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:52:58.408 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2023-07-09T21:52:56.888355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230136,"kb_used_data":6328,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754744584,"statfs":{"total":773094113280,"available":772858454016,"internally_reserved":0,"allocated":6479872,"data_stored":3607734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-139237,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":-5,"num_read_kb":-3,"num_write":-105,"num_write_kb":-185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001402"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-09T21:52:53.657315+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:52:53.657315+0000","last_peered":"2023-07-09T21:52:53.657315+0000","last_clean":"2023-07-09T21:52:53.657315+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:52:53.657315+0000","last_undegraded":"2023-07-09T21:52:53.657315+0000","last_fullsized":"2023-07-09T21:52:53.657315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:40:53.507614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:51.579876+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:52:51.579876+0000","last_peered":"2023-07-09T21:52:51.579876+0000","last_clean":"2023-07-09T21:52:51.579876+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:52:51.579876+0000","last_undegraded":"2023-07-09T21:52:51.579876+0000","last_fullsized":"2023-07-09T21:52:51.579876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:35:04.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.051168+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:52:52.051168+0000","last_peered":"2023-07-09T21:52:52.051168+0000","last_clean":"2023-07-09T21:52:52.051168+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:52:52.051168+0000","last_undegraded":"2023-07-09T21:52:52.051168+0000","last_fullsized":"2023-07-09T21:52:52.051168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:55:00.293625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:51.580501+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:52:51.580501+0000","last_peered":"2023-07-09T21:52:51.580501+0000","last_clean":"2023-07-09T21:52:51.580501+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:52:51.580501+0000","last_undegraded":"2023-07-09T21:52:51.580501+0000","last_fullsized":"2023-07-09T21:52:51.580501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:24:53.250765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":222,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.051144+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:52:52.051144+0000","last_peered":"2023-07-09T21:52:52.051144+0000","last_clean":"2023-07-09T21:52:52.051144+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:52:52.051144+0000","last_undegraded":"2023-07-09T21:52:52.051144+0000","last_fullsized":"2023-07-09T21:52:52.051144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:54:48.978657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.051313+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:52:52.051313+0000","last_peered":"2023-07-09T21:52:52.051313+0000","last_clean":"2023-07-09T21:52:52.051313+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:52:52.051313+0000","last_undegraded":"2023-07-09T21:52:52.051313+0000","last_fullsized":"2023-07-09T21:52:52.051313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:47:44.136990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.052045+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:52:52.052045+0000","last_peered":"2023-07-09T21:52:52.052045+0000","last_clean":"2023-07-09T21:52:52.052045+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:52:52.052045+0000","last_undegraded":"2023-07-09T21:52:52.052045+0000","last_fullsized":"2023-07-09T21:52:52.052045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:09:12.531270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-09T21:52:53.658211+0000","last_change":"2023-07-09T21:50:17.546700+0000","last_active":"2023-07-09T21:52:53.658211+0000","last_peered":"2023-07-09T21:52:53.658211+0000","last_clean":"2023-07-09T21:52:53.658211+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:52:53.658211+0000","last_undegraded":"2023-07-09T21:52:53.658211+0000","last_fullsized":"2023-07-09T21:52:53.658211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:31.720010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-09T21:52:52.051088+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:52:52.051088+0000","last_peered":"2023-07-09T21:52:52.051088+0000","last_clean":"2023-07-09T21:52:52.051088+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:52:52.051088+0000","last_undegraded":"2023-07-09T21:52:52.051088+0000","last_fullsized":"2023-07-09T21:52:52.051088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:45:09.892202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":626688,"data_stored":270965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95099999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.752}]},{"osd":1,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.45900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81999999999999995,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.79000000000000004,"15min":0.82099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78700000000000003,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97099999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.78500000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92900000000000005,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89200000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.51700000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":1.214,"15min":1.214},"last":0.53800000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.61499999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":630784,"data_stored":270555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52000000000000002,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55500000000000005,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.53700000000000003,"15min":0.55600000000000005},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56699999999999995,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.60599999999999998,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.63300000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.3180000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.68100000000000005,"15min":0.70899999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63400000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60399999999999998,"5min":3.129,"15min":3.129},"last":0.47099999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94499999999999995,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.998,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.389}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91200000000000003,"5min":1.929,"15min":1.929},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.85099999999999998,"15min":0.86399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97599999999999998,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.98999999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93500000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.95199999999999996,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.0529999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":2.766,"15min":2.766},"last":1.446},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.93400000000000005,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.72299999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":770048,"data_stored":408082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":1.232,"15min":1.3700000000000001},"min":{"1min":0.28899999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":16.946000000000002,"15min":16.946000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.93200000000000005,"15min":1.0089999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":9.5449999999999999,"15min":9.5449999999999999},"last":0.50700000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.92100000000000004,"15min":0.99399999999999999},"min":{"1min":0.38200000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65200000000000002,"5min":9.6950000000000003,"15min":9.6950000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.95099999999999996,"15min":1.0329999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63200000000000001,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.46300000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.995,"15min":1.077},"min":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69199999999999995,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.327,"15min":1.4630000000000001},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73599999999999999,"5min":17.004000000000001,"15min":17.004000000000001},"last":0.63}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.048,"15min":1.1000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.081,"5min":6.2510000000000003,"15min":6.2510000000000003},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.2849999999999999,"15min":1.3680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2050000000000001,"5min":9.6630000000000003,"15min":9.6630000000000003},"last":0.85899999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":1.091,"15min":1.139},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2370000000000001,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.2849999999999999,"15min":1.369},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.1619999999999999,"5min":9.5879999999999992,"15min":9.5879999999999992},"last":0.90200000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":1.2849999999999999,"15min":1.371},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.048,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":1.266,"15min":1.349},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0529999999999999,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":0.88500000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.2250000000000001,"15min":1.2969999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.103,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.1160000000000001,"15min":1.1659999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.163,"5min":6.2169999999999996,"15min":6.2169999999999996},"last":0.92100000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1220608,"data_stored":860605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.92200000000000004,"15min":1.01},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55000000000000004,"5min":11.949999999999999,"15min":11.949999999999999},"last":0.317},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60199999999999998,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.439}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73899999999999999,"5min":1.212,"15min":1.212},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.48299999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":1.4179999999999999,"15min":1.5720000000000001},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90900000000000003,"15min":0.97499999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65100000000000002,"5min":10.952,"15min":10.952},"last":0.54500000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":1.696,"15min":1.859},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":22.974,"15min":22.974},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":1.264,"15min":1.3520000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.98799999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52300000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":1.589,"15min":1.589},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.748,"5min":1.6890000000000001,"15min":1.8460000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":22.933,"15min":22.933},"last":0.80200000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93100000000000005,"5min":1.623,"15min":1.623},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.6830000000000001,"15min":1.8400000000000001},"min":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98199999999999998,"5min":22.867999999999999,"15min":22.867999999999999},"last":0.82299999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.1639999999999999,"15min":1.23},"min":{"1min":0.57499999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.93300000000000005,"5min":10.907999999999999,"15min":10.907999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83299999999999996,"15min":0.83999999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.99299999999999999,"5min":1.546,"15min":1.546},"last":0.83899999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1228800,"data_stored":861009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.57099999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85799999999999998,"5min":1.464,"15min":1.464},"last":0.628},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94999999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71199999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89100000000000001,"5min":1.121,"15min":1.121},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.78600000000000003,"15min":0.80400000000000005},"min":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.88}]},{"osd":3,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70799999999999996,"15min":0.71699999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.091,"15min":1.091},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96599999999999997,"5min":1.405,"15min":1.405},"last":0.73099999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.95399999999999996,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70399999999999996,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82799999999999996,"5min":1.341,"15min":1.341},"last":0.68000000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.443,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.871,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.90100000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88100000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.84399999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542179,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":401844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57599999999999996,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.435,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68200000000000005,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.35799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.53800000000000003,"5min":1.21,"15min":1.21},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.54900000000000004,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60699999999999998,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.56100000000000005,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.016,"5min":1.258,"15min":1.258},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0049999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.80900000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95599999999999996,"5min":1.486,"15min":1.486},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98999999999999999,"5min":1.327,"15min":1.327},"last":0.88400000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":1.302,"15min":1.302},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.86199999999999999,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":0.90500000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.04,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.008,"5min":1.349,"15min":1.349},"last":0.92300000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":270303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.74199999999999999,"15min":0.69999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":7.9779999999999998,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.41399999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":7.8650000000000002,"5min":7.8650000000000002,"15min":7.8650000000000002},"last":0.434},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.421,"15min":1.421},"last":0.60099999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.73199999999999998,"15min":0.68200000000000005},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":7.9390000000000001,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88300000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.47399999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1799999999999999,"5min":1.597,"15min":1.597},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.93700000000000006,"5min":1.216,"15min":1.216},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91200000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0609999999999999,"5min":1.069,"15min":1.069},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":1.093,"15min":1.093},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.038,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76800000000000002,"15min":0.76300000000000001},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.054,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.64300000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":614400,"data_stored":264371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.54400000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84799999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.68799999999999994}]},{"osd":1,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.86399999999999999,"5min":1.113,"15min":1.113},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84199999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85599999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.46800000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.621}]},{"osd":3,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93400000000000005,"5min":1.018,"15min":1.018},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95099999999999996,"5min":1.171,"15min":1.171},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98199999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.754,"15min":0.749},"min":{"1min":0.56699999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96399999999999997,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.999,"5min":1.133,"15min":1.133},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.022,"5min":1.123,"15min":1.123},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:52:58.414 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:52:58.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.612+0000 7f1571fff700 1 Processor -- start 2023-07-09T21:52:58.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.612+0000 7f1571fff700 1 -- start start 2023-07-09T21:52:58.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.614+0000 7f1571fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c070350 0x7f156c070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:58.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.614+0000 7f1571fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156c15a090 con 0x7f156c1597c0 2023-07-09T21:52:58.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.614+0000 7f1571fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156c0cdf90 con 0x7f156c159c30 2023-07-09T21:52:58.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.614+0000 7f1571fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c15a2f0 con 0x7f156c070350 2023-07-09T21:52:58.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.614+0000 7f156affd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f156c1597c0 0x7f156c0cea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41530/0 (socket says 172.21.15.53:41530) 2023-07-09T21:52:58.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.614+0000 7f156affd700 1 -- 172.21.15.53:0/978841364 learned_addr learned my addr 172.21.15.53:0/978841364 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:52:58.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.614+0000 7f156b7fe700 1 --2- 172.21.15.53:0/978841364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c070350 0x7f156c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:58.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.615+0000 7f156a7fc700 1 -- 172.21.15.53:0/978841364 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917280231 0 0) 0x7f156c15a090 con 0x7f156c1597c0 2023-07-09T21:52:58.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.615+0000 7f156a7fc700 1 -- 172.21.15.53:0/978841364 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15540035b0 con 0x7f156c1597c0 2023-07-09T21:52:58.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.615+0000 7f156a7fc700 1 -- 172.21.15.53:0/978841364 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902784971 0 0) 0x7f156c0cdf90 con 0x7f156c159c30 2023-07-09T21:52:58.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.615+0000 7f156b7fe700 1 -- 172.21.15.53:0/978841364 >> v1:172.21.15.184:6789/0 conn(0x7f156c159c30 legacy=0x7f156c0b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:58.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.615+0000 7f156b7fe700 1 -- 172.21.15.53:0/978841364 >> v1:172.21.15.53:6789/0 conn(0x7f156c1597c0 legacy=0x7f156c0cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:58.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.615+0000 7f156b7fe700 1 -- 172.21.15.53:0/978841364 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c15a5d0 con 0x7f156c070350 2023-07-09T21:52:58.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.615+0000 7f156b7fe700 1 --2- 172.21.15.53:0/978841364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c070350 0x7f156c070720 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f155c009870 tx=0x7f155c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=992af66d4287accf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:58.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.615+0000 7f156a7fc700 1 -- 172.21.15.53:0/978841364 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c011830 con 0x7f156c070350 2023-07-09T21:52:58.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.615+0000 7f156a7fc700 1 -- 172.21.15.53:0/978841364 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c011990 con 0x7f156c070350 2023-07-09T21:52:58.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.615+0000 7f156a7fc700 1 -- 172.21.15.53:0/978841364 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c011d20 con 0x7f156c070350 2023-07-09T21:52:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.616+0000 7f1571fff700 1 -- 172.21.15.53:0/978841364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c070350 msgr2=0x7f156c070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.616+0000 7f1571fff700 1 --2- 172.21.15.53:0/978841364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c070350 0x7f156c070720 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f155c009870 tx=0x7f155c009b80 comp rx=0 tx=0).stop 2023-07-09T21:52:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.616+0000 7f1571fff700 1 -- 172.21.15.53:0/978841364 shutdown_connections 2023-07-09T21:52:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.616+0000 7f1571fff700 1 --2- 172.21.15.53:0/978841364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c070350 0x7f156c070720 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.616+0000 7f1571fff700 1 -- 172.21.15.53:0/978841364 >> 172.21.15.53:0/978841364 conn(0x7f156c069f30 msgr2=0x7f156c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.616+0000 7f1571fff700 1 -- 172.21.15.53:0/978841364 shutdown_connections 2023-07-09T21:52:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.616+0000 7f1571fff700 1 -- 172.21.15.53:0/978841364 wait complete. 2023-07-09T21:52:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.618+0000 7f1571fff700 1 Processor -- start 2023-07-09T21:52:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.618+0000 7f1571fff700 1 -- start start 2023-07-09T21:52:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.619+0000 7f1571fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c070350 0x7f156c1426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.619+0000 7f1571fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f156c1597c0 0x7f156c151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.619+0000 7f1571fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c159c30 0x7f156c1504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.619+0000 7f1571fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c1524b0 con 0x7f156c1597c0 2023-07-09T21:52:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.619+0000 7f1571fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c150ed0 con 0x7f156c070350 2023-07-09T21:52:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.619+0000 7f1571fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c1511b0 con 0x7f156c159c30 2023-07-09T21:52:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.619+0000 7f156affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f156c1597c0 0x7f156c151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.619+0000 7f156affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f156c1597c0 0x7f156c151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54778/0 (socket says 172.21.15.53:54778) 2023-07-09T21:52:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.619+0000 7f156affd700 1 -- 172.21.15.53:0/3627988655 learned_addr learned my addr 172.21.15.53:0/3627988655 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:52:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.619+0000 7f156b7fe700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c070350 0x7f156c1426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.619+0000 7f156bfff700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c159c30 0x7f156c1504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:58.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.620+0000 7f156affd700 1 -- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c159c30 msgr2=0x7f156c1504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:58.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.620+0000 7f156affd700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c159c30 0x7f156c1504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.620+0000 7f156affd700 1 -- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c070350 msgr2=0x7f156c1426e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:58.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.620+0000 7f156affd700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c070350 0x7f156c1426e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.620+0000 7f156affd700 1 -- 172.21.15.53:0/3627988655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0094a0 con 0x7f156c1597c0 2023-07-09T21:52:58.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.620+0000 7f156bfff700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c159c30 0x7f156c1504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:52:58.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.620+0000 7f156affd700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f156c1597c0 0x7f156c151f70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f156000c4d0 tx=0x7f156000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:58.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.620+0000 7f1553fff700 1 -- 172.21.15.53:0/3627988655 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1560005d70 con 0x7f156c1597c0 2023-07-09T21:52:58.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.620+0000 7f1553fff700 1 -- 172.21.15.53:0/3627988655 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15600070d0 con 0x7f156c1597c0 2023-07-09T21:52:58.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.620+0000 7f1553fff700 1 -- 172.21.15.53:0/3627988655 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1560007440 con 0x7f156c1597c0 2023-07-09T21:52:58.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.620+0000 7f1571fff700 1 -- 172.21.15.53:0/3627988655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c151490 con 0x7f156c1597c0 2023-07-09T21:52:58.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.620+0000 7f1571fff700 1 -- 172.21.15.53:0/3627988655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c151a50 con 0x7f156c1597c0 2023-07-09T21:52:58.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.621+0000 7f1571fff700 1 -- 172.21.15.53:0/3627988655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c0cafd0 con 0x7f156c1597c0 2023-07-09T21:52:58.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.622+0000 7f1553fff700 1 -- 172.21.15.53:0/3627988655 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f15600075a0 con 0x7f156c1597c0 2023-07-09T21:52:58.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.623+0000 7f1553fff700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f155806ae00 0x7f155806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:52:58.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.623+0000 7f1553fff700 1 -- 172.21.15.53:0/3627988655 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f1560088760 con 0x7f156c1597c0 2023-07-09T21:52:58.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.624+0000 7f156b7fe700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f155806ae00 0x7f155806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:52:58.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.624+0000 7f156b7fe700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f155806ae00 0x7f155806d2b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f155c0090b0 tx=0x7f155c01c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:52:58.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.627+0000 7f1553fff700 1 -- 172.21.15.53:0/3627988655 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f15600539f0 con 0x7f156c1597c0 2023-07-09T21:52:58.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.836+0000 7f1571fff700 1 -- 172.21.15.53:0/3627988655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f156c04e280 con 0x7f156c1597c0 2023-07-09T21:52:58.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.837+0000 7f1553fff700 1 -- 172.21.15.53:0/3627988655 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+14787 (secure 0 0 0) 0x7f1560057010 con 0x7f156c1597c0 2023-07-09T21:52:58.840 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:52:58.840 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":55,"fsid":"25d21351-dc09-4310-b56b-79a331e4aa31","created":"2023-07-09T21:49:55.749261+0000","modified":"2023-07-09T21:52:54.662512+0000","last_up_change":"2023-07-09T21:50:08.127111+0000","last_in_change":"2023-07-09T21:49:59.323314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:50:08.910389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:50:15.789288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"282d22e7-b7e6-46cd-a8ca-9e7191bb271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6809","nonce":1521858900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6811","nonce":1521858900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6815","nonce":1521858900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1521858900},{"type":"v1","addr":"172.21.15.53:6813","nonce":1521858900}]},"public_addr":"172.21.15.53:6809/1521858900","cluster_addr":"172.21.15.53:6811/1521858900","heartbeat_back_addr":"172.21.15.53:6815/1521858900","heartbeat_front_addr":"172.21.15.53:6813/1521858900","state":["exists","up"]},{"osd":1,"uuid":"4a0566a8-107d-4bc6-9c16-af686ea0f58f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6817","nonce":801424543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6819","nonce":801424543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6823","nonce":801424543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":801424543},{"type":"v1","addr":"172.21.15.53:6821","nonce":801424543}]},"public_addr":"172.21.15.53:6817/801424543","cluster_addr":"172.21.15.53:6819/801424543","heartbeat_back_addr":"172.21.15.53:6823/801424543","heartbeat_front_addr":"172.21.15.53:6821/801424543","state":["exists","up"]},{"osd":2,"uuid":"016d7aac-bd5c-445f-97f4-4b904cc4036e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6801","nonce":2275952419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6803","nonce":2275952419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6807","nonce":2275952419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2275952419},{"type":"v1","addr":"172.21.15.53:6805","nonce":2275952419}]},"public_addr":"172.21.15.53:6801/2275952419","cluster_addr":"172.21.15.53:6803/2275952419","heartbeat_back_addr":"172.21.15.53:6807/2275952419","heartbeat_front_addr":"172.21.15.53:6805/2275952419","state":["exists","up"]},{"osd":3,"uuid":"9a0bb860-f0aa-48e1-91c6-c2c1bab811d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6825","nonce":743855822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6827","nonce":743855822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6831","nonce":743855822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":743855822},{"type":"v1","addr":"172.21.15.53:6829","nonce":743855822}]},"public_addr":"172.21.15.53:6825/743855822","cluster_addr":"172.21.15.53:6827/743855822","heartbeat_back_addr":"172.21.15.53:6831/743855822","heartbeat_front_addr":"172.21.15.53:6829/743855822","state":["exists","up"]},{"osd":4,"uuid":"fa07c13d-5240-4815-ab88-67c32e36e515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6801","nonce":2051967353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6803","nonce":2051967353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6807","nonce":2051967353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2051967353},{"type":"v1","addr":"172.21.15.184:6805","nonce":2051967353}]},"public_addr":"172.21.15.184:6801/2051967353","cluster_addr":"172.21.15.184:6803/2051967353","heartbeat_back_addr":"172.21.15.184:6807/2051967353","heartbeat_front_addr":"172.21.15.184:6805/2051967353","state":["exists","up"]},{"osd":5,"uuid":"fc7c0ae4-47bf-40e4-918d-8dc8d9b3b49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6809","nonce":1885482202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6811","nonce":1885482202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6818","nonce":1885482202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1885482202},{"type":"v1","addr":"172.21.15.184:6814","nonce":1885482202}]},"public_addr":"172.21.15.184:6809/1885482202","cluster_addr":"172.21.15.184:6811/1885482202","heartbeat_back_addr":"172.21.15.184:6818/1885482202","heartbeat_front_addr":"172.21.15.184:6814/1885482202","state":["exists","up"]},{"osd":6,"uuid":"54260f3c-7279-4c91-a6c4-790d620b90bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6815","nonce":587359560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6819","nonce":587359560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6823","nonce":587359560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":587359560},{"type":"v1","addr":"172.21.15.184:6821","nonce":587359560}]},"public_addr":"172.21.15.184:6815/587359560","cluster_addr":"172.21.15.184:6819/587359560","heartbeat_back_addr":"172.21.15.184:6823/587359560","heartbeat_front_addr":"172.21.15.184:6821/587359560","state":["exists","up"]},{"osd":7,"uuid":"319b0584-fb9b-4adf-a4be-9fa598581cb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6825","nonce":3630658135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6827","nonce":3630658135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6831","nonce":3630658135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3630658135},{"type":"v1","addr":"172.21.15.184:6829","nonce":3630658135}]},"public_addr":"172.21.15.184:6825/3630658135","cluster_addr":"172.21.15.184:6827/3630658135","heartbeat_back_addr":"172.21.15.184:6831/3630658135","heartbeat_front_addr":"172.21.15.184:6829/3630658135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.703052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.891168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.716384+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.758256+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.831955+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:06.938025+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.598098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:50:04.641275+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/3167613257":"2023-07-10T21:52:51.573882+0000","172.21.15.53:6833/3167613257":"2023-07-10T21:52:51.573882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:52:58.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.840+0000 7f1571fff700 1 -- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f155806ae00 msgr2=0x7f155806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:58.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.840+0000 7f1571fff700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f155806ae00 0x7f155806d2b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f155c0090b0 tx=0x7f155c01c040 comp rx=0 tx=0).stop 2023-07-09T21:52:58.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.840+0000 7f1571fff700 1 -- 172.21.15.53:0/3627988655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f156c1597c0 msgr2=0x7f156c151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:52:58.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.840+0000 7f1571fff700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f156c1597c0 0x7f156c151f70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f156000c4d0 tx=0x7f156000c7e0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.840+0000 7f1571fff700 1 -- 172.21.15.53:0/3627988655 shutdown_connections 2023-07-09T21:52:58.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.840+0000 7f1571fff700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f155806ae00 0x7f155806d2b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.840+0000 7f1571fff700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c159c30 0x7f156c1504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.840+0000 7f1571fff700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c070350 0x7f156c1426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.840+0000 7f1571fff700 1 --2- 172.21.15.53:0/3627988655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f156c1597c0 0x7f156c151f70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:52:58.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.840+0000 7f1571fff700 1 -- 172.21.15.53:0/3627988655 >> 172.21.15.53:0/3627988655 conn(0x7f156c069f30 msgr2=0x7f156c146cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:52:58.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.840+0000 7f1571fff700 1 -- 172.21.15.53:0/3627988655 shutdown_connections 2023-07-09T21:52:58.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:52:58.840+0000 7f1571fff700 1 -- 172.21.15.53:0/3627988655 wait complete. 2023-07-09T21:52:59.861 INFO:tasks.ceph:Scrubbing osd.0 2023-07-09T21:52:59.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-09T21:53:00.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.075+0000 7f68229ff700 1 Processor -- start 2023-07-09T21:53:00.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.076+0000 7f68229ff700 1 -- start start 2023-07-09T21:53:00.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.077+0000 7f68229ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f681c0d1140 0x7f681c15c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.077+0000 7f68229ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f681c0ce030 0x7f681c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.077+0000 7f68229ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681c0d2c70 con 0x7f681c0d28a0 2023-07-09T21:53:00.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.077+0000 7f68229ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681c0d3de0 con 0x7f681c0d1140 2023-07-09T21:53:00.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.077+0000 7f68229ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681c15ccf0 con 0x7f681c0ce030 2023-07-09T21:53:00.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.077+0000 7f681b7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f681c0d1140 0x7f681c15c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.077+0000 7f681b7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f681c0d1140 0x7f681c15c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54794/0 (socket says 172.21.15.53:54794) 2023-07-09T21:53:00.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.077+0000 7f681b7fe700 1 -- 172.21.15.53:0/1710012800 learned_addr learned my addr 172.21.15.53:0/1710012800 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:00.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.077+0000 7f6820f9c700 1 --2- 172.21.15.53:0/1710012800 >> v2:172.21.15.184:3300/0 conn(0x7f681c0ce030 0x7f681c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.078+0000 7f681b7fe700 1 -- 172.21.15.53:0/1710012800 >> v2:172.21.15.184:3300/0 conn(0x7f681c0ce030 msgr2=0x7f681c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:00.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.078+0000 7f681b7fe700 1 --2- 172.21.15.53:0/1710012800 >> v2:172.21.15.184:3300/0 conn(0x7f681c0ce030 0x7f681c0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.078+0000 7f681b7fe700 1 -- 172.21.15.53:0/1710012800 >> v1:172.21.15.184:6789/0 conn(0x7f681c0d28a0 legacy=0x7f681c0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.078+0000 7f681b7fe700 1 -- 172.21.15.53:0/1710012800 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c0d0190 con 0x7f681c0d1140 2023-07-09T21:53:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.078+0000 7f6820f9c700 1 --2- 172.21.15.53:0/1710012800 >> v2:172.21.15.184:3300/0 conn(0x7f681c0ce030 0x7f681c0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:53:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.078+0000 7f681b7fe700 1 --2- 172.21.15.53:0/1710012800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f681c0d1140 0x7f681c15c7b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f681c08d670 tx=0x7f6810009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234388a94074a352 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.078+0000 7f681affd700 1 -- 172.21.15.53:0/1710012800 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681000b870 con 0x7f681c0d1140 2023-07-09T21:53:00.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.078+0000 7f681affd700 1 -- 172.21.15.53:0/1710012800 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681000b9d0 con 0x7f681c0d1140 2023-07-09T21:53:00.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.078+0000 7f681affd700 1 -- 172.21.15.53:0/1710012800 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681000bd60 con 0x7f681c0d1140 2023-07-09T21:53:00.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.079+0000 7f68229ff700 1 -- 172.21.15.53:0/1710012800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f681c0d1140 msgr2=0x7f681c15c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.079+0000 7f68229ff700 1 --2- 172.21.15.53:0/1710012800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f681c0d1140 0x7f681c15c7b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f681c08d670 tx=0x7f6810009bd0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.079+0000 7f68229ff700 1 -- 172.21.15.53:0/1710012800 shutdown_connections 2023-07-09T21:53:00.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.079+0000 7f68229ff700 1 --2- 172.21.15.53:0/1710012800 >> v2:172.21.15.184:3300/0 conn(0x7f681c0ce030 0x7f681c0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.079+0000 7f68229ff700 1 --2- 172.21.15.53:0/1710012800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f681c0d1140 0x7f681c15c7b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.079+0000 7f68229ff700 1 -- 172.21.15.53:0/1710012800 >> 172.21.15.53:0/1710012800 conn(0x7f681c09c1b0 msgr2=0x7f681c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:00.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.079+0000 7f68229ff700 1 -- 172.21.15.53:0/1710012800 shutdown_connections 2023-07-09T21:53:00.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.079+0000 7f68229ff700 1 -- 172.21.15.53:0/1710012800 wait complete. 2023-07-09T21:53:00.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.081+0000 7f68229ff700 1 Processor -- start 2023-07-09T21:53:00.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.081+0000 7f68229ff700 1 -- start start 2023-07-09T21:53:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.082+0000 7f68229ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f681c0ce030 0x7f681c0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.082+0000 7f68229ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f681c0d1140 0x7f681c15f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.082+0000 7f68229ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f681c0d28a0 0x7f681c0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.082+0000 7f68229ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681c0cae90 con 0x7f681c0ce030 2023-07-09T21:53:00.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.082+0000 7f68229ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681c0cc470 con 0x7f681c0d1140 2023-07-09T21:53:00.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.082+0000 7f68229ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681c0cbb40 con 0x7f681c0d28a0 2023-07-09T21:53:00.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.082+0000 7f681bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f681c0ce030 0x7f681c0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.082+0000 7f681bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f681c0ce030 0x7f681c0cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54808/0 (socket says 172.21.15.53:54808) 2023-07-09T21:53:00.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.082+0000 7f681bfff700 1 -- 172.21.15.53:0/789309943 learned_addr learned my addr 172.21.15.53:0/789309943 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:00.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.082+0000 7f681b7fe700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f681c0d1140 0x7f681c15f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.082+0000 7f6820f9c700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f681c0d28a0 0x7f681c0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.083+0000 7f681bfff700 1 -- 172.21.15.53:0/789309943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f681c0d28a0 msgr2=0x7f681c0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.083+0000 7f681bfff700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f681c0d28a0 0x7f681c0b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.083+0000 7f681bfff700 1 -- 172.21.15.53:0/789309943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f681c0d1140 msgr2=0x7f681c15f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.083+0000 7f681bfff700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f681c0d1140 0x7f681c15f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.083+0000 7f681bfff700 1 -- 172.21.15.53:0/789309943 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6810009550 con 0x7f681c0ce030 2023-07-09T21:53:00.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.083+0000 7f681bfff700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f681c0ce030 0x7f681c0cc900 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f680c00c480 tx=0x7f680c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:00.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.083+0000 7f6818ff9700 1 -- 172.21.15.53:0/789309943 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c0052d0 con 0x7f681c0ce030 2023-07-09T21:53:00.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.083+0000 7f6818ff9700 1 -- 172.21.15.53:0/789309943 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680c005430 con 0x7f681c0ce030 2023-07-09T21:53:00.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.083+0000 7f6818ff9700 1 -- 172.21.15.53:0/789309943 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c0038c0 con 0x7f681c0ce030 2023-07-09T21:53:00.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.083+0000 7f68229ff700 1 -- 172.21.15.53:0/789309943 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681c0cbe20 con 0x7f681c0ce030 2023-07-09T21:53:00.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.083+0000 7f68229ff700 1 -- 172.21.15.53:0/789309943 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681c15fba0 con 0x7f681c0ce030 2023-07-09T21:53:00.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.084+0000 7f68229ff700 1 -- 172.21.15.53:0/789309943 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f681c0d0750 con 0x7f681c0ce030 2023-07-09T21:53:00.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.085+0000 7f6818ff9700 1 -- 172.21.15.53:0/789309943 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f680c003a20 con 0x7f681c0ce030 2023-07-09T21:53:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.086+0000 7f6818ff9700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f680806ae00 0x7f680806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.086+0000 7f6818ff9700 1 -- 172.21.15.53:0/789309943 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f680c088660 con 0x7f681c0ce030 2023-07-09T21:53:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.086+0000 7f6818ff9700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] conn(0x7f6808071270 0x7f68080736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.086+0000 7f6818ff9700 1 -- 172.21.15.53:0/789309943 --> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6808073d70 con 0x7f6808071270 2023-07-09T21:53:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.086+0000 7f6818ff9700 1 -- 172.21.15.53:0/789309943 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f680c08ac40 con 0x7f681c0ce030 2023-07-09T21:53:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.087+0000 7f6820f9c700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] conn(0x7f6808071270 0x7f68080736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.087+0000 7f681b7fe700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f680806ae00 0x7f680806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.087+0000 7f6820f9c700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] conn(0x7f6808071270 0x7f68080736a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.087+0000 7f681b7fe700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f680806ae00 0x7f680806d2b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6810000c00 tx=0x7f6810008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.088+0000 7f6818ff9700 1 -- 172.21.15.53:0/789309943 <== osd.0 v2:172.21.15.53:6808/1521858900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6808073d70 con 0x7f6808071270 2023-07-09T21:53:00.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.103+0000 7f68229ff700 1 -- 172.21.15.53:0/789309943 --> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f681c0b3a40 con 0x7f6808071270 2023-07-09T21:53:00.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.104+0000 7f6818ff9700 1 -- 172.21.15.53:0/789309943 <== osd.0 v2:172.21.15.53:6808/1521858900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f681c0b3a40 con 0x7f6808071270 2023-07-09T21:53:00.106 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-07-09T21:53:00.107 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T21:53:00.107 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-07-09T21:53:00.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.104+0000 7f68229ff700 1 -- 172.21.15.53:0/789309943 >> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] conn(0x7f6808071270 msgr2=0x7f68080736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.104+0000 7f68229ff700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.53:6808/1521858900,v1:172.21.15.53:6809/1521858900] conn(0x7f6808071270 0x7f68080736a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.104+0000 7f68229ff700 1 -- 172.21.15.53:0/789309943 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f680806ae00 msgr2=0x7f680806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.104+0000 7f68229ff700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f680806ae00 0x7f680806d2b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6810000c00 tx=0x7f6810008030 comp rx=0 tx=0).stop 2023-07-09T21:53:00.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.104+0000 7f68229ff700 1 -- 172.21.15.53:0/789309943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f681c0ce030 msgr2=0x7f681c0cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.104+0000 7f68229ff700 1 --2- 172.21.15.53:0/789309943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f681c0ce030 0x7f681c0cc900 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f680c00c480 tx=0x7f680c00c790 comp rx=0 tx=0).stop 2023-07-09T21:53:00.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.104+0000 7f6820f9c700 1 -- 172.21.15.53:0/789309943 reap_dead start 2023-07-09T21:53:00.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.104+0000 7f68229ff700 1 -- 172.21.15.53:0/789309943 shutdown_connections 2023-07-09T21:53:00.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.104+0000 7f68229ff700 1 -- 172.21.15.53:0/789309943 >> 172.21.15.53:0/789309943 conn(0x7f681c09c1b0 msgr2=0x7f681c0ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:00.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.104+0000 7f68229ff700 1 -- 172.21.15.53:0/789309943 shutdown_connections 2023-07-09T21:53:00.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.104+0000 7f68229ff700 1 -- 172.21.15.53:0/789309943 wait complete. 2023-07-09T21:53:00.123 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-09T21:53:00.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.322+0000 7f5c5a3ff700 1 Processor -- start 2023-07-09T21:53:00.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.322+0000 7f5c5a3ff700 1 -- start start 2023-07-09T21:53:00.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.323+0000 7f5c5a3ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5c540b3ff0 0x7f5c540b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.323+0000 7f5c5a3ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c540b8e80 con 0x7f5c540d0b10 2023-07-09T21:53:00.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.323+0000 7f5c5a3ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c540b33f0 con 0x7f5c540d0f90 2023-07-09T21:53:00.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.323+0000 7f5c5a3ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c540b1e30 con 0x7f5c540b3ff0 2023-07-09T21:53:00.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.324+0000 7f5c53fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5c540b3ff0 0x7f5c540b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.324+0000 7f5c537fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5c540d0b10 0x7f5c540b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41532/0 (socket says 172.21.15.53:41532) 2023-07-09T21:53:00.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.324+0000 7f5c537fe700 1 -- 172.21.15.53:0/2501232476 learned_addr learned my addr 172.21.15.53:0/2501232476 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:53:00.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.324+0000 7f5c52ffd700 1 -- 172.21.15.53:0/2501232476 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648839921 0 0) 0x7f5c48001110 con 0x7f5c540d0b10 2023-07-09T21:53:00.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.324+0000 7f5c53fff700 1 -- 172.21.15.53:0/2501232476 >> v1:172.21.15.184:6789/0 conn(0x7f5c540d0f90 legacy=0x7f5c540b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.324+0000 7f5c53fff700 1 -- 172.21.15.53:0/2501232476 >> v1:172.21.15.53:6789/0 conn(0x7f5c540d0b10 legacy=0x7f5c540b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.324+0000 7f5c53fff700 1 -- 172.21.15.53:0/2501232476 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c540afaa0 con 0x7f5c540b3ff0 2023-07-09T21:53:00.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.324+0000 7f5c53fff700 1 --2- 172.21.15.53:0/2501232476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c540b3ff0 0x7f5c540b43c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5c440097c0 tx=0x7f5c44009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88658a726334f40d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:00.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.325+0000 7f5c52ffd700 1 -- 172.21.15.53:0/2501232476 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44004230 con 0x7f5c540b3ff0 2023-07-09T21:53:00.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.325+0000 7f5c52ffd700 1 -- 172.21.15.53:0/2501232476 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c44004390 con 0x7f5c540b3ff0 2023-07-09T21:53:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.325+0000 7f5c52ffd700 1 -- 172.21.15.53:0/2501232476 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440036a0 con 0x7f5c540b3ff0 2023-07-09T21:53:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.325+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/2501232476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c540b3ff0 msgr2=0x7f5c540b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.325+0000 7f5c5a3ff700 1 --2- 172.21.15.53:0/2501232476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c540b3ff0 0x7f5c540b43c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5c440097c0 tx=0x7f5c44009ad0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.325+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/2501232476 shutdown_connections 2023-07-09T21:53:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.325+0000 7f5c5a3ff700 1 --2- 172.21.15.53:0/2501232476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c540b3ff0 0x7f5c540b43c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.325+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/2501232476 >> 172.21.15.53:0/2501232476 conn(0x7f5c5409c1b0 msgr2=0x7f5c540d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.325+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/2501232476 shutdown_connections 2023-07-09T21:53:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.326+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/2501232476 wait complete. 2023-07-09T21:53:00.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.327+0000 7f5c5a3ff700 1 Processor -- start 2023-07-09T21:53:00.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.327+0000 7f5c5a3ff700 1 -- start start 2023-07-09T21:53:00.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.328+0000 7f5c5a3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c540b3ff0 0x7f5c540cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.328+0000 7f5c5a3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c540d0b10 0x7f5c541f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.328+0000 7f5c5a3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c540d0f90 0x7f5c54159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.328+0000 7f5c5a3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c541f63b0 con 0x7f5c540b3ff0 2023-07-09T21:53:00.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.328+0000 7f5c5a3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540cc0d0 con 0x7f5c540d0b10 2023-07-09T21:53:00.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.328+0000 7f5c5a3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540cc3b0 con 0x7f5c540d0f90 2023-07-09T21:53:00.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.329+0000 7f5c53fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c540b3ff0 0x7f5c540cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.329+0000 7f5c53fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c540b3ff0 0x7f5c540cba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54826/0 (socket says 172.21.15.53:54826) 2023-07-09T21:53:00.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.329+0000 7f5c53fff700 1 -- 172.21.15.53:0/813958109 learned_addr learned my addr 172.21.15.53:0/813958109 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:00.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.329+0000 7f5c537fe700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c540d0b10 0x7f5c541f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.329+0000 7f5c5899c700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c540d0f90 0x7f5c54159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.329+0000 7f5c53fff700 1 -- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c540d0f90 msgr2=0x7f5c54159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.329+0000 7f5c53fff700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c540d0f90 0x7f5c54159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.329+0000 7f5c53fff700 1 -- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c540d0b10 msgr2=0x7f5c541f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.329+0000 7f5c53fff700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c540d0b10 0x7f5c541f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.329+0000 7f5c53fff700 1 -- 172.21.15.53:0/813958109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c440094a0 con 0x7f5c540b3ff0 2023-07-09T21:53:00.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.329+0000 7f5c5899c700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c540d0f90 0x7f5c54159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:53:00.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.329+0000 7f5c53fff700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c540b3ff0 0x7f5c540cba40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5c440090b0 tx=0x7f5c44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:00.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.330+0000 7f5c50ff9700 1 -- 172.21.15.53:0/813958109 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44011630 con 0x7f5c540b3ff0 2023-07-09T21:53:00.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.330+0000 7f5c50ff9700 1 -- 172.21.15.53:0/813958109 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4401f070 con 0x7f5c540b3ff0 2023-07-09T21:53:00.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.330+0000 7f5c50ff9700 1 -- 172.21.15.53:0/813958109 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440119d0 con 0x7f5c540b3ff0 2023-07-09T21:53:00.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.330+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/813958109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c540cc690 con 0x7f5c540b3ff0 2023-07-09T21:53:00.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.330+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/813958109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c540ca0b0 con 0x7f5c540b3ff0 2023-07-09T21:53:00.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.331+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/813958109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c54074350 con 0x7f5c540b3ff0 2023-07-09T21:53:00.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.332+0000 7f5c50ff9700 1 -- 172.21.15.53:0/813958109 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f5c44011b30 con 0x7f5c540b3ff0 2023-07-09T21:53:00.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.333+0000 7f5c50ff9700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5c4006ae00 0x7f5c4006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.333+0000 7f5c50ff9700 1 -- 172.21.15.53:0/813958109 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f5c44021070 con 0x7f5c540b3ff0 2023-07-09T21:53:00.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.334+0000 7f5c537fe700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5c4006ae00 0x7f5c4006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.336+0000 7f5c537fe700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5c4006ae00 0x7f5c4006d2b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5c540cd110 tx=0x7f5c48007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:00.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.338+0000 7f5c50ff9700 1 -- 172.21.15.53:0/813958109 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5c44056090 con 0x7f5c540b3ff0 2023-07-09T21:53:00.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.547+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/813958109 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c540b0060 con 0x7f5c4006ae00 2023-07-09T21:53:00.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.548+0000 7f5c50ff9700 1 -- 172.21.15.53:0/813958109 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5c480049b0 con 0x7f5c4006ae00 2023-07-09T21:53:00.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.550+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5c4006ae00 msgr2=0x7f5c4006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.550+0000 7f5c5a3ff700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5c4006ae00 0x7f5c4006d2b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5c540cd110 tx=0x7f5c48007c20 comp rx=0 tx=0).stop 2023-07-09T21:53:00.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.550+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/813958109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c540b3ff0 msgr2=0x7f5c540cba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.550+0000 7f5c5a3ff700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c540b3ff0 0x7f5c540cba40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5c440090b0 tx=0x7f5c44004750 comp rx=0 tx=0).stop 2023-07-09T21:53:00.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.550+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/813958109 shutdown_connections 2023-07-09T21:53:00.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.550+0000 7f5c5a3ff700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f5c4006ae00 0x7f5c4006d2b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.550+0000 7f5c5a3ff700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c540d0f90 0x7f5c54159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.550+0000 7f5c5a3ff700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c540b3ff0 0x7f5c540cba40 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.550+0000 7f5c5a3ff700 1 --2- 172.21.15.53:0/813958109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c540d0b10 0x7f5c541f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.550+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/813958109 >> 172.21.15.53:0/813958109 conn(0x7f5c5409c1b0 msgr2=0x7f5c5406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:00.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.551+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/813958109 shutdown_connections 2023-07-09T21:53:00.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.551+0000 7f5c5a3ff700 1 -- 172.21.15.53:0/813958109 wait complete. 2023-07-09T21:53:00.556 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 0 to deep-scrub 2023-07-09T21:53:00.571 INFO:tasks.ceph:Scrubbing osd.1 2023-07-09T21:53:00.572 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-09T21:53:00.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.773+0000 7fd88f7ff700 1 Processor -- start 2023-07-09T21:53:00.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.774+0000 7fd88f7ff700 1 -- start start 2023-07-09T21:53:00.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.775+0000 7fd88f7ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd8880d28a0 0x7fd88815c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.775+0000 7fd88f7ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd8880cf040 0x7fd8880d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.775+0000 7fd88f7ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8880d2c70 con 0x7fd8880d0a30 2023-07-09T21:53:00.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.775+0000 7fd88f7ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8880d1410 con 0x7fd8880cf040 2023-07-09T21:53:00.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.775+0000 7fd88f7ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8880d3de0 con 0x7fd8880d28a0 2023-07-09T21:53:00.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.775+0000 7fd88cd9a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd8880d0a30 0x7fd888160350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41540/0 (socket says 172.21.15.53:41540) 2023-07-09T21:53:00.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.775+0000 7fd88cd9a700 1 -- 172.21.15.53:0/2585671549 learned_addr learned my addr 172.21.15.53:0/2585671549 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:53:00.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.775+0000 7fd88dd9c700 1 --2- 172.21.15.53:0/2585671549 >> v2:172.21.15.53:3300/0 conn(0x7fd8880cf040 0x7fd8880d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.776+0000 7fd88d59b700 1 --2- 172.21.15.53:0/2585671549 >> v2:172.21.15.184:3300/0 conn(0x7fd8880d28a0 0x7fd88815c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.776+0000 7fd87ffff700 1 -- 172.21.15.53:0/2585671549 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105372895 0 0) 0x7fd8880d2c70 con 0x7fd8880d0a30 2023-07-09T21:53:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.776+0000 7fd87ffff700 1 -- 172.21.15.53:0/2585671549 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8740035b0 con 0x7fd8880d0a30 2023-07-09T21:53:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.776+0000 7fd88dd9c700 1 -- 172.21.15.53:0/2585671549 >> v2:172.21.15.184:3300/0 conn(0x7fd8880d28a0 msgr2=0x7fd88815c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:00.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.776+0000 7fd88dd9c700 1 --2- 172.21.15.53:0/2585671549 >> v2:172.21.15.184:3300/0 conn(0x7fd8880d28a0 0x7fd88815c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.776+0000 7fd88dd9c700 1 -- 172.21.15.53:0/2585671549 >> v1:172.21.15.53:6789/0 conn(0x7fd8880d0a30 legacy=0x7fd888160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.776+0000 7fd88dd9c700 1 -- 172.21.15.53:0/2585671549 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880d0190 con 0x7fd8880cf040 2023-07-09T21:53:00.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.776+0000 7fd88dd9c700 1 --2- 172.21.15.53:0/2585671549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8880cf040 0x7fd8880d0ed0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd888072060 tx=0x7fd88000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbccd10f38327cdf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:00.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.776+0000 7fd87ffff700 1 -- 172.21.15.53:0/2585671549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88000e070 con 0x7fd8880cf040 2023-07-09T21:53:00.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.776+0000 7fd87ffff700 1 -- 172.21.15.53:0/2585671549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88000bb20 con 0x7fd8880cf040 2023-07-09T21:53:00.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.776+0000 7fd87ffff700 1 -- 172.21.15.53:0/2585671549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd880012430 con 0x7fd8880cf040 2023-07-09T21:53:00.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.777+0000 7fd88f7ff700 1 -- 172.21.15.53:0/2585671549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8880cf040 msgr2=0x7fd8880d0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.777+0000 7fd88f7ff700 1 --2- 172.21.15.53:0/2585671549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8880cf040 0x7fd8880d0ed0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd888072060 tx=0x7fd88000b330 comp rx=0 tx=0).stop 2023-07-09T21:53:00.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.777+0000 7fd88f7ff700 1 -- 172.21.15.53:0/2585671549 shutdown_connections 2023-07-09T21:53:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.777+0000 7fd88f7ff700 1 --2- 172.21.15.53:0/2585671549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8880cf040 0x7fd8880d0ed0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.777+0000 7fd88f7ff700 1 --2- 172.21.15.53:0/2585671549 >> v2:172.21.15.184:3300/0 conn(0x7fd8880d28a0 0x7fd88815c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.777+0000 7fd88f7ff700 1 -- 172.21.15.53:0/2585671549 >> 172.21.15.53:0/2585671549 conn(0x7fd88809c1b0 msgr2=0x7fd8880d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.777+0000 7fd88f7ff700 1 -- 172.21.15.53:0/2585671549 shutdown_connections 2023-07-09T21:53:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.777+0000 7fd88f7ff700 1 -- 172.21.15.53:0/2585671549 wait complete. 2023-07-09T21:53:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.779+0000 7fd88f7ff700 1 Processor -- start 2023-07-09T21:53:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.779+0000 7fd88f7ff700 1 -- start start 2023-07-09T21:53:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.780+0000 7fd88f7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8880cf040 0x7fd8880b8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.780+0000 7fd88f7ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8880d0a30 0x7fd8880b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.780+0000 7fd88f7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8880d28a0 0x7fd8880cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.780+0000 7fd88f7ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8881f6630 con 0x7fd8880d0a30 2023-07-09T21:53:00.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.780+0000 7fd88f7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880caa70 con 0x7fd8880d28a0 2023-07-09T21:53:00.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.780+0000 7fd88f7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880b8c90 con 0x7fd8880cf040 2023-07-09T21:53:00.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.780+0000 7fd88cd9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8880d0a30 0x7fd8880b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.780+0000 7fd88cd9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8880d0a30 0x7fd8880b67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54852/0 (socket says 172.21.15.53:54852) 2023-07-09T21:53:00.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.780+0000 7fd88cd9a700 1 -- 172.21.15.53:0/1204775050 learned_addr learned my addr 172.21.15.53:0/1204775050 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.780+0000 7fd88dd9c700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8880d28a0 0x7fd8880cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.781+0000 7fd88d59b700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8880cf040 0x7fd8880b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.781+0000 7fd88cd9a700 1 -- 172.21.15.53:0/1204775050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8880cf040 msgr2=0x7fd8880b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.781+0000 7fd88cd9a700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8880cf040 0x7fd8880b8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.781+0000 7fd88cd9a700 1 -- 172.21.15.53:0/1204775050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8880d28a0 msgr2=0x7fd8880cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.781+0000 7fd88cd9a700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8880d28a0 0x7fd8880cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.781+0000 7fd88cd9a700 1 -- 172.21.15.53:0/1204775050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd880009a70 con 0x7fd8880d0a30 2023-07-09T21:53:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.781+0000 7fd88cd9a700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8880d0a30 0x7fd8880b67f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c700 tx=0x7fd87800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.781+0000 7fd87dffb700 1 -- 172.21.15.53:0/1204775050 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878005d70 con 0x7fd8880d0a30 2023-07-09T21:53:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.781+0000 7fd87dffb700 1 -- 172.21.15.53:0/1204775050 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8780070d0 con 0x7fd8880d0a30 2023-07-09T21:53:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.781+0000 7fd88f7ff700 1 -- 172.21.15.53:0/1204775050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8880ca0d0 con 0x7fd8880d0a30 2023-07-09T21:53:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.781+0000 7fd87dffb700 1 -- 172.21.15.53:0/1204775050 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878007460 con 0x7fd8880d0a30 2023-07-09T21:53:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.781+0000 7fd88f7ff700 1 -- 172.21.15.53:0/1204775050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8880ca690 con 0x7fd8880d0a30 2023-07-09T21:53:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.782+0000 7fd88f7ff700 1 -- 172.21.15.53:0/1204775050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd88814fc00 con 0x7fd8880d0a30 2023-07-09T21:53:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.783+0000 7fd87dffb700 1 -- 172.21.15.53:0/1204775050 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fd8780075c0 con 0x7fd8880d0a30 2023-07-09T21:53:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.784+0000 7fd87dffb700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd86c06ae00 0x7fd86c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.784+0000 7fd87dffb700 1 -- 172.21.15.53:0/1204775050 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7fd8780889d0 con 0x7fd8880d0a30 2023-07-09T21:53:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.785+0000 7fd87dffb700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] conn(0x7fd86c071270 0x7fd86c0736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.785+0000 7fd87dffb700 1 -- 172.21.15.53:0/1204775050 --> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd86c073d70 con 0x7fd86c071270 2023-07-09T21:53:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.785+0000 7fd87dffb700 1 -- 172.21.15.53:0/1204775050 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd87808d2a0 con 0x7fd8880d0a30 2023-07-09T21:53:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.785+0000 7fd88d59b700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd86c06ae00 0x7fd86c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.785+0000 7fd88dd9c700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] conn(0x7fd86c071270 0x7fd86c0736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:00.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.786+0000 7fd88dd9c700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] conn(0x7fd86c071270 0x7fd86c0736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:00.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.786+0000 7fd88d59b700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd86c06ae00 0x7fd86c06d2b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd884009930 tx=0x7fd884008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:00.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.786+0000 7fd87dffb700 1 -- 172.21.15.53:0/1204775050 <== osd.1 v2:172.21.15.53:6816/801424543 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd86c073d70 con 0x7fd86c071270 2023-07-09T21:53:00.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.801+0000 7fd88f7ff700 1 -- 172.21.15.53:0/1204775050 --> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd8880d0750 con 0x7fd86c071270 2023-07-09T21:53:00.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.802+0000 7fd87dffb700 1 -- 172.21.15.53:0/1204775050 <== osd.1 v2:172.21.15.53:6816/801424543 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd880003b80 con 0x7fd86c071270 2023-07-09T21:53:00.804 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-07-09T21:53:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T21:53:00.805 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-07-09T21:53:00.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.802+0000 7fd88f7ff700 1 -- 172.21.15.53:0/1204775050 >> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] conn(0x7fd86c071270 msgr2=0x7fd86c0736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.802+0000 7fd88f7ff700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.53:6816/801424543,v1:172.21.15.53:6817/801424543] conn(0x7fd86c071270 0x7fd86c0736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.802+0000 7fd88f7ff700 1 -- 172.21.15.53:0/1204775050 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd86c06ae00 msgr2=0x7fd86c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.802+0000 7fd88f7ff700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fd86c06ae00 0x7fd86c06d2b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd884009930 tx=0x7fd884008040 comp rx=0 tx=0).stop 2023-07-09T21:53:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.802+0000 7fd88f7ff700 1 -- 172.21.15.53:0/1204775050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8880d0a30 msgr2=0x7fd8880b67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.802+0000 7fd88f7ff700 1 --2- 172.21.15.53:0/1204775050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8880d0a30 0x7fd8880b67f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c700 tx=0x7fd87800cac0 comp rx=0 tx=0).stop 2023-07-09T21:53:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.802+0000 7fd88dd9c700 1 -- 172.21.15.53:0/1204775050 reap_dead start 2023-07-09T21:53:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.802+0000 7fd88f7ff700 1 -- 172.21.15.53:0/1204775050 shutdown_connections 2023-07-09T21:53:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.802+0000 7fd88f7ff700 1 -- 172.21.15.53:0/1204775050 >> 172.21.15.53:0/1204775050 conn(0x7fd88809c1b0 msgr2=0x7fd8880b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.802+0000 7fd88f7ff700 1 -- 172.21.15.53:0/1204775050 shutdown_connections 2023-07-09T21:53:00.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:00.802+0000 7fd88f7ff700 1 -- 172.21.15.53:0/1204775050 wait complete. 2023-07-09T21:53:00.821 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-09T21:53:01.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.020+0000 7fcdb49ff700 1 Processor -- start 2023-07-09T21:53:01.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.020+0000 7fcdb49ff700 1 -- start start 2023-07-09T21:53:01.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.021+0000 7fcdb49ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcdb00b4600 0x7fcdb00cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.021+0000 7fcdb49ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb00b6f00 0x7fcdb00cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.021+0000 7fcdb49ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb015cd60 con 0x7fcdb00d0260 2023-07-09T21:53:01.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.021+0000 7fcdb49ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb00d1550 con 0x7fcdb00b4600 2023-07-09T21:53:01.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.021+0000 7fcdb49ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00d2d90 con 0x7fcdb00b6f00 2023-07-09T21:53:01.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.022+0000 7fcdae59c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcdb00b4600 0x7fcdb00cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.022+0000 7fcdae59c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcdb00b4600 0x7fcdb00cfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54864/0 (socket says 172.21.15.53:54864) 2023-07-09T21:53:01.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.022+0000 7fcdae59c700 1 -- 172.21.15.53:0/1497492273 learned_addr learned my addr 172.21.15.53:0/1497492273 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:01.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.022+0000 7fcdaed9d700 1 --2- 172.21.15.53:0/1497492273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb00b6f00 0x7fcdb00cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.022+0000 7fcdae59c700 1 -- 172.21.15.53:0/1497492273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb00b6f00 msgr2=0x7fcdb00cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:01.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.022+0000 7fcdae59c700 1 --2- 172.21.15.53:0/1497492273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb00b6f00 0x7fcdb00cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.022+0000 7fcdae59c700 1 -- 172.21.15.53:0/1497492273 >> v1:172.21.15.184:6789/0 conn(0x7fcdb00d0260 legacy=0x7fcdb00cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.022+0000 7fcdae59c700 1 -- 172.21.15.53:0/1497492273 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb00cf340 con 0x7fcdb00b4600 2023-07-09T21:53:01.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.022+0000 7fcdae59c700 1 --2- 172.21.15.53:0/1497492273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdb00b4600 0x7fcdb00cfd20 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcda00098f0 tx=0x7fcda0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd15ce7f90fca445 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:01.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.023+0000 7fcdad59a700 1 -- 172.21.15.53:0/1497492273 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda000b8a0 con 0x7fcdb00b4600 2023-07-09T21:53:01.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.023+0000 7fcdad59a700 1 -- 172.21.15.53:0/1497492273 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda000ba00 con 0x7fcdb00b4600 2023-07-09T21:53:01.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.023+0000 7fcdad59a700 1 -- 172.21.15.53:0/1497492273 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda000bd90 con 0x7fcdb00b4600 2023-07-09T21:53:01.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.023+0000 7fcdb49ff700 1 -- 172.21.15.53:0/1497492273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdb00b4600 msgr2=0x7fcdb00cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.023+0000 7fcdb49ff700 1 --2- 172.21.15.53:0/1497492273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdb00b4600 0x7fcdb00cfd20 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcda00098f0 tx=0x7fcda0009c00 comp rx=0 tx=0).stop 2023-07-09T21:53:01.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.023+0000 7fcdb49ff700 1 -- 172.21.15.53:0/1497492273 shutdown_connections 2023-07-09T21:53:01.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.023+0000 7fcdb49ff700 1 --2- 172.21.15.53:0/1497492273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb00b6f00 0x7fcdb00cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.023+0000 7fcdb49ff700 1 --2- 172.21.15.53:0/1497492273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdb00b4600 0x7fcdb00cfd20 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.023+0000 7fcdb49ff700 1 -- 172.21.15.53:0/1497492273 >> 172.21.15.53:0/1497492273 conn(0x7fcdb009c200 msgr2=0x7fcdb00d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:01.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.023+0000 7fcdb49ff700 1 -- 172.21.15.53:0/1497492273 shutdown_connections 2023-07-09T21:53:01.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.023+0000 7fcdb49ff700 1 -- 172.21.15.53:0/1497492273 wait complete. 2023-07-09T21:53:01.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.025+0000 7fcdb49ff700 1 Processor -- start 2023-07-09T21:53:01.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.025+0000 7fcdb49ff700 1 -- start start 2023-07-09T21:53:01.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.026+0000 7fcdb49ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdb00b6f00 0x7fcdb0156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.026+0000 7fcdb49ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdb00d0260 0x7fcdb00c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.026+0000 7fcdb49ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb0158a40 0x7fcdb0158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.026+0000 7fcdb49ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb01f2000 con 0x7fcdb00d0260 2023-07-09T21:53:01.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.026+0000 7fcdb49ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00c9900 con 0x7fcdb00b6f00 2023-07-09T21:53:01.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.026+0000 7fcdb49ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00c7480 con 0x7fcdb0158a40 2023-07-09T21:53:01.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.026+0000 7fcdadd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdb00d0260 0x7fcdb00c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcdadd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdb00d0260 0x7fcdb00c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54874/0 (socket says 172.21.15.53:54874) 2023-07-09T21:53:01.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcdadd9b700 1 -- 172.21.15.53:0/339134248 learned_addr learned my addr 172.21.15.53:0/339134248 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:01.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcdae59c700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdb00b6f00 0x7fcdb0156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcdaed9d700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb0158a40 0x7fcdb0158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcdadd9b700 1 -- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb0158a40 msgr2=0x7fcdb0158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcdadd9b700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb0158a40 0x7fcdb0158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcdadd9b700 1 -- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdb00b6f00 msgr2=0x7fcdb0156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcdadd9b700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdb00b6f00 0x7fcdb0156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcdadd9b700 1 -- 172.21.15.53:0/339134248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda0009550 con 0x7fcdb00d0260 2023-07-09T21:53:01.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcdadd9b700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdb00d0260 0x7fcdb00c9110 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcda400c450 tx=0x7fcda400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:01.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcd9effd700 1 -- 172.21.15.53:0/339134248 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda40052d0 con 0x7fcdb00d0260 2023-07-09T21:53:01.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcd9effd700 1 -- 172.21.15.53:0/339134248 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda4005430 con 0x7fcdb00d0260 2023-07-09T21:53:01.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcdb49ff700 1 -- 172.21.15.53:0/339134248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb0159420 con 0x7fcdb00d0260 2023-07-09T21:53:01.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.027+0000 7fcd9effd700 1 -- 172.21.15.53:0/339134248 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda40038c0 con 0x7fcdb00d0260 2023-07-09T21:53:01.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.028+0000 7fcdb49ff700 1 -- 172.21.15.53:0/339134248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb00c6b50 con 0x7fcdb00d0260 2023-07-09T21:53:01.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.029+0000 7fcdb49ff700 1 -- 172.21.15.53:0/339134248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb00c75f0 con 0x7fcdb00d0260 2023-07-09T21:53:01.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.029+0000 7fcd9effd700 1 -- 172.21.15.53:0/339134248 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fcda4003a20 con 0x7fcdb00d0260 2023-07-09T21:53:01.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.030+0000 7fcd9effd700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcd9006ae00 0x7fcd9006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.031+0000 7fcd9effd700 1 -- 172.21.15.53:0/339134248 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7fcda4088710 con 0x7fcdb00d0260 2023-07-09T21:53:01.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.031+0000 7fcdae59c700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcd9006ae00 0x7fcd9006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.031+0000 7fcdae59c700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcd9006ae00 0x7fcd9006d2b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009c40 tx=0x7fcda0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:01.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.035+0000 7fcd9effd700 1 -- 172.21.15.53:0/339134248 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcda4053980 con 0x7fcdb00d0260 2023-07-09T21:53:01.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.245+0000 7fcdb49ff700 1 -- 172.21.15.53:0/339134248 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdb00d1170 con 0x7fcd9006ae00 2023-07-09T21:53:01.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.246+0000 7fcd9effd700 1 -- 172.21.15.53:0/339134248 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcda000bb70 con 0x7fcd9006ae00 2023-07-09T21:53:01.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.248+0000 7fcdb49ff700 1 -- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcd9006ae00 msgr2=0x7fcd9006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.248+0000 7fcdb49ff700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcd9006ae00 0x7fcd9006d2b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009c40 tx=0x7fcda0008030 comp rx=0 tx=0).stop 2023-07-09T21:53:01.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.248+0000 7fcdb49ff700 1 -- 172.21.15.53:0/339134248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdb00d0260 msgr2=0x7fcdb00c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.248+0000 7fcdb49ff700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdb00d0260 0x7fcdb00c9110 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcda400c450 tx=0x7fcda400c760 comp rx=0 tx=0).stop 2023-07-09T21:53:01.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.248+0000 7fcdb49ff700 1 -- 172.21.15.53:0/339134248 shutdown_connections 2023-07-09T21:53:01.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.248+0000 7fcdb49ff700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fcd9006ae00 0x7fcd9006d2b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.248+0000 7fcdb49ff700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb0158a40 0x7fcdb0158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.248+0000 7fcdb49ff700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdb00b6f00 0x7fcdb0156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.248+0000 7fcdb49ff700 1 --2- 172.21.15.53:0/339134248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdb00d0260 0x7fcdb00c9110 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.248+0000 7fcdb49ff700 1 -- 172.21.15.53:0/339134248 >> 172.21.15.53:0/339134248 conn(0x7fcdb009c200 msgr2=0x7fcdb00b73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:01.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.248+0000 7fcdb49ff700 1 -- 172.21.15.53:0/339134248 shutdown_connections 2023-07-09T21:53:01.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.248+0000 7fcdb49ff700 1 -- 172.21.15.53:0/339134248 wait complete. 2023-07-09T21:53:01.254 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 1 to deep-scrub 2023-07-09T21:53:01.268 INFO:tasks.ceph:Scrubbing osd.2 2023-07-09T21:53:01.269 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-09T21:53:01.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.470+0000 7f34199ff700 1 Processor -- start 2023-07-09T21:53:01.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.470+0000 7f34199ff700 1 -- start start 2023-07-09T21:53:01.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.472+0000 7f34199ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34140c9860 0x7f34140cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.472+0000 7f34199ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3414071250 0x7f341406c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.472+0000 7f34199ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341406fdb0 con 0x7f341406c2c0 2023-07-09T21:53:01.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.472+0000 7f34199ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341406cca0 con 0x7f34140c9860 2023-07-09T21:53:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.472+0000 7f34199ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3414159880 con 0x7f3414071250 2023-07-09T21:53:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.472+0000 7f3412ffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34140c9860 0x7f34140cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.472+0000 7f3412ffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34140c9860 0x7f34140cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54886/0 (socket says 172.21.15.53:54886) 2023-07-09T21:53:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.472+0000 7f3412ffd700 1 -- 172.21.15.53:0/2451307668 learned_addr learned my addr 172.21.15.53:0/2451307668 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.472+0000 7f34137fe700 1 --2- 172.21.15.53:0/2451307668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3414071250 0x7f341406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.472+0000 7f3412ffd700 1 -- 172.21.15.53:0/2451307668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3414071250 msgr2=0x7f341406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.472+0000 7f3412ffd700 1 --2- 172.21.15.53:0/2451307668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3414071250 0x7f341406c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.472+0000 7f3412ffd700 1 -- 172.21.15.53:0/2451307668 >> v1:172.21.15.184:6789/0 conn(0x7f341406c2c0 legacy=0x7f34140b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.472+0000 7f3412ffd700 1 -- 172.21.15.53:0/2451307668 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34140ae120 con 0x7f34140c9860 2023-07-09T21:53:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.473+0000 7f3412ffd700 1 --2- 172.21.15.53:0/2451307668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34140c9860 0x7f34140cd1c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3404009920 tx=0x7f3404009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f35c80acaea3851 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.473+0000 7f34127fc700 1 -- 172.21.15.53:0/2451307668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340400ba20 con 0x7f34140c9860 2023-07-09T21:53:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.473+0000 7f34127fc700 1 -- 172.21.15.53:0/2451307668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340400bb80 con 0x7f34140c9860 2023-07-09T21:53:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.473+0000 7f34127fc700 1 -- 172.21.15.53:0/2451307668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404009e70 con 0x7f34140c9860 2023-07-09T21:53:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.473+0000 7f34199ff700 1 -- 172.21.15.53:0/2451307668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34140c9860 msgr2=0x7f34140cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.473+0000 7f34199ff700 1 --2- 172.21.15.53:0/2451307668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34140c9860 0x7f34140cd1c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3404009920 tx=0x7f3404009c30 comp rx=0 tx=0).stop 2023-07-09T21:53:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.474+0000 7f34199ff700 1 -- 172.21.15.53:0/2451307668 shutdown_connections 2023-07-09T21:53:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.474+0000 7f34199ff700 1 --2- 172.21.15.53:0/2451307668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3414071250 0x7f341406c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.474+0000 7f34199ff700 1 --2- 172.21.15.53:0/2451307668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34140c9860 0x7f34140cd1c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.474+0000 7f34199ff700 1 -- 172.21.15.53:0/2451307668 >> 172.21.15.53:0/2451307668 conn(0x7f34140cea00 msgr2=0x7f34140cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.474+0000 7f34199ff700 1 -- 172.21.15.53:0/2451307668 shutdown_connections 2023-07-09T21:53:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.474+0000 7f34199ff700 1 -- 172.21.15.53:0/2451307668 wait complete. 2023-07-09T21:53:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.475+0000 7f34199ff700 1 Processor -- start 2023-07-09T21:53:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.476+0000 7f34199ff700 1 -- start start 2023-07-09T21:53:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.476+0000 7f34199ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f341406c2c0 0x7f34140b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.476+0000 7f34199ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3414071250 0x7f34140b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.476+0000 7f34199ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34140c9860 0x7f34140b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.476+0000 7f34199ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34140b1360 con 0x7f34140c9860 2023-07-09T21:53:01.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.476+0000 7f34199ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34140b2ae0 con 0x7f3414071250 2023-07-09T21:53:01.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.476+0000 7f34199ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34140b1ed0 con 0x7f341406c2c0 2023-07-09T21:53:01.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.477+0000 7f34137fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34140c9860 0x7f34140b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.477+0000 7f34137fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34140c9860 0x7f34140b0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54896/0 (socket says 172.21.15.53:54896) 2023-07-09T21:53:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.477+0000 7f34137fe700 1 -- 172.21.15.53:0/2123986506 learned_addr learned my addr 172.21.15.53:0/2123986506 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.477+0000 7f340bfff700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3414071250 0x7f34140b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.477+0000 7f3412ffd700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f341406c2c0 0x7f34140b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.477+0000 7f34137fe700 1 -- 172.21.15.53:0/2123986506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f341406c2c0 msgr2=0x7f34140b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.477+0000 7f34137fe700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f341406c2c0 0x7f34140b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.477+0000 7f34137fe700 1 -- 172.21.15.53:0/2123986506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3414071250 msgr2=0x7f34140b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.477+0000 7f34137fe700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3414071250 0x7f34140b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.477+0000 7f34137fe700 1 -- 172.21.15.53:0/2123986506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3404009550 con 0x7f34140c9860 2023-07-09T21:53:01.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.477+0000 7f34137fe700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34140c9860 0x7f34140b0e20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f340c007e40 tx=0x7f340c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:01.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.478+0000 7f3410ff9700 1 -- 172.21.15.53:0/2123986506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00ed30 con 0x7f34140c9860 2023-07-09T21:53:01.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.478+0000 7f3410ff9700 1 -- 172.21.15.53:0/2123986506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340c014420 con 0x7f34140c9860 2023-07-09T21:53:01.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.478+0000 7f34199ff700 1 -- 172.21.15.53:0/2123986506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34140b21b0 con 0x7f34140c9860 2023-07-09T21:53:01.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.478+0000 7f3410ff9700 1 -- 172.21.15.53:0/2123986506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c0147d0 con 0x7f34140c9860 2023-07-09T21:53:01.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.478+0000 7f34199ff700 1 -- 172.21.15.53:0/2123986506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34140b2770 con 0x7f34140c9860 2023-07-09T21:53:01.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.479+0000 7f34199ff700 1 -- 172.21.15.53:0/2123986506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f34140cd9a0 con 0x7f34140c9860 2023-07-09T21:53:01.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.480+0000 7f3410ff9700 1 -- 172.21.15.53:0/2123986506 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f340c014930 con 0x7f34140c9860 2023-07-09T21:53:01.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.481+0000 7f3410ff9700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f33f406ae00 0x7f33f406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.481+0000 7f3410ff9700 1 -- 172.21.15.53:0/2123986506 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f340c089a80 con 0x7f34140c9860 2023-07-09T21:53:01.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.481+0000 7f3410ff9700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] conn(0x7f33f4071270 0x7f33f40736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.481+0000 7f3410ff9700 1 -- 172.21.15.53:0/2123986506 --> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33f4073d70 con 0x7f33f4071270 2023-07-09T21:53:01.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.481+0000 7f3410ff9700 1 -- 172.21.15.53:0/2123986506 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f340c08e2a0 con 0x7f34140c9860 2023-07-09T21:53:01.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.481+0000 7f3412ffd700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f33f406ae00 0x7f33f406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.482+0000 7f340bfff700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] conn(0x7f33f4071270 0x7f33f40736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.482+0000 7f340bfff700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] conn(0x7f33f4071270 0x7f33f40736a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:01.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.482+0000 7f3412ffd700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f33f406ae00 0x7f33f406d2b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3404000c00 tx=0x7f3404008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:01.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.483+0000 7f3410ff9700 1 -- 172.21.15.53:0/2123986506 <== osd.2 v2:172.21.15.53:6800/2275952419 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f33f4073d70 con 0x7f33f4071270 2023-07-09T21:53:01.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.498+0000 7f34199ff700 1 -- 172.21.15.53:0/2123986506 --> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f34140cd700 con 0x7f33f4071270 2023-07-09T21:53:01.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.498+0000 7f3410ff9700 1 -- 172.21.15.53:0/2123986506 <== osd.2 v2:172.21.15.53:6800/2275952419 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f33fc001560 con 0x7f33f4071270 2023-07-09T21:53:01.501 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-07-09T21:53:01.501 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T21:53:01.501 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-07-09T21:53:01.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.498+0000 7f34199ff700 1 -- 172.21.15.53:0/2123986506 >> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] conn(0x7f33f4071270 msgr2=0x7f33f40736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.498+0000 7f34199ff700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.53:6800/2275952419,v1:172.21.15.53:6801/2275952419] conn(0x7f33f4071270 0x7f33f40736a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.499+0000 7f34199ff700 1 -- 172.21.15.53:0/2123986506 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f33f406ae00 msgr2=0x7f33f406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.499+0000 7f34199ff700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f33f406ae00 0x7f33f406d2b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3404000c00 tx=0x7f3404008030 comp rx=0 tx=0).stop 2023-07-09T21:53:01.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.499+0000 7f34199ff700 1 -- 172.21.15.53:0/2123986506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34140c9860 msgr2=0x7f34140b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.499+0000 7f34199ff700 1 --2- 172.21.15.53:0/2123986506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34140c9860 0x7f34140b0e20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f340c007e40 tx=0x7f340c00e3c0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.499+0000 7f34137fe700 1 -- 172.21.15.53:0/2123986506 reap_dead start 2023-07-09T21:53:01.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.499+0000 7f34199ff700 1 -- 172.21.15.53:0/2123986506 shutdown_connections 2023-07-09T21:53:01.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.499+0000 7f34199ff700 1 -- 172.21.15.53:0/2123986506 >> 172.21.15.53:0/2123986506 conn(0x7f34140cea00 msgr2=0x7f34141599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:01.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.499+0000 7f34199ff700 1 -- 172.21.15.53:0/2123986506 shutdown_connections 2023-07-09T21:53:01.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.499+0000 7f34199ff700 1 -- 172.21.15.53:0/2123986506 wait complete. 2023-07-09T21:53:01.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-09T21:53:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.718+0000 7f2a3dfff700 1 Processor -- start 2023-07-09T21:53:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.718+0000 7f2a3dfff700 1 -- start start 2023-07-09T21:53:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.719+0000 7f2a3dfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a380b3ff0 0x7f2a380b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.719+0000 7f2a3dfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2a380d0f90 0x7f2a380b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.719+0000 7f2a3dfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a380b8e80 con 0x7f2a380d0b10 2023-07-09T21:53:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.719+0000 7f2a3dfff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a380b1e30 con 0x7f2a380b3ff0 2023-07-09T21:53:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.719+0000 7f2a3dfff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a380afaa0 con 0x7f2a380d0f90 2023-07-09T21:53:01.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.719+0000 7f2a377fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a380b3ff0 0x7f2a380b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.720+0000 7f2a377fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a380b3ff0 0x7f2a380b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54900/0 (socket says 172.21.15.53:54900) 2023-07-09T21:53:01.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.720+0000 7f2a377fe700 1 -- 172.21.15.53:0/2942046155 learned_addr learned my addr 172.21.15.53:0/2942046155 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:01.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.720+0000 7f2a37fff700 1 --2- 172.21.15.53:0/2942046155 >> v2:172.21.15.184:3300/0 conn(0x7f2a380d0f90 0x7f2a380b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.720+0000 7f2a377fe700 1 -- 172.21.15.53:0/2942046155 >> v2:172.21.15.184:3300/0 conn(0x7f2a380d0f90 msgr2=0x7f2a380b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:01.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.720+0000 7f2a377fe700 1 --2- 172.21.15.53:0/2942046155 >> v2:172.21.15.184:3300/0 conn(0x7f2a380d0f90 0x7f2a380b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.720+0000 7f2a377fe700 1 -- 172.21.15.53:0/2942046155 >> v1:172.21.15.184:6789/0 conn(0x7f2a380d0b10 legacy=0x7f2a380b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.720+0000 7f2a377fe700 1 -- 172.21.15.53:0/2942046155 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a380afd80 con 0x7f2a380b3ff0 2023-07-09T21:53:01.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.720+0000 7f2a377fe700 1 --2- 172.21.15.53:0/2942046155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a380b3ff0 0x7f2a380b43c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2a380674e0 tx=0x7f2a28009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d8c338f292460 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.720+0000 7f2a367fc700 1 -- 172.21.15.53:0/2942046155 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2800b870 con 0x7f2a380b3ff0 2023-07-09T21:53:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.721+0000 7f2a367fc700 1 -- 172.21.15.53:0/2942046155 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2800b9d0 con 0x7f2a380b3ff0 2023-07-09T21:53:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.721+0000 7f2a367fc700 1 -- 172.21.15.53:0/2942046155 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2800bd60 con 0x7f2a380b3ff0 2023-07-09T21:53:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.721+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2942046155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a380b3ff0 msgr2=0x7f2a380b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.721+0000 7f2a3dfff700 1 --2- 172.21.15.53:0/2942046155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a380b3ff0 0x7f2a380b43c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2a380674e0 tx=0x7f2a28009bd0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.721+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2942046155 shutdown_connections 2023-07-09T21:53:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.721+0000 7f2a3dfff700 1 --2- 172.21.15.53:0/2942046155 >> v2:172.21.15.184:3300/0 conn(0x7f2a380d0f90 0x7f2a380b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.721+0000 7f2a3dfff700 1 --2- 172.21.15.53:0/2942046155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a380b3ff0 0x7f2a380b43c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.721+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2942046155 >> 172.21.15.53:0/2942046155 conn(0x7f2a3809c1b0 msgr2=0x7f2a380d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.721+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2942046155 shutdown_connections 2023-07-09T21:53:01.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.721+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2942046155 wait complete. 2023-07-09T21:53:01.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.723+0000 7f2a3dfff700 1 Processor -- start 2023-07-09T21:53:01.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.723+0000 7f2a3dfff700 1 -- start start 2023-07-09T21:53:01.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.724+0000 7f2a3dfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a380b3ff0 0x7f2a3815bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.724+0000 7f2a3dfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a380d0b10 0x7f2a380a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.724+0000 7f2a3dfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a380d0f90 0x7f2a380cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.724+0000 7f2a3dfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380caeb0 con 0x7f2a380b3ff0 2023-07-09T21:53:01.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.724+0000 7f2a3dfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380cba30 con 0x7f2a380d0f90 2023-07-09T21:53:01.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.724+0000 7f2a3dfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380cb100 con 0x7f2a380d0b10 2023-07-09T21:53:01.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.724+0000 7f2a377fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a380b3ff0 0x7f2a3815bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.724+0000 7f2a377fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a380b3ff0 0x7f2a3815bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54902/0 (socket says 172.21.15.53:54902) 2023-07-09T21:53:01.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.724+0000 7f2a377fe700 1 -- 172.21.15.53:0/2803283160 learned_addr learned my addr 172.21.15.53:0/2803283160 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:01.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.724+0000 7f2a37fff700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a380d0f90 0x7f2a380cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.724+0000 7f2a36ffd700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a380d0b10 0x7f2a380a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.725+0000 7f2a377fe700 1 -- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a380d0b10 msgr2=0x7f2a380a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.725+0000 7f2a377fe700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a380d0b10 0x7f2a380a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.725+0000 7f2a377fe700 1 -- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a380d0f90 msgr2=0x7f2a380cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.725+0000 7f2a377fe700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a380d0f90 0x7f2a380cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.725+0000 7f2a377fe700 1 -- 172.21.15.53:0/2803283160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a28009550 con 0x7f2a380b3ff0 2023-07-09T21:53:01.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.725+0000 7f2a377fe700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a380b3ff0 0x7f2a3815bf00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2a28000c00 tx=0x7f2a28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:01.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.725+0000 7f2a1ffff700 1 -- 172.21.15.53:0/2803283160 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a28004480 con 0x7f2a380b3ff0 2023-07-09T21:53:01.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.725+0000 7f2a1ffff700 1 -- 172.21.15.53:0/2803283160 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a280045e0 con 0x7f2a380b3ff0 2023-07-09T21:53:01.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.725+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2803283160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a380cb3e0 con 0x7f2a380b3ff0 2023-07-09T21:53:01.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.725+0000 7f2a1ffff700 1 -- 172.21.15.53:0/2803283160 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280038e0 con 0x7f2a380b3ff0 2023-07-09T21:53:01.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.726+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2803283160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a380a0a40 con 0x7f2a380b3ff0 2023-07-09T21:53:01.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.727+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2803283160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a38074350 con 0x7f2a380b3ff0 2023-07-09T21:53:01.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.728+0000 7f2a1ffff700 1 -- 172.21.15.53:0/2803283160 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f2a28021070 con 0x7f2a380b3ff0 2023-07-09T21:53:01.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.728+0000 7f2a1ffff700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2a2406ae00 0x7f2a2406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:01.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.729+0000 7f2a1ffff700 1 -- 172.21.15.53:0/2803283160 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f2a2808a990 con 0x7f2a380b3ff0 2023-07-09T21:53:01.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.729+0000 7f2a36ffd700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2a2406ae00 0x7f2a2406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:01.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.730+0000 7f2a36ffd700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2a2406ae00 0x7f2a2406d2b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2a3809fe00 tx=0x7f2a2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:01.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.733+0000 7f2a1ffff700 1 -- 172.21.15.53:0/2803283160 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2a28055c20 con 0x7f2a380b3ff0 2023-07-09T21:53:01.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.941+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2803283160 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a380ccd30 con 0x7f2a2406ae00 2023-07-09T21:53:01.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.942+0000 7f2a1ffff700 1 -- 172.21.15.53:0/2803283160 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2a380ccd30 con 0x7f2a2406ae00 2023-07-09T21:53:01.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.944+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2a2406ae00 msgr2=0x7f2a2406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.944+0000 7f2a3dfff700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2a2406ae00 0x7f2a2406d2b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2a3809fe00 tx=0x7f2a2c009040 comp rx=0 tx=0).stop 2023-07-09T21:53:01.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.944+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2803283160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a380b3ff0 msgr2=0x7f2a3815bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:01.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.944+0000 7f2a3dfff700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a380b3ff0 0x7f2a3815bf00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2a28000c00 tx=0x7f2a28004750 comp rx=0 tx=0).stop 2023-07-09T21:53:01.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.944+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2803283160 shutdown_connections 2023-07-09T21:53:01.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.944+0000 7f2a3dfff700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2a2406ae00 0x7f2a2406d2b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.944+0000 7f2a3dfff700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a380d0f90 0x7f2a380cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.944+0000 7f2a3dfff700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a380b3ff0 0x7f2a3815bf00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.944+0000 7f2a3dfff700 1 --2- 172.21.15.53:0/2803283160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a380d0b10 0x7f2a380a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:01.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.944+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2803283160 >> 172.21.15.53:0/2803283160 conn(0x7f2a3809c1b0 msgr2=0x7f2a3806b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:01.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.945+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2803283160 shutdown_connections 2023-07-09T21:53:01.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:01.945+0000 7f2a3dfff700 1 -- 172.21.15.53:0/2803283160 wait complete. 2023-07-09T21:53:01.949 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 2 to deep-scrub 2023-07-09T21:53:01.965 INFO:tasks.ceph:Scrubbing osd.3 2023-07-09T21:53:01.965 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-09T21:53:02.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.166+0000 7f50c13ff700 1 Processor -- start 2023-07-09T21:53:02.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.166+0000 7f50c13ff700 1 -- start start 2023-07-09T21:53:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.168+0000 7f50c13ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50bc0d1140 0x7f50bc15c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.168+0000 7f50c13ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f50bc0ce030 0x7f50bc0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.168+0000 7f50c13ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50bc0d2c70 con 0x7f50bc0d28a0 2023-07-09T21:53:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.168+0000 7f50c13ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50bc0d3de0 con 0x7f50bc0d1140 2023-07-09T21:53:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.168+0000 7f50c13ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50bc15ccf0 con 0x7f50bc0ce030 2023-07-09T21:53:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.168+0000 7f50ba7fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50bc0d1140 0x7f50bc15c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.168+0000 7f50baffd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f50bc0d28a0 0x7f50bc0d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41542/0 (socket says 172.21.15.53:41542) 2023-07-09T21:53:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.168+0000 7f50baffd700 1 -- 172.21.15.53:0/2013845919 learned_addr learned my addr 172.21.15.53:0/2013845919 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:53:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.168+0000 7f50bb7fe700 1 --2- 172.21.15.53:0/2013845919 >> v2:172.21.15.184:3300/0 conn(0x7f50bc0ce030 0x7f50bc0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.169+0000 7f50ba7fc700 1 -- 172.21.15.53:0/2013845919 >> v2:172.21.15.184:3300/0 conn(0x7f50bc0ce030 msgr2=0x7f50bc0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.169+0000 7f50ba7fc700 1 --2- 172.21.15.53:0/2013845919 >> v2:172.21.15.184:3300/0 conn(0x7f50bc0ce030 0x7f50bc0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.169+0000 7f50ba7fc700 1 -- 172.21.15.53:0/2013845919 >> v1:172.21.15.53:6789/0 conn(0x7f50bc0d28a0 legacy=0x7f50bc0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.169+0000 7f50ba7fc700 1 -- 172.21.15.53:0/2013845919 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc0d0190 con 0x7f50bc0d1140 2023-07-09T21:53:02.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.169+0000 7f50b9ffb700 1 -- 172.21.15.53:0/2013845919 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933297883 0 0) 0x7f50bc0d2c70 con 0x7f50bc0d28a0 2023-07-09T21:53:02.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.169+0000 7f50ba7fc700 1 --2- 172.21.15.53:0/2013845919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc0d1140 0x7f50bc15c7b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f50bc08d670 tx=0x7f50b0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d19909a5e65fd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:02.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.169+0000 7f50b9ffb700 1 -- 172.21.15.53:0/2013845919 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0011830 con 0x7f50bc0d1140 2023-07-09T21:53:02.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.169+0000 7f50b9ffb700 1 -- 172.21.15.53:0/2013845919 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b0011990 con 0x7f50bc0d1140 2023-07-09T21:53:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.169+0000 7f50b9ffb700 1 -- 172.21.15.53:0/2013845919 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0011d20 con 0x7f50bc0d1140 2023-07-09T21:53:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.169+0000 7f50c13ff700 1 -- 172.21.15.53:0/2013845919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc0d1140 msgr2=0x7f50bc15c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.169+0000 7f50c13ff700 1 --2- 172.21.15.53:0/2013845919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc0d1140 0x7f50bc15c7b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f50bc08d670 tx=0x7f50b0009b20 comp rx=0 tx=0).stop 2023-07-09T21:53:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.170+0000 7f50c13ff700 1 -- 172.21.15.53:0/2013845919 shutdown_connections 2023-07-09T21:53:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.170+0000 7f50c13ff700 1 --2- 172.21.15.53:0/2013845919 >> v2:172.21.15.184:3300/0 conn(0x7f50bc0ce030 0x7f50bc0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.170+0000 7f50c13ff700 1 --2- 172.21.15.53:0/2013845919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc0d1140 0x7f50bc15c7b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.170+0000 7f50c13ff700 1 -- 172.21.15.53:0/2013845919 >> 172.21.15.53:0/2013845919 conn(0x7f50bc09c1b0 msgr2=0x7f50bc0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:02.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.170+0000 7f50c13ff700 1 -- 172.21.15.53:0/2013845919 shutdown_connections 2023-07-09T21:53:02.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.170+0000 7f50c13ff700 1 -- 172.21.15.53:0/2013845919 wait complete. 2023-07-09T21:53:02.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.172+0000 7f50c13ff700 1 Processor -- start 2023-07-09T21:53:02.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.172+0000 7f50c13ff700 1 -- start start 2023-07-09T21:53:02.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50c13ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc0ce030 0x7f50bc15b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50c13ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50bc0d1140 0x7f50bc15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50c13ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50bc0d28a0 0x7f50bc15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50c13ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0cade0 con 0x7f50bc0ce030 2023-07-09T21:53:02.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50c13ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0ca760 con 0x7f50bc0d28a0 2023-07-09T21:53:02.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50c13ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc15fa00 con 0x7f50bc0d1140 2023-07-09T21:53:02.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50baffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc0ce030 0x7f50bc15b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50baffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc0ce030 0x7f50bc15b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54926/0 (socket says 172.21.15.53:54926) 2023-07-09T21:53:02.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50baffd700 1 -- 172.21.15.53:0/4173668521 learned_addr learned my addr 172.21.15.53:0/4173668521 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:02.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50bb7fe700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50bc0d28a0 0x7f50bc15cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50ba7fc700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50bc0d1140 0x7f50bc15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50baffd700 1 -- 172.21.15.53:0/4173668521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50bc0d1140 msgr2=0x7f50bc15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50baffd700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50bc0d1140 0x7f50bc15efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50baffd700 1 -- 172.21.15.53:0/4173668521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50bc0d28a0 msgr2=0x7f50bc15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50baffd700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50bc0d28a0 0x7f50bc15cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50baffd700 1 -- 172.21.15.53:0/4173668521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b00094a0 con 0x7f50bc0ce030 2023-07-09T21:53:02.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.173+0000 7f50ba7fc700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50bc0d1140 0x7f50bc15efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:53:02.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.174+0000 7f50baffd700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc0ce030 0x7f50bc15b350 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00c550 tx=0x7f50ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:02.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.174+0000 7f50a37fe700 1 -- 172.21.15.53:0/4173668521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac004c80 con 0x7f50bc0ce030 2023-07-09T21:53:02.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.174+0000 7f50a37fe700 1 -- 172.21.15.53:0/4173668521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac004e00 con 0x7f50bc0ce030 2023-07-09T21:53:02.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.174+0000 7f50a37fe700 1 -- 172.21.15.53:0/4173668521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac007310 con 0x7f50bc0ce030 2023-07-09T21:53:02.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.174+0000 7f50c13ff700 1 -- 172.21.15.53:0/4173668521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50bc0caa00 con 0x7f50bc0ce030 2023-07-09T21:53:02.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.174+0000 7f50c13ff700 1 -- 172.21.15.53:0/4173668521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50bc153300 con 0x7f50bc0ce030 2023-07-09T21:53:02.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.175+0000 7f50c13ff700 1 -- 172.21.15.53:0/4173668521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50bc0d0750 con 0x7f50bc0ce030 2023-07-09T21:53:02.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.176+0000 7f50a37fe700 1 -- 172.21.15.53:0/4173668521 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f50ac007470 con 0x7f50bc0ce030 2023-07-09T21:53:02.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.177+0000 7f50a37fe700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f50a806ae00 0x7f50a806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.177+0000 7f50a37fe700 1 -- 172.21.15.53:0/4173668521 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f50ac089130 con 0x7f50bc0ce030 2023-07-09T21:53:02.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.177+0000 7f50a37fe700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] conn(0x7f50a8071270 0x7f50a80736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.177+0000 7f50a37fe700 1 -- 172.21.15.53:0/4173668521 --> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50a8073d70 con 0x7f50a8071270 2023-07-09T21:53:02.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.177+0000 7f50a37fe700 1 -- 172.21.15.53:0/4173668521 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50ac08b6b0 con 0x7f50bc0ce030 2023-07-09T21:53:02.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.177+0000 7f50ba7fc700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f50a806ae00 0x7f50a806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.177+0000 7f50bb7fe700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] conn(0x7f50a8071270 0x7f50a80736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.178+0000 7f50bb7fe700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] conn(0x7f50a8071270 0x7f50a80736a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:02.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.178+0000 7f50ba7fc700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f50a806ae00 0x7f50a806d2b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f50bc15bb30 tx=0x7f50b0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:02.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.179+0000 7f50a37fe700 1 -- 172.21.15.53:0/4173668521 <== osd.3 v2:172.21.15.53:6824/743855822 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f50a8073d70 con 0x7f50a8071270 2023-07-09T21:53:02.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.194+0000 7f50c13ff700 1 -- 172.21.15.53:0/4173668521 --> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f50bc0d0470 con 0x7f50a8071270 2023-07-09T21:53:02.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.194+0000 7f50a37fe700 1 -- 172.21.15.53:0/4173668521 <== osd.3 v2:172.21.15.53:6824/743855822 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f50b400f040 con 0x7f50a8071270 2023-07-09T21:53:02.197 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-07-09T21:53:02.197 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T21:53:02.197 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-07-09T21:53:02.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.194+0000 7f50c13ff700 1 -- 172.21.15.53:0/4173668521 >> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] conn(0x7f50a8071270 msgr2=0x7f50a80736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.194+0000 7f50c13ff700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.53:6824/743855822,v1:172.21.15.53:6825/743855822] conn(0x7f50a8071270 0x7f50a80736a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.194+0000 7f50c13ff700 1 -- 172.21.15.53:0/4173668521 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f50a806ae00 msgr2=0x7f50a806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.194+0000 7f50c13ff700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f50a806ae00 0x7f50a806d2b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f50bc15bb30 tx=0x7f50b0008030 comp rx=0 tx=0).stop 2023-07-09T21:53:02.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.194+0000 7f50c13ff700 1 -- 172.21.15.53:0/4173668521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc0ce030 msgr2=0x7f50bc15b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.194+0000 7f50c13ff700 1 --2- 172.21.15.53:0/4173668521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc0ce030 0x7f50bc15b350 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00c550 tx=0x7f50ac00c910 comp rx=0 tx=0).stop 2023-07-09T21:53:02.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.194+0000 7f50bb7fe700 1 -- 172.21.15.53:0/4173668521 reap_dead start 2023-07-09T21:53:02.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.194+0000 7f50c13ff700 1 -- 172.21.15.53:0/4173668521 shutdown_connections 2023-07-09T21:53:02.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.194+0000 7f50c13ff700 1 -- 172.21.15.53:0/4173668521 >> 172.21.15.53:0/4173668521 conn(0x7f50bc09c1b0 msgr2=0x7f50bc0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:02.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.195+0000 7f50c13ff700 1 -- 172.21.15.53:0/4173668521 shutdown_connections 2023-07-09T21:53:02.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.195+0000 7f50c13ff700 1 -- 172.21.15.53:0/4173668521 wait complete. 2023-07-09T21:53:02.213 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-09T21:53:02.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.412+0000 7f03c89ff700 1 Processor -- start 2023-07-09T21:53:02.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.412+0000 7f03c89ff700 1 -- start start 2023-07-09T21:53:02.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.413+0000 7f03c89ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c40b3ff0 0x7f03c40b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.413+0000 7f03c89ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c40b8e80 con 0x7f03c40d0b10 2023-07-09T21:53:02.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.413+0000 7f03c89ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c40b33f0 con 0x7f03c40d0f60 2023-07-09T21:53:02.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.413+0000 7f03c89ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40b1e30 con 0x7f03c40b3ff0 2023-07-09T21:53:02.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.413+0000 7f03c1d9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f03c40d0b10 0x7f03c40b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41548/0 (socket says 172.21.15.53:41548) 2023-07-09T21:53:02.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.413+0000 7f03c1d9b700 1 -- 172.21.15.53:0/3227443553 learned_addr learned my addr 172.21.15.53:0/3227443553 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:53:02.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.414+0000 7f03c259c700 1 --2- 172.21.15.53:0/3227443553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c40b3ff0 0x7f03c40b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.414+0000 7f03c159a700 1 -- 172.21.15.53:0/3227443553 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279349873 0 0) 0x7f03b8001110 con 0x7f03c40d0b10 2023-07-09T21:53:02.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.414+0000 7f03c159a700 1 -- 172.21.15.53:0/3227443553 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03ac0035b0 con 0x7f03c40d0b10 2023-07-09T21:53:02.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.414+0000 7f03c159a700 1 -- 172.21.15.53:0/3227443553 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584429693 0 0) 0x7f03c40b33f0 con 0x7f03c40d0f60 2023-07-09T21:53:02.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.414+0000 7f03c159a700 1 -- 172.21.15.53:0/3227443553 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03b8001110 con 0x7f03c40d0f60 2023-07-09T21:53:02.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.414+0000 7f03c259c700 1 -- 172.21.15.53:0/3227443553 >> v1:172.21.15.184:6789/0 conn(0x7f03c40d0f60 legacy=0x7f03c40b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.414+0000 7f03c259c700 1 -- 172.21.15.53:0/3227443553 >> v1:172.21.15.53:6789/0 conn(0x7f03c40d0b10 legacy=0x7f03c40b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.414+0000 7f03c259c700 1 -- 172.21.15.53:0/3227443553 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c40afaa0 con 0x7f03c40b3ff0 2023-07-09T21:53:02.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.415+0000 7f03c259c700 1 --2- 172.21.15.53:0/3227443553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c40b3ff0 0x7f03c40b43c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f03b4009870 tx=0x7f03b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ba416b0750b3e86 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:02.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.415+0000 7f03c159a700 1 -- 172.21.15.53:0/3227443553 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4011830 con 0x7f03c40b3ff0 2023-07-09T21:53:02.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.415+0000 7f03c159a700 1 -- 172.21.15.53:0/3227443553 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b4011990 con 0x7f03c40b3ff0 2023-07-09T21:53:02.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.415+0000 7f03c159a700 1 -- 172.21.15.53:0/3227443553 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4011d20 con 0x7f03c40b3ff0 2023-07-09T21:53:02.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.415+0000 7f03c89ff700 1 -- 172.21.15.53:0/3227443553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c40b3ff0 msgr2=0x7f03c40b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.415+0000 7f03c89ff700 1 --2- 172.21.15.53:0/3227443553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c40b3ff0 0x7f03c40b43c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f03b4009870 tx=0x7f03b4009b80 comp rx=0 tx=0).stop 2023-07-09T21:53:02.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.415+0000 7f03c89ff700 1 -- 172.21.15.53:0/3227443553 shutdown_connections 2023-07-09T21:53:02.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.415+0000 7f03c89ff700 1 --2- 172.21.15.53:0/3227443553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c40b3ff0 0x7f03c40b43c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.415+0000 7f03c89ff700 1 -- 172.21.15.53:0/3227443553 >> 172.21.15.53:0/3227443553 conn(0x7f03c409c1b0 msgr2=0x7f03c40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:02.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.416+0000 7f03c89ff700 1 -- 172.21.15.53:0/3227443553 shutdown_connections 2023-07-09T21:53:02.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.416+0000 7f03c89ff700 1 -- 172.21.15.53:0/3227443553 wait complete. 2023-07-09T21:53:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.417+0000 7f03c89ff700 1 Processor -- start 2023-07-09T21:53:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.417+0000 7f03c89ff700 1 -- start start 2023-07-09T21:53:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.418+0000 7f03c89ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c40b3ff0 0x7f03c414c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.418+0000 7f03c89ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c40d0b10 0x7f03c40b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.418+0000 7f03c89ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c40d0f60 0x7f03c40b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.418+0000 7f03c89ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c415d0b0 con 0x7f03c40b3ff0 2023-07-09T21:53:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.418+0000 7f03c89ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40b6a90 con 0x7f03c40d0b10 2023-07-09T21:53:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.418+0000 7f03c89ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40b6d70 con 0x7f03c40d0f60 2023-07-09T21:53:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.419+0000 7f03c259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c40b3ff0 0x7f03c414c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.419+0000 7f03c259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c40b3ff0 0x7f03c414c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54938/0 (socket says 172.21.15.53:54938) 2023-07-09T21:53:02.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.419+0000 7f03c259c700 1 -- 172.21.15.53:0/900202068 learned_addr learned my addr 172.21.15.53:0/900202068 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:02.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.419+0000 7f03c1d9b700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c40d0b10 0x7f03c40b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.419+0000 7f03c2d9d700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c40d0f60 0x7f03c40b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.419+0000 7f03c259c700 1 -- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c40d0f60 msgr2=0x7f03c40b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.419+0000 7f03c259c700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c40d0f60 0x7f03c40b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.419+0000 7f03c259c700 1 -- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c40d0b10 msgr2=0x7f03c40b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.419+0000 7f03c259c700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c40d0b10 0x7f03c40b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.419+0000 7f03c259c700 1 -- 172.21.15.53:0/900202068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40094a0 con 0x7f03c40b3ff0 2023-07-09T21:53:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.419+0000 7f03c259c700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c40b3ff0 0x7f03c414c930 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f03b40090b0 tx=0x7f03b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.420+0000 7f03b2ffd700 1 -- 172.21.15.53:0/900202068 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b401a6e0 con 0x7f03c40b3ff0 2023-07-09T21:53:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.420+0000 7f03b2ffd700 1 -- 172.21.15.53:0/900202068 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b401a840 con 0x7f03c40b3ff0 2023-07-09T21:53:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.420+0000 7f03b2ffd700 1 -- 172.21.15.53:0/900202068 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b401abb0 con 0x7f03c40b3ff0 2023-07-09T21:53:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.420+0000 7f03c89ff700 1 -- 172.21.15.53:0/900202068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c415d350 con 0x7f03c40b3ff0 2023-07-09T21:53:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.420+0000 7f03c89ff700 1 -- 172.21.15.53:0/900202068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c414ce70 con 0x7f03c40b3ff0 2023-07-09T21:53:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.421+0000 7f03c89ff700 1 -- 172.21.15.53:0/900202068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c414d060 con 0x7f03c40b3ff0 2023-07-09T21:53:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.422+0000 7f03b2ffd700 1 -- 172.21.15.53:0/900202068 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f03b4022070 con 0x7f03c40b3ff0 2023-07-09T21:53:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.423+0000 7f03b2ffd700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f03a406ae00 0x7f03a406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.423+0000 7f03b2ffd700 1 -- 172.21.15.53:0/900202068 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f03b4089f90 con 0x7f03c40b3ff0 2023-07-09T21:53:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.423+0000 7f03c1d9b700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f03a406ae00 0x7f03a406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.424+0000 7f03c1d9b700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f03a406ae00 0x7f03a406d2b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f03c41513b0 tx=0x7f03b8007e00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:02.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.427+0000 7f03b2ffd700 1 -- 172.21.15.53:0/900202068 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03b4055220 con 0x7f03c40b3ff0 2023-07-09T21:53:02.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.638+0000 7f03c89ff700 1 -- 172.21.15.53:0/900202068 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f03c40b0060 con 0x7f03a406ae00 2023-07-09T21:53:02.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.639+0000 7f03b2ffd700 1 -- 172.21.15.53:0/900202068 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f03b80058e0 con 0x7f03a406ae00 2023-07-09T21:53:02.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.641+0000 7f03c89ff700 1 -- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f03a406ae00 msgr2=0x7f03a406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.641+0000 7f03c89ff700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f03a406ae00 0x7f03a406d2b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f03c41513b0 tx=0x7f03b8007e00 comp rx=0 tx=0).stop 2023-07-09T21:53:02.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.641+0000 7f03c89ff700 1 -- 172.21.15.53:0/900202068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c40b3ff0 msgr2=0x7f03c414c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.641+0000 7f03c89ff700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c40b3ff0 0x7f03c414c930 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f03b40090b0 tx=0x7f03b4004750 comp rx=0 tx=0).stop 2023-07-09T21:53:02.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.641+0000 7f03c89ff700 1 -- 172.21.15.53:0/900202068 shutdown_connections 2023-07-09T21:53:02.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.641+0000 7f03c89ff700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f03a406ae00 0x7f03a406d2b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.641+0000 7f03c89ff700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c40d0f60 0x7f03c40b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.641+0000 7f03c89ff700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c40b3ff0 0x7f03c414c930 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.641+0000 7f03c89ff700 1 --2- 172.21.15.53:0/900202068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c40d0b10 0x7f03c40b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.641+0000 7f03c89ff700 1 -- 172.21.15.53:0/900202068 >> 172.21.15.53:0/900202068 conn(0x7f03c409c1b0 msgr2=0x7f03c40b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:02.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.641+0000 7f03c89ff700 1 -- 172.21.15.53:0/900202068 shutdown_connections 2023-07-09T21:53:02.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.641+0000 7f03c89ff700 1 -- 172.21.15.53:0/900202068 wait complete. 2023-07-09T21:53:02.647 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 3 to deep-scrub 2023-07-09T21:53:02.661 INFO:tasks.ceph:Scrubbing osd.4 2023-07-09T21:53:02.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-09T21:53:02.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.863+0000 7fb4953ff700 1 Processor -- start 2023-07-09T21:53:02.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.863+0000 7fb4953ff700 1 -- start start 2023-07-09T21:53:02.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.864+0000 7fb4953ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb4900d1160 0x7fb49015c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.864+0000 7fb4953ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49006a7f0 con 0x7fb49006c240 2023-07-09T21:53:02.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.864+0000 7fb4953ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49006b760 con 0x7fb4900d2990 2023-07-09T21:53:02.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.864+0000 7fb4953ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb49006ba40 con 0x7fb4900d1160 2023-07-09T21:53:02.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.865+0000 7fb48effd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb49006c240 0x7fb4900d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47530/0 (socket says 172.21.15.53:47530) 2023-07-09T21:53:02.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.865+0000 7fb48e7fc700 1 --2- 172.21.15.53:0/1176380889 >> v2:172.21.15.53:3300/0 conn(0x7fb4900d1160 0x7fb49015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.865+0000 7fb48effd700 1 -- 172.21.15.53:0/1176380889 learned_addr learned my addr 172.21.15.53:0/1176380889 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:53:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.865+0000 7fb48e7fc700 1 -- 172.21.15.53:0/1176380889 >> v1:172.21.15.184:6789/0 conn(0x7fb4900d2990 legacy=0x7fb4900cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.865+0000 7fb48e7fc700 1 -- 172.21.15.53:0/1176380889 >> v1:172.21.15.53:6789/0 conn(0x7fb49006c240 legacy=0x7fb4900d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.865+0000 7fb48e7fc700 1 -- 172.21.15.53:0/1176380889 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49006bd20 con 0x7fb4900d1160 2023-07-09T21:53:02.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.865+0000 7fb48e7fc700 1 --2- 172.21.15.53:0/1176380889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4900d1160 0x7fb49015c890 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb484009840 tx=0x7fb484009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554e5ee543383cf1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:02.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.866+0000 7fb48dffb700 1 -- 172.21.15.53:0/1176380889 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484011830 con 0x7fb4900d1160 2023-07-09T21:53:02.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.866+0000 7fb48dffb700 1 -- 172.21.15.53:0/1176380889 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb484011990 con 0x7fb4900d1160 2023-07-09T21:53:02.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.866+0000 7fb48dffb700 1 -- 172.21.15.53:0/1176380889 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484011d20 con 0x7fb4900d1160 2023-07-09T21:53:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.866+0000 7fb4953ff700 1 -- 172.21.15.53:0/1176380889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4900d1160 msgr2=0x7fb49015c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.866+0000 7fb4953ff700 1 --2- 172.21.15.53:0/1176380889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4900d1160 0x7fb49015c890 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb484009840 tx=0x7fb484009b50 comp rx=0 tx=0).stop 2023-07-09T21:53:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.866+0000 7fb4953ff700 1 -- 172.21.15.53:0/1176380889 shutdown_connections 2023-07-09T21:53:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.866+0000 7fb4953ff700 1 --2- 172.21.15.53:0/1176380889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4900d1160 0x7fb49015c890 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.866+0000 7fb4953ff700 1 -- 172.21.15.53:0/1176380889 >> 172.21.15.53:0/1176380889 conn(0x7fb49009c170 msgr2=0x7fb4900d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:02.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.866+0000 7fb4953ff700 1 -- 172.21.15.53:0/1176380889 shutdown_connections 2023-07-09T21:53:02.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.866+0000 7fb4953ff700 1 -- 172.21.15.53:0/1176380889 wait complete. 2023-07-09T21:53:02.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.868+0000 7fb4953ff700 1 Processor -- start 2023-07-09T21:53:02.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.868+0000 7fb4953ff700 1 -- start start 2023-07-09T21:53:02.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.869+0000 7fb4953ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb49006c240 0x7fb49015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.869+0000 7fb4953ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4900d1160 0x7fb49015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.869+0000 7fb4953ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4900d2990 0x7fb4900c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.869+0000 7fb4953ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4900c6990 con 0x7fb49006c240 2023-07-09T21:53:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.869+0000 7fb4953ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4900b4d30 con 0x7fb4900d2990 2023-07-09T21:53:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.869+0000 7fb4953ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4900b5010 con 0x7fb4900d1160 2023-07-09T21:53:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.869+0000 7fb48effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb49006c240 0x7fb49015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.869+0000 7fb48effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb49006c240 0x7fb49015ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42660/0 (socket says 172.21.15.53:42660) 2023-07-09T21:53:02.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.870+0000 7fb48effd700 1 -- 172.21.15.53:0/837751965 learned_addr learned my addr 172.21.15.53:0/837751965 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:02.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.870+0000 7fb48f7fe700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4900d2990 0x7fb4900c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.870+0000 7fb48e7fc700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4900d1160 0x7fb49015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.870+0000 7fb48effd700 1 -- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4900d1160 msgr2=0x7fb49015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.870+0000 7fb48effd700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4900d1160 0x7fb49015b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.870+0000 7fb48effd700 1 -- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4900d2990 msgr2=0x7fb4900c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.870+0000 7fb48effd700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4900d2990 0x7fb4900c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.870+0000 7fb48effd700 1 -- 172.21.15.53:0/837751965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4840094a0 con 0x7fb49006c240 2023-07-09T21:53:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.870+0000 7fb48effd700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb49006c240 0x7fb49015ae90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb48000c520 tx=0x7fb48000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.870+0000 7fb4777fe700 1 -- 172.21.15.53:0/837751965 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480005d70 con 0x7fb49006c240 2023-07-09T21:53:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.870+0000 7fb4777fe700 1 -- 172.21.15.53:0/837751965 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4800070d0 con 0x7fb49006c240 2023-07-09T21:53:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.870+0000 7fb4777fe700 1 -- 172.21.15.53:0/837751965 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480007440 con 0x7fb49006c240 2023-07-09T21:53:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.870+0000 7fb4953ff700 1 -- 172.21.15.53:0/837751965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4900b52f0 con 0x7fb49006c240 2023-07-09T21:53:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.871+0000 7fb4953ff700 1 -- 172.21.15.53:0/837751965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4900b4990 con 0x7fb49006c240 2023-07-09T21:53:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.872+0000 7fb4953ff700 1 -- 172.21.15.53:0/837751965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4900b4b20 con 0x7fb49006c240 2023-07-09T21:53:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.873+0000 7fb4777fe700 1 -- 172.21.15.53:0/837751965 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fb4800075a0 con 0x7fb49006c240 2023-07-09T21:53:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.873+0000 7fb4777fe700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb47c06ae00 0x7fb47c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.874+0000 7fb4777fe700 1 -- 172.21.15.53:0/837751965 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7fb480088600 con 0x7fb49006c240 2023-07-09T21:53:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.874+0000 7fb4777fe700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] conn(0x7fb47c071270 0x7fb47c0736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:02.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.874+0000 7fb4777fe700 1 -- 172.21.15.53:0/837751965 --> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb47c073d70 con 0x7fb47c071270 2023-07-09T21:53:02.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.874+0000 7fb4777fe700 1 -- 172.21.15.53:0/837751965 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb48008acc0 con 0x7fb49006c240 2023-07-09T21:53:02.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.874+0000 7fb48e7fc700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb47c06ae00 0x7fb47c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.874+0000 7fb48f7fe700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] conn(0x7fb47c071270 0x7fb47c0736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:02.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.875+0000 7fb48e7fc700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb47c06ae00 0x7fb47c06d2b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb4840090b0 tx=0x7fb484008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:02.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.875+0000 7fb48f7fe700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] conn(0x7fb47c071270 0x7fb47c0736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:02.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.876+0000 7fb4777fe700 1 -- 172.21.15.53:0/837751965 <== osd.4 v2:172.21.15.184:6800/2051967353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb47c073d70 con 0x7fb47c071270 2023-07-09T21:53:02.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.891+0000 7fb4953ff700 1 -- 172.21.15.53:0/837751965 --> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb4900b5810 con 0x7fb47c071270 2023-07-09T21:53:02.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.891+0000 7fb4777fe700 1 -- 172.21.15.53:0/837751965 <== osd.4 v2:172.21.15.184:6800/2051967353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb4900b5810 con 0x7fb47c071270 2023-07-09T21:53:02.894 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-07-09T21:53:02.894 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T21:53:02.894 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-07-09T21:53:02.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.892+0000 7fb4953ff700 1 -- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] conn(0x7fb47c071270 msgr2=0x7fb47c0736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.892+0000 7fb4953ff700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:6800/2051967353,v1:172.21.15.184:6801/2051967353] conn(0x7fb47c071270 0x7fb47c0736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:02.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.892+0000 7fb4953ff700 1 -- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb47c06ae00 msgr2=0x7fb47c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.892+0000 7fb4953ff700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fb47c06ae00 0x7fb47c06d2b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb4840090b0 tx=0x7fb484008030 comp rx=0 tx=0).stop 2023-07-09T21:53:02.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.892+0000 7fb4953ff700 1 -- 172.21.15.53:0/837751965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb49006c240 msgr2=0x7fb49015ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:02.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.892+0000 7fb4953ff700 1 --2- 172.21.15.53:0/837751965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb49006c240 0x7fb49015ae90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb48000c520 tx=0x7fb48000c830 comp rx=0 tx=0).stop 2023-07-09T21:53:02.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.892+0000 7fb48f7fe700 1 -- 172.21.15.53:0/837751965 reap_dead start 2023-07-09T21:53:02.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.892+0000 7fb4953ff700 1 -- 172.21.15.53:0/837751965 shutdown_connections 2023-07-09T21:53:02.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.892+0000 7fb4953ff700 1 -- 172.21.15.53:0/837751965 >> 172.21.15.53:0/837751965 conn(0x7fb49009c170 msgr2=0x7fb4900afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:02.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.892+0000 7fb4953ff700 1 -- 172.21.15.53:0/837751965 shutdown_connections 2023-07-09T21:53:02.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:02.892+0000 7fb4953ff700 1 -- 172.21.15.53:0/837751965 wait complete. 2023-07-09T21:53:02.911 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-09T21:53:03.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.110+0000 7fc2ce1ff700 1 Processor -- start 2023-07-09T21:53:03.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.110+0000 7fc2ce1ff700 1 -- start start 2023-07-09T21:53:03.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.111+0000 7fc2ce1ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2c80b3ff0 0x7fc2c80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.111+0000 7fc2ce1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc2c80d0f90 0x7fc2c80b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.111+0000 7fc2ce1ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c80b8e80 con 0x7fc2c80d0b10 2023-07-09T21:53:03.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.111+0000 7fc2ce1ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c80b1e30 con 0x7fc2c80b3ff0 2023-07-09T21:53:03.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.111+0000 7fc2ce1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c80afaa0 con 0x7fc2c80d0f90 2023-07-09T21:53:03.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.112+0000 7fc2c77fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2c80b3ff0 0x7fc2c80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.112+0000 7fc2c6ffd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc2c80d0b10 0x7fc2c80b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47538/0 (socket says 172.21.15.53:47538) 2023-07-09T21:53:03.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.112+0000 7fc2c6ffd700 1 -- 172.21.15.53:0/1648647774 learned_addr learned my addr 172.21.15.53:0/1648647774 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:53:03.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.112+0000 7fc2c7fff700 1 --2- 172.21.15.53:0/1648647774 >> v2:172.21.15.184:3300/0 conn(0x7fc2c80d0f90 0x7fc2c80b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.112+0000 7fc2c77fe700 1 -- 172.21.15.53:0/1648647774 >> v2:172.21.15.184:3300/0 conn(0x7fc2c80d0f90 msgr2=0x7fc2c80b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:03.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.112+0000 7fc2c77fe700 1 --2- 172.21.15.53:0/1648647774 >> v2:172.21.15.184:3300/0 conn(0x7fc2c80d0f90 0x7fc2c80b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.112+0000 7fc2c77fe700 1 -- 172.21.15.53:0/1648647774 >> v1:172.21.15.53:6789/0 conn(0x7fc2c80d0b10 legacy=0x7fc2c80b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.112+0000 7fc2c77fe700 1 -- 172.21.15.53:0/1648647774 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c80afd80 con 0x7fc2c80b3ff0 2023-07-09T21:53:03.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.112+0000 7fc2c7fff700 1 --2- 172.21.15.53:0/1648647774 >> v2:172.21.15.184:3300/0 conn(0x7fc2c80d0f90 0x7fc2c80b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:53:03.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.112+0000 7fc2c67fc700 1 -- 172.21.15.53:0/1648647774 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954407585 0 0) 0x7fc2bc001110 con 0x7fc2c80d0b10 2023-07-09T21:53:03.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.113+0000 7fc2c77fe700 1 --2- 172.21.15.53:0/1648647774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2c80b3ff0 0x7fc2c80b43c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80674e0 tx=0x7fc2b8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc01431cfdbca92 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:03.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.113+0000 7fc2c67fc700 1 -- 172.21.15.53:0/1648647774 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8011830 con 0x7fc2c80b3ff0 2023-07-09T21:53:03.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.113+0000 7fc2c67fc700 1 -- 172.21.15.53:0/1648647774 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b8011990 con 0x7fc2c80b3ff0 2023-07-09T21:53:03.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.113+0000 7fc2c67fc700 1 -- 172.21.15.53:0/1648647774 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8011d20 con 0x7fc2c80b3ff0 2023-07-09T21:53:03.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.113+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1648647774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2c80b3ff0 msgr2=0x7fc2c80b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.113+0000 7fc2ce1ff700 1 --2- 172.21.15.53:0/1648647774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2c80b3ff0 0x7fc2c80b43c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80674e0 tx=0x7fc2b8009b20 comp rx=0 tx=0).stop 2023-07-09T21:53:03.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.113+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1648647774 shutdown_connections 2023-07-09T21:53:03.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.113+0000 7fc2ce1ff700 1 --2- 172.21.15.53:0/1648647774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2c80b3ff0 0x7fc2c80b43c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.113+0000 7fc2ce1ff700 1 --2- 172.21.15.53:0/1648647774 >> v2:172.21.15.184:3300/0 conn(0x7fc2c80d0f90 0x7fc2c80b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.113+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1648647774 >> 172.21.15.53:0/1648647774 conn(0x7fc2c809c1b0 msgr2=0x7fc2c80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:03.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.113+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1648647774 shutdown_connections 2023-07-09T21:53:03.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.114+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1648647774 wait complete. 2023-07-09T21:53:03.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.115+0000 7fc2ce1ff700 1 Processor -- start 2023-07-09T21:53:03.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.115+0000 7fc2ce1ff700 1 -- start start 2023-07-09T21:53:03.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.116+0000 7fc2ce1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2c80b3ff0 0x7fc2c8152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.116+0000 7fc2ce1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2c80d0b10 0x7fc2c80cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.116+0000 7fc2ce1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2c80d0f90 0x7fc2c80cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.116+0000 7fc2ce1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c80cba30 con 0x7fc2c80d0b10 2023-07-09T21:53:03.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.116+0000 7fc2ce1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c815d610 con 0x7fc2c80b3ff0 2023-07-09T21:53:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.116+0000 7fc2ce1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c80cb750 con 0x7fc2c80d0f90 2023-07-09T21:53:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.116+0000 7fc2c6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2c80d0b10 0x7fc2c80cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2c6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2c80d0b10 0x7fc2c80cbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42674/0 (socket says 172.21.15.53:42674) 2023-07-09T21:53:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2c6ffd700 1 -- 172.21.15.53:0/1988059609 learned_addr learned my addr 172.21.15.53:0/1988059609 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2c77fe700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2c80b3ff0 0x7fc2c8152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2c7fff700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2c80d0f90 0x7fc2c80cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2c6ffd700 1 -- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2c80d0f90 msgr2=0x7fc2c80cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2c6ffd700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2c80d0f90 0x7fc2c80cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2c6ffd700 1 -- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2c80b3ff0 msgr2=0x7fc2c8152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2c6ffd700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2c80b3ff0 0x7fc2c8152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2c6ffd700 1 -- 172.21.15.53:0/1988059609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b80094a0 con 0x7fc2c80d0b10 2023-07-09T21:53:03.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2c77fe700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2c80b3ff0 0x7fc2c8152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:53:03.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2c6ffd700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2c80d0b10 0x7fc2c80cbce0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00c730 tx=0x7fc2bc00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:03.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2affff700 1 -- 172.21.15.53:0/1988059609 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc004c80 con 0x7fc2c80d0b10 2023-07-09T21:53:03.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2affff700 1 -- 172.21.15.53:0/1988059609 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc004e00 con 0x7fc2c80d0b10 2023-07-09T21:53:03.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.117+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1988059609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c815cf50 con 0x7fc2c80d0b10 2023-07-09T21:53:03.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.118+0000 7fc2affff700 1 -- 172.21.15.53:0/1988059609 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc007310 con 0x7fc2c80d0b10 2023-07-09T21:53:03.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.118+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1988059609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c8152dd0 con 0x7fc2c80d0b10 2023-07-09T21:53:03.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.119+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1988059609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c815cdb0 con 0x7fc2c80d0b10 2023-07-09T21:53:03.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.120+0000 7fc2affff700 1 -- 172.21.15.53:0/1988059609 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fc2bc007470 con 0x7fc2c80d0b10 2023-07-09T21:53:03.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.121+0000 7fc2affff700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc2b406ae00 0x7fc2b406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.121+0000 7fc2affff700 1 -- 172.21.15.53:0/1988059609 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7fc2bc088f80 con 0x7fc2c80d0b10 2023-07-09T21:53:03.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.121+0000 7fc2c77fe700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc2b406ae00 0x7fc2b406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.122+0000 7fc2c77fe700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc2b406ae00 0x7fc2b406d2b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80090b0 tx=0x7fc2b8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:03.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.125+0000 7fc2affff700 1 -- 172.21.15.53:0/1988059609 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc2c815cdb0 con 0x7fc2c80d0b10 2023-07-09T21:53:03.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.332+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1988059609 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2c80b0340 con 0x7fc2b406ae00 2023-07-09T21:53:03.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.333+0000 7fc2affff700 1 -- 172.21.15.53:0/1988059609 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc2b8011c00 con 0x7fc2b406ae00 2023-07-09T21:53:03.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.335+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc2b406ae00 msgr2=0x7fc2b406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.335+0000 7fc2ce1ff700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc2b406ae00 0x7fc2b406d2b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80090b0 tx=0x7fc2b8008030 comp rx=0 tx=0).stop 2023-07-09T21:53:03.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.335+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1988059609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2c80d0b10 msgr2=0x7fc2c80cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.335+0000 7fc2ce1ff700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2c80d0b10 0x7fc2c80cbce0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00c730 tx=0x7fc2bc00caf0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.335+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1988059609 shutdown_connections 2023-07-09T21:53:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.335+0000 7fc2ce1ff700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7fc2b406ae00 0x7fc2b406d2b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.335+0000 7fc2ce1ff700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2c80d0f90 0x7fc2c80cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.335+0000 7fc2ce1ff700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2c80b3ff0 0x7fc2c8152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.335+0000 7fc2ce1ff700 1 --2- 172.21.15.53:0/1988059609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2c80d0b10 0x7fc2c80cbce0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.335+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1988059609 >> 172.21.15.53:0/1988059609 conn(0x7fc2c809c1b0 msgr2=0x7fc2c80b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:03.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.336+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1988059609 shutdown_connections 2023-07-09T21:53:03.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.336+0000 7fc2ce1ff700 1 -- 172.21.15.53:0/1988059609 wait complete. 2023-07-09T21:53:03.340 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 4 to deep-scrub 2023-07-09T21:53:03.355 INFO:tasks.ceph:Scrubbing osd.5 2023-07-09T21:53:03.356 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-09T21:53:03.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.557+0000 7f17e59ff700 1 Processor -- start 2023-07-09T21:53:03.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.557+0000 7f17e59ff700 1 -- start start 2023-07-09T21:53:03.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.558+0000 7f17e59ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17e00d28a0 0x7f17e015c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.558+0000 7f17e59ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f17e00cf040 0x7f17e00d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.558+0000 7f17e59ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e00d2c70 con 0x7f17e00d0a30 2023-07-09T21:53:03.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.558+0000 7f17e59ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e00d3de0 con 0x7f17e00cf040 2023-07-09T21:53:03.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.558+0000 7f17e59ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e015ccf0 con 0x7f17e00d28a0 2023-07-09T21:53:03.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.559+0000 7f17de7fc700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f17e00d0a30 0x7f17e0160350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47554/0 (socket says 172.21.15.53:47554) 2023-07-09T21:53:03.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.559+0000 7f17de7fc700 1 -- 172.21.15.53:0/1267660056 learned_addr learned my addr 172.21.15.53:0/1267660056 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:53:03.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.559+0000 7f17deffd700 1 --2- 172.21.15.53:0/1267660056 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17e00d28a0 0x7f17e015c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.559+0000 7f17df7fe700 1 --2- 172.21.15.53:0/1267660056 >> v2:172.21.15.184:3300/0 conn(0x7f17e00cf040 0x7f17e00d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.559+0000 7f17ddffb700 1 -- 172.21.15.53:0/1267660056 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720410425 0 0) 0x7f17e00d2c70 con 0x7f17e00d0a30 2023-07-09T21:53:03.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.559+0000 7f17ddffb700 1 -- 172.21.15.53:0/1267660056 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17c80035b0 con 0x7f17e00d0a30 2023-07-09T21:53:03.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.559+0000 7f17deffd700 1 -- 172.21.15.53:0/1267660056 >> v2:172.21.15.184:3300/0 conn(0x7f17e00cf040 msgr2=0x7f17e00d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:03.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.559+0000 7f17deffd700 1 --2- 172.21.15.53:0/1267660056 >> v2:172.21.15.184:3300/0 conn(0x7f17e00cf040 0x7f17e00d0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.559+0000 7f17deffd700 1 -- 172.21.15.53:0/1267660056 >> v1:172.21.15.53:6789/0 conn(0x7f17e00d0a30 legacy=0x7f17e0160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.559+0000 7f17deffd700 1 -- 172.21.15.53:0/1267660056 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e00d0190 con 0x7f17e00d28a0 2023-07-09T21:53:03.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.559+0000 7f17df7fe700 1 --2- 172.21.15.53:0/1267660056 >> v2:172.21.15.184:3300/0 conn(0x7f17e00cf040 0x7f17e00d0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:53:03.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.560+0000 7f17deffd700 1 --2- 172.21.15.53:0/1267660056 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17e00d28a0 0x7f17e015c7b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009840 tx=0x7f17d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b76d5f51fd8926b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:03.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.560+0000 7f17ddffb700 1 -- 172.21.15.53:0/1267660056 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0011830 con 0x7f17e00d28a0 2023-07-09T21:53:03.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.560+0000 7f17ddffb700 1 -- 172.21.15.53:0/1267660056 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d0011990 con 0x7f17e00d28a0 2023-07-09T21:53:03.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.560+0000 7f17ddffb700 1 -- 172.21.15.53:0/1267660056 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0011d00 con 0x7f17e00d28a0 2023-07-09T21:53:03.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.560+0000 7f17e59ff700 1 -- 172.21.15.53:0/1267660056 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17e00d28a0 msgr2=0x7f17e015c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.560+0000 7f17e59ff700 1 --2- 172.21.15.53:0/1267660056 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17e00d28a0 0x7f17e015c7b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009840 tx=0x7f17d0009b50 comp rx=0 tx=0).stop 2023-07-09T21:53:03.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.561+0000 7f17e59ff700 1 -- 172.21.15.53:0/1267660056 shutdown_connections 2023-07-09T21:53:03.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.561+0000 7f17e59ff700 1 --2- 172.21.15.53:0/1267660056 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17e00d28a0 0x7f17e015c7b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.561+0000 7f17e59ff700 1 --2- 172.21.15.53:0/1267660056 >> v2:172.21.15.184:3300/0 conn(0x7f17e00cf040 0x7f17e00d0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.561+0000 7f17e59ff700 1 -- 172.21.15.53:0/1267660056 >> 172.21.15.53:0/1267660056 conn(0x7f17e009c1b0 msgr2=0x7f17e00d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:03.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.561+0000 7f17e59ff700 1 -- 172.21.15.53:0/1267660056 shutdown_connections 2023-07-09T21:53:03.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.561+0000 7f17e59ff700 1 -- 172.21.15.53:0/1267660056 wait complete. 2023-07-09T21:53:03.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.562+0000 7f17e59ff700 1 Processor -- start 2023-07-09T21:53:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.562+0000 7f17e59ff700 1 -- start start 2023-07-09T21:53:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.563+0000 7f17e59ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17e00cf040 0x7f17e0159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.563+0000 7f17e59ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17e00d0a30 0x7f17e015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.563+0000 7f17e59ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17e00d28a0 0x7f17e0158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.563+0000 7f17e59ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e015d0b0 con 0x7f17e00d0a30 2023-07-09T21:53:03.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.563+0000 7f17e59ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e015b4e0 con 0x7f17e00cf040 2023-07-09T21:53:03.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.563+0000 7f17e59ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e0158120 con 0x7f17e00d28a0 2023-07-09T21:53:03.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.564+0000 7f17de7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17e00d0a30 0x7f17e015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.564+0000 7f17de7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17e00d0a30 0x7f17e015afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42680/0 (socket says 172.21.15.53:42680) 2023-07-09T21:53:03.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.564+0000 7f17de7fc700 1 -- 172.21.15.53:0/3203187997 learned_addr learned my addr 172.21.15.53:0/3203187997 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.564+0000 7f17df7fe700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17e00d28a0 0x7f17e0158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.564+0000 7f17deffd700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17e00cf040 0x7f17e0159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.564+0000 7f17de7fc700 1 -- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17e00d28a0 msgr2=0x7f17e0158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.564+0000 7f17de7fc700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17e00d28a0 0x7f17e0158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.564+0000 7f17de7fc700 1 -- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17e00cf040 msgr2=0x7f17e0159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.564+0000 7f17de7fc700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17e00cf040 0x7f17e0159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.564+0000 7f17de7fc700 1 -- 172.21.15.53:0/3203187997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d8009a70 con 0x7f17e00d0a30 2023-07-09T21:53:03.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.564+0000 7f17de7fc700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17e00d0a30 0x7f17e015afa0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f17d400c4d0 tx=0x7f17d400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:03.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.564+0000 7f17c7fff700 1 -- 172.21.15.53:0/3203187997 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4005d70 con 0x7f17e00d0a30 2023-07-09T21:53:03.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.565+0000 7f17c7fff700 1 -- 172.21.15.53:0/3203187997 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d40070d0 con 0x7f17e00d0a30 2023-07-09T21:53:03.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.565+0000 7f17c7fff700 1 -- 172.21.15.53:0/3203187997 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4007440 con 0x7f17e00d0a30 2023-07-09T21:53:03.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.565+0000 7f17e59ff700 1 -- 172.21.15.53:0/3203187997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d00094a0 con 0x7f17e00d0a30 2023-07-09T21:53:03.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.565+0000 7f17e59ff700 1 -- 172.21.15.53:0/3203187997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e015ba40 con 0x7f17e00d0a30 2023-07-09T21:53:03.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.565+0000 7f17e59ff700 1 -- 172.21.15.53:0/3203187997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f17e00d0470 con 0x7f17e00d0a30 2023-07-09T21:53:03.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.567+0000 7f17c7fff700 1 -- 172.21.15.53:0/3203187997 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f17d40075a0 con 0x7f17e00d0a30 2023-07-09T21:53:03.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.567+0000 7f17c7fff700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f17cc06ae00 0x7f17cc06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.568+0000 7f17c7fff700 1 -- 172.21.15.53:0/3203187997 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f17d40887e0 con 0x7f17e00d0a30 2023-07-09T21:53:03.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.568+0000 7f17c7fff700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] conn(0x7f17cc071270 0x7f17cc0736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.568+0000 7f17c7fff700 1 -- 172.21.15.53:0/3203187997 --> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17cc073d70 con 0x7f17cc071270 2023-07-09T21:53:03.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.568+0000 7f17c7fff700 1 -- 172.21.15.53:0/3203187997 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17d408adc0 con 0x7f17e00d0a30 2023-07-09T21:53:03.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.568+0000 7f17deffd700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f17cc06ae00 0x7f17cc06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.568+0000 7f17df7fe700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] conn(0x7f17cc071270 0x7f17cc0736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.569+0000 7f17df7fe700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] conn(0x7f17cc071270 0x7f17cc0736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:03.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.569+0000 7f17deffd700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f17cc06ae00 0x7f17cc06d2b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009b90 tx=0x7f17d0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:03.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.570+0000 7f17c7fff700 1 -- 172.21.15.53:0/3203187997 <== osd.5 v2:172.21.15.184:6808/1885482202 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f17cc073d70 con 0x7f17cc071270 2023-07-09T21:53:03.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.585+0000 7f17e59ff700 1 -- 172.21.15.53:0/3203187997 --> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f17e00d13e0 con 0x7f17cc071270 2023-07-09T21:53:03.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.586+0000 7f17c7fff700 1 -- 172.21.15.53:0/3203187997 <== osd.5 v2:172.21.15.184:6808/1885482202 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f17d800f040 con 0x7f17cc071270 2023-07-09T21:53:03.588 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-07-09T21:53:03.589 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T21:53:03.589 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-07-09T21:53:03.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.586+0000 7f17e59ff700 1 -- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] conn(0x7f17cc071270 msgr2=0x7f17cc0736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.586+0000 7f17e59ff700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:6808/1885482202,v1:172.21.15.184:6809/1885482202] conn(0x7f17cc071270 0x7f17cc0736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.586+0000 7f17e59ff700 1 -- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f17cc06ae00 msgr2=0x7f17cc06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.586+0000 7f17e59ff700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f17cc06ae00 0x7f17cc06d2b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009b90 tx=0x7f17d0008030 comp rx=0 tx=0).stop 2023-07-09T21:53:03.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.586+0000 7f17e59ff700 1 -- 172.21.15.53:0/3203187997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17e00d0a30 msgr2=0x7f17e015afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.586+0000 7f17e59ff700 1 --2- 172.21.15.53:0/3203187997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17e00d0a30 0x7f17e015afa0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f17d400c4d0 tx=0x7f17d400c890 comp rx=0 tx=0).stop 2023-07-09T21:53:03.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.586+0000 7f17df7fe700 1 -- 172.21.15.53:0/3203187997 reap_dead start 2023-07-09T21:53:03.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.586+0000 7f17e59ff700 1 -- 172.21.15.53:0/3203187997 shutdown_connections 2023-07-09T21:53:03.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.586+0000 7f17e59ff700 1 -- 172.21.15.53:0/3203187997 >> 172.21.15.53:0/3203187997 conn(0x7f17e009c1b0 msgr2=0x7f17e00b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:03.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.586+0000 7f17e59ff700 1 -- 172.21.15.53:0/3203187997 shutdown_connections 2023-07-09T21:53:03.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.587+0000 7f17e59ff700 1 -- 172.21.15.53:0/3203187997 wait complete. 2023-07-09T21:53:03.605 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-09T21:53:03.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.807+0000 7f2f60dff700 1 Processor -- start 2023-07-09T21:53:03.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.807+0000 7f2f60dff700 1 -- start start 2023-07-09T21:53:03.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f60dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f5c0b1910 0x7f2f5c071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f60dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f5c0b1d60 0x7f2f5c0716b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f60dff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5c06bcc0 con 0x7f2f5c06c9f0 2023-07-09T21:53:03.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f60dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5c15ddf0 con 0x7f2f5c0b1910 2023-07-09T21:53:03.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f60dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c06c4e0 con 0x7f2f5c0b1d60 2023-07-09T21:53:03.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f5a59c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2f5c06c9f0 0x7f2f5c06b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47568/0 (socket says 172.21.15.53:47568) 2023-07-09T21:53:03.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f5a59c700 1 -- 172.21.15.53:0/1865129494 learned_addr learned my addr 172.21.15.53:0/1865129494 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:53:03.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f59d9b700 1 --2- 172.21.15.53:0/1865129494 >> v2:172.21.15.53:3300/0 conn(0x7f2f5c0b1910 0x7f2f5c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f5ad9d700 1 --2- 172.21.15.53:0/1865129494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f5c0b1d60 0x7f2f5c0716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f5959a700 1 -- 172.21.15.53:0/1865129494 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381352075 0 0) 0x7f2f5c06bcc0 con 0x7f2f5c06c9f0 2023-07-09T21:53:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f5959a700 1 -- 172.21.15.53:0/1865129494 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f440035b0 con 0x7f2f5c06c9f0 2023-07-09T21:53:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f59d9b700 1 -- 172.21.15.53:0/1865129494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f5c0b1d60 msgr2=0x7f2f5c0716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f59d9b700 1 --2- 172.21.15.53:0/1865129494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f5c0b1d60 0x7f2f5c0716b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f59d9b700 1 -- 172.21.15.53:0/1865129494 >> v1:172.21.15.53:6789/0 conn(0x7f2f5c06c9f0 legacy=0x7f2f5c06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f59d9b700 1 -- 172.21.15.53:0/1865129494 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c06bf20 con 0x7f2f5c0b1910 2023-07-09T21:53:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f59d9b700 1 --2- 172.21.15.53:0/1865129494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5c0b1910 0x7f2f5c071170 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009840 tx=0x7f2f50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d504fcc724b568 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f5959a700 1 -- 172.21.15.53:0/1865129494 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50011830 con 0x7f2f5c0b1910 2023-07-09T21:53:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f5959a700 1 -- 172.21.15.53:0/1865129494 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f50011990 con 0x7f2f5c0b1910 2023-07-09T21:53:03.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.809+0000 7f2f5959a700 1 -- 172.21.15.53:0/1865129494 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50011d20 con 0x7f2f5c0b1910 2023-07-09T21:53:03.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.810+0000 7f2f60dff700 1 -- 172.21.15.53:0/1865129494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5c0b1910 msgr2=0x7f2f5c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.810+0000 7f2f60dff700 1 --2- 172.21.15.53:0/1865129494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5c0b1910 0x7f2f5c071170 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009840 tx=0x7f2f50009b50 comp rx=0 tx=0).stop 2023-07-09T21:53:03.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.810+0000 7f2f60dff700 1 -- 172.21.15.53:0/1865129494 shutdown_connections 2023-07-09T21:53:03.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.810+0000 7f2f60dff700 1 --2- 172.21.15.53:0/1865129494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f5c0b1d60 0x7f2f5c0716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.810+0000 7f2f60dff700 1 --2- 172.21.15.53:0/1865129494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5c0b1910 0x7f2f5c071170 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.810+0000 7f2f60dff700 1 -- 172.21.15.53:0/1865129494 >> 172.21.15.53:0/1865129494 conn(0x7f2f5c0b05d0 msgr2=0x7f2f5c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:03.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.810+0000 7f2f60dff700 1 -- 172.21.15.53:0/1865129494 shutdown_connections 2023-07-09T21:53:03.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.810+0000 7f2f60dff700 1 -- 172.21.15.53:0/1865129494 wait complete. 2023-07-09T21:53:03.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.812+0000 7f2f60dff700 1 Processor -- start 2023-07-09T21:53:03.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.812+0000 7f2f60dff700 1 -- start start 2023-07-09T21:53:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.813+0000 7f2f60dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5c06c9f0 0x7f2f5c152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.813+0000 7f2f60dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f5c0b1910 0x7f2f5c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.813+0000 7f2f60dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f5c0b1d60 0x7f2f5c0c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.813+0000 7f2f60dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0c3c70 con 0x7f2f5c06c9f0 2023-07-09T21:53:03.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.813+0000 7f2f60dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c15a380 con 0x7f2f5c0b1d60 2023-07-09T21:53:03.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.813+0000 7f2f60dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0c39f0 con 0x7f2f5c0b1910 2023-07-09T21:53:03.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.813+0000 7f2f5a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5c06c9f0 0x7f2f5c152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.813+0000 7f2f5a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5c06c9f0 0x7f2f5c152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42692/0 (socket says 172.21.15.53:42692) 2023-07-09T21:53:03.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.813+0000 7f2f5a59c700 1 -- 172.21.15.53:0/4257414954 learned_addr learned my addr 172.21.15.53:0/4257414954 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:03.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.813+0000 7f2f59d9b700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f5c0b1910 0x7f2f5c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.813+0000 7f2f5ad9d700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f5c0b1d60 0x7f2f5c0c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.814+0000 7f2f5a59c700 1 -- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f5c0b1910 msgr2=0x7f2f5c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.814+0000 7f2f5a59c700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f5c0b1910 0x7f2f5c15b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.814+0000 7f2f5a59c700 1 -- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f5c0b1d60 msgr2=0x7f2f5c0c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:03.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.814+0000 7f2f5a59c700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f5c0b1d60 0x7f2f5c0c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:03.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.814+0000 7f2f5a59c700 1 -- 172.21.15.53:0/4257414954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f500094a0 con 0x7f2f5c06c9f0 2023-07-09T21:53:03.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.814+0000 7f2f5a59c700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5c06c9f0 0x7f2f5c152120 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c700 tx=0x7f2f4c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:03.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.814+0000 7f2f4affd700 1 -- 172.21.15.53:0/4257414954 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c005d70 con 0x7f2f5c06c9f0 2023-07-09T21:53:03.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.814+0000 7f2f4affd700 1 -- 172.21.15.53:0/4257414954 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c0070d0 con 0x7f2f5c06c9f0 2023-07-09T21:53:03.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.814+0000 7f2f4affd700 1 -- 172.21.15.53:0/4257414954 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c007460 con 0x7f2f5c06c9f0 2023-07-09T21:53:03.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.814+0000 7f2f60dff700 1 -- 172.21.15.53:0/4257414954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5c159a50 con 0x7f2f5c06c9f0 2023-07-09T21:53:03.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.814+0000 7f2f60dff700 1 -- 172.21.15.53:0/4257414954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c15a010 con 0x7f2f5c06c9f0 2023-07-09T21:53:03.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.815+0000 7f2f60dff700 1 -- 172.21.15.53:0/4257414954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c074350 con 0x7f2f5c06c9f0 2023-07-09T21:53:03.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.816+0000 7f2f4affd700 1 -- 172.21.15.53:0/4257414954 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f2f4c0075c0 con 0x7f2f5c06c9f0 2023-07-09T21:53:03.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.817+0000 7f2f4affd700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2f3c06ae00 0x7f2f3c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:03.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.817+0000 7f2f4affd700 1 -- 172.21.15.53:0/4257414954 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f2f4c0886e0 con 0x7f2f5c06c9f0 2023-07-09T21:53:03.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.818+0000 7f2f59d9b700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2f3c06ae00 0x7f2f3c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:03.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.818+0000 7f2f59d9b700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2f3c06ae00 0x7f2f3c06d2b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2f50000c00 tx=0x7f2f50008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:03.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:03.823+0000 7f2f4affd700 1 -- 172.21.15.53:0/4257414954 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2f4c0539d0 con 0x7f2f5c06c9f0 2023-07-09T21:53:04.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.034+0000 7f2f60dff700 1 -- 172.21.15.53:0/4257414954 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f5c070970 con 0x7f2f3c06ae00 2023-07-09T21:53:04.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.035+0000 7f2f4affd700 1 -- 172.21.15.53:0/4257414954 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2f50011630 con 0x7f2f3c06ae00 2023-07-09T21:53:04.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.037+0000 7f2f60dff700 1 -- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2f3c06ae00 msgr2=0x7f2f3c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.037+0000 7f2f60dff700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2f3c06ae00 0x7f2f3c06d2b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2f50000c00 tx=0x7f2f50008030 comp rx=0 tx=0).stop 2023-07-09T21:53:04.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.037+0000 7f2f60dff700 1 -- 172.21.15.53:0/4257414954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5c06c9f0 msgr2=0x7f2f5c152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.037+0000 7f2f60dff700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5c06c9f0 0x7f2f5c152120 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c700 tx=0x7f2f4c00ca10 comp rx=0 tx=0).stop 2023-07-09T21:53:04.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.037+0000 7f2f60dff700 1 -- 172.21.15.53:0/4257414954 shutdown_connections 2023-07-09T21:53:04.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.037+0000 7f2f60dff700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2f3c06ae00 0x7f2f3c06d2b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.037+0000 7f2f60dff700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f5c0b1d60 0x7f2f5c0c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.037+0000 7f2f60dff700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5c06c9f0 0x7f2f5c152120 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.037+0000 7f2f60dff700 1 --2- 172.21.15.53:0/4257414954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f5c0b1910 0x7f2f5c15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.037+0000 7f2f60dff700 1 -- 172.21.15.53:0/4257414954 >> 172.21.15.53:0/4257414954 conn(0x7f2f5c0b05d0 msgr2=0x7f2f5c0afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:04.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.037+0000 7f2f60dff700 1 -- 172.21.15.53:0/4257414954 shutdown_connections 2023-07-09T21:53:04.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.037+0000 7f2f60dff700 1 -- 172.21.15.53:0/4257414954 wait complete. 2023-07-09T21:53:04.044 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 5 to deep-scrub 2023-07-09T21:53:04.057 INFO:tasks.ceph:Scrubbing osd.6 2023-07-09T21:53:04.058 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-09T21:53:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.261+0000 7f7ac91ff700 1 Processor -- start 2023-07-09T21:53:04.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.261+0000 7f7ac91ff700 1 -- start start 2023-07-09T21:53:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.261+0000 7f7ac91ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ac40d28a0 0x7f7ac415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac91ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7ac40cf040 0x7f7ac40d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac91ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac40d2c70 con 0x7f7ac40d0a30 2023-07-09T21:53:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac91ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac40d1410 con 0x7f7ac40d28a0 2023-07-09T21:53:04.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac91ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac40d3de0 con 0x7f7ac40cf040 2023-07-09T21:53:04.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac2d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ac40d28a0 0x7f7ac415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac259c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7ac40d0a30 0x7f7ac4160350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47580/0 (socket says 172.21.15.53:47580) 2023-07-09T21:53:04.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac259c700 1 -- 172.21.15.53:0/3295122998 learned_addr learned my addr 172.21.15.53:0/3295122998 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:53:04.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac359e700 1 --2- 172.21.15.53:0/3295122998 >> v2:172.21.15.184:3300/0 conn(0x7f7ac40cf040 0x7f7ac40d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac2d9d700 1 -- 172.21.15.53:0/3295122998 >> v2:172.21.15.184:3300/0 conn(0x7f7ac40cf040 msgr2=0x7f7ac40d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:04.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac2d9d700 1 --2- 172.21.15.53:0/3295122998 >> v2:172.21.15.184:3300/0 conn(0x7f7ac40cf040 0x7f7ac40d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac2d9d700 1 -- 172.21.15.53:0/3295122998 >> v1:172.21.15.53:6789/0 conn(0x7f7ac40d0a30 legacy=0x7f7ac4160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac1d9b700 1 -- 172.21.15.53:0/3295122998 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025167008 0 0) 0x7f7ac40d2c70 con 0x7f7ac40d0a30 2023-07-09T21:53:04.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac2d9d700 1 -- 172.21.15.53:0/3295122998 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac40d0190 con 0x7f7ac40d28a0 2023-07-09T21:53:04.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.262+0000 7f7ac359e700 1 --2- 172.21.15.53:0/3295122998 >> v2:172.21.15.184:3300/0 conn(0x7f7ac40cf040 0x7f7ac40d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:53:04.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.263+0000 7f7ac2d9d700 1 --2- 172.21.15.53:0/3295122998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac40d28a0 0x7f7ac415c7b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4072230 tx=0x7f7ab4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2caaaf2cc0fb197a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:04.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.263+0000 7f7ac1d9b700 1 -- 172.21.15.53:0/3295122998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4011830 con 0x7f7ac40d28a0 2023-07-09T21:53:04.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.263+0000 7f7ac1d9b700 1 -- 172.21.15.53:0/3295122998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab4011990 con 0x7f7ac40d28a0 2023-07-09T21:53:04.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.263+0000 7f7ac1d9b700 1 -- 172.21.15.53:0/3295122998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4011d20 con 0x7f7ac40d28a0 2023-07-09T21:53:04.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.263+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3295122998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac40d28a0 msgr2=0x7f7ac415c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.263+0000 7f7ac91ff700 1 --2- 172.21.15.53:0/3295122998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac40d28a0 0x7f7ac415c7b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4072230 tx=0x7f7ab4009b20 comp rx=0 tx=0).stop 2023-07-09T21:53:04.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.263+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3295122998 shutdown_connections 2023-07-09T21:53:04.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.263+0000 7f7ac91ff700 1 --2- 172.21.15.53:0/3295122998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac40d28a0 0x7f7ac415c7b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.263+0000 7f7ac91ff700 1 --2- 172.21.15.53:0/3295122998 >> v2:172.21.15.184:3300/0 conn(0x7f7ac40cf040 0x7f7ac40d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.263+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3295122998 >> 172.21.15.53:0/3295122998 conn(0x7f7ac409c1b0 msgr2=0x7f7ac40d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:04.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.264+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3295122998 shutdown_connections 2023-07-09T21:53:04.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.264+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3295122998 wait complete. 2023-07-09T21:53:04.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.265+0000 7f7ac91ff700 1 Processor -- start 2023-07-09T21:53:04.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.265+0000 7f7ac91ff700 1 -- start start 2023-07-09T21:53:04.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.266+0000 7f7ac91ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac40cf040 0x7f7ac41f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.266+0000 7f7ac91ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ac40d0a30 0x7f7ac41ef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.266+0000 7f7ac91ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ac40d28a0 0x7f7ac41f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.266+0000 7f7ac91ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac4156e10 con 0x7f7ac40cf040 2023-07-09T21:53:04.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.266+0000 7f7ac91ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac41f3200 con 0x7f7ac40d28a0 2023-07-09T21:53:04.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.266+0000 7f7ac91ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac41f21f0 con 0x7f7ac40d0a30 2023-07-09T21:53:04.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.267+0000 7f7ac2d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac40cf040 0x7f7ac41f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.267+0000 7f7ac2d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac40cf040 0x7f7ac41f2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42708/0 (socket says 172.21.15.53:42708) 2023-07-09T21:53:04.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.267+0000 7f7ac2d9d700 1 -- 172.21.15.53:0/3240101773 learned_addr learned my addr 172.21.15.53:0/3240101773 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:04.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.267+0000 7f7ac259c700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ac40d0a30 0x7f7ac41ef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.267+0000 7f7ac359e700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ac40d28a0 0x7f7ac41f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.267+0000 7f7ac2d9d700 1 -- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ac40d0a30 msgr2=0x7f7ac41ef6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.267+0000 7f7ac2d9d700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ac40d0a30 0x7f7ac41ef6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.267+0000 7f7ac2d9d700 1 -- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ac40d28a0 msgr2=0x7f7ac41f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.267+0000 7f7ac2d9d700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ac40d28a0 0x7f7ac41f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.267+0000 7f7ac2d9d700 1 -- 172.21.15.53:0/3240101773 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40094a0 con 0x7f7ac40cf040 2023-07-09T21:53:04.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.267+0000 7f7ac359e700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ac40d28a0 0x7f7ac41f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:53:04.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.267+0000 7f7ac259c700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ac40d0a30 0x7f7ac41ef6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:53:04.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.267+0000 7f7ac2d9d700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac40cf040 0x7f7ac41f2cc0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40090b0 tx=0x7f7ab4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:04.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.268+0000 7f7aab7fe700 1 -- 172.21.15.53:0/3240101773 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40038a0 con 0x7f7ac40cf040 2023-07-09T21:53:04.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.268+0000 7f7aab7fe700 1 -- 172.21.15.53:0/3240101773 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab401f070 con 0x7f7ac40cf040 2023-07-09T21:53:04.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.268+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3240101773 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac41f62f0 con 0x7f7ac40cf040 2023-07-09T21:53:04.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.268+0000 7f7aab7fe700 1 -- 172.21.15.53:0/3240101773 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4003c20 con 0x7f7ac40cf040 2023-07-09T21:53:04.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.268+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3240101773 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac41f24c0 con 0x7f7ac40cf040 2023-07-09T21:53:04.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.269+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3240101773 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ac40d0750 con 0x7f7ac40cf040 2023-07-09T21:53:04.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.270+0000 7f7aab7fe700 1 -- 172.21.15.53:0/3240101773 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f7ab401a430 con 0x7f7ac40cf040 2023-07-09T21:53:04.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.271+0000 7f7aab7fe700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7ab006ae00 0x7f7ab006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.271+0000 7f7aab7fe700 1 -- 172.21.15.53:0/3240101773 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f7ab4021070 con 0x7f7ac40cf040 2023-07-09T21:53:04.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.271+0000 7f7aab7fe700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] conn(0x7f7ab0071270 0x7f7ab00736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.271+0000 7f7aab7fe700 1 -- 172.21.15.53:0/3240101773 --> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ab0073d70 con 0x7f7ab0071270 2023-07-09T21:53:04.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.271+0000 7f7aab7fe700 1 -- 172.21.15.53:0/3240101773 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ab408b5c0 con 0x7f7ac40cf040 2023-07-09T21:53:04.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.271+0000 7f7ac259c700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7ab006ae00 0x7f7ab006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.271+0000 7f7ac359e700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] conn(0x7f7ab0071270 0x7f7ab00736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.272+0000 7f7ac259c700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7ab006ae00 0x7f7ab006d2b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7ac415cf00 tx=0x7f7ab8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:04.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.272+0000 7f7ac359e700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] conn(0x7f7ab0071270 0x7f7ab00736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:04.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.273+0000 7f7aab7fe700 1 -- 172.21.15.53:0/3240101773 <== osd.6 v2:172.21.15.184:6813/587359560 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7ab0073d70 con 0x7f7ab0071270 2023-07-09T21:53:04.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.288+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3240101773 --> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7ac40d0470 con 0x7f7ab0071270 2023-07-09T21:53:04.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.290+0000 7f7aab7fe700 1 -- 172.21.15.53:0/3240101773 <== osd.6 v2:172.21.15.184:6813/587359560 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7abc00f040 con 0x7f7ab0071270 2023-07-09T21:53:04.291 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-07-09T21:53:04.291 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T21:53:04.291 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-07-09T21:53:04.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.290+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] conn(0x7f7ab0071270 msgr2=0x7f7ab00736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.290+0000 7f7ac91ff700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:6813/587359560,v1:172.21.15.184:6815/587359560] conn(0x7f7ab0071270 0x7f7ab00736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.290+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7ab006ae00 msgr2=0x7f7ab006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.290+0000 7f7ac91ff700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f7ab006ae00 0x7f7ab006d2b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7ac415cf00 tx=0x7f7ab8009040 comp rx=0 tx=0).stop 2023-07-09T21:53:04.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.290+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3240101773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac40cf040 msgr2=0x7f7ac41f2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.290+0000 7f7ac91ff700 1 --2- 172.21.15.53:0/3240101773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac40cf040 0x7f7ac41f2cc0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40090b0 tx=0x7f7ab4004750 comp rx=0 tx=0).stop 2023-07-09T21:53:04.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.290+0000 7f7ac359e700 1 -- 172.21.15.53:0/3240101773 reap_dead start 2023-07-09T21:53:04.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.290+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3240101773 shutdown_connections 2023-07-09T21:53:04.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.290+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3240101773 >> 172.21.15.53:0/3240101773 conn(0x7f7ac409c1b0 msgr2=0x7f7ac40b7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:04.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.290+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3240101773 shutdown_connections 2023-07-09T21:53:04.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.290+0000 7f7ac91ff700 1 -- 172.21.15.53:0/3240101773 wait complete. 2023-07-09T21:53:04.308 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-09T21:53:04.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.508+0000 7f23685ff700 1 Processor -- start 2023-07-09T21:53:04.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.508+0000 7f23685ff700 1 -- start start 2023-07-09T21:53:04.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f23685ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f23600b43c0 0x7f23600b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f23685ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23600b8e80 con 0x7f23600d1220 2023-07-09T21:53:04.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f23685ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23600afaa0 con 0x7f23600b3ff0 2023-07-09T21:53:04.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f23685ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23600afd80 con 0x7f23600b43c0 2023-07-09T21:53:04.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f2366b9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f23600b43c0 0x7f23600b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f2365b9a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f23600d1220 0x7f23600b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47586/0 (socket says 172.21.15.53:47586) 2023-07-09T21:53:04.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f2365b9a700 1 -- 172.21.15.53:0/3187711022 learned_addr learned my addr 172.21.15.53:0/3187711022 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:53:04.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f2366b9c700 1 -- 172.21.15.53:0/3187711022 >> v1:172.21.15.184:6789/0 conn(0x7f23600b3ff0 legacy=0x7f23600d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f2366b9c700 1 -- 172.21.15.53:0/3187711022 >> v1:172.21.15.53:6789/0 conn(0x7f23600d1220 legacy=0x7f23600b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f2366b9c700 1 -- 172.21.15.53:0/3187711022 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600b0060 con 0x7f23600b43c0 2023-07-09T21:53:04.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f2365399700 1 -- 172.21.15.53:0/3187711022 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188338018 0 0) 0x7f2350001110 con 0x7f23600d1220 2023-07-09T21:53:04.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f2366b9c700 1 --2- 172.21.15.53:0/3187711022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23600b43c0 0x7f23600b1530 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2358009d90 tx=0x7f235800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362d0029b0184503 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:04.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f2365399700 1 -- 172.21.15.53:0/3187711022 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235800e070 con 0x7f23600b43c0 2023-07-09T21:53:04.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f2365399700 1 -- 172.21.15.53:0/3187711022 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235800bbd0 con 0x7f23600b43c0 2023-07-09T21:53:04.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.509+0000 7f2365399700 1 -- 172.21.15.53:0/3187711022 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358012430 con 0x7f23600b43c0 2023-07-09T21:53:04.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.511+0000 7f23685ff700 1 -- 172.21.15.53:0/3187711022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23600b43c0 msgr2=0x7f23600b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.511+0000 7f23685ff700 1 --2- 172.21.15.53:0/3187711022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23600b43c0 0x7f23600b1530 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2358009d90 tx=0x7f235800b330 comp rx=0 tx=0).stop 2023-07-09T21:53:04.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.511+0000 7f23685ff700 1 -- 172.21.15.53:0/3187711022 shutdown_connections 2023-07-09T21:53:04.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.511+0000 7f23685ff700 1 --2- 172.21.15.53:0/3187711022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23600b43c0 0x7f23600b1530 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.511+0000 7f23685ff700 1 -- 172.21.15.53:0/3187711022 >> 172.21.15.53:0/3187711022 conn(0x7f236009c1b0 msgr2=0x7f23600d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:04.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.511+0000 7f23685ff700 1 -- 172.21.15.53:0/3187711022 shutdown_connections 2023-07-09T21:53:04.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.511+0000 7f23685ff700 1 -- 172.21.15.53:0/3187711022 wait complete. 2023-07-09T21:53:04.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.513+0000 7f23685ff700 1 Processor -- start 2023-07-09T21:53:04.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.513+0000 7f23685ff700 1 -- start start 2023-07-09T21:53:04.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.514+0000 7f23685ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23600b3ff0 0x7f236014f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.514+0000 7f23685ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23600b43c0 0x7f236015f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.514+0000 7f23685ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23600d1220 0x7f23600c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.514+0000 7f23685ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236015c8d0 con 0x7f23600b3ff0 2023-07-09T21:53:04.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.514+0000 7f23685ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236015dfa0 con 0x7f23600b43c0 2023-07-09T21:53:04.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.514+0000 7f23685ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236015e280 con 0x7f23600d1220 2023-07-09T21:53:04.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.514+0000 7f236639b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23600b3ff0 0x7f236014f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.514+0000 7f236639b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23600b3ff0 0x7f236014f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42714/0 (socket says 172.21.15.53:42714) 2023-07-09T21:53:04.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.514+0000 7f236639b700 1 -- 172.21.15.53:0/1092830423 learned_addr learned my addr 172.21.15.53:0/1092830423 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:04.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.514+0000 7f2365b9a700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23600b43c0 0x7f236015f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.514+0000 7f2366b9c700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23600d1220 0x7f23600c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.514+0000 7f236639b700 1 -- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23600d1220 msgr2=0x7f23600c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.514+0000 7f236639b700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23600d1220 0x7f23600c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.515+0000 7f236639b700 1 -- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23600b43c0 msgr2=0x7f236015f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.515+0000 7f236639b700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23600b43c0 0x7f236015f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.515+0000 7f236639b700 1 -- 172.21.15.53:0/1092830423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2358009a70 con 0x7f23600b3ff0 2023-07-09T21:53:04.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.515+0000 7f236639b700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23600b3ff0 0x7f236014f1e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f235c00c4e0 tx=0x7f235c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:04.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.515+0000 7f2356ffd700 1 -- 172.21.15.53:0/1092830423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c0052d0 con 0x7f23600b3ff0 2023-07-09T21:53:04.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.515+0000 7f2356ffd700 1 -- 172.21.15.53:0/1092830423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c005430 con 0x7f23600b3ff0 2023-07-09T21:53:04.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.515+0000 7f2356ffd700 1 -- 172.21.15.53:0/1092830423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c0038c0 con 0x7f23600b3ff0 2023-07-09T21:53:04.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.515+0000 7f23685ff700 1 -- 172.21.15.53:0/1092830423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236015e560 con 0x7f23600b3ff0 2023-07-09T21:53:04.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.515+0000 7f23685ff700 1 -- 172.21.15.53:0/1092830423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236015eb20 con 0x7f23600b3ff0 2023-07-09T21:53:04.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.515+0000 7f23685ff700 1 -- 172.21.15.53:0/1092830423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2360074350 con 0x7f23600b3ff0 2023-07-09T21:53:04.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.517+0000 7f2356ffd700 1 -- 172.21.15.53:0/1092830423 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f235c003a20 con 0x7f23600b3ff0 2023-07-09T21:53:04.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.518+0000 7f2356ffd700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f234406ae00 0x7f234406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.518+0000 7f2356ffd700 1 -- 172.21.15.53:0/1092830423 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f235c0888e0 con 0x7f23600b3ff0 2023-07-09T21:53:04.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.519+0000 7f2365b9a700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f234406ae00 0x7f234406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.519+0000 7f2365b9a700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f234406ae00 0x7f234406d2b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f236015c550 tx=0x7f2350007d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:04.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.522+0000 7f2356ffd700 1 -- 172.21.15.53:0/1092830423 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f235c053ac0 con 0x7f23600b3ff0 2023-07-09T21:53:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.730+0000 7f23685ff700 1 -- 172.21.15.53:0/1092830423 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f23600b0620 con 0x7f234406ae00 2023-07-09T21:53:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.730+0000 7f2356ffd700 1 -- 172.21.15.53:0/1092830423 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2350004870 con 0x7f234406ae00 2023-07-09T21:53:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.733+0000 7f23685ff700 1 -- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f234406ae00 msgr2=0x7f234406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.733+0000 7f23685ff700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f234406ae00 0x7f234406d2b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f236015c550 tx=0x7f2350007d90 comp rx=0 tx=0).stop 2023-07-09T21:53:04.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.733+0000 7f23685ff700 1 -- 172.21.15.53:0/1092830423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23600b3ff0 msgr2=0x7f236014f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.733+0000 7f23685ff700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23600b3ff0 0x7f236014f1e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f235c00c4e0 tx=0x7f235c00c8a0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.733+0000 7f23685ff700 1 -- 172.21.15.53:0/1092830423 shutdown_connections 2023-07-09T21:53:04.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.733+0000 7f23685ff700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f234406ae00 0x7f234406d2b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.733+0000 7f23685ff700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23600d1220 0x7f23600c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.733+0000 7f23685ff700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23600b3ff0 0x7f236014f1e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.733+0000 7f23685ff700 1 --2- 172.21.15.53:0/1092830423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23600b43c0 0x7f236015f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.733+0000 7f23685ff700 1 -- 172.21.15.53:0/1092830423 >> 172.21.15.53:0/1092830423 conn(0x7f236009c1b0 msgr2=0x7f23600b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:04.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.733+0000 7f23685ff700 1 -- 172.21.15.53:0/1092830423 shutdown_connections 2023-07-09T21:53:04.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.733+0000 7f23685ff700 1 -- 172.21.15.53:0/1092830423 wait complete. 2023-07-09T21:53:04.737 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 6 to deep-scrub 2023-07-09T21:53:04.752 INFO:tasks.ceph:Scrubbing osd.7 2023-07-09T21:53:04.753 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-09T21:53:04.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.956+0000 7ffa22dff700 1 Processor -- start 2023-07-09T21:53:04.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.956+0000 7ffa22dff700 1 -- start start 2023-07-09T21:53:04.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.957+0000 7ffa22dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ffa1c160c50 0x7ffa1c06dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.957+0000 7ffa22dff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffa1c06a640 0x7ffa1c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.957+0000 7ffa22dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c15cb50 con 0x7ffa1c0af170 2023-07-09T21:53:04.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.957+0000 7ffa22dff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1c1610c0 con 0x7ffa1c06a640 2023-07-09T21:53:04.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.957+0000 7ffa22dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1c0ce830 con 0x7ffa1c160c50 2023-07-09T21:53:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.958+0000 7ffa2139c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffa1c06a640 0x7ffa1c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.958+0000 7ffa2139c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffa1c06a640 0x7ffa1c06c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42730/0 (socket says 172.21.15.53:42730) 2023-07-09T21:53:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.958+0000 7ffa2139c700 1 -- 172.21.15.53:0/3218509671 learned_addr learned my addr 172.21.15.53:0/3218509671 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.958+0000 7ffa2139c700 1 -- 172.21.15.53:0/3218509671 >> v2:172.21.15.184:3300/0 conn(0x7ffa1c160c50 msgr2=0x7ffa1c06dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.958+0000 7ffa2139c700 1 --2- 172.21.15.53:0/3218509671 >> v2:172.21.15.184:3300/0 conn(0x7ffa1c160c50 0x7ffa1c06dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.958+0000 7ffa2139c700 1 -- 172.21.15.53:0/3218509671 >> v1:172.21.15.184:6789/0 conn(0x7ffa1c0af170 legacy=0x7ffa1c069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.958+0000 7ffa2139c700 1 -- 172.21.15.53:0/3218509671 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c0ceb10 con 0x7ffa1c06a640 2023-07-09T21:53:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.958+0000 7ffa2139c700 1 --2- 172.21.15.53:0/3218509671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa1c06a640 0x7ffa1c06c2c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0675b0 tx=0x7ffa1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e6aaf2082995df server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.958+0000 7ffa1b7fe700 1 -- 172.21.15.53:0/3218509671 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1400e070 con 0x7ffa1c06a640 2023-07-09T21:53:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.958+0000 7ffa1b7fe700 1 -- 172.21.15.53:0/3218509671 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa14003a20 con 0x7ffa1c06a640 2023-07-09T21:53:04.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.958+0000 7ffa1b7fe700 1 -- 172.21.15.53:0/3218509671 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa14003dd0 con 0x7ffa1c06a640 2023-07-09T21:53:04.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.959+0000 7ffa22dff700 1 -- 172.21.15.53:0/3218509671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa1c06a640 msgr2=0x7ffa1c06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.959+0000 7ffa22dff700 1 --2- 172.21.15.53:0/3218509671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa1c06a640 0x7ffa1c06c2c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0675b0 tx=0x7ffa1400b330 comp rx=0 tx=0).stop 2023-07-09T21:53:04.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.959+0000 7ffa22dff700 1 -- 172.21.15.53:0/3218509671 shutdown_connections 2023-07-09T21:53:04.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.959+0000 7ffa22dff700 1 --2- 172.21.15.53:0/3218509671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa1c06a640 0x7ffa1c06c2c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.959+0000 7ffa22dff700 1 --2- 172.21.15.53:0/3218509671 >> v2:172.21.15.184:3300/0 conn(0x7ffa1c160c50 0x7ffa1c06dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.959+0000 7ffa22dff700 1 -- 172.21.15.53:0/3218509671 >> 172.21.15.53:0/3218509671 conn(0x7ffa1c0cfb10 msgr2=0x7ffa1c0cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:04.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.959+0000 7ffa22dff700 1 -- 172.21.15.53:0/3218509671 shutdown_connections 2023-07-09T21:53:04.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.959+0000 7ffa22dff700 1 -- 172.21.15.53:0/3218509671 wait complete. 2023-07-09T21:53:04.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.961+0000 7ffa22dff700 1 Processor -- start 2023-07-09T21:53:04.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.961+0000 7ffa22dff700 1 -- start start 2023-07-09T21:53:04.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.962+0000 7ffa22dff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa1c06a640 0x7ffa1c150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.962+0000 7ffa22dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa1c0af170 0x7ffa1c150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.962+0000 7ffa22dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa1c160c50 0x7ffa1c0c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.962+0000 7ffa22dff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c15cd40 con 0x7ffa1c06a640 2023-07-09T21:53:04.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.962+0000 7ffa22dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0b50f0 con 0x7ffa1c0af170 2023-07-09T21:53:04.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.962+0000 7ffa22dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0b53d0 con 0x7ffa1c160c50 2023-07-09T21:53:04.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.962+0000 7ffa20b9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa1c06a640 0x7ffa1c150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.962+0000 7ffa20b9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa1c06a640 0x7ffa1c150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42746/0 (socket says 172.21.15.53:42746) 2023-07-09T21:53:04.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.962+0000 7ffa20b9b700 1 -- 172.21.15.53:0/1930464996 learned_addr learned my addr 172.21.15.53:0/1930464996 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:04.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.963+0000 7ffa20b9b700 1 -- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa1c160c50 msgr2=0x7ffa1c0c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.963+0000 7ffa20b9b700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa1c160c50 0x7ffa1c0c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.963+0000 7ffa20b9b700 1 -- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa1c0af170 msgr2=0x7ffa1c150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.963+0000 7ffa1bfff700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa1c0af170 0x7ffa1c150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.963+0000 7ffa20b9b700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa1c0af170 0x7ffa1c150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.963+0000 7ffa20b9b700 1 -- 172.21.15.53:0/1930464996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa14009b30 con 0x7ffa1c06a640 2023-07-09T21:53:04.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.963+0000 7ffa1bfff700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa1c0af170 0x7ffa1c150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:53:04.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.963+0000 7ffa20b9b700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa1c06a640 0x7ffa1c150d20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000b4a0 tx=0x7ffa1000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:04.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.963+0000 7ffa197fa700 1 -- 172.21.15.53:0/1930464996 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10011830 con 0x7ffa1c06a640 2023-07-09T21:53:04.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.963+0000 7ffa197fa700 1 -- 172.21.15.53:0/1930464996 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa10011990 con 0x7ffa1c06a640 2023-07-09T21:53:04.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.963+0000 7ffa197fa700 1 -- 172.21.15.53:0/1930464996 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10011d40 con 0x7ffa1c06a640 2023-07-09T21:53:04.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.963+0000 7ffa22dff700 1 -- 172.21.15.53:0/1930464996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c15cf90 con 0x7ffa1c06a640 2023-07-09T21:53:04.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.963+0000 7ffa22dff700 1 -- 172.21.15.53:0/1930464996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c150a40 con 0x7ffa1c06a640 2023-07-09T21:53:04.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.964+0000 7ffa22dff700 1 -- 172.21.15.53:0/1930464996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa1c0cf0d0 con 0x7ffa1c06a640 2023-07-09T21:53:04.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.965+0000 7ffa197fa700 1 -- 172.21.15.53:0/1930464996 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7ffa1001a400 con 0x7ffa1c06a640 2023-07-09T21:53:04.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.966+0000 7ffa197fa700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ffa0006ae00 0x7ffa0006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.967+0000 7ffa197fa700 1 -- 172.21.15.53:0/1930464996 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7ffa10089460 con 0x7ffa1c06a640 2023-07-09T21:53:04.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.967+0000 7ffa197fa700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] conn(0x7ffa00071270 0x7ffa000736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:04.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.967+0000 7ffa197fa700 1 -- 172.21.15.53:0/1930464996 --> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa00073d70 con 0x7ffa00071270 2023-07-09T21:53:04.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.967+0000 7ffa197fa700 1 -- 172.21.15.53:0/1930464996 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa1008b9e0 con 0x7ffa1c06a640 2023-07-09T21:53:04.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.967+0000 7ffa1bfff700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ffa0006ae00 0x7ffa0006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.967+0000 7ffa2139c700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] conn(0x7ffa00071270 0x7ffa000736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:04.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.968+0000 7ffa1bfff700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ffa0006ae00 0x7ffa0006d2b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0c8750 tx=0x7ffa08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:04.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.968+0000 7ffa2139c700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] conn(0x7ffa00071270 0x7ffa000736a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:04.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.969+0000 7ffa197fa700 1 -- 172.21.15.53:0/1930464996 <== osd.7 v2:172.21.15.184:6824/3630658135 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ffa00073d70 con 0x7ffa00071270 2023-07-09T21:53:04.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.984+0000 7ffa22dff700 1 -- 172.21.15.53:0/1930464996 --> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffa1c0cedf0 con 0x7ffa00071270 2023-07-09T21:53:04.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.984+0000 7ffa197fa700 1 -- 172.21.15.53:0/1930464996 <== osd.7 v2:172.21.15.184:6824/3630658135 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ffa14003d70 con 0x7ffa00071270 2023-07-09T21:53:04.986 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-07-09T21:53:04.986 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T21:53:04.986 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-07-09T21:53:04.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.985+0000 7ffa22dff700 1 -- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] conn(0x7ffa00071270 msgr2=0x7ffa000736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.985+0000 7ffa22dff700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:6824/3630658135,v1:172.21.15.184:6825/3630658135] conn(0x7ffa00071270 0x7ffa000736a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:04.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.985+0000 7ffa22dff700 1 -- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ffa0006ae00 msgr2=0x7ffa0006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.985+0000 7ffa22dff700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7ffa0006ae00 0x7ffa0006d2b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0c8750 tx=0x7ffa08009040 comp rx=0 tx=0).stop 2023-07-09T21:53:04.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.985+0000 7ffa22dff700 1 -- 172.21.15.53:0/1930464996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa1c06a640 msgr2=0x7ffa1c150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:04.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.985+0000 7ffa22dff700 1 --2- 172.21.15.53:0/1930464996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa1c06a640 0x7ffa1c150d20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000b4a0 tx=0x7ffa1000b860 comp rx=0 tx=0).stop 2023-07-09T21:53:04.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.985+0000 7ffa2139c700 1 -- 172.21.15.53:0/1930464996 reap_dead start 2023-07-09T21:53:04.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.985+0000 7ffa22dff700 1 -- 172.21.15.53:0/1930464996 shutdown_connections 2023-07-09T21:53:04.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.985+0000 7ffa22dff700 1 -- 172.21.15.53:0/1930464996 >> 172.21.15.53:0/1930464996 conn(0x7ffa1c0cfb10 msgr2=0x7ffa1c0ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:04.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.985+0000 7ffa22dff700 1 -- 172.21.15.53:0/1930464996 shutdown_connections 2023-07-09T21:53:04.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:04.985+0000 7ffa22dff700 1 -- 172.21.15.53:0/1930464996 wait complete. 2023-07-09T21:53:05.003 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-09T21:53:05.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.203+0000 7f4630fff700 1 Processor -- start 2023-07-09T21:53:05.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.204+0000 7f4630fff700 1 -- start start 2023-07-09T21:53:05.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f4630fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f462c0b4600 0x7f462c0cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:05.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f4630fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f462c0d0260 0x7f462c0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:05.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f4630fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f462c0cda80 0x7f462c0cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:05.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f4630fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462c0d1550 con 0x7f462c0d0260 2023-07-09T21:53:05.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f4630fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462c0d2d90 con 0x7f462c0cda80 2023-07-09T21:53:05.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f4630fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c15cd60 con 0x7f462c0b4600 2023-07-09T21:53:05.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f4623fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f462c0d0260 0x7f462c0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:05.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f4623fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f462c0d0260 0x7f462c0cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42750/0 (socket says 172.21.15.53:42750) 2023-07-09T21:53:05.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f4623fff700 1 -- 172.21.15.53:0/755064130 learned_addr learned my addr 172.21.15.53:0/755064130 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:05.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f462a59c700 1 --2- 172.21.15.53:0/755064130 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f462c0b4600 0x7f462c0cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:05.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f462ad9d700 1 --2- 172.21.15.53:0/755064130 >> v2:172.21.15.184:3300/0 conn(0x7f462c0cda80 0x7f462c0cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:05.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f4623fff700 1 -- 172.21.15.53:0/755064130 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f462c0b4600 msgr2=0x7f462c0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:05.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f4623fff700 1 --2- 172.21.15.53:0/755064130 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f462c0b4600 0x7f462c0cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.205+0000 7f4623fff700 1 -- 172.21.15.53:0/755064130 >> v2:172.21.15.184:3300/0 conn(0x7f462c0cda80 msgr2=0x7f462c0cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:05.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.206+0000 7f4623fff700 1 --2- 172.21.15.53:0/755064130 >> v2:172.21.15.184:3300/0 conn(0x7f462c0cda80 0x7f462c0cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.206+0000 7f4623fff700 1 -- 172.21.15.53:0/755064130 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c0cf340 con 0x7f462c0d0260 2023-07-09T21:53:05.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.206+0000 7f462ad9d700 1 --2- 172.21.15.53:0/755064130 >> v2:172.21.15.184:3300/0 conn(0x7f462c0cda80 0x7f462c0cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:53:05.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.206+0000 7f462a59c700 1 --2- 172.21.15.53:0/755064130 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f462c0b4600 0x7f462c0cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:53:05.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.206+0000 7f4623fff700 1 --2- 172.21.15.53:0/755064130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f462c0d0260 0x7f462c0cd540 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f462c08d430 tx=0x7f4614009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe224cc783381efb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:05.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.206+0000 7f4629d9b700 1 -- 172.21.15.53:0/755064130 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461400b860 con 0x7f462c0d0260 2023-07-09T21:53:05.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.206+0000 7f4629d9b700 1 -- 172.21.15.53:0/755064130 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461400b9c0 con 0x7f462c0d0260 2023-07-09T21:53:05.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.206+0000 7f4629d9b700 1 -- 172.21.15.53:0/755064130 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461400bd50 con 0x7f462c0d0260 2023-07-09T21:53:05.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.207+0000 7f4630fff700 1 -- 172.21.15.53:0/755064130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f462c0d0260 msgr2=0x7f462c0cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:05.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.207+0000 7f4630fff700 1 --2- 172.21.15.53:0/755064130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f462c0d0260 0x7f462c0cd540 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f462c08d430 tx=0x7f4614009c00 comp rx=0 tx=0).stop 2023-07-09T21:53:05.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.207+0000 7f4630fff700 1 -- 172.21.15.53:0/755064130 shutdown_connections 2023-07-09T21:53:05.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.207+0000 7f4630fff700 1 --2- 172.21.15.53:0/755064130 >> v2:172.21.15.184:3300/0 conn(0x7f462c0cda80 0x7f462c0cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.207+0000 7f4630fff700 1 --2- 172.21.15.53:0/755064130 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f462c0b4600 0x7f462c0cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.207+0000 7f4630fff700 1 --2- 172.21.15.53:0/755064130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f462c0d0260 0x7f462c0cd540 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.207+0000 7f4630fff700 1 -- 172.21.15.53:0/755064130 >> 172.21.15.53:0/755064130 conn(0x7f462c09c200 msgr2=0x7f462c0d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:05.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.207+0000 7f4630fff700 1 -- 172.21.15.53:0/755064130 shutdown_connections 2023-07-09T21:53:05.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.207+0000 7f4630fff700 1 -- 172.21.15.53:0/755064130 wait complete. 2023-07-09T21:53:05.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.209+0000 7f4630fff700 1 Processor -- start 2023-07-09T21:53:05.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.210+0000 7f4630fff700 1 -- start start 2023-07-09T21:53:05.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f4630fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f462c0cda80 0x7f462c0b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:05.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f4630fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f462c0d0260 0x7f462c0b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:05.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f4630fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f462c0b4f20 0x7f462c14ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:05.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f4630fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c1f3160 con 0x7f462c0b4f20 2023-07-09T21:53:05.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f4630fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0b53a0 con 0x7f462c0d0260 2023-07-09T21:53:05.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f4630fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c1f3580 con 0x7f462c0cda80 2023-07-09T21:53:05.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f462ad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f462c0b4f20 0x7f462c14ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:05.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f462ad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f462c0b4f20 0x7f462c14ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42760/0 (socket says 172.21.15.53:42760) 2023-07-09T21:53:05.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f462ad9d700 1 -- 172.21.15.53:0/1536206323 learned_addr learned my addr 172.21.15.53:0/1536206323 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:05.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f462a59c700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f462c0cda80 0x7f462c0b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:05.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f4623fff700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f462c0d0260 0x7f462c0b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:05.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f462ad9d700 1 -- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f462c0cda80 msgr2=0x7f462c0b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:05.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f462ad9d700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f462c0cda80 0x7f462c0b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f462ad9d700 1 -- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f462c0d0260 msgr2=0x7f462c0b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:05.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f462ad9d700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f462c0d0260 0x7f462c0b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.211+0000 7f462ad9d700 1 -- 172.21.15.53:0/1536206323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4614009550 con 0x7f462c0b4f20 2023-07-09T21:53:05.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.212+0000 7f462ad9d700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f462c0b4f20 0x7f462c14ecd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f462400cef0 tx=0x7f462400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:05.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.212+0000 7f4622ffd700 1 -- 172.21.15.53:0/1536206323 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462400ad00 con 0x7f462c0b4f20 2023-07-09T21:53:05.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.212+0000 7f4622ffd700 1 -- 172.21.15.53:0/1536206323 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462400ae60 con 0x7f462c0b4f20 2023-07-09T21:53:05.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.212+0000 7f4622ffd700 1 -- 172.21.15.53:0/1536206323 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624015680 con 0x7f462c0b4f20 2023-07-09T21:53:05.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.212+0000 7f4630fff700 1 -- 172.21.15.53:0/1536206323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c1f24e0 con 0x7f462c0b4f20 2023-07-09T21:53:05.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.212+0000 7f4630fff700 1 -- 172.21.15.53:0/1536206323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c1f2aa0 con 0x7f462c0b4f20 2023-07-09T21:53:05.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.213+0000 7f4630fff700 1 -- 172.21.15.53:0/1536206323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462c1f32a0 con 0x7f462c0b4f20 2023-07-09T21:53:05.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.214+0000 7f4622ffd700 1 -- 172.21.15.53:0/1536206323 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f46240157e0 con 0x7f462c0b4f20 2023-07-09T21:53:05.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.215+0000 7f4622ffd700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f460c06ae00 0x7f460c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:05.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.215+0000 7f4622ffd700 1 -- 172.21.15.53:0/1536206323 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f46240897b0 con 0x7f462c0b4f20 2023-07-09T21:53:05.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.216+0000 7f462a59c700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f460c06ae00 0x7f460c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:05.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.216+0000 7f462a59c700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f460c06ae00 0x7f460c06d2b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f461c00ab70 tx=0x7f461c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:05.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.219+0000 7f4622ffd700 1 -- 172.21.15.53:0/1536206323 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f462c1f32a0 con 0x7f462c0b4f20 2023-07-09T21:53:05.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.430+0000 7f4630fff700 1 -- 172.21.15.53:0/1536206323 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f462c0d1170 con 0x7f460c06ae00 2023-07-09T21:53:05.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.430+0000 7f4622ffd700 1 -- 172.21.15.53:0/1536206323 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f461c00c040 con 0x7f460c06ae00 2023-07-09T21:53:05.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.433+0000 7f4630fff700 1 -- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f460c06ae00 msgr2=0x7f460c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:05.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.433+0000 7f4630fff700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f460c06ae00 0x7f460c06d2b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f461c00ab70 tx=0x7f461c008040 comp rx=0 tx=0).stop 2023-07-09T21:53:05.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.433+0000 7f4630fff700 1 -- 172.21.15.53:0/1536206323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f462c0b4f20 msgr2=0x7f462c14ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:05.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.433+0000 7f4630fff700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f462c0b4f20 0x7f462c14ecd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f462400cef0 tx=0x7f462400cf20 comp rx=0 tx=0).stop 2023-07-09T21:53:05.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.433+0000 7f4630fff700 1 -- 172.21.15.53:0/1536206323 shutdown_connections 2023-07-09T21:53:05.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.433+0000 7f4630fff700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f460c06ae00 0x7f460c06d2b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.433+0000 7f4630fff700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f462c0b4f20 0x7f462c14ecd0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.433+0000 7f4630fff700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f462c0cda80 0x7f462c0b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.433+0000 7f4630fff700 1 --2- 172.21.15.53:0/1536206323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f462c0d0260 0x7f462c0b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.433+0000 7f4630fff700 1 -- 172.21.15.53:0/1536206323 >> 172.21.15.53:0/1536206323 conn(0x7f462c09c200 msgr2=0x7f462c0ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:05.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.433+0000 7f4630fff700 1 -- 172.21.15.53:0/1536206323 shutdown_connections 2023-07-09T21:53:05.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.433+0000 7f4630fff700 1 -- 172.21.15.53:0/1536206323 wait complete. 2023-07-09T21:53:05.439 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 7 to deep-scrub 2023-07-09T21:53:05.452 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:53:05.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.652+0000 7f28839ff700 1 Processor -- start 2023-07-09T21:53:05.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.653+0000 7f28839ff700 1 -- start start 2023-07-09T21:53:05.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f28839ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c0d1220 0x7f287c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:05.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f28839ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f287c0b2350 0x7f287c0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:05.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f28839ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c0d2ce0 con 0x7f287c0b1e00 2023-07-09T21:53:05.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f28839ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c0b3350 con 0x7f287c0b2350 2023-07-09T21:53:05.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f28839ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0b3630 con 0x7f287c0d1220 2023-07-09T21:53:05.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f2881f9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f287c0b2350 0x7f287c0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:05.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f2881f9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f287c0b2350 0x7f287c0afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42768/0 (socket says 172.21.15.53:42768) 2023-07-09T21:53:05.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f2881f9c700 1 -- 172.21.15.53:0/3016098258 learned_addr learned my addr 172.21.15.53:0/3016098258 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:05.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f2880f9a700 1 --2- 172.21.15.53:0/3016098258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c0d1220 0x7f287c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:05.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f2881f9c700 1 -- 172.21.15.53:0/3016098258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c0d1220 msgr2=0x7f287c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:05.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f2881f9c700 1 --2- 172.21.15.53:0/3016098258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c0d1220 0x7f287c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f2881f9c700 1 -- 172.21.15.53:0/3016098258 >> v1:172.21.15.184:6789/0 conn(0x7f287c0b1e00 legacy=0x7f287c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:05.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f2881f9c700 1 -- 172.21.15.53:0/3016098258 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0b3910 con 0x7f287c0b2350 2023-07-09T21:53:05.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.654+0000 7f2880f9a700 1 --2- 172.21.15.53:0/3016098258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c0d1220 0x7f287c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:53:05.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.655+0000 7f2881f9c700 1 --2- 172.21.15.53:0/3016098258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f287c0b2350 0x7f287c0afac0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2874009e50 tx=0x7f287400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c306f08b6d1c01b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:05.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.655+0000 7f2873fff700 1 -- 172.21.15.53:0/3016098258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400e070 con 0x7f287c0b2350 2023-07-09T21:53:05.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.655+0000 7f2873fff700 1 -- 172.21.15.53:0/3016098258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2874003a20 con 0x7f287c0b2350 2023-07-09T21:53:05.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.655+0000 7f2873fff700 1 -- 172.21.15.53:0/3016098258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874003dd0 con 0x7f287c0b2350 2023-07-09T21:53:05.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.655+0000 7f28839ff700 1 -- 172.21.15.53:0/3016098258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f287c0b2350 msgr2=0x7f287c0afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:05.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.655+0000 7f28839ff700 1 --2- 172.21.15.53:0/3016098258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f287c0b2350 0x7f287c0afac0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2874009e50 tx=0x7f287400b330 comp rx=0 tx=0).stop 2023-07-09T21:53:05.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.656+0000 7f28839ff700 1 -- 172.21.15.53:0/3016098258 shutdown_connections 2023-07-09T21:53:05.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.656+0000 7f28839ff700 1 --2- 172.21.15.53:0/3016098258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f287c0b2350 0x7f287c0afac0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.656+0000 7f28839ff700 1 --2- 172.21.15.53:0/3016098258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c0d1220 0x7f287c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.656+0000 7f28839ff700 1 -- 172.21.15.53:0/3016098258 >> 172.21.15.53:0/3016098258 conn(0x7f287c09c1d0 msgr2=0x7f287c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:05.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.656+0000 7f28839ff700 1 -- 172.21.15.53:0/3016098258 shutdown_connections 2023-07-09T21:53:05.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.656+0000 7f28839ff700 1 -- 172.21.15.53:0/3016098258 wait complete. 2023-07-09T21:53:05.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.657+0000 7f28839ff700 1 Processor -- start 2023-07-09T21:53:05.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.657+0000 7f28839ff700 1 -- start start 2023-07-09T21:53:05.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.658+0000 7f28839ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c0b1e00 0x7f287c155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:05.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.658+0000 7f28839ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f287c0b2350 0x7f287c0c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:05.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.658+0000 7f28839ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c0d1220 0x7f287c15af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:05.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.658+0000 7f28839ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1f1ef0 con 0x7f287c0b2350 2023-07-09T21:53:05.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.658+0000 7f28839ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1f2eb0 con 0x7f287c0d1220 2023-07-09T21:53:05.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.658+0000 7f28839ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1f2a20 con 0x7f287c0b1e00 2023-07-09T21:53:05.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.659+0000 7f2880f9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f287c0b2350 0x7f287c0c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:05.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.659+0000 7f2880f9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f287c0b2350 0x7f287c0c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42780/0 (socket says 172.21.15.53:42780) 2023-07-09T21:53:05.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.659+0000 7f2880f9a700 1 -- 172.21.15.53:0/1543463506 learned_addr learned my addr 172.21.15.53:0/1543463506 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:05.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.659+0000 7f288179b700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c0b1e00 0x7f287c155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:05.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.659+0000 7f2881f9c700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c0d1220 0x7f287c15af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:05.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.659+0000 7f2880f9a700 1 -- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c0b1e00 msgr2=0x7f287c155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:05.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.659+0000 7f2880f9a700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c0b1e00 0x7f287c155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.659+0000 7f2880f9a700 1 -- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c0d1220 msgr2=0x7f287c15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:05.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.659+0000 7f2880f9a700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c0d1220 0x7f287c15af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.659+0000 7f2880f9a700 1 -- 172.21.15.53:0/1543463506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874009b30 con 0x7f287c0b2350 2023-07-09T21:53:05.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.659+0000 7f288179b700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c0b1e00 0x7f287c155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:53:05.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.659+0000 7f2880f9a700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f287c0b2350 0x7f287c0c6a70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f286c00c820 tx=0x7f286c00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:05.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.660+0000 7f2871ffb700 1 -- 172.21.15.53:0/1543463506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c011800 con 0x7f287c0b2350 2023-07-09T21:53:05.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.660+0000 7f2871ffb700 1 -- 172.21.15.53:0/1543463506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c011960 con 0x7f287c0b2350 2023-07-09T21:53:05.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.660+0000 7f28839ff700 1 -- 172.21.15.53:0/1543463506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c0c7150 con 0x7f287c0b2350 2023-07-09T21:53:05.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.660+0000 7f2871ffb700 1 -- 172.21.15.53:0/1543463506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c011d10 con 0x7f287c0b2350 2023-07-09T21:53:05.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.660+0000 7f28839ff700 1 -- 172.21.15.53:0/1543463506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c1f23d0 con 0x7f287c0b2350 2023-07-09T21:53:05.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.661+0000 7f28839ff700 1 -- 172.21.15.53:0/1543463506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c04e280 con 0x7f287c0b2350 2023-07-09T21:53:05.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.662+0000 7f2871ffb700 1 -- 172.21.15.53:0/1543463506 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f286c018360 con 0x7f287c0b2350 2023-07-09T21:53:05.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.663+0000 7f2871ffb700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f286006ae00 0x7f286006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:05.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.663+0000 7f2871ffb700 1 -- 172.21.15.53:0/1543463506 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f286c0893d0 con 0x7f287c0b2350 2023-07-09T21:53:05.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.663+0000 7f288179b700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f286006ae00 0x7f286006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:05.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.664+0000 7f288179b700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f286006ae00 0x7f286006d2b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2878007fd0 tx=0x7f2878009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:05.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.667+0000 7f2871ffb700 1 -- 172.21.15.53:0/1543463506 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f286c057f30 con 0x7f287c0b2350 2023-07-09T21:53:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.873+0000 7f28839ff700 1 -- 172.21.15.53:0/1543463506 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f287c0b3ed0 con 0x7f286006ae00 2023-07-09T21:53:05.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.877+0000 7f2871ffb700 1 -- 172.21.15.53:0/1543463506 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72901 (secure 0 0 0) 0x7f28780068b0 con 0x7f286006ae00 2023-07-09T21:53:05.879 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:53:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.879+0000 7f28839ff700 1 -- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f286006ae00 msgr2=0x7f286006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.879+0000 7f28839ff700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f286006ae00 0x7f286006d2b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2878007fd0 tx=0x7f2878009040 comp rx=0 tx=0).stop 2023-07-09T21:53:05.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.879+0000 7f28839ff700 1 -- 172.21.15.53:0/1543463506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f287c0b2350 msgr2=0x7f287c0c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:05.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.879+0000 7f28839ff700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f287c0b2350 0x7f287c0c6a70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f286c00c820 tx=0x7f286c00cb30 comp rx=0 tx=0).stop 2023-07-09T21:53:05.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.879+0000 7f28839ff700 1 -- 172.21.15.53:0/1543463506 shutdown_connections 2023-07-09T21:53:05.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.879+0000 7f28839ff700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f286006ae00 0x7f286006d2b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.879+0000 7f28839ff700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c0d1220 0x7f287c15af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.879+0000 7f28839ff700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c0b1e00 0x7f287c155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.879+0000 7f28839ff700 1 --2- 172.21.15.53:0/1543463506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f287c0b2350 0x7f287c0c6a70 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:05.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.879+0000 7f28839ff700 1 -- 172.21.15.53:0/1543463506 >> 172.21.15.53:0/1543463506 conn(0x7f287c09c1d0 msgr2=0x7f287c0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:05.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.879+0000 7f28839ff700 1 -- 172.21.15.53:0/1543463506 shutdown_connections 2023-07-09T21:53:05.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:05.879+0000 7f28839ff700 1 -- 172.21.15.53:0/1543463506 wait complete. 2023-07-09T21:53:05.884 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:53:05.899 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-07-09T21:53:04.890206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":230056,"kb_used_data":6248,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754744664,"statfs":{"total":773094113280,"available":772858535936,"internally_reserved":0,"allocated":6397952,"data_stored":3440824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.225247"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:52:54.667389+0000","last_change":"2023-07-09T21:50:17.577615+0000","last_active":"2023-07-09T21:52:54.667389+0000","last_peered":"2023-07-09T21:52:54.667389+0000","last_clean":"2023-07-09T21:52:54.667389+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:52:54.667389+0000","last_undegraded":"2023-07-09T21:52:54.667389+0000","last_fullsized":"2023-07-09T21:52:54.667389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":78,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:52:54.669411+0000","last_change":"2023-07-09T21:50:17.538463+0000","last_active":"2023-07-09T21:52:54.669411+0000","last_peered":"2023-07-09T21:52:54.669411+0000","last_clean":"2023-07-09T21:52:54.669411+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:52:54.669411+0000","last_undegraded":"2023-07-09T21:52:54.669411+0000","last_fullsized":"2023-07-09T21:52:54.669411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:27:38.175130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:52:54.671864+0000","last_change":"2023-07-09T21:50:17.607575+0000","last_active":"2023-07-09T21:52:54.671864+0000","last_peered":"2023-07-09T21:52:54.671864+0000","last_clean":"2023-07-09T21:52:54.671864+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:52:54.671864+0000","last_undegraded":"2023-07-09T21:52:54.671864+0000","last_fullsized":"2023-07-09T21:52:54.671864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:52:54.670207+0000","last_change":"2023-07-09T21:50:17.538705+0000","last_active":"2023-07-09T21:52:54.670207+0000","last_peered":"2023-07-09T21:52:54.670207+0000","last_clean":"2023-07-09T21:52:54.670207+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:52:54.670207+0000","last_undegraded":"2023-07-09T21:52:54.670207+0000","last_fullsized":"2023-07-09T21:52:54.670207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:26.231366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":226,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:52:54.802731+0000","last_change":"2023-07-09T21:50:10.301144+0000","last_active":"2023-07-09T21:52:54.802731+0000","last_peered":"2023-07-09T21:52:54.802731+0000","last_clean":"2023-07-09T21:52:54.802731+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:52:54.802731+0000","last_undegraded":"2023-07-09T21:52:54.802731+0000","last_fullsized":"2023-07-09T21:52:54.802731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:09.129531+0000","last_clean_scrub_stamp":"2023-07-09T21:50:09.129531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:27:28.379822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:52:54.803345+0000","last_change":"2023-07-09T21:50:17.538333+0000","last_active":"2023-07-09T21:52:54.803345+0000","last_peered":"2023-07-09T21:52:54.803345+0000","last_clean":"2023-07-09T21:52:54.803345+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:52:54.803345+0000","last_undegraded":"2023-07-09T21:52:54.803345+0000","last_fullsized":"2023-07-09T21:52:54.803345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:59:19.118323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:52:54.802587+0000","last_change":"2023-07-09T21:50:17.577557+0000","last_active":"2023-07-09T21:52:54.802587+0000","last_peered":"2023-07-09T21:52:54.802587+0000","last_clean":"2023-07-09T21:52:54.802587+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:52:54.802587+0000","last_undegraded":"2023-07-09T21:52:54.802587+0000","last_fullsized":"2023-07-09T21:52:54.802587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:52:05.958396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":81,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:53:03.199679+0000","last_change":"2023-07-09T21:53:03.199719+0000","last_active":"2023-07-09T21:53:03.199679+0000","last_peered":"2023-07-09T21:53:03.199679+0000","last_clean":"2023-07-09T21:53:03.199679+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:53:03.199679+0000","last_undegraded":"2023-07-09T21:53:03.199679+0000","last_fullsized":"2023-07-09T21:53:03.199679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:53:03.199611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:53:03.199611+0000","last_clean_scrub_stamp":"2023-07-09T21:53:03.199611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:22:38.178523+0000","scrub_duration":0.0021238910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:52:54.800800+0000","last_change":"2023-07-09T21:50:17.546613+0000","last_active":"2023-07-09T21:52:54.800800+0000","last_peered":"2023-07-09T21:52:54.800800+0000","last_clean":"2023-07-09T21:52:54.800800+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:52:54.800800+0000","last_undegraded":"2023-07-09T21:52:54.800800+0000","last_fullsized":"2023-07-09T21:52:54.800800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:50:16.524754+0000","last_clean_scrub_stamp":"2023-07-09T21:50:16.524754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:25:59.899507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27588,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":651264,"data_stored":282511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95099999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.73999999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.45900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81999999999999995,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.622}]},{"osd":2,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.79000000000000004,"15min":0.82099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78700000000000003,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.84399999999999997,"15min":0.86499999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97099999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.60399999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92900000000000005,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89200000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.75900000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.65700000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":1.214,"15min":1.214},"last":0.67000000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.71199999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509478,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":651264,"data_stored":282511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52000000000000002,"15min":0.54000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55500000000000005,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.61399999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.53700000000000003,"15min":0.55600000000000005},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56699999999999995,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.60599999999999998,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.63300000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.68100000000000005,"15min":0.70899999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63400000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60399999999999998,"5min":3.129,"15min":3.129},"last":0.45300000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94499999999999995,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.998,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.64800000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91200000000000003,"5min":1.929,"15min":1.929},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.85099999999999998,"15min":0.86399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97599999999999998,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93500000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.95199999999999996,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.60499999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":2.766,"15min":2.766},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.93400000000000005,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.872}]}]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":651264,"data_stored":282511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":1.232,"15min":1.3700000000000001},"min":{"1min":0.28899999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":16.946000000000002,"15min":16.946000000000002},"last":0.438},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.93200000000000005,"15min":1.0089999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69099999999999995,"5min":9.5449999999999999,"15min":9.5449999999999999},"last":0.32600000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.92100000000000004,"15min":0.99399999999999999},"min":{"1min":0.38200000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65200000000000002,"5min":9.6950000000000003,"15min":9.6950000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.95099999999999996,"15min":1.0329999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63200000000000001,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.46300000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.995,"15min":1.077},"min":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69199999999999995,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.498},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.327,"15min":1.4630000000000001},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73599999999999999,"5min":17.004000000000001,"15min":17.004000000000001},"last":0.53100000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.048,"15min":1.1000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.081,"5min":6.2510000000000003,"15min":6.2510000000000003},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.2849999999999999,"15min":1.3680000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2050000000000001,"5min":9.6630000000000003,"15min":9.6630000000000003},"last":0.92000000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":1.091,"15min":1.139},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2370000000000001,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.2849999999999999,"15min":1.369},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.1619999999999999,"5min":9.5879999999999992,"15min":9.5879999999999992},"last":0.94699999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":1.2849999999999999,"15min":1.371},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.048,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":1.266,"15min":1.349},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0529999999999999,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":0.90600000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.2250000000000001,"15min":1.2969999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.103,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.1160000000000001,"15min":1.1659999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.163,"5min":6.2169999999999996,"15min":6.2169999999999996},"last":0.88200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542181,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1245184,"data_stored":872879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.92200000000000004,"15min":1.01},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55000000000000004,"5min":11.949999999999999,"15min":11.949999999999999},"last":0.436},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60199999999999998,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73899999999999999,"5min":1.212,"15min":1.212},"last":0.309},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.46300000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":1.4179999999999999,"15min":1.5720000000000001},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90900000000000003,"15min":0.97499999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65100000000000002,"5min":10.952,"15min":10.952},"last":0.50900000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":1.696,"15min":1.859},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":22.974,"15min":22.974},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":1.264,"15min":1.3520000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.97099999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52300000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":1.589,"15min":1.589},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.748,"5min":1.6890000000000001,"15min":1.8460000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":22.933,"15min":22.933},"last":0.81899999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93100000000000005,"5min":1.623,"15min":1.623},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.6830000000000001,"15min":1.8400000000000001},"min":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98199999999999998,"5min":22.867999999999999,"15min":22.867999999999999},"last":0.93100000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.1639999999999999,"15min":1.23},"min":{"1min":0.57499999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.93300000000000005,"5min":10.907999999999999,"15min":10.907999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83299999999999996,"15min":0.83999999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.99299999999999999,"5min":1.546,"15min":1.546},"last":0.91700000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1245184,"data_stored":872879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85799999999999998,"5min":1.464,"15min":1.464},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94999999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.53100000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89100000000000001,"5min":1.121,"15min":1.121},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.78600000000000003,"15min":0.80400000000000005},"min":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66300000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70799999999999996,"15min":0.71699999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.091,"15min":1.091},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96599999999999997,"5min":1.405,"15min":1.405},"last":0.58899999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.95399999999999996,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70399999999999996,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82799999999999996,"5min":1.341,"15min":1.341},"last":0.79800000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.443,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.871,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.77400000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88100000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.76100000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":651264,"data_stored":282511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57599999999999996,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.93799999999999994,"15min":1.022},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68200000000000005,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.53800000000000003,"5min":1.21,"15min":1.21},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.54900000000000004,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.505}]},{"osd":2,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60699999999999998,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.56100000000000005,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.016,"5min":1.258,"15min":1.258},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0049999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.78200000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95599999999999996,"5min":1.486,"15min":1.486},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98999999999999999,"5min":1.327,"15min":1.327},"last":0.73399999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":1.302,"15min":1.302},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.86199999999999999,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":0.751}]},{"osd":7,"last update":"Sun Jul 9 21:52:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.04,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.008,"5min":1.349,"15min":1.349},"last":0.875}]}]},{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":651264,"data_stored":282511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.74199999999999999,"15min":0.69999999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":7.9779999999999998,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":7.8650000000000002,"5min":7.8650000000000002,"15min":7.8650000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.421,"15min":1.421},"last":0.63}]},{"osd":2,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.73199999999999998,"15min":0.68200000000000005},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":7.9390000000000001,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88300000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.44900000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1799999999999999,"5min":1.597,"15min":1.597},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.93700000000000006,"5min":1.216,"15min":1.216},"last":0.57599999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91200000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0609999999999999,"5min":1.069,"15min":1.069},"last":0.59899999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":1.093,"15min":1.093},"last":0.754},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72099999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.038,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76800000000000002,"15min":0.76300000000000001},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.054,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.69899999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":651264,"data_stored":282511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.54400000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67800000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84799999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.755}]},{"osd":1,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.86399999999999999,"5min":1.113,"15min":1.113},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84199999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.82799999999999996}]},{"osd":2,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85599999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.46800000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.77000000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72899999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93400000000000005,"5min":1.018,"15min":1.018},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95099999999999996,"5min":1.171,"15min":1.171},"last":0.78300000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98199999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.754,"15min":0.749},"min":{"1min":0.56699999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96399999999999997,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.999,"5min":1.133,"15min":1.133},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.022,"5min":1.123,"15min":1.123},"last":0.70899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:53:05.951 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-09T21:50:16.524754+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=50, tm_sec=16, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=52, tm_sec=58, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T21:53:05.952 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-09T21:50:16.524754+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=50, tm_sec=16, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=52, tm_sec=58, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T21:53:05.952 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-07-09T21:50:16.524754+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=50, tm_sec=16, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=52, tm_sec=58, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T21:53:05.952 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-09T21:50:16.524754+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=50, tm_sec=16, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=52, tm_sec=58, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T21:53:05.953 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-09T21:50:09.129531+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=50, tm_sec=9, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=52, tm_sec=58, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T21:53:05.953 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-09T21:50:16.524754+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=50, tm_sec=16, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=52, tm_sec=58, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T21:53:05.953 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-09T21:50:16.524754+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=50, tm_sec=16, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=52, tm_sec=58, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T21:53:05.954 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-09T21:50:16.524754+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=50, tm_sec=16, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=52, tm_sec=58, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T21:53:05.954 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-09T21:53:11.466 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:53:11.472 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:53:25.955 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:53:26.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.167+0000 7f91c7fff700 1 Processor -- start 2023-07-09T21:53:26.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.167+0000 7f91c7fff700 1 -- start start 2023-07-09T21:53:26.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.168+0000 7f91c7fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f91c00d1220 0x7f91c00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:26.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.168+0000 7f91c7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91c00b2350 0x7f91c00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:26.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.168+0000 7f91c7fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c00d2ce0 con 0x7f91c00b1e00 2023-07-09T21:53:26.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.168+0000 7f91c7fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c00b3350 con 0x7f91c00d1220 2023-07-09T21:53:26.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.168+0000 7f91c7fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00b3630 con 0x7f91c00b2350 2023-07-09T21:53:26.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.169+0000 7f91c659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91c00b2350 0x7f91c00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:26.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.169+0000 7f91c559a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f91c00d1220 0x7f91c00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:26.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.169+0000 7f91c659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91c00b2350 0x7f91c00afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.53:56398/0 (socket says 172.21.15.53:56398) 2023-07-09T21:53:26.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.169+0000 7f91c659c700 1 -- 172.21.15.53:0/2254730141 learned_addr learned my addr 172.21.15.53:0/2254730141 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:26.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.169+0000 7f91c5d9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f91c00b1e00 0x7f91c00d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.53:60094/0 (socket says 172.21.15.53:60094) 2023-07-09T21:53:26.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.169+0000 7f91c659c700 1 -- 172.21.15.53:0/2254730141 >> v2:172.21.15.184:3300/0 conn(0x7f91c00d1220 msgr2=0x7f91c00b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:26.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.169+0000 7f91c659c700 1 --2- 172.21.15.53:0/2254730141 >> v2:172.21.15.184:3300/0 conn(0x7f91c00d1220 0x7f91c00b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.169+0000 7f91c659c700 1 -- 172.21.15.53:0/2254730141 >> v1:172.21.15.184:6789/0 conn(0x7f91c00b1e00 legacy=0x7f91c00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:26.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.169+0000 7f91c659c700 1 -- 172.21.15.53:0/2254730141 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c00b3910 con 0x7f91c00b2350 2023-07-09T21:53:26.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.169+0000 7f91c559a700 1 --2- 172.21.15.53:0/2254730141 >> v2:172.21.15.184:3300/0 conn(0x7f91c00d1220 0x7f91c00b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:53:26.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.170+0000 7f91c659c700 1 --2- 172.21.15.53:0/2254730141 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91c00b2350 0x7f91c00afac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009e50 tx=0x7f91b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f415275ce145c463 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:26.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.170+0000 7f91c4d99700 1 -- 172.21.15.53:0/2254730141 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800e070 con 0x7f91c00b2350 2023-07-09T21:53:26.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.170+0000 7f91c4d99700 1 -- 172.21.15.53:0/2254730141 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b800b910 con 0x7f91c00b2350 2023-07-09T21:53:26.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.170+0000 7f91c4d99700 1 -- 172.21.15.53:0/2254730141 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800bcc0 con 0x7f91c00b2350 2023-07-09T21:53:26.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.170+0000 7f91c7fff700 1 -- 172.21.15.53:0/2254730141 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91c00b2350 msgr2=0x7f91c00afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:26.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.170+0000 7f91c7fff700 1 --2- 172.21.15.53:0/2254730141 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91c00b2350 0x7f91c00afac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009e50 tx=0x7f91b800b330 comp rx=0 tx=0).stop 2023-07-09T21:53:26.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.171+0000 7f91c7fff700 1 -- 172.21.15.53:0/2254730141 shutdown_connections 2023-07-09T21:53:26.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.171+0000 7f91c7fff700 1 --2- 172.21.15.53:0/2254730141 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91c00b2350 0x7f91c00afac0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.171+0000 7f91c7fff700 1 --2- 172.21.15.53:0/2254730141 >> v2:172.21.15.184:3300/0 conn(0x7f91c00d1220 0x7f91c00b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.171+0000 7f91c7fff700 1 -- 172.21.15.53:0/2254730141 >> 172.21.15.53:0/2254730141 conn(0x7f91c009c1d0 msgr2=0x7f91c00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:26.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.171+0000 7f91c7fff700 1 -- 172.21.15.53:0/2254730141 shutdown_connections 2023-07-09T21:53:26.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.171+0000 7f91c7fff700 1 -- 172.21.15.53:0/2254730141 wait complete. 2023-07-09T21:53:26.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.172+0000 7f91c7fff700 1 Processor -- start 2023-07-09T21:53:26.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.173+0000 7f91c7fff700 1 -- start start 2023-07-09T21:53:26.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c7fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91c00b1e00 0x7f91c00c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:26.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91c00b2350 0x7f91c00c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:26.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00d1220 0x7f91c0154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:26.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c7fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0153d20 con 0x7f91c00d1220 2023-07-09T21:53:26.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c7fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c015db20 con 0x7f91c00b1e00 2023-07-09T21:53:26.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c7fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c015f260 con 0x7f91c00b2350 2023-07-09T21:53:26.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00d1220 0x7f91c0154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:26.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00d1220 0x7f91c0154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51992/0 (socket says 172.21.15.53:51992) 2023-07-09T21:53:26.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c659c700 1 -- 172.21.15.53:0/733363854 learned_addr learned my addr 172.21.15.53:0/733363854 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:26.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c5d9b700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91c00b1e00 0x7f91c00c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:26.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c559a700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91c00b2350 0x7f91c00c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:26.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c659c700 1 -- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91c00b2350 msgr2=0x7f91c00c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:26.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c659c700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91c00b2350 0x7f91c00c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c659c700 1 -- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91c00b1e00 msgr2=0x7f91c00c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:26.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c659c700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91c00b1e00 0x7f91c00c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.174+0000 7f91c659c700 1 -- 172.21.15.53:0/733363854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b00094a0 con 0x7f91c00d1220 2023-07-09T21:53:26.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.175+0000 7f91c659c700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00d1220 0x7f91c0154030 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f91c00b3770 tx=0x7f91b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:26.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.175+0000 7f91b67fc700 1 -- 172.21.15.53:0/733363854 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80048b0 con 0x7f91c00d1220 2023-07-09T21:53:26.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.175+0000 7f91b67fc700 1 -- 172.21.15.53:0/733363854 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b80099b0 con 0x7f91c00d1220 2023-07-09T21:53:26.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.175+0000 7f91c7fff700 1 -- 172.21.15.53:0/733363854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b8009b30 con 0x7f91c00d1220 2023-07-09T21:53:26.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.175+0000 7f91b67fc700 1 -- 172.21.15.53:0/733363854 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b801c680 con 0x7f91c00d1220 2023-07-09T21:53:26.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.175+0000 7f91c7fff700 1 -- 172.21.15.53:0/733363854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c015d1f0 con 0x7f91c00d1220 2023-07-09T21:53:26.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.176+0000 7f91a3fff700 1 -- 172.21.15.53:0/733363854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c00723e0 con 0x7f91c00d1220 2023-07-09T21:53:26.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.177+0000 7f91b67fc700 1 -- 172.21.15.53:0/733363854 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f91b801c7e0 con 0x7f91c00d1220 2023-07-09T21:53:26.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.178+0000 7f91b67fc700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f91a406ae30 0x7f91a406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:26.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.178+0000 7f91b67fc700 1 -- 172.21.15.53:0/733363854 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f91b808b080 con 0x7f91c00d1220 2023-07-09T21:53:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.178+0000 7f91c5d9b700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f91a406ae30 0x7f91a406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.179+0000 7f91c5d9b700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f91a406ae30 0x7f91a406d2e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f91bc000fb0 tx=0x7f91bc007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.182+0000 7f91b67fc700 1 -- 172.21.15.53:0/733363854 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f91b80bd310 con 0x7f91c00d1220 2023-07-09T21:53:26.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.383+0000 7f91a3fff700 1 -- 172.21.15.53:0/733363854 --> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91c00b3ed0 con 0x7f91a406ae30 2023-07-09T21:53:26.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.387+0000 7f91b67fc700 1 -- 172.21.15.53:0/733363854 <== mgr.4103 v2:172.21.15.184:6832/2043123506 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73042 (secure 0 0 0) 0x7f91bc001380 con 0x7f91a406ae30 2023-07-09T21:53:26.389 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:53:26.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.389+0000 7f91a3fff700 1 -- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f91a406ae30 msgr2=0x7f91a406d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:26.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.389+0000 7f91a3fff700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f91a406ae30 0x7f91a406d2e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f91bc000fb0 tx=0x7f91bc007ec0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.389+0000 7f91a3fff700 1 -- 172.21.15.53:0/733363854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00d1220 msgr2=0x7f91c0154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:26.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.389+0000 7f91a3fff700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00d1220 0x7f91c0154030 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f91c00b3770 tx=0x7f91b8004ad0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.389+0000 7f91a3fff700 1 -- 172.21.15.53:0/733363854 shutdown_connections 2023-07-09T21:53:26.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.389+0000 7f91a3fff700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f91a406ae30 0x7f91a406d2e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.389+0000 7f91a3fff700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00d1220 0x7f91c0154030 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.389+0000 7f91a3fff700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91c00b1e00 0x7f91c00c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.389+0000 7f91a3fff700 1 --2- 172.21.15.53:0/733363854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91c00b2350 0x7f91c00c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.389+0000 7f91a3fff700 1 -- 172.21.15.53:0/733363854 >> 172.21.15.53:0/733363854 conn(0x7f91c009c1d0 msgr2=0x7f91c00b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:26.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.389+0000 7f91a3fff700 1 -- 172.21.15.53:0/733363854 shutdown_connections 2023-07-09T21:53:26.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.389+0000 7f91a3fff700 1 -- 172.21.15.53:0/733363854 wait complete. 2023-07-09T21:53:26.393 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-07-09T21:53:26.409 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-07-09T21:53:24.895032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":230056,"kb_used_data":6248,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754744664,"statfs":{"total":773094113280,"available":772858535936,"internally_reserved":0,"allocated":6397952,"data_stored":3440824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002830"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":81,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:53:04.207229+0000","last_change":"2023-07-09T21:53:04.207296+0000","last_active":"2023-07-09T21:53:04.207229+0000","last_peered":"2023-07-09T21:53:04.207229+0000","last_clean":"2023-07-09T21:53:04.207229+0000","last_became_active":"2023-07-09T21:50:17.577263+0000","last_became_peered":"2023-07-09T21:50:17.577263+0000","last_unstale":"2023-07-09T21:53:04.207229+0000","last_undegraded":"2023-07-09T21:53:04.207229+0000","last_fullsized":"2023-07-09T21:53:04.207229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:53:04.207134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:53:04.207134+0000","last_clean_scrub_stamp":"2023-07-09T21:53:04.207134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:00:34.552739+0000","scrub_duration":0.0014443609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:53:06.030234+0000","last_change":"2023-07-09T21:53:06.030289+0000","last_active":"2023-07-09T21:53:06.030234+0000","last_peered":"2023-07-09T21:53:06.030234+0000","last_clean":"2023-07-09T21:53:06.030234+0000","last_became_active":"2023-07-09T21:50:17.538119+0000","last_became_peered":"2023-07-09T21:50:17.538119+0000","last_unstale":"2023-07-09T21:53:06.030234+0000","last_undegraded":"2023-07-09T21:53:06.030234+0000","last_fullsized":"2023-07-09T21:53:06.030234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:53:06.030130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:53:06.030130+0000","last_clean_scrub_stamp":"2023-07-09T21:53:06.030130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:55.463772+0000","scrub_duration":0.0020932609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":87,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:53:04.092433+0000","last_change":"2023-07-09T21:53:04.092470+0000","last_active":"2023-07-09T21:53:04.092433+0000","last_peered":"2023-07-09T21:53:04.092433+0000","last_clean":"2023-07-09T21:53:04.092433+0000","last_became_active":"2023-07-09T21:50:17.607256+0000","last_became_peered":"2023-07-09T21:50:17.607256+0000","last_unstale":"2023-07-09T21:53:04.092433+0000","last_undegraded":"2023-07-09T21:53:04.092433+0000","last_fullsized":"2023-07-09T21:53:04.092433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:53:04.092360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:53:04.092360+0000","last_clean_scrub_stamp":"2023-07-09T21:53:04.092360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:38:39.327131+0000","scrub_duration":0.001361782,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:53:05.021308+0000","last_change":"2023-07-09T21:53:05.021356+0000","last_active":"2023-07-09T21:53:05.021308+0000","last_peered":"2023-07-09T21:53:05.021308+0000","last_clean":"2023-07-09T21:53:05.021308+0000","last_became_active":"2023-07-09T21:50:17.538169+0000","last_became_peered":"2023-07-09T21:50:17.538169+0000","last_unstale":"2023-07-09T21:53:05.021308+0000","last_undegraded":"2023-07-09T21:53:05.021308+0000","last_fullsized":"2023-07-09T21:53:05.021308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:53:05.021218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:53:05.021218+0000","last_clean_scrub_stamp":"2023-07-09T21:53:05.021218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:10:23.562098+0000","scrub_duration":0.001679128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"55'119","reported_seq":237,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:53:06.436902+0000","last_change":"2023-07-09T21:53:06.436971+0000","last_active":"2023-07-09T21:53:06.436902+0000","last_peered":"2023-07-09T21:53:06.436902+0000","last_clean":"2023-07-09T21:53:06.436902+0000","last_became_active":"2023-07-09T21:50:10.299845+0000","last_became_peered":"2023-07-09T21:50:10.299845+0000","last_unstale":"2023-07-09T21:53:06.436902+0000","last_undegraded":"2023-07-09T21:53:06.436902+0000","last_fullsized":"2023-07-09T21:53:06.436902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'119","last_scrub_stamp":"2023-07-09T21:53:06.436786+0000","last_deep_scrub":"55'119","last_deep_scrub_stamp":"2023-07-09T21:53:06.436786+0000","last_clean_scrub_stamp":"2023-07-09T21:53:06.436786+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:02:15.934620+0000","scrub_duration":0.0052051290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:53:11.362566+0000","last_change":"2023-07-09T21:53:11.362617+0000","last_active":"2023-07-09T21:53:11.362566+0000","last_peered":"2023-07-09T21:53:11.362566+0000","last_clean":"2023-07-09T21:53:11.362566+0000","last_became_active":"2023-07-09T21:50:17.538058+0000","last_became_peered":"2023-07-09T21:50:17.538058+0000","last_unstale":"2023-07-09T21:53:11.362566+0000","last_undegraded":"2023-07-09T21:53:11.362566+0000","last_fullsized":"2023-07-09T21:53:11.362566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:53:11.362465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:53:11.362465+0000","last_clean_scrub_stamp":"2023-07-09T21:53:11.362465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:09:46.949132+0000","scrub_duration":0.0024836440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:53:08.355980+0000","last_change":"2023-07-09T21:53:08.356032+0000","last_active":"2023-07-09T21:53:08.355980+0000","last_peered":"2023-07-09T21:53:08.355980+0000","last_clean":"2023-07-09T21:53:08.355980+0000","last_became_active":"2023-07-09T21:50:17.577217+0000","last_became_peered":"2023-07-09T21:50:17.577217+0000","last_unstale":"2023-07-09T21:53:08.355980+0000","last_undegraded":"2023-07-09T21:53:08.355980+0000","last_fullsized":"2023-07-09T21:53:08.355980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:53:08.355878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:53:08.355878+0000","last_clean_scrub_stamp":"2023-07-09T21:53:08.355878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:13:09.053178+0000","scrub_duration":0.0023309030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":81,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:53:03.199679+0000","last_change":"2023-07-09T21:53:03.199719+0000","last_active":"2023-07-09T21:53:03.199679+0000","last_peered":"2023-07-09T21:53:03.199679+0000","last_clean":"2023-07-09T21:53:03.199679+0000","last_became_active":"2023-07-09T21:50:17.546314+0000","last_became_peered":"2023-07-09T21:50:17.546314+0000","last_unstale":"2023-07-09T21:53:03.199679+0000","last_undegraded":"2023-07-09T21:53:03.199679+0000","last_fullsized":"2023-07-09T21:53:03.199679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:53:03.199611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:53:03.199611+0000","last_clean_scrub_stamp":"2023-07-09T21:53:03.199611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:22:38.178523+0000","scrub_duration":0.0021238910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-07-09T21:53:06.140361+0000","last_change":"2023-07-09T21:53:06.140408+0000","last_active":"2023-07-09T21:53:06.140361+0000","last_peered":"2023-07-09T21:53:06.140361+0000","last_clean":"2023-07-09T21:53:06.140361+0000","last_became_active":"2023-07-09T21:50:17.546267+0000","last_became_peered":"2023-07-09T21:50:17.546267+0000","last_unstale":"2023-07-09T21:53:06.140361+0000","last_undegraded":"2023-07-09T21:53:06.140361+0000","last_fullsized":"2023-07-09T21:53:06.140361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:53:06.140270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:53:06.140270+0000","last_clean_scrub_stamp":"2023-07-09T21:53:06.140270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:48:04.730797+0000","scrub_duration":0.001708469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27588,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":651264,"data_stored":282511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.42599999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77300000000000002,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.72699999999999998,"15min":0.67100000000000004},"min":{"1min":0.52800000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":7.9660000000000002,"5min":7.9660000000000002,"15min":7.9660000000000002},"last":0.74299999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.78200000000000003,"15min":0.83499999999999996},"min":{"1min":0.51000000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80900000000000005,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.87},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.49199999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85599999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.88800000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.54200000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":8.0030000000000001,"5min":8.0030000000000001,"15min":8.0030000000000001},"last":0.628},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.57299999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.89400000000000002,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.64700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.503,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.76800000000000002,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.0820000000000001,"5min":0.80000000000000004,"15min":0.76100000000000001},"min":{"1min":0.624,"5min":0.496,"15min":0.496},"max":{"1min":8.0640000000000001,"5min":8.0640000000000001,"15min":8.0640000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.93300000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.47399999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68200000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68600000000000005,"15min":0.69999999999999996},"min":{"1min":0.44500000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89000000000000001,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.746,"15min":0.755},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98099999999999998,"5min":1.214,"15min":1.214},"last":0.91100000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.46300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77900000000000003,"15min":0.80000000000000004},"min":{"1min":0.49399999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.93100000000000005,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.92600000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":651264,"data_stored":282511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.49099999999999999,"15min":0.53000000000000003},"min":{"1min":0.29199999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.46899999999999997,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.56200000000000006},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61899999999999999,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.51300000000000001,"15min":0.54800000000000004},"min":{"1min":0.32500000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.621,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58799999999999997,"15min":0.622},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.3180000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.64700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.64500000000000002,"15min":0.69699999999999995},"min":{"1min":0.42499999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66900000000000004,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.57999999999999996,"15min":0.626},"min":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.629,"5min":3.129,"15min":3.129},"last":0.71499999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.92000000000000004,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.82699999999999996,"15min":0.85999999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.389,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.98799999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.99199999999999999,"5min":1.929,"15min":1.929},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.82499999999999996,"15min":0.85499999999999998},"min":{"1min":0.55500000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98999999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.81100000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78300000000000003,"15min":0.78000000000000003},"min":{"1min":0.55500000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0389999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84999999999999998,"15min":0.88600000000000001},"min":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0529999999999999,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.876}]},{"osd":7,"last update":"Sun Jul 9 21:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.85599999999999998,"15min":0.88},"min":{"1min":0.68400000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.446,"5min":2.766,"15min":2.766},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.80300000000000005,"15min":0.81499999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.97199999999999998,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.92900000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":651264,"data_stored":282511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":1.028,"15min":1.302},"min":{"1min":0.28399999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86399999999999999,"5min":16.946000000000002,"15min":16.946000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.81599999999999995,"15min":0.96999999999999997},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66500000000000004,"5min":9.5449999999999999,"15min":9.5449999999999999},"last":0.55200000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.81299999999999994,"15min":0.95799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65000000000000002,"5min":9.6950000000000003,"15min":9.6950000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.82799999999999996,"15min":0.99199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69799999999999995,"5min":9.3659999999999997,"15min":9.3659999999999997},"last":0.61199999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.872,"15min":1.036},"min":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81999999999999995,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":1.1240000000000001,"15min":1.3959999999999999},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.081,"5min":17.004000000000001,"15min":17.004000000000001},"last":0.44700000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.97499999999999998,"15min":1.0760000000000001},"min":{"1min":0.502,"5min":0.501,"15min":0.501},"max":{"1min":1.1200000000000001,"5min":6.2510000000000003,"15min":6.2510000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.747,"5min":1.1519999999999999,"15min":1.3240000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.97099999999999997,"5min":9.6630000000000003,"15min":9.6630000000000003},"last":0.80700000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":1.014,"15min":1.113},"min":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1839999999999999,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":1.1559999999999999,"15min":1.3260000000000001},"min":{"1min":0.55600000000000005,"5min":0.498,"15min":0.498},"max":{"1min":0.94699999999999995,"5min":9.5879999999999992,"15min":9.5879999999999992},"last":0.70899999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":1.153,"15min":1.327},"min":{"1min":0.60699999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.93400000000000005,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.745},{"interface":"front","average":{"1min":0.755,"5min":1.1379999999999999,"15min":1.306},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92200000000000004,"5min":9.2319999999999993,"15min":9.2319999999999993},"last":0.82399999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":1.1040000000000001,"15min":1.2569999999999999},"min":{"1min":0.53300000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.96799999999999997,"5min":9.3190000000000008,"15min":9.3190000000000008},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":1.032,"15min":1.1379999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.2050000000000001,"5min":6.2169999999999996,"15min":6.2169999999999996},"last":0.84499999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1245184,"data_stored":872879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.82299999999999995,"15min":0.97699999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":3.4849999999999999,"5min":11.949999999999999,"15min":11.949999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53600000000000003,"15min":0.55600000000000005},"min":{"1min":0.38300000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60599999999999998,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.49399999999999999,"15min":0.495},"min":{"1min":0.309,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.66700000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.2330000000000001,"15min":1.51},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.9569999999999999,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.85399999999999998,"15min":0.95599999999999996},"min":{"1min":0.39200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.226,"5min":10.952,"15min":10.952},"last":0.59199999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.4970000000000001,"15min":1.7929999999999999},"min":{"1min":0.59199999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":3.1349999999999998,"5min":22.974,"15min":22.974},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.1799999999999999,"15min":1.3240000000000001},"min":{"1min":0.622,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.2109999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":1.137}]},{"osd":5,"last update":"Sun Jul 9 21:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.77000000000000002},"min":{"1min":0.58399999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94699999999999995,"5min":1.589,"15min":1.589},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":1.4930000000000001,"15min":1.7809999999999999},"min":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":3.2450000000000001,"5min":22.933,"15min":22.933},"last":1.077}]},{"osd":6,"last update":"Sun Jul 9 21:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0049999999999999,"5min":1.623,"15min":1.623},"last":1.369},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.4890000000000001,"15min":1.7749999999999999},"min":{"1min":0.64100000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.1749999999999998,"5min":22.867999999999999,"15min":22.867999999999999},"last":1.0269999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":1.075,"15min":1.2010000000000001},"min":{"1min":0.56599999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.4339999999999999,"5min":10.907999999999999,"15min":10.907999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82599999999999996,"15min":0.83799999999999997},"min":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0960000000000001,"5min":1.546,"15min":1.546},"last":1.419}]}]},{"osd":7,"up_from":14,"seq":60129542186,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1245184,"data_stored":872879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.49399999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92300000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.57699999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.69599999999999995,"15min":0.72999999999999998},"min":{"1min":0.41199999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86799999999999999,"5min":1.464,"15min":1.464},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.47699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93799999999999994,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.76300000000000001},"min":{"1min":0.53700000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0449999999999999,"5min":1.121,"15min":1.121},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76200000000000001,"15min":0.79600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.052,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.70799999999999996,"15min":0.71699999999999997},"min":{"1min":0.51800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.022,"5min":1.091,"15min":1.091},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77200000000000002,"15min":0.80400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95699999999999996,"5min":1.405,"15min":1.405},"last":0.63800000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68600000000000005,"15min":0.70799999999999996},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86099999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69099999999999995,"15min":0.71099999999999997},"min":{"1min":0.497,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81100000000000005,"5min":1.341,"15min":1.341},"last":0.68600000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.68400000000000005},"min":{"1min":0.47699999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.872,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.50900000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0029999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.86899999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78900000000000003,"15min":0.80700000000000005},"min":{"1min":0.64900000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97499999999999998,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.629,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0209999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.84599999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":651264,"data_stored":282511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45900000000000002,"15min":0.46899999999999997},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.82599999999999996,"15min":0.98399999999999999},"min":{"1min":0.34599999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77900000000000003,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.65200000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69699999999999995,"5min":1.21,"15min":1.21},"last":0.621},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.98599999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.44500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0349999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53500000000000003,"15min":0.55100000000000005},"min":{"1min":0.39100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74199999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.59299999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.745,"15min":0.75},"min":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.91600000000000004,"5min":1.258,"15min":1.258},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77800000000000002,"15min":0.77900000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1120000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.92300000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.123,"5min":1.486,"15min":1.486},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0569999999999999,"5min":1.327,"15min":1.327},"last":0.76500000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76200000000000001,"15min":0.76900000000000002},"min":{"1min":0.49099999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.077,"5min":1.302,"15min":1.302},"last":0.997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.86399999999999999,"15min":0.82799999999999996},"min":{"1min":0.60099999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2330000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":1.0189999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79300000000000004,"15min":0.80000000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1020000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78200000000000003,"15min":0.79100000000000004},"min":{"1min":0.58999999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1,"5min":1.349,"15min":1.349},"last":0.94599999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":651264,"data_stored":282511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.73099999999999998,"15min":0.69699999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92200000000000004,"5min":7.9779999999999998,"15min":7.9779999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82299999999999995,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.77300000000000002,"15min":0.746},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91500000000000004,"5min":7.8650000000000002,"15min":7.8650000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.752,"15min":0.76500000000000001},"min":{"1min":0.59099999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88600000000000001,"5min":1.421,"15min":1.421},"last":0.76500000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.72999999999999998,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84899999999999998,"5min":7.9390000000000001,"15min":7.9390000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71499999999999997,"15min":0.72799999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88300000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.78500000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94699999999999995,"5min":1.597,"15min":1.597},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.745,"15min":0.76400000000000001},"min":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.86599999999999999,"5min":1.216,"15min":1.216},"last":0.71599999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63100000000000001,"15min":0.61899999999999999},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65700000000000003,"15min":0.64700000000000002},"min":{"1min":0.47199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.016,"5min":1.069,"15min":1.069},"last":0.55300000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71599999999999997,"15min":0.70799999999999996},"min":{"1min":0.49199999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0529999999999999,"5min":1.093,"15min":1.093},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.54000000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0629999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.624}]},{"osd":7,"last update":"Sun Jul 9 21:53:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98199999999999998,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.77800000000000002,"15min":0.76600000000000001},"min":{"1min":0.64300000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.079,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.64300000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":651264,"data_stored":282511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64900000000000002,"15min":0.64300000000000002},"min":{"1min":0.53600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80200000000000005,"5min":0.88,"15min":0.88},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65900000000000003,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79500000000000004,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.70399999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68999999999999995,"15min":0.70499999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86799999999999999,"5min":1.113,"15min":1.113},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.64900000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71899999999999997,"15min":0.73899999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83099999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73299999999999998,"15min":0.74299999999999999},"min":{"1min":0.48899999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.874,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72299999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.72799999999999998,"15min":0.75900000000000001},"min":{"1min":0.502,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.85399999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.66000000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.68400000000000005,"15min":0.70399999999999996},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73099999999999998,"5min":1.018,"15min":1.018},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84499999999999997,"5min":1.171,"15min":1.171},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.747,"15min":0.76200000000000001},"min":{"1min":0.48599999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91600000000000004,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.749,"15min":0.747},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1020000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.46000000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.47099999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84899999999999998,"5min":1.133,"15min":1.133},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80100000000000005,"15min":0.82099999999999995},"min":{"1min":0.53000000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88900000000000001,"5min":1.123,"15min":1.123},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:53:26.412 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-09T21:53:26.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.605+0000 7f2dd11ff700 1 Processor -- start 2023-07-09T21:53:26.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.605+0000 7f2dd11ff700 1 -- start start 2023-07-09T21:53:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.606+0000 7f2dd11ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2dcc0b3ff0 0x7f2dcc0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:26.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.606+0000 7f2dd11ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2dcc0d0f90 0x7f2dcc0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:26.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.606+0000 7f2dd11ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dcc0b8e80 con 0x7f2dcc0d0b10 2023-07-09T21:53:26.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.606+0000 7f2dd11ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dcc0b1e30 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.606+0000 7f2dd11ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dcc0afaa0 con 0x7f2dcc0b3ff0 2023-07-09T21:53:26.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.607+0000 7f2dcb59e700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2dcc0d0f90 0x7f2dcc0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:26.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.607+0000 7f2dcb59e700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2dcc0d0f90 0x7f2dcc0b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51996/0 (socket says 172.21.15.53:51996) 2023-07-09T21:53:26.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.607+0000 7f2dcb59e700 1 -- 172.21.15.53:0/2799635134 learned_addr learned my addr 172.21.15.53:0/2799635134 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:26.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.607+0000 7f2dcad9d700 1 --2- 172.21.15.53:0/2799635134 >> v2:172.21.15.184:3300/0 conn(0x7f2dcc0b3ff0 0x7f2dcc0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:26.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.607+0000 7f2dcb59e700 1 -- 172.21.15.53:0/2799635134 >> v2:172.21.15.184:3300/0 conn(0x7f2dcc0b3ff0 msgr2=0x7f2dcc0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:53:26.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.607+0000 7f2dcb59e700 1 --2- 172.21.15.53:0/2799635134 >> v2:172.21.15.184:3300/0 conn(0x7f2dcc0b3ff0 0x7f2dcc0b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.607+0000 7f2dcb59e700 1 -- 172.21.15.53:0/2799635134 >> v1:172.21.15.184:6789/0 conn(0x7f2dcc0d0b10 legacy=0x7f2dcc0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:26.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.607+0000 7f2dcb59e700 1 -- 172.21.15.53:0/2799635134 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc0afd80 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.607+0000 7f2dcb59e700 1 --2- 172.21.15.53:0/2799635134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dcc0d0f90 0x7f2dcc0b2ce0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0b5b00 tx=0x7f2dc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208b26301cc43e8e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:26.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.607+0000 7f2dc9d9b700 1 -- 172.21.15.53:0/2799635134 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc400e070 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.608+0000 7f2dc9d9b700 1 -- 172.21.15.53:0/2799635134 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc400b910 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.608+0000 7f2dc9d9b700 1 -- 172.21.15.53:0/2799635134 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc400bcc0 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.608+0000 7f2dd11ff700 1 -- 172.21.15.53:0/2799635134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dcc0d0f90 msgr2=0x7f2dcc0b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:26.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.608+0000 7f2dd11ff700 1 --2- 172.21.15.53:0/2799635134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dcc0d0f90 0x7f2dcc0b2ce0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0b5b00 tx=0x7f2dc400b330 comp rx=0 tx=0).stop 2023-07-09T21:53:26.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.608+0000 7f2dd11ff700 1 -- 172.21.15.53:0/2799635134 shutdown_connections 2023-07-09T21:53:26.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.608+0000 7f2dd11ff700 1 --2- 172.21.15.53:0/2799635134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dcc0d0f90 0x7f2dcc0b2ce0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.608+0000 7f2dd11ff700 1 --2- 172.21.15.53:0/2799635134 >> v2:172.21.15.184:3300/0 conn(0x7f2dcc0b3ff0 0x7f2dcc0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.608+0000 7f2dd11ff700 1 -- 172.21.15.53:0/2799635134 >> 172.21.15.53:0/2799635134 conn(0x7f2dcc09c1b0 msgr2=0x7f2dcc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:26.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.608+0000 7f2dd11ff700 1 -- 172.21.15.53:0/2799635134 shutdown_connections 2023-07-09T21:53:26.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.608+0000 7f2dd11ff700 1 -- 172.21.15.53:0/2799635134 wait complete. 2023-07-09T21:53:26.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.610+0000 7f2dd11ff700 1 Processor -- start 2023-07-09T21:53:26.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.610+0000 7f2dd11ff700 1 -- start start 2023-07-09T21:53:26.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.611+0000 7f2dd11ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dcc0b3ff0 0x7f2dcc0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:26.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.611+0000 7f2dd11ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dcc0d0b10 0x7f2dcc14c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:26.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.611+0000 7f2dd11ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dcc0d0f90 0x7f2dcc0b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.611+0000 7f2dd11ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc14cab0 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.611+0000 7f2dd11ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc14cd90 con 0x7f2dcc0d0b10 2023-07-09T21:53:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.612+0000 7f2dd11ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc14d070 con 0x7f2dcc0b3ff0 2023-07-09T21:53:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.612+0000 7f2dcb59e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dcc0d0f90 0x7f2dcc0b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.612+0000 7f2dcb59e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dcc0d0f90 0x7f2dcc0b7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52008/0 (socket says 172.21.15.53:52008) 2023-07-09T21:53:26.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.612+0000 7f2dcb59e700 1 -- 172.21.15.53:0/4028959598 learned_addr learned my addr 172.21.15.53:0/4028959598 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:26.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.612+0000 7f2dcad9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dcc0b3ff0 0x7f2dcc0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:26.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.612+0000 7f2dca59c700 1 --2- 172.21.15.53:0/4028959598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dcc0d0b10 0x7f2dcc14c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:26.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.612+0000 7f2dcb59e700 1 -- 172.21.15.53:0/4028959598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dcc0b3ff0 msgr2=0x7f2dcc0ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:26.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.612+0000 7f2dcb59e700 1 --2- 172.21.15.53:0/4028959598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dcc0b3ff0 0x7f2dcc0ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.612+0000 7f2dcb59e700 1 -- 172.21.15.53:0/4028959598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dcc0d0b10 msgr2=0x7f2dcc14c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:26.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.612+0000 7f2dcb59e700 1 --2- 172.21.15.53:0/4028959598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dcc0d0b10 0x7f2dcc14c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.612+0000 7f2dcb59e700 1 -- 172.21.15.53:0/4028959598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc4009b30 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.613+0000 7f2dcb59e700 1 --2- 172.21.15.53:0/4028959598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dcc0d0f90 0x7f2dcc0b7130 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0681d0 tx=0x7f2dc4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:26.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.613+0000 7f2db37fe700 1 -- 172.21.15.53:0/4028959598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4004880 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.613+0000 7f2db37fe700 1 -- 172.21.15.53:0/4028959598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc40099b0 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.613+0000 7f2db37fe700 1 -- 172.21.15.53:0/4028959598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc401b670 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.613+0000 7f2dd11ff700 1 -- 172.21.15.53:0/4028959598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dcc14d350 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.613+0000 7f2dd11ff700 1 -- 172.21.15.53:0/4028959598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc0b7670 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.614+0000 7f2dd11ff700 1 -- 172.21.15.53:0/4028959598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dcc074350 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.615+0000 7f2db37fe700 1 -- 172.21.15.53:0/4028959598 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f2dc401b7d0 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.616+0000 7f2db37fe700 1 --2- 172.21.15.53:0/4028959598 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2db806ae00 0x7f2db806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:26.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.616+0000 7f2db37fe700 1 -- 172.21.15.53:0/4028959598 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f2dc408a970 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.616+0000 7f2dcad9d700 1 --2- 172.21.15.53:0/4028959598 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2db806ae00 0x7f2db806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:26.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.617+0000 7f2dcad9d700 1 --2- 172.21.15.53:0/4028959598 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2db806ae00 0x7f2db806d2b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc1f59f0 tx=0x7f2dbc009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:26.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.620+0000 7f2db37fe700 1 -- 172.21.15.53:0/4028959598 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2dc4055a40 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.828+0000 7f2dd11ff700 1 -- 172.21.15.53:0/4028959598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2dcc0d1b00 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.832+0000 7f2db37fe700 1 -- 172.21.15.53:0/4028959598 <== mon.0 v2:172.21.15.53:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2dc4055a40 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.832+0000 7f2db37fe700 1 -- 172.21.15.53:0/4028959598 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2dc4059060 con 0x7f2dcc0d0f90 2023-07-09T21:53:26.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.835+0000 7f2dd11ff700 1 -- 172.21.15.53:0/4028959598 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2db806ae00 msgr2=0x7f2db806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:26.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.835+0000 7f2dd11ff700 1 --2- 172.21.15.53:0/4028959598 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2db806ae00 0x7f2db806d2b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc1f59f0 tx=0x7f2dbc009210 comp rx=0 tx=0).stop 2023-07-09T21:53:26.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.835+0000 7f2dd11ff700 1 -- 172.21.15.53:0/4028959598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dcc0d0f90 msgr2=0x7f2dcc0b7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:26.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.835+0000 7f2dd11ff700 1 --2- 172.21.15.53:0/4028959598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dcc0d0f90 0x7f2dcc0b7130 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0681d0 tx=0x7f2dc4004ad0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.835+0000 7f2dd11ff700 1 -- 172.21.15.53:0/4028959598 shutdown_connections 2023-07-09T21:53:26.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.835+0000 7f2dd11ff700 1 --2- 172.21.15.53:0/4028959598 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2db806ae00 0x7f2db806d2b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.835+0000 7f2dd11ff700 1 --2- 172.21.15.53:0/4028959598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dcc0d0f90 0x7f2dcc0b7130 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.835+0000 7f2dd11ff700 1 --2- 172.21.15.53:0/4028959598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dcc0b3ff0 0x7f2dcc0ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.835+0000 7f2dd11ff700 1 --2- 172.21.15.53:0/4028959598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dcc0d0b10 0x7f2dcc14c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:26.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.835+0000 7f2dd11ff700 1 -- 172.21.15.53:0/4028959598 >> 172.21.15.53:0/4028959598 conn(0x7f2dcc09c1b0 msgr2=0x7f2dcc06b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:26.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.836+0000 7f2dd11ff700 1 -- 172.21.15.53:0/4028959598 shutdown_connections 2023-07-09T21:53:26.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:26.836+0000 7f2dd11ff700 1 -- 172.21.15.53:0/4028959598 wait complete. 2023-07-09T21:53:26.854 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T21:53:26.855 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:53:27.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.054+0000 7f2cda3ff700 1 Processor -- start 2023-07-09T21:53:27.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.054+0000 7f2cda3ff700 1 -- start start 2023-07-09T21:53:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.055+0000 7f2cda3ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2cd40b1e00 0x7f2cd40b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.056+0000 7f2cda3ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd40d2ce0 con 0x7f2cd40b2350 2023-07-09T21:53:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.056+0000 7f2cda3ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd40b3350 con 0x7f2cd40d1220 2023-07-09T21:53:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.056+0000 7f2cda3ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd40b3630 con 0x7f2cd40b1e00 2023-07-09T21:53:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.056+0000 7f2cd37fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2cd40b2350 0x7f2cd40d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49758/0 (socket says 172.21.15.53:49758) 2023-07-09T21:53:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.056+0000 7f2cd37fe700 1 -- 172.21.15.53:0/3895937608 learned_addr learned my addr 172.21.15.53:0/3895937608 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-07-09T21:53:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.056+0000 7f2cd3fff700 1 --2- 172.21.15.53:0/3895937608 >> v2:172.21.15.53:3300/0 conn(0x7f2cd40b1e00 0x7f2cd40b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.056+0000 7f2cd2ffd700 1 -- 172.21.15.53:0/3895937608 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802907034 0 0) 0x7f2cd40d2ce0 con 0x7f2cd40b2350 2023-07-09T21:53:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.056+0000 7f2cd2ffd700 1 -- 172.21.15.53:0/3895937608 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cbc0035b0 con 0x7f2cd40b2350 2023-07-09T21:53:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.056+0000 7f2cd3fff700 1 -- 172.21.15.53:0/3895937608 >> v1:172.21.15.184:6789/0 conn(0x7f2cd40d1220 legacy=0x7f2cd40afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.056+0000 7f2cd3fff700 1 -- 172.21.15.53:0/3895937608 >> v1:172.21.15.53:6789/0 conn(0x7f2cd40b2350 legacy=0x7f2cd40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.056+0000 7f2cd3fff700 1 -- 172.21.15.53:0/3895937608 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd40b3910 con 0x7f2cd40b1e00 2023-07-09T21:53:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.057+0000 7f2cd3fff700 1 --2- 172.21.15.53:0/3895937608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cd40b1e00 0x7f2cd40b43f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009820 tx=0x7f2cc4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a930d222e6ebe4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.057+0000 7f2cd2ffd700 1 -- 172.21.15.53:0/3895937608 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4005e30 con 0x7f2cd40b1e00 2023-07-09T21:53:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.057+0000 7f2cd2ffd700 1 -- 172.21.15.53:0/3895937608 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2cc4006030 con 0x7f2cd40b1e00 2023-07-09T21:53:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.057+0000 7f2cd2ffd700 1 -- 172.21.15.53:0/3895937608 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40063e0 con 0x7f2cd40b1e00 2023-07-09T21:53:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.057+0000 7f2cda3ff700 1 -- 172.21.15.53:0/3895937608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cd40b1e00 msgr2=0x7f2cd40b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.057+0000 7f2cda3ff700 1 --2- 172.21.15.53:0/3895937608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cd40b1e00 0x7f2cd40b43f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009820 tx=0x7f2cc4009b30 comp rx=0 tx=0).stop 2023-07-09T21:53:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.057+0000 7f2cda3ff700 1 -- 172.21.15.53:0/3895937608 shutdown_connections 2023-07-09T21:53:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.057+0000 7f2cda3ff700 1 --2- 172.21.15.53:0/3895937608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cd40b1e00 0x7f2cd40b43f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.058+0000 7f2cda3ff700 1 -- 172.21.15.53:0/3895937608 >> 172.21.15.53:0/3895937608 conn(0x7f2cd409c1d0 msgr2=0x7f2cd40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.058+0000 7f2cda3ff700 1 -- 172.21.15.53:0/3895937608 shutdown_connections 2023-07-09T21:53:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.058+0000 7f2cda3ff700 1 -- 172.21.15.53:0/3895937608 wait complete. 2023-07-09T21:53:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.059+0000 7f2cda3ff700 1 Processor -- start 2023-07-09T21:53:27.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.060+0000 7f2cda3ff700 1 -- start start 2023-07-09T21:53:27.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cda3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cd40b1e00 0x7f2cd414d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:27.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cda3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2cd40b2350 0x7f2cd414ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:27.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cda3ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cd40d1220 0x7f2cd406a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:27.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cda3ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40cd3a0 con 0x7f2cd40d1220 2023-07-09T21:53:27.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cda3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40ccb60 con 0x7f2cd40b1e00 2023-07-09T21:53:27.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cda3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40cb6e0 con 0x7f2cd40b2350 2023-07-09T21:53:27.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cd3fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cd40b1e00 0x7f2cd414d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:27.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cd899c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cd40d1220 0x7f2cd406a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:27.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cd3fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cd40b1e00 0x7f2cd414d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.53:37268/0 (socket says 172.21.15.53:37268) 2023-07-09T21:53:27.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cd3fff700 1 -- 172.21.15.53:0/976894413 learned_addr learned my addr 172.21.15.53:0/976894413 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-07-09T21:53:27.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cd37fe700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2cd40b2350 0x7f2cd414ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cd899c700 1 -- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2cd40b2350 msgr2=0x7f2cd414ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cd899c700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2cd40b2350 0x7f2cd414ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cd899c700 1 -- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cd40b1e00 msgr2=0x7f2cd414d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cd899c700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cd40b1e00 0x7f2cd414d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cd899c700 1 -- 172.21.15.53:0/976894413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4009430 con 0x7f2cd40d1220 2023-07-09T21:53:27.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.061+0000 7f2cd3fff700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cd40b1e00 0x7f2cd414d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:53:27.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.062+0000 7f2cd899c700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cd40d1220 0x7f2cd406a700 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4067240 tx=0x7f2ccc00cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:27.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.062+0000 7f2cd0ff9700 1 -- 172.21.15.53:0/976894413 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc003c00 con 0x7f2cd40d1220 2023-07-09T21:53:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.062+0000 7f2cd0ff9700 1 -- 172.21.15.53:0/976894413 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2ccc003d60 con 0x7f2cd40d1220 2023-07-09T21:53:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.062+0000 7f2cda3ff700 1 -- 172.21.15.53:0/976894413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd414cfd0 con 0x7f2cd40d1220 2023-07-09T21:53:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.062+0000 7f2cd0ff9700 1 -- 172.21.15.53:0/976894413 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc00aa40 con 0x7f2cd40d1220 2023-07-09T21:53:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.062+0000 7f2cda3ff700 1 -- 172.21.15.53:0/976894413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd40ccde0 con 0x7f2cd40d1220 2023-07-09T21:53:27.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.063+0000 7f2cda3ff700 1 -- 172.21.15.53:0/976894413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd404e280 con 0x7f2cd40d1220 2023-07-09T21:53:27.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.064+0000 7f2cd0ff9700 1 -- 172.21.15.53:0/976894413 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f2ccc00aba0 con 0x7f2cd40d1220 2023-07-09T21:53:27.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.065+0000 7f2cd0ff9700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2cc006ae00 0x7f2cc006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:53:27.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.065+0000 7f2cd0ff9700 1 -- 172.21.15.53:0/976894413 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f2ccc089140 con 0x7f2cd40d1220 2023-07-09T21:53:27.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.066+0000 7f2cd3fff700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2cc006ae00 0x7f2cc006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:53:27.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.067+0000 7f2cd3fff700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2cc006ae00 0x7f2cc006d2b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4013040 tx=0x7f2cc4008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:53:27.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.070+0000 7f2cd0ff9700 1 -- 172.21.15.53:0/976894413 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2ccc0543c0 con 0x7f2cd40d1220 2023-07-09T21:53:27.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.320+0000 7f2cda3ff700 1 -- 172.21.15.53:0/976894413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cd408c5a0 con 0x7f2cd40d1220 2023-07-09T21:53:27.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.321+0000 7f2cd0ff9700 1 -- 172.21.15.53:0/976894413 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f2ccc0579e0 con 0x7f2cd40d1220 2023-07-09T21:53:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-09T21:53:27.323 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2286885595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2286885595},{"type":"v1","addr":"172.21.15.184:6837","nonce":2286885595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2019231045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2019231045},{"type":"v1","addr":"172.21.15.53:6834","nonce":2019231045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/1440999283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1440999283},{"type":"v1","addr":"172.21.15.184:6836","nonce":1440999283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6048,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2018035592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":2018035592},{"type":"v1","addr":"172.21.15.53:6835","nonce":2018035592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[]} 2023-07-09T21:53:27.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.323+0000 7f2cda3ff700 1 -- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2cc006ae00 msgr2=0x7f2cc006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:27.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.323+0000 7f2cda3ff700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2cc006ae00 0x7f2cc006d2b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4013040 tx=0x7f2cc4008070 comp rx=0 tx=0).stop 2023-07-09T21:53:27.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.323+0000 7f2cda3ff700 1 -- 172.21.15.53:0/976894413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cd40d1220 msgr2=0x7f2cd406a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:53:27.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.323+0000 7f2cda3ff700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cd40d1220 0x7f2cd406a700 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4067240 tx=0x7f2ccc00cdc0 comp rx=0 tx=0).stop 2023-07-09T21:53:27.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.324+0000 7f2cda3ff700 1 -- 172.21.15.53:0/976894413 shutdown_connections 2023-07-09T21:53:27.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.324+0000 7f2cda3ff700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:6832/2043123506,v1:172.21.15.184:6833/2043123506] conn(0x7f2cc006ae00 0x7f2cc006d2b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:27.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.324+0000 7f2cda3ff700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cd40d1220 0x7f2cd406a700 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:27.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.324+0000 7f2cda3ff700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cd40b1e00 0x7f2cd414d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:27.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.324+0000 7f2cda3ff700 1 --2- 172.21.15.53:0/976894413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2cd40b2350 0x7f2cd414ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:53:27.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.324+0000 7f2cda3ff700 1 -- 172.21.15.53:0/976894413 >> 172.21.15.53:0/976894413 conn(0x7f2cd409c1d0 msgr2=0x7f2cd40afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:53:27.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.324+0000 7f2cda3ff700 1 -- 172.21.15.53:0/976894413 shutdown_connections 2023-07-09T21:53:27.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-07-09T21:53:27.324+0000 7f2cda3ff700 1 -- 172.21.15.53:0/976894413 wait complete. 2023-07-09T21:53:27.327 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 30 2023-07-09T21:53:27.343 DEBUG:tasks.cephfs.filesystem:already dead... 2023-07-09T21:53:27.344 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-09T21:53:27.344 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T21:53:27.345 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:27.357 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T21:53:27.358 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T21:53:27.358 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:27.411 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T21:53:27.412 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T21:53:27.412 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:27.429 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T21:53:27.430 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T21:53:27.430 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:27.486 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T21:53:27.486 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-09T21:53:27.487 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-09T21:53:27.487 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:27.534 INFO:tasks.ceph.osd.0:Stopped 2023-07-09T21:53:27.535 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-09T21:53:27.535 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:27.583 INFO:tasks.ceph.osd.1:Stopped 2023-07-09T21:53:27.584 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-09T21:53:27.584 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:27.629 INFO:tasks.ceph.osd.2:Stopped 2023-07-09T21:53:27.630 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-09T21:53:27.630 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:27.671 INFO:tasks.ceph.osd.3:Stopped 2023-07-09T21:53:27.672 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-09T21:53:27.672 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:27.712 INFO:tasks.ceph.osd.4:Stopped 2023-07-09T21:53:27.713 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-09T21:53:27.713 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:27.805 INFO:tasks.ceph.osd.5:Stopped 2023-07-09T21:53:27.806 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-09T21:53:27.807 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:27.861 INFO:tasks.ceph.osd.6:Stopped 2023-07-09T21:53:27.862 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-09T21:53:27.862 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:27.908 INFO:tasks.ceph.osd.7:Stopped 2023-07-09T21:53:27.909 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-09T21:53:27.909 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-09T21:53:27.910 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:27.969 INFO:tasks.ceph.mgr.y:Stopped 2023-07-09T21:53:27.969 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-09T21:53:27.970 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:28.035 INFO:tasks.ceph.mgr.x:Stopped 2023-07-09T21:53:28.035 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-09T21:53:28.036 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-09T21:53:28.036 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:28.056 INFO:tasks.ceph.mon.a:Stopped 2023-07-09T21:53:28.057 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-09T21:53:28.057 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:28.075 INFO:tasks.ceph.mon.b:Stopped 2023-07-09T21:53:28.076 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-09T21:53:28.076 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:53:28.135 INFO:tasks.ceph.mon.c:Stopped 2023-07-09T21:53:28.135 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-09T21:53:28.136 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-07-09T21:53:28.224 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:53:28.225 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-09T21:53:28.423 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:53:28.423 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-09T21:53:28.619 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:53:28.619 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-09T21:53:28.824 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:53:28.825 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-09T21:53:29.027 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:53:29.028 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-09T21:53:29.357 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:53:29.358 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-09T21:53:29.556 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:53:29.556 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-09T21:53:29.764 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:53:29.764 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-09T21:53:29.949 INFO:tasks.ceph:Archiving mon data... 2023-07-09T21:53:29.951 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692/data/mon.a.tgz 2023-07-09T21:53:29.951 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2023-07-09T21:53:29.999 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.1293mvWoDh 2023-07-09T21:53:30.000 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.1293mvWoDh 2023-07-09T21:53:30.171 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.1293mvWoDh 2023-07-09T21:53:30.284 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.1293mvWoDh is 416KB 2023-07-09T21:53:30.379 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.1293mvWoDh 2023-07-09T21:53:30.421 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692/data/mon.b.tgz 2023-07-09T21:53:30.422 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-07-09T21:53:30.465 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.dfPykXEiKc 2023-07-09T21:53:30.466 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.dfPykXEiKc 2023-07-09T21:53:30.693 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.dfPykXEiKc 2023-07-09T21:53:30.805 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.dfPykXEiKc is 557KB 2023-07-09T21:53:30.903 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.dfPykXEiKc 2023-07-09T21:53:30.945 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692/data/mon.c.tgz 2023-07-09T21:53:30.946 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-07-09T21:53:31.027 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.WoQXMXKxO7 2023-07-09T21:53:31.027 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.WoQXMXKxO7 2023-07-09T21:53:31.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.WoQXMXKxO7 2023-07-09T21:53:31.349 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.WoQXMXKxO7 is 557KB 2023-07-09T21:53:31.444 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.WoQXMXKxO7 2023-07-09T21:53:31.486 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-09T21:53:31.487 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-09T21:53:31.492 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-09T21:53:31.593 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-09T21:53:31.593 DEBUG:teuthology.orchestra.run.smithi053:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-09T21:53:31.598 DEBUG:teuthology.orchestra.run.smithi184:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-09T21:53:31.673 INFO:teuthology.orchestra.run.smithi184.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-09T21:53:31.673 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-09T21:53:31.689 INFO:tasks.ceph:Archiving crash dumps... 2023-07-09T21:53:31.691 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692/remote/smithi053/crash 2023-07-09T21:53:31.693 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-09T21:53:31.760 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692/remote/smithi184/crash 2023-07-09T21:53:31.762 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-09T21:53:31.827 INFO:tasks.ceph:Shutting down logrotate 2023-07-09T21:53:31.828 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:53:31.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:53:31.930 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-09T21:53:31.998 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-09T21:53:32.064 INFO:tasks.ceph:Compressing logs... 2023-07-09T21:53:32.065 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-09T21:53:32.069 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-09T21:53:32.132 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139890.log 2023-07-09T21:53:32.133 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145293.log 2023-07-09T21:53:32.134 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139890.log: gzip 88.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.139890.log.gz 2023-07-09T21:53:32.134 INFO:teuthology.orchestra.run.smithi053.stderr:--verbose -- /var/log/ceph/ceph-client.admin.144925.log 2023-07-09T21:53:32.136 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145293.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.145293.log.gz 2023-07-09T21:53:32.136 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139844.log 2023-07-09T21:53:32.137 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-09T21:53:32.138 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144925.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144925.log.gz 2023-07-09T21:53:32.138 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140770.log 2023-07-09T21:53:32.138 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139844.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.139844.log.gz 2023-07-09T21:53:32.138 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135492.log 2023-07-09T21:53:32.139 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140770.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140770.log.gzgzip 2023-07-09T21:53:32.140 INFO:teuthology.orchestra.run.smithi053.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.148477.log 2023-07-09T21:53:32.140 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150438.log 2023-07-09T21:53:32.140 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135492.log.gz 2023-07-09T21:53:32.141 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-09T21:53:32.141 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-09T21:53:32.141 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.138099.log 2023-07-09T21:53:32.142 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148477.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148477.log.gz 2023-07-09T21:53:32.142 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145431.log 2023-07-09T21:53:32.142 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150438.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150438.log.gz 2023-07-09T21:53:32.143 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142571.log 2023-07-09T21:53:32.143 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145431.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.145431.log.gz 2023-07-09T21:53:32.144 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136100.log 2023-07-09T21:53:32.144 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142571.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142571.log.gz 2023-07-09T21:53:32.144 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141421.log 2023-07-09T21:53:32.145 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136100.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136100.log.gz 2023-07-09T21:53:32.145 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139982.log 2023-07-09T21:53:32.145 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141421.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141421.log.gz 2023-07-09T21:53:32.146 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135446.log 2023-07-09T21:53:32.146 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139982.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139982.log.gz 2023-07-09T21:53:32.147 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150300.log 2023-07-09T21:53:32.148 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135446.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135446.log.gz 2023-07-09T21:53:32.148 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141191.log 2023-07-09T21:53:32.149 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.6.log: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-09T21:53:32.150 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130258.log 2023-07-09T21:53:32.150 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.138099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.138099.log.gz 2023-07-09T21:53:32.150 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130167.log 2023-07-09T21:53:32.150 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.130258.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-09T21:53:32.151 INFO:teuthology.orchestra.run.smithi184.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.130258.log.gz 2023-07-09T21:53:32.151 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.130167.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130167.log.gz 2023-07-09T21:53:32.151 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130403.log 2023-07-09T21:53:32.151 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-09T21:53:32.151 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.130403.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.130403.log.gz 2023-07-09T21:53:32.152 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.138095.log 2023-07-09T21:53:32.152 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130121.log 2023-07-09T21:53:32.152 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.138095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.138095.log.gz 2023-07-09T21:53:32.152 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-09T21:53:32.154 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.130121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.138723.log 2023-07-09T21:53:32.154 INFO:teuthology.orchestra.run.smithi184.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130121.log.gz 2023-07-09T21:53:32.154 INFO:teuthology.orchestra.run.smithi184.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-09T21:53:32.154 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130356.log 2023-07-09T21:53:32.155 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.138723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.138723.log.gz 2023-07-09T21:53:32.155 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-09T21:53:32.156 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150300.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150300.log.gz 2023-07-09T21:53:32.157 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144538.log 2023-07-09T21:53:32.157 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141191.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141191.log.gz 2023-07-09T21:53:32.157 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135745.log 2023-07-09T21:53:32.157 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144538.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.144538.log.gz 2023-07-09T21:53:32.157 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134606.log 2023-07-09T21:53:32.158 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135745.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135745.log.gz 2023-07-09T21:53:32.158 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143056.log 2023-07-09T21:53:32.158 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134606.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.134606.log.gz 2023-07-09T21:53:32.158 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135400.log 2023-07-09T21:53:32.158 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143056.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143056.log.gz 2023-07-09T21:53:32.159 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149794.log 2023-07-09T21:53:32.159 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135400.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135400.log.gz 2023-07-09T21:53:32.159 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-09T21:53:32.159 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149794.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149794.log.gz 2023-07-09T21:53:32.159 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143837.log 2023-07-09T21:53:32.160 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134932.log 2023-07-09T21:53:32.162 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.130356.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130356.log.gz 2023-07-09T21:53:32.162 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.137300.log 2023-07-09T21:53:32.162 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130311.log 2023-07-09T21:53:32.162 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.3.137300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.137300.log.gz 2023-07-09T21:53:32.163 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.137296.log 2023-07-09T21:53:32.163 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.130311.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.130311.log.gz 2023-07-09T21:53:32.163 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-09T21:53:32.163 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.3.137296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.137296.log.gz 2023-07-09T21:53:32.163 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.138727.log 2023-07-09T21:53:32.164 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143837.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143837.log.gz 2023-07-09T21:53:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146346.log 2023-07-09T21:53:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134932.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.134932.log.gz 2023-07-09T21:53:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146578.log 2023-07-09T21:53:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146346.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146346.log.gz 2023-07-09T21:53:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135732.log 2023-07-09T21:53:32.166 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146578.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146578.log.gz 2023-07-09T21:53:32.166 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142479.log 2023-07-09T21:53:32.166 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135732.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.135732.log.gz 2023-07-09T21:53:32.166 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-09T21:53:32.166 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142479.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142479.log.gz 2023-07-09T21:53:32.167 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134336.log 2023-07-09T21:53:32.167 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136113.log 2023-07-09T21:53:32.167 INFO:teuthology.orchestra.run.smithi053.stderr: 85.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-09T21:53:32.168 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-09T21:53:32.168 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.138727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.138727.log.gz 2023-07-09T21:53:32.169 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.136689.log 2023-07-09T21:53:32.170 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134336.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.134336.log.gz 2023-07-09T21:53:32.170 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134792.log 2023-07-09T21:53:32.170 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143424.log 2023-07-09T21:53:32.170 INFO:teuthology.orchestra.run.smithi053.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.136113.log.gz 2023-07-09T21:53:32.171 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134792.log: gzip -5 --verbose -- 88.4%/var/log/ceph/ceph-client.admin.148818.log -- replaced with /var/log/ceph/ceph-client.admin.134792.log.gz 2023-07-09T21:53:32.171 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-07-09T21:53:32.171 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146816.log 2023-07-09T21:53:32.171 INFO:teuthology.orchestra.run.smithi053.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.143424.log.gz 2023-07-09T21:53:32.171 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148818.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148818.log.gz 2023-07-09T21:53:32.172 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139338.log 2023-07-09T21:53:32.172 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146816.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146816.log.gz 2023-07-09T21:53:32.173 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145523.log 2023-07-09T21:53:32.173 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139338.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.139338.log.gz 2023-07-09T21:53:32.173 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144220.log 2023-07-09T21:53:32.174 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145523.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.145523.log.gz 2023-07-09T21:53:32.174 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144879.log 2023-07-09T21:53:32.175 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.1.136689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.136689.log.gz 2023-07-09T21:53:32.175 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-09T21:53:32.176 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144220.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.144220.log.gz 2023-07-09T21:53:32.176 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135262.log 2023-07-09T21:53:32.176 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144879.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144879.log.gz 2023-07-09T21:53:32.177 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145247.log 2023-07-09T21:53:32.177 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135262.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135262.log.gz 2023-07-09T21:53:32.178 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139752.log 2023-07-09T21:53:32.178 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145247.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.145247.log.gz 2023-07-09T21:53:32.179 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140406.log 2023-07-09T21:53:32.179 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139752.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.139752.log.gz 2023-07-09T21:53:32.180 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134031.log 2023-07-09T21:53:32.181 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140406.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140406.log.gz 2023-07-09T21:53:32.181 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148092.log 2023-07-09T21:53:32.181 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134031.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.134031.log.gz 2023-07-09T21:53:32.182 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147893.log 2023-07-09T21:53:32.183 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148092.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148092.log.gz 2023-07-09T21:53:32.183 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137645.log 2023-07-09T21:53:32.184 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.147893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143148.log 2023-07-09T21:53:32.184 INFO:teuthology.orchestra.run.smithi053.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.147893.log.gz 2023-07-09T21:53:32.185 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.137645.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137645.log.gz 2023-07-09T21:53:32.186 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139430.log 2023-07-09T21:53:32.186 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.136675.log 2023-07-09T21:53:32.187 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143148.log: 88.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.143148.log.gz--verbose 2023-07-09T21:53:32.187 INFO:teuthology.orchestra.run.smithi053.stderr:-- /var/log/ceph/ceph-client.admin.149702.log 2023-07-09T21:53:32.187 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139430.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139430.log.gz 2023-07-09T21:53:32.188 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147735.log 2023-07-09T21:53:32.189 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149702.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149702.log.gz 2023-07-09T21:53:32.189 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-09T21:53:32.190 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.147735.log: gzip 87.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.147735.log.gz 2023-07-09T21:53:32.190 INFO:teuthology.orchestra.run.smithi053.stderr:--verbose -- /var/log/ceph/ceph-client.admin.141375.log 2023-07-09T21:53:32.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135722.log 2023-07-09T21:53:32.193 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141375.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141375.log.gz 2023-07-09T21:53:32.193 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139706.log 2023-07-09T21:53:32.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135722.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.135722.log.gz 2023-07-09T21:53:32.194 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134886.log 2023-07-09T21:53:32.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139706.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139706.log.gz 2023-07-09T21:53:32.195 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144112.log 2023-07-09T21:53:32.196 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.136675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.136675.log.gz 2023-07-09T21:53:32.197 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130213.log 2023-07-09T21:53:32.197 INFO:teuthology.orchestra.run.smithi184.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-09T21:53:32.197 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.130213.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130213.log.gz 2023-07-09T21:53:32.197 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130075.log 2023-07-09T21:53:32.198 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134886.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.134886.log.gz 2023-07-09T21:53:32.198 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148956.log 2023-07-09T21:53:32.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144112.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.144112.log.gz 2023-07-09T21:53:32.199 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136939.log 2023-07-09T21:53:32.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148956.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.148956.log.gz 2023-07-09T21:53:32.200 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147505.log 2023-07-09T21:53:32.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136939.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136939.log.gz 2023-07-09T21:53:32.201 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140087.log 2023-07-09T21:53:32.201 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.147505.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.147505.log.gz 2023-07-09T21:53:32.202 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137123.log 2023-07-09T21:53:32.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140087.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140087.log.gz 2023-07-09T21:53:32.203 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136780.log 2023-07-09T21:53:32.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.137123.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137123.log.gz 2023-07-09T21:53:32.205 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.130075.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130075.log.gz 2023-07-09T21:53:32.205 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-09T21:53:32.205 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140724.log 2023-07-09T21:53:32.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150346.log 2023-07-09T21:53:32.206 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136780.log.gz 2023-07-09T21:53:32.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140724.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140724.log.gz 2023-07-09T21:53:32.207 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-07-09T21:53:32.208 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150346.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150346.log.gz 2023-07-09T21:53:32.208 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143975.log 2023-07-09T21:53:32.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143102.log 2023-07-09T21:53:32.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143975.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143975.log.gz 2023-07-09T21:53:32.211 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137031.log 2023-07-09T21:53:32.212 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143102.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143102.log.gz 2023-07-09T21:53:32.212 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146624.log 2023-07-09T21:53:32.213 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.137031.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137031.log.gz 2023-07-09T21:53:32.214 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139015.log 2023-07-09T21:53:32.216 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146624.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.146624.log.gz 2023-07-09T21:53:32.216 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134986.log 2023-07-09T21:53:32.217 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139015.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139015.log.gz 2023-07-09T21:53:32.217 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136477.log 2023-07-09T21:53:32.219 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139061.log 2023-07-09T21:53:32.219 INFO:teuthology.orchestra.run.smithi053.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.134986.log.gz 2023-07-09T21:53:32.220 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136477.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136477.log.gz 2023-07-09T21:53:32.220 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141659.log 2023-07-09T21:53:32.221 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134840.log 2023-07-09T21:53:32.222 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139061.log.gz 2023-07-09T21:53:32.222 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141659.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.141659.log.gz 2023-07-09T21:53:32.223 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149978.log 2023-07-09T21:53:32.224 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134840.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.134840.log.gz 2023-07-09T21:53:32.224 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141057.log 2023-07-09T21:53:32.225 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149978.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149978.log.gz 2023-07-09T21:53:32.226 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149048.log 2023-07-09T21:53:32.227 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141057.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141057.log.gz 2023-07-09T21:53:32.227 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-09T21:53:32.228 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149048.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149048.log.gz 2023-07-09T21:53:32.229 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144676.log 2023-07-09T21:53:32.230 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147803.log 2023-07-09T21:53:32.232 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144676.log: gzip 88.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.144676.log.gz--verbose 2023-07-09T21:53:32.233 INFO:teuthology.orchestra.run.smithi053.stderr:-- /var/log/ceph/ceph-client.admin.149748.log 2023-07-09T21:53:32.233 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.147803.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147803.log.gz 2023-07-09T21:53:32.234 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146010.log 2023-07-09T21:53:32.235 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149748.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.149748.log.gz 2023-07-09T21:53:32.235 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147643.log 2023-07-09T21:53:32.236 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146010.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.146010.log.gz 2023-07-09T21:53:32.237 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148339.log 2023-07-09T21:53:32.238 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.147643.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147643.log.gzgzip 2023-07-09T21:53:32.239 INFO:teuthology.orchestra.run.smithi053.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.140919.log 2023-07-09T21:53:32.240 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148339.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148339.log.gz 2023-07-09T21:53:32.240 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142964.log 2023-07-09T21:53:32.241 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140919.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140919.log.gz 2023-07-09T21:53:32.241 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140452.log 2023-07-09T21:53:32.243 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142964.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.142964.log.gz 2023-07-09T21:53:32.243 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145385.log 2023-07-09T21:53:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140452.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140452.log.gz 2023-07-09T21:53:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146150.log 2023-07-09T21:53:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145385.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145385.log.gz 2023-07-09T21:53:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142918.log 2023-07-09T21:53:32.248 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146150.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146150.log.gz 2023-07-09T21:53:32.248 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137399.log 2023-07-09T21:53:32.249 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142918.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142918.log.gz 2023-07-09T21:53:32.250 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147413.log 2023-07-09T21:53:32.251 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mds.b.log: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-09T21:53:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.137399.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137399.log.gz 2023-07-09T21:53:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137261.log 2023-07-09T21:53:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.147413.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147413.log.gz 2023-07-09T21:53:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135032.log 2023-07-09T21:53:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.137261.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137261.log.gz 2023-07-09T21:53:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134200.log 2023-07-09T21:53:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135032.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135032.log.gz 2023-07-09T21:53:32.256 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148159.log 2023-07-09T21:53:32.257 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134200.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.134200.log.gz 2023-07-09T21:53:32.258 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149251.log 2023-07-09T21:53:32.259 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148159.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148159.log.gz 2023-07-09T21:53:32.259 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142340.log 2023-07-09T21:53:32.260 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149251.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.149251.log.gz 2023-07-09T21:53:32.261 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136826.log 2023-07-09T21:53:32.262 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142340.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142340.log.gz 2023-07-09T21:53:32.263 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145790.log 2023-07-09T21:53:32.263 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136826.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136826.log.gz 2023-07-09T21:53:32.264 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149140.log 2023-07-09T21:53:32.265 INFO:teuthology.orchestra.run.smithi184.stderr: 95.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-09T21:53:32.265 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145790.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145790.log.gz 2023-07-09T21:53:32.266 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145063.log 2023-07-09T21:53:32.267 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149140.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149140.log.gz 2023-07-09T21:53:32.267 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136481.log 2023-07-09T21:53:32.268 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145063.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.145063.log.gz 2023-07-09T21:53:32.268 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138122.log 2023-07-09T21:53:32.270 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136481.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136481.log.gz 2023-07-09T21:53:32.270 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150208.log 2023-07-09T21:53:32.271 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.138122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.138122.log.gz 2023-07-09T21:53:32.271 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149002.log 2023-07-09T21:53:32.273 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150208.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150208.log.gz 2023-07-09T21:53:32.273 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150530.log 2023-07-09T21:53:32.274 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144450.log 2023-07-09T21:53:32.275 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149002.log.gz 2023-07-09T21:53:32.276 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150530.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150530.log.gz 2023-07-09T21:53:32.277 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-07-09T21:53:32.277 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144450.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144450.log.gz 2023-07-09T21:53:32.278 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141889.log 2023-07-09T21:53:32.279 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135216.log 2023-07-09T21:53:32.280 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141889.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-09T21:53:32.281 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141889.log.gz 2023-07-09T21:53:32.281 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136112.log 2023-07-09T21:53:32.282 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135216.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135216.log.gz 2023-07-09T21:53:32.283 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148000.log 2023-07-09T21:53:32.284 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136112.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136112.log.gz 2023-07-09T21:53:32.285 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146532.log 2023-07-09T21:53:32.285 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148000.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148000.log.gz 2023-07-09T21:53:32.286 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149656.log 2023-07-09T21:53:32.287 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146532.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146532.log.gz 2023-07-09T21:53:32.288 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146244.log 2023-07-09T21:53:32.289 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149656.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149656.log.gz 2023-07-09T21:53:32.289 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146762.log 2023-07-09T21:53:32.290 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146244.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146244.log.gz 2023-07-09T21:53:32.291 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142073.log 2023-07-09T21:53:32.292 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146762.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.146762.log.gz 2023-07-09T21:53:32.292 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149204.log 2023-07-09T21:53:32.294 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142073.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142073.log.gz 2023-07-09T21:53:32.294 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.147303.log 2023-07-09T21:53:32.295 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149204.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.149204.log.gz 2023-07-09T21:53:32.296 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142709.log 2023-07-09T21:53:32.296 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.147303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.147303.log.gz 2023-07-09T21:53:32.297 INFO:teuthology.orchestra.run.smithi184.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-09T21:53:32.297 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150606.log 2023-07-09T21:53:32.298 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142709.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142709.log.gz 2023-07-09T21:53:32.299 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143929.log 2023-07-09T21:53:32.300 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150606.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150606.log.gz 2023-07-09T21:53:32.300 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136101.log 2023-07-09T21:53:32.305 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147689.log 2023-07-09T21:53:32.305 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143929.log.gz 2023-07-09T21:53:32.305 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136101.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.136101.log.gz 2023-07-09T21:53:32.306 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136109.log 2023-07-09T21:53:32.306 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.147689.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.147689.log.gz 2023-07-09T21:53:32.306 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143332.log 2023-07-09T21:53:32.307 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136109.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.136109.log.gz 2023-07-09T21:53:32.307 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135124.log 2023-07-09T21:53:32.308 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143332.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143332.log.gz 2023-07-09T21:53:32.308 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150116.log 2023-07-09T21:53:32.309 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135124.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.135124.log.gz 2023-07-09T21:53:32.310 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147000.log 2023-07-09T21:53:32.310 INFO:teuthology.orchestra.run.smithi053.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-09T21:53:32.311 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150116.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.150116.log.gz 2023-07-09T21:53:32.311 INFO:teuthology.orchestra.run.smithi053.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-09T21:53:32.312 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141935.log 2023-07-09T21:53:32.313 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.147000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130403.log 2023-07-09T21:53:32.314 INFO:teuthology.orchestra.run.smithi053.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.147000.log.gz 2023-07-09T21:53:32.314 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141935.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141935.log.gz 2023-07-09T21:53:32.315 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149297.log 2023-07-09T21:53:32.316 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.130403.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130403.log.gz 2023-07-09T21:53:32.316 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139108.log 2023-07-09T21:53:32.317 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149297.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-09T21:53:32.318 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149297.log.gz 2023-07-09T21:53:32.318 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139108.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139108.log.gz 2023-07-09T21:53:32.319 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150162.log 2023-07-09T21:53:32.320 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143883.log 2023-07-09T21:53:32.321 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150162.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-09T21:53:32.321 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.150162.log.gz 2023-07-09T21:53:32.322 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135734.log 2023-07-09T21:53:32.323 INFO:teuthology.orchestra.run.smithi184.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-09T21:53:32.323 INFO:teuthology.orchestra.run.smithi184.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-09T21:53:32.323 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143883.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143883.log.gz 2023-07-09T21:53:32.324 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141467.log 2023-07-09T21:53:32.324 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135734.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.135734.log.gz 2023-07-09T21:53:32.325 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.143731.log 2023-07-09T21:53:32.325 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141467.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141467.log.gz 2023-07-09T21:53:32.325 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144630.log 2023-07-09T21:53:32.326 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.143731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.143731.log.gz 2023-07-09T21:53:32.326 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134467.log 2023-07-09T21:53:32.327 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144630.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144630.log.gz 2023-07-09T21:53:32.327 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140965.log 2023-07-09T21:53:32.328 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134467.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.134467.log.gz 2023-07-09T21:53:32.329 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136110.log 2023-07-09T21:53:32.329 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140965.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140965.log.gz 2023-07-09T21:53:32.330 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148523.log 2023-07-09T21:53:32.331 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136110.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136110.log.gz 2023-07-09T21:53:32.331 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147459.log 2023-07-09T21:53:32.332 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148523.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148523.log.gz 2023-07-09T21:53:32.332 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141103.log 2023-07-09T21:53:32.333 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.147459.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.147459.log.gz 2023-07-09T21:53:32.333 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140222.log 2023-07-09T21:53:32.334 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141103.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.141103.log.gz 2023-07-09T21:53:32.335 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149389.log 2023-07-09T21:53:32.335 INFO:teuthology.orchestra.run.smithi184.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-09T21:53:32.336 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148431.log 88.1% 2023-07-09T21:53:32.336 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140222.log.gz 2023-07-09T21:53:32.337 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149389.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149389.log.gz 2023-07-09T21:53:32.337 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140314.log 2023-07-09T21:53:32.338 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148431.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148431.log.gz 2023-07-09T21:53:32.338 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143010.log 2023-07-09T21:53:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140314.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140314.log.gz-5 2023-07-09T21:53:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:--verbose -- /var/log/ceph/ceph-client.admin.141613.log 2023-07-09T21:53:32.340 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143010.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143010.log.gz 2023-07-09T21:53:32.340 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142617.log 2023-07-09T21:53:32.341 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141613.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141613.log.gz 2023-07-09T21:53:32.341 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139246.log 2023-07-09T21:53:32.343 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142617.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142617.log.gz 2023-07-09T21:53:32.343 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137491.log 2023-07-09T21:53:32.344 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139246.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.139246.log.gz 2023-07-09T21:53:32.344 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150024.log 2023-07-09T21:53:32.345 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.137491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147551.log 2023-07-09T21:53:32.345 INFO:teuthology.orchestra.run.smithi053.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.137491.log.gz 2023-07-09T21:53:32.346 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150024.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150024.log.gz 2023-07-09T21:53:32.347 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136474.log 2023-07-09T21:53:32.348 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.147551.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147551.log.gz 2023-07-09T21:53:32.348 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136734.log 2023-07-09T21:53:32.349 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136474.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136474.log.gz 2023-07-09T21:53:32.349 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136111.log 2023-07-09T21:53:32.350 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136734.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.136734.log.gz 2023-07-09T21:53:32.350 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139200.log 2023-07-09T21:53:32.351 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136111.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.136111.log.gz 2023-07-09T21:53:32.351 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129966.log 2023-07-09T21:53:32.352 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139200.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139200.log.gz 2023-07-09T21:53:32.353 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141843.log 2023-07-09T21:53:32.353 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.129966.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.101605.log 2023-07-09T21:53:32.354 INFO:teuthology.orchestra.run.smithi053.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.129966.log.gz 2023-07-09T21:53:32.355 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141843.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141843.log.gz 2023-07-09T21:53:32.355 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.147307.log 2023-07-09T21:53:32.356 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.tmp-client.admin.101605.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.101605.log.gz 2023-07-09T21:53:32.356 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137445.log 2023-07-09T21:53:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.147307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.147307.log.gz 2023-07-09T21:53:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145880.log 2023-07-09T21:53:32.358 INFO:teuthology.orchestra.run.smithi184.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-09T21:53:32.358 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.137445.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137445.log.gz 2023-07-09T21:53:32.359 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139154.log 2023-07-09T21:53:32.359 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145880.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145880.log.gz 2023-07-09T21:53:32.360 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145477.log 2023-07-09T21:53:32.360 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139154.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139154.log.gz 2023-07-09T21:53:32.360 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130275.log 2023-07-09T21:53:32.361 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145477.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.145477.log.gz 2023-07-09T21:53:32.362 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136985.log 2023-07-09T21:53:32.362 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.130275.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130275.log.gz 2023-07-09T21:53:32.363 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134698.log 2023-07-09T21:53:32.364 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136985.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136985.log.gz 2023-07-09T21:53:32.364 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139568.log 2023-07-09T21:53:32.365 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134698.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.134698.log.gz 2023-07-09T21:53:32.365 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145615.log 2023-07-09T21:53:32.366 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139568.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139568.log.gz 2023-07-09T21:53:32.367 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137169.log 2023-07-09T21:53:32.367 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145615.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145615.log.gz 2023-07-09T21:53:32.368 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142525.log 2023-07-09T21:53:32.368 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.137169.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137169.log.gz 2023-07-09T21:53:32.369 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142387.log 2023-07-09T21:53:32.370 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142525.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142525.log.gz 2023-07-09T21:53:32.370 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134137.log 2023-07-09T21:53:32.371 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142387.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142387.log.gz 2023-07-09T21:53:32.371 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136688.log 2023-07-09T21:53:32.372 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134137.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.134137.log.gz 2023-07-09T21:53:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143240.log 2023-07-09T21:53:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136688.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.136688.log.gz 2023-07-09T21:53:32.374 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139936.log 2023-07-09T21:53:32.375 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143240.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143240.log.gz 2023-07-09T21:53:32.375 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145682.log 2023-07-09T21:53:32.376 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139936.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.139936.log.gz 2023-07-09T21:53:32.376 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150696.log 2023-07-09T21:53:32.377 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145682.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.145682.log.gz 2023-07-09T21:53:32.377 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141329.log 2023-07-09T21:53:32.378 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150696.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.150696.log.gz 2023-07-09T21:53:32.378 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139292.log 2023-07-09T21:53:32.379 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141329.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141329.log.gz 2023-07-09T21:53:32.380 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139476.log 2023-07-09T21:53:32.380 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139292.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.139292.log.gz 2023-07-09T21:53:32.381 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135354.log 2023-07-09T21:53:32.381 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139476.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.139476.log.gz 2023-07-09T21:53:32.382 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.143727.log 2023-07-09T21:53:32.383 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135354.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135354.log.gz 2023-07-09T21:53:32.383 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141559.log 2023-07-09T21:53:32.384 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.143727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.143727.log.gz 2023-07-09T21:53:32.384 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146196.log 2023-07-09T21:53:32.385 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141559.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141559.log.gz 2023-07-09T21:53:32.385 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144768.log 2023-07-09T21:53:32.386 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146196.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.146196.log.gz 2023-07-09T21:53:32.387 INFO:teuthology.orchestra.run.smithi053.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-09T21:53:32.387 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140678.log 2023-07-09T21:53:32.387 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144768.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144768.log.gz 2023-07-09T21:53:32.388 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-07-09T21:53:32.389 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140678.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.140678.log.gz 2023-07-09T21:53:32.389 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135170.log 2023-07-09T21:53:32.390 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137077.log 2023-07-09T21:53:32.391 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135170.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.135170.log.gz 2023-07-09T21:53:32.392 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147597.log 2023-07-09T21:53:32.393 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.137077.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137077.log.gz 2023-07-09T21:53:32.393 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142801.log 2023-07-09T21:53:32.394 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.147597.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147597.log.gz 2023-07-09T21:53:32.395 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144722.log 2023-07-09T21:53:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142801.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142801.log.gz 2023-07-09T21:53:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144971.log 2023-07-09T21:53:32.397 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145109.log 88.3% 2023-07-09T21:53:32.397 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.144722.log.gz 2023-07-09T21:53:32.398 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144971.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144971.log.gz 2023-07-09T21:53:32.398 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141797.log 2023-07-09T21:53:32.399 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145109.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.145109.log.gz 2023-07-09T21:53:32.400 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140028.log 2023-07-09T21:53:32.400 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141797.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141797.log.gz 2023-07-09T21:53:32.400 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136479.log 2023-07-09T21:53:32.401 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140028.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140028.log.gz 2023-07-09T21:53:32.402 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140360.log 2023-07-09T21:53:32.402 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136479.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.136479.log.gz 2023-07-09T21:53:32.403 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136885.log 2023-07-09T21:53:32.404 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140360.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140360.log.gz 2023-07-09T21:53:32.404 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148680.log 2023-07-09T21:53:32.405 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136885.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136885.log.gz 2023-07-09T21:53:32.405 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134652.log 2023-07-09T21:53:32.406 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148680.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148680.log.gz 2023-07-09T21:53:32.406 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140540.log 2023-07-09T21:53:32.407 INFO:teuthology.orchestra.run.smithi184.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-09T21:53:32.408 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148772.log 2023-07-09T21:53:32.408 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.134652.log.gz 2023-07-09T21:53:32.409 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140540.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140540.log.gz 2023-07-09T21:53:32.409 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139384.log 2023-07-09T21:53:32.410 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146292.log 2023-07-09T21:53:32.410 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148772.log.gz 2023-07-09T21:53:32.410 INFO:teuthology.orchestra.run.smithi184.stderr: 2023-07-09T21:53:32.411 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m0.302s 2023-07-09T21:53:32.411 INFO:teuthology.orchestra.run.smithi184.stderr:user 0m1.225s 2023-07-09T21:53:32.411 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m0.218s 2023-07-09T21:53:32.412 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139384.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139384.log.gz 2023-07-09T21:53:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143286.log 2023-07-09T21:53:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146292.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.146292.log.gz 2023-07-09T21:53:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142294.log 2023-07-09T21:53:32.414 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143286.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143286.log.gz 2023-07-09T21:53:32.414 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148864.log 2023-07-09T21:53:32.415 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142294.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142294.log.gz 2023-07-09T21:53:32.415 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135308.log 2023-07-09T21:53:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148864.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148864.log.gz 2023-07-09T21:53:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145964.log 2023-07-09T21:53:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135308.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135308.log.gz 2023-07-09T21:53:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148910.log 2023-07-09T21:53:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145964.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.145964.log.gz 2023-07-09T21:53:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145339.log 2023-07-09T21:53:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148910.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148910.log.gz 2023-07-09T21:53:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143494.log 2023-07-09T21:53:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145339.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.145339.log.gz 2023-07-09T21:53:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144021.log 2023-07-09T21:53:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143494.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143494.log.gz 2023-07-09T21:53:32.423 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140586.log 2023-07-09T21:53:32.423 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144021.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144021.log.gz 2023-07-09T21:53:32.424 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134421.log 2023-07-09T21:53:32.424 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140586.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140586.log.gz 2023-07-09T21:53:32.425 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136468.log 2023-07-09T21:53:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148046.log 2023-07-09T21:53:32.426 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134421.log.gz 2023-07-09T21:53:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136468.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136468.log.gz 2023-07-09T21:53:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138358.log 2023-07-09T21:53:32.428 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148046.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148046.log.gz 2023-07-09T21:53:32.428 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135538.log 2023-07-09T21:53:32.429 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.138358.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.138358.log.gz 2023-07-09T21:53:32.429 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141513.log 2023-07-09T21:53:32.430 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135538.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135538.log.gz 2023-07-09T21:53:32.431 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142755.log 2023-07-09T21:53:32.431 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141513.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141513.log.gz 2023-07-09T21:53:32.432 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.138789.log 2023-07-09T21:53:32.433 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142755.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.142755.log.gz 2023-07-09T21:53:32.433 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136409.log 2023-07-09T21:53:32.434 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.2.138789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.138789.log.gz 2023-07-09T21:53:32.434 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139522.log 2023-07-09T21:53:32.435 INFO:teuthology.orchestra.run.smithi053.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-09T21:53:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136409.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136409.log.gz 2023-07-09T21:53:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137353.log 2023-07-09T21:53:32.436 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139522.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139522.log.gz 2023-07-09T21:53:32.437 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134560.log 2023-07-09T21:53:32.438 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.137353.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.137353.log.gz 2023-07-09T21:53:32.438 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146954.log 2023-07-09T21:53:32.439 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134560.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.134560.log.gz 2023-07-09T21:53:32.439 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148205.log 2023-07-09T21:53:32.440 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146954.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146954.log.gz 2023-07-09T21:53:32.441 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142433.log 2023-07-09T21:53:32.441 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148205.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148205.log.gz 2023-07-09T21:53:32.442 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141237.log 2023-07-09T21:53:32.442 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142433.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142433.log.gz 2023-07-09T21:53:32.442 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146486.log 2023-07-09T21:53:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141237.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141237.log.gz 2023-07-09T21:53:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141751.log 2023-07-09T21:53:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146486.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146486.log.gz 2023-07-09T21:53:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143378.log 2023-07-09T21:53:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148634.log 2023-07-09T21:53:32.446 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141751.log.gz 2023-07-09T21:53:32.446 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143378.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143378.log.gz 2023-07-09T21:53:32.447 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141705.log 2023-07-09T21:53:32.448 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135744.log 2023-07-09T21:53:32.448 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.148634.log.gz 2023-07-09T21:53:32.449 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141705.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.141705.log.gz 2023-07-09T21:53:32.449 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146908.log 2023-07-09T21:53:32.450 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135742.log 2023-07-09T21:53:32.450 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135744.log.gz 2023-07-09T21:53:32.451 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146908.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146908.log.gz 2023-07-09T21:53:32.451 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141283.log 2023-07-09T21:53:32.452 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135742.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135742.log.gz 2023-07-09T21:53:32.453 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140632.log 2023-07-09T21:53:32.453 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141283.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141283.log.gz 2023-07-09T21:53:32.454 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144266.log 2023-07-09T21:53:32.455 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140632.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140632.log.gz 2023-07-09T21:53:32.455 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145569.log 2023-07-09T21:53:32.456 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144266.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.144266.log.gz 2023-07-09T21:53:32.456 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140268.log 2023-07-09T21:53:32.457 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145569.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.145569.log.gz 2023-07-09T21:53:32.457 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142119.log 2023-07-09T21:53:32.458 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140268.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140268.log.gz 2023-07-09T21:53:32.458 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137307.log 2023-07-09T21:53:32.459 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142119.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.142119.log.gz 2023-07-09T21:53:32.459 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150650.log 2023-07-09T21:53:32.460 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.137307.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137307.log.gz 2023-07-09T21:53:32.461 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140873.log 2023-07-09T21:53:32.462 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150650.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150650.log.gz 2023-07-09T21:53:32.462 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148251.log 2023-07-09T21:53:32.462 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.140873.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140873.log.gz 2023-07-09T21:53:32.463 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148385.log 2023-07-09T21:53:32.464 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148251.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148251.log.gz 2023-07-09T21:53:32.464 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149094.log 2023-07-09T21:53:32.465 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148385.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148385.log.gz 2023-07-09T21:53:32.465 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136478.log 2023-07-09T21:53:32.466 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149094.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149094.log.gz 2023-07-09T21:53:32.467 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144312.log 2023-07-09T21:53:32.467 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136478.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136478.log.gz 2023-07-09T21:53:32.468 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145155.log 2023-07-09T21:53:32.468 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144312.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144312.log.gz 2023-07-09T21:53:32.469 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146104.log 2023-07-09T21:53:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145155.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145155.log.gz 2023-07-09T21:53:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134514.log 2023-07-09T21:53:32.471 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146862.log 2023-07-09T21:53:32.471 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.146104.log.gz 2023-07-09T21:53:32.472 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134514.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134514.log.gz 2023-07-09T21:53:32.473 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139660.log 2023-07-09T21:53:32.473 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146862.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146862.log.gz 2023-07-09T21:53:32.474 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145017.log 2023-07-09T21:53:32.475 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139660.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.139660.log.gz 2023-07-09T21:53:32.475 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146058.log 2023-07-09T21:53:32.476 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145017.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.145017.log.gz 2023-07-09T21:53:32.476 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142209.log 2023-07-09T21:53:32.477 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146058.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146058.log.gz 2023-07-09T21:53:32.477 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150484.log 2023-07-09T21:53:32.478 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142209.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142209.log.gz 2023-07-09T21:53:32.478 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146440.log 2023-07-09T21:53:32.479 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150484.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.150484.log.gz 2023-07-09T21:53:32.479 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135078.log 2023-07-09T21:53:32.480 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146440.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.146440.log.gz 2023-07-09T21:53:32.481 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148569.log 2023-07-09T21:53:32.481 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135078.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135078.log.gz 2023-07-09T21:53:32.482 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147070.log 2023-07-09T21:53:32.483 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148569.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148569.log.gz 2023-07-09T21:53:32.483 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139798.log 2023-07-09T21:53:32.484 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.147070.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147070.log.gz 2023-07-09T21:53:32.484 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136097.log 2023-07-09T21:53:32.485 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139798.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139798.log.gz 2023-07-09T21:53:32.486 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134744.log 2023-07-09T21:53:32.487 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136097.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136097.log.gz 2023-07-09T21:53:32.487 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144584.log 2023-07-09T21:53:32.488 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134744.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134744.log.gz 2023-07-09T21:53:32.488 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139614.log 2023-07-09T21:53:32.489 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144584.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144584.log.gz 2023-07-09T21:53:32.489 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.138793.log 2023-07-09T21:53:32.490 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.139614.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139614.log.gz 2023-07-09T21:53:32.490 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134246.log 2023-07-09T21:53:32.491 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.2.138793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.138793.log.gz 2023-07-09T21:53:32.491 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144067.log 2023-07-09T21:53:32.492 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.134246.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134246.log.gz 2023-07-09T21:53:32.493 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144404.log 2023-07-09T21:53:32.493 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144067.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144067.log.gz 2023-07-09T21:53:32.494 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146716.log 2023-07-09T21:53:32.495 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144404.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.144404.log.gz 2023-07-09T21:53:32.495 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150070.log 2023-07-09T21:53:32.496 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146716.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.146716.log.gz 2023-07-09T21:53:32.496 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143194.log 2023-07-09T21:53:32.497 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150070.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150070.log.gz 2023-07-09T21:53:32.497 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150392.log 2023-07-09T21:53:32.498 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.143194.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143194.log.gz 2023-07-09T21:53:32.498 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-09T21:53:32.499 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150392.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.150392.log.gz 2023-07-09T21:53:32.500 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137215.log 2023-07-09T21:53:32.500 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144358.log 2023-07-09T21:53:32.501 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.137215.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.137215.log.gz 2023-07-09T21:53:32.502 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141981.log 2023-07-09T21:53:32.503 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145201.log 2023-07-09T21:53:32.503 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144358.log.gz 2023-07-09T21:53:32.504 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141981.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141981.log.gz 2023-07-09T21:53:32.504 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142027.log 2023-07-09T21:53:32.505 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.145201.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145201.log.gz 2023-07-09T21:53:32.505 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141011.log 2023-07-09T21:53:32.506 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142027.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142027.log.gzgzip 2023-07-09T21:53:32.507 INFO:teuthology.orchestra.run.smithi053.stderr:-5 --verbose -- /var/log/ceph/ceph-client.0.138136.log 2023-07-09T21:53:32.507 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.141011.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141011.log.gz 2023-07-09T21:53:32.508 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144833.log 2023-07-09T21:53:32.508 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.138136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.138136.log.gz 2023-07-09T21:53:32.509 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146670.log 2023-07-09T21:53:32.510 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.144833.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144833.log.gz 2023-07-09T21:53:32.510 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142849.log 2023-07-09T21:53:32.511 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146670.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146670.log.gz 2023-07-09T21:53:32.511 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149840.log 2023-07-09T21:53:32.512 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142849.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142849.log.gz 2023-07-09T21:53:32.512 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-07-09T21:53:32.513 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149840.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.149840.log.gz 2023-07-09T21:53:32.514 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136480.log 2023-07-09T21:53:32.514 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149886.log 2023-07-09T21:53:32.515 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.136480.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136480.log.gz 2023-07-09T21:53:32.516 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150254.log 2023-07-09T21:53:32.517 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149932.log 2023-07-09T21:53:32.517 INFO:teuthology.orchestra.run.smithi053.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.149886.log.gz 2023-07-09T21:53:32.518 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.150254.log: 93.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-09T21:53:32.518 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150254.log.gz 2023-07-09T21:53:32.519 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148726.log 2023-07-09T21:53:32.519 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149932.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149932.log.gz 2023-07-09T21:53:32.520 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146392.log 2023-07-09T21:53:32.521 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.148726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135736.log 2023-07-09T21:53:32.521 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148726.log.gz 2023-07-09T21:53:32.522 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.146392.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146392.log.gz 2023-07-09T21:53:32.522 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142663.log 2023-07-09T21:53:32.523 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135736.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.135736.log.gz 2023-07-09T21:53:32.523 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135739.log 2023-07-09T21:53:32.524 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.142663.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.142663.log.gz 2023-07-09T21:53:32.524 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149343.log 2023-07-09T21:53:32.525 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.135739.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135739.log.gz 2023-07-09T21:53:32.526 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149610.log 2023-07-09T21:53:32.526 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149343.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149343.log.gz 2023-07-09T21:53:32.527 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.149610.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149610.log.gz 2023-07-09T21:53:32.550 INFO:teuthology.orchestra.run.smithi053.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-09T21:53:32.755 INFO:teuthology.orchestra.run.smithi053.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-09T21:53:32.758 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-07-09T21:53:32.758 INFO:teuthology.orchestra.run.smithi053.stderr:real 0m0.653s 2023-07-09T21:53:32.758 INFO:teuthology.orchestra.run.smithi053.stderr:user 0m1.097s 2023-07-09T21:53:32.759 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m0.856s 2023-07-09T21:53:32.760 INFO:tasks.ceph:Archiving logs... 2023-07-09T21:53:32.760 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692/remote/smithi053/log 2023-07-09T21:53:32.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-09T21:53:33.196 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692/remote/smithi184/log 2023-07-09T21:53:33.197 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-09T21:53:33.401 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-09T21:53:33.411 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-09T21:53:33.411 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-09T21:53:33.416 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-09T21:53:33.558 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-09T21:53:33.573 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-09T21:53:33.574 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-09T21:53:33.579 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-09T21:53:33.615 INFO:teuthology.orchestra.run.smithi053.stderr:bash: ntpq: command not found 2023-07-09T21:53:33.619 INFO:teuthology.orchestra.run.smithi184.stderr:bash: ntpq: command not found 2023-07-09T21:53:33.622 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-09T21:53:33.623 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2023-07-09T21:53:33.623 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 28 +468us[ +458us] +/- 82ms 2023-07-09T21:53:33.623 INFO:teuthology.orchestra.run.smithi053.stdout:^* hv02.front.sepia.ceph.com 3 6 377 27 -363us[ -373us] +/- 59ms 2023-07-09T21:53:33.623 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +38us[ +27us] +/- 70ms 2023-07-09T21:53:33.623 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-09T21:53:33.627 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-09T21:53:33.627 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2023-07-09T21:53:33.628 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 26 +469us[ +469us] +/- 82ms 2023-07-09T21:53:33.628 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv02.front.sepia.ceph.com 3 6 377 28 -369us[ -375us] +/- 59ms 2023-07-09T21:53:33.628 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +34us[ +34us] +/- 70ms 2023-07-09T21:53:33.628 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-09T21:53:33.629 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-09T21:53:33.667 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-09T21:53:33.668 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-09T21:53:33.686 DEBUG:teuthology.orchestra.run.smithi053:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-09T21:53:33.862 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-09T21:53:34.024 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-09T21:53:34.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:53:34.100 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-09T21:53:34.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:53:34.175 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-09T21:53:34.185 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-09T21:53:34.199 INFO:teuthology.task.internal:Duration was 1259.113462 seconds 2023-07-09T21:53:34.200 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-09T21:53:34.210 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-09T21:53:34.210 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-09T21:53:34.216 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-09T21:53:34.329 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-09T21:53:34.331 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-09T21:53:34.659 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-09T21:53:34.660 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2023-07-09T21:53:34.661 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-09T21:53:34.721 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2023-07-09T21:53:34.721 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-09T21:53:34.780 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-09T21:53:34.781 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-09T21:53:34.786 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-09T21:53:34.871 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-09T21:53:34.872 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-09T21:53:34.877 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-09T21:53:35.013 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-09T21:53:35.023 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-09T21:53:35.023 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-09T21:53:35.092 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-09T21:53:35.161 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-09T21:53:35.171 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-09T21:53:35.176 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-09T21:53:35.238 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2023-07-09T21:53:35.242 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2023-07-09T21:53:35.277 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-09T21:53:35.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:53:35.319 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-09T21:53:35.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:53:35.361 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-09T21:53:35.372 INFO:teuthology.task.internal:Transferring archived files... 2023-07-09T21:53:35.373 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692/remote/smithi053 2023-07-09T21:53:35.373 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-09T21:53:35.451 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692/remote/smithi184 2023-07-09T21:53:35.451 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-09T21:53:35.531 INFO:teuthology.task.internal:Removing archive directory... 2023-07-09T21:53:35.532 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-09T21:53:35.536 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-09T21:53:35.579 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-09T21:53:35.591 INFO:teuthology.task.internal:Not uploading archives. 2023-07-09T21:53:35.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-09T21:53:35.602 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-09T21:53:35.602 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-09T21:53:35.618 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-09T21:53:35.656 INFO:teuthology.orchestra.run.smithi053.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 9 21:53 /home/ubuntu/cephtest 2023-07-09T21:53:35.661 INFO:teuthology.orchestra.run.smithi184.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 9 21:53 /home/ubuntu/cephtest 2023-07-09T21:53:35.664 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-09T21:53:35.675 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-09T21:53:35.695 INFO:teuthology.nuke:Checking targets against current locks 2023-07-09T21:53:35.725 DEBUG:teuthology.nuke:shortname: smithi053 2023-07-09T21:53:35.725 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T21:53:35.750 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 21:23:42.840811', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-09T21:53:35.753 DEBUG:teuthology.nuke:shortname: smithi184 2023-07-09T21:53:35.754 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T21:53:35.775 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 21:23:42.838747', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-09T21:53:35.813 INFO:teuthology.orchestra.console:Power off smithi053 2023-07-09T21:53:35.814 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T21:53:35.834 INFO:teuthology.orchestra.console:Power off smithi184 2023-07-09T21:53:35.835 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T21:53:35.848 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T21:53:35.861 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T21:53:39.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T21:53:39.889 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T21:53:43.993 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T21:53:44.003 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T21:53:44.206 INFO:teuthology.orchestra.console:Power off for smithi053 completed 2023-07-09T21:53:48.124 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T21:53:48.337 INFO:teuthology.orchestra.console:Power off for smithi184 completed 2023-07-09T21:53:48.442 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd client.1-kernel-sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} duration: 1259.1134622097015 failure_reason: 'Test failure: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8a2ac253bc2c42ebb316b610ca455488 status: fail success: false 2023-07-09T21:53:48.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T21:53:48.530 INFO:teuthology.run:FAIL